Difference between revisions of "Quota Information and Management"

From DeepSense Docs
Jump to: navigation, search
Line 40: Line 40:
 
The quotas are the default values.  Users requiring additional space should first clean out any old data, and if space is still required, contact ([mailto:support@deepsense.ca support@deepsense.ca]).  Please include a paragraph justifying your need.
 
The quotas are the default values.  Users requiring additional space should first clean out any old data, and if space is still required, contact ([mailto:support@deepsense.ca support@deepsense.ca]).  Please include a paragraph justifying your need.
  
There is a soft limit of 90% of the quota.  If you go over this, you will be given the grace period above to clean out old data and try to get below the soft limit.  If after the grace period, you are still above the soft limit, you will not be able to write further data.  You will never be allowed to write more than the actual quota.
+
=== How Quotas Work ===
  
'''Note''': If you go over the hard limit will a job is running, it may not be able to write output, and therefore crash.  If it can't write output, it also cannot record the reason for the job crashing.  Please be aware of how much data you have stored, especially if you are near your quota.
+
There is a soft limit of 90% of the quota.  If you go over this, you will be given the grace period above to clean out old data and try to get below the soft limit.  If after the grace period has expired, you are still above the soft limit, you will not be able to write further data.  You will never be allowed to write more than the actual quota.  If you do reach your quota, we will send you an e-mail notification.
 +
 
 +
== What happens if you are over your quota ==
 +
If you go over the hard limit will a job is running, it may not be able to write output, and therefore crash.  If it can't write output, it also cannot record the reason for the job crashing.  This can cause undue headaches.  Please be aware of how much data you have stored, especially if you are near your quota.
  
 
=== Checking disk usage ===
 
=== Checking disk usage ===
Line 48: Line 51:
 
You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>.   
 
You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>.   
 
This will show your user quotas, as well as the group quotas for any group you are in.
 
This will show your user quotas, as well as the group quotas for any group you are in.
 
You will not be able to write more data if you are over the hard limit.  If you do reach your quota, we will send you an e-mail with this information.
 

Revision as of 18:16, 1 December 2020

The filesystems provided are a resource shared by all users. It is expected that users make sensible use of the space, and follow the guidelines outlined here. It is possible the quotas and policies will change in the future, but we will strive to provide plenty of notice.

Quotas

Filesystem Location Default Quota Grace Period Backed up? Purged? Notes
Home /dshome/subdir/username 1Tb and 500K files per user 7 days yes no subdir may be visitor, research, grad, etc.
Data /data/projectname 2Tb and 500K files per project 7 days yes no
Scratch /scratch/projectname 2Tb and 1M files per project 24 hours no yes Data not accessed in 60 days may be purged

The quotas are the default values. Users requiring additional space should first clean out any old data, and if space is still required, contact (support@deepsense.ca). Please include a paragraph justifying your need.

How Quotas Work

There is a soft limit of 90% of the quota. If you go over this, you will be given the grace period above to clean out old data and try to get below the soft limit. If after the grace period has expired, you are still above the soft limit, you will not be able to write further data. You will never be allowed to write more than the actual quota. If you do reach your quota, we will send you an e-mail notification.

What happens if you are over your quota

If you go over the hard limit will a job is running, it may not be able to write output, and therefore crash. If it can't write output, it also cannot record the reason for the job crashing. This can cause undue headaches. Please be aware of how much data you have stored, especially if you are near your quota.

Checking disk usage

You can check how much space you have used on the various filesystems using: /software/scripts/diskusage_report.py. This will show your user quotas, as well as the group quotas for any group you are in.