Difference between revisions of "Quota Information and Management"
| (2 intermediate revisions by the same user not shown) | |||
| Line 40: | Line 40: | ||
The quotas are the default values. Users requiring additional space should first clean out any old data, and if space is still required, contact ([mailto:support@deepsense.ca support@deepsense.ca]). Please include a paragraph justifying your need. | The quotas are the default values. Users requiring additional space should first clean out any old data, and if space is still required, contact ([mailto:support@deepsense.ca support@deepsense.ca]). Please include a paragraph justifying your need. | ||
| − | + | === How Quotas Work === | |
| − | + | There is a soft limit of 90% of the quota. If you go over this, you will be given the grace period above to clean out old data and try to get below the soft limit. If after the grace period has expired, you are still above the soft limit, you will not be able to write further data. You will never be allowed to write more than the actual quota. If you do reach your quota, we will send you an e-mail notification. | |
| − | === Checking disk usage | + | == What happens if you are over your quota == |
| + | If you go over the hard limit will a job is running, it may not be able to write output, and therefore crash. If it can't write output, it also cannot record the reason for the job crashing. Figuring out the reason for the crash will cause undue headaches. Please be aware of how much data you have stored, especially if you are near your quota. | ||
| + | |||
| + | == Checking disk usage == | ||
You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>. | You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>. | ||
This will show your user quotas, as well as the group quotas for any group you are in. | This will show your user quotas, as well as the group quotas for any group you are in. | ||
| − | |||
| − | |||
Latest revision as of 18:17, 1 December 2020
The filesystems provided are a resource shared by all users. It is expected that users make sensible use of the space, and follow the guidelines outlined here. It is possible the quotas and policies will change in the future, but we will strive to provide plenty of notice.
Contents
Quotas
| Filesystem | Location | Default Quota | Grace Period | Backed up? | Purged? | Notes |
|---|---|---|---|---|---|---|
| Home | /dshome/subdir/username | 1Tb and 500K files per user | 7 days | yes | no | subdir may be visitor, research, grad, etc. |
| Data | /data/projectname | 2Tb and 500K files per project | 7 days | yes | no | |
| Scratch | /scratch/projectname | 2Tb and 1M files per project | 24 hours | no | yes | Data not accessed in 60 days may be purged |
The quotas are the default values. Users requiring additional space should first clean out any old data, and if space is still required, contact (support@deepsense.ca). Please include a paragraph justifying your need.
How Quotas Work
There is a soft limit of 90% of the quota. If you go over this, you will be given the grace period above to clean out old data and try to get below the soft limit. If after the grace period has expired, you are still above the soft limit, you will not be able to write further data. You will never be allowed to write more than the actual quota. If you do reach your quota, we will send you an e-mail notification.
What happens if you are over your quota
If you go over the hard limit will a job is running, it may not be able to write output, and therefore crash. If it can't write output, it also cannot record the reason for the job crashing. Figuring out the reason for the crash will cause undue headaches. Please be aware of how much data you have stored, especially if you are near your quota.
Checking disk usage
You can check how much space you have used on the various filesystems using: /software/scripts/diskusage_report.py.
This will show your user quotas, as well as the group quotas for any group you are in.
