Quota Information and Management

From DeepSense Docs
Revision as of 18:12, 1 December 2020 by Jnewport (talk | contribs)
Jump to: navigation, search

The filesystems provided are a resource shared by all users. It is expected that users make sensible use of the space, and follow the guidelines outlined here. It is possible the quotas and policies will change in the future, but we will strive to provide plenty of notice.

Quotas

Filesystem Location Default Quota Grace Period Backed up? Purged? Notes
Home /dshome/subdir/username 1Tb and 500K files per user 7 days yes no subdir may be visitor, research, grad, etc.
Data /data/projectname 2Tb and 500K files per project 7 days yes no
Scratch /scratch/projectname 2Tb and 1M files per project 24 hours no yes Data not accessed in 60 days may be purged

The quotas are the default values. Users requiring additional space should first clean out any old data, and if space is still required, contact (support@deepsense.ca). Please include a paragraph justifying your need.

There is a soft limit of 90% of the quota. If you go over this, you will be given the grace period above to clean out old data and try to get below the soft limit. If after the grace period, you are still above the soft limit, you will not be able to write further data. You will never be allowed to write more than the actual quota.

Note: If you go over the hard limit will a job is running, it may not be able to write output, and therefore crash. If it can't write output, it also cannot record the reason for the job crashing. Please be aware of how much data you have stored, especially if you are near your quota.

Checking disk usage

You can check how much space you have used on the various filesystems using: /software/scripts/diskusage_report.py. This will show your user quotas, as well as the group quotas for any group you are in.

You will not be able to write more data if you are over the hard limit. If you do reach your quota, we will send you an e-mail with this information.