Storage policies - Revision history

Jnewport: /* Checking disk usage */

2020-07-07T17:53:11Z

‎Checking disk usage

Jnewport: /* Data */

2020-04-02T16:51:31Z

‎Data

Jnewport: /* Quotas and Policies */

2019-12-05T18:36:47Z

‎Quotas and Policies

Jnewport: /* Checking disk usage */

2019-11-05T19:14:50Z

‎Checking disk usage

Jnewport: /* Checking disk usage */

2019-11-05T19:14:23Z

‎Checking disk usage

Jnewport at 19:10, 5 November 2019

2019-11-05T19:10:38Z

Jnewport: /* Home directory */

2019-11-05T19:09:43Z

‎Home directory

Jnewport: /* Quotas and Policies */

2019-11-05T19:08:24Z

‎Quotas and Policies

Jnewport: /* Filesystems */

2019-11-05T19:07:18Z

‎Filesystems

Jnewport: /* Overview */

2019-11-05T18:58:59Z

‎Overview

@@ Line 83: / Line 83: @@
 You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>.
-This will show your user quotas.  If you are a part of a group, you will have a shared group data folder.  To check your group quota, use:
+This will show your user quotas, as well as the group quotas for any group you are in.
 You will not be able to write more data if you are over the hard limit.  If you do reach your quota, we will send you an e-mail with this information.

@@ Line 24: / Line 24: @@
 * If you are an individual student, your directory is /data/''username''.  Only you will have access to this directory.
-The data filesystem will house the bulk of your data, and it has a larger default quota. This is also the primary location for transferring large amounts of data.  It is accessible via [[Getting_started#4._Transfer_data|samba]].
+The data filesystem will house the bulk of your data, and it has a larger default quota. This is also the primary location for transferring large amounts of data.  It is accessible via [[Getting_started#2._Transfer_data|samba]].
 === Scratch ===

@@ Line 68: / Line 68: @@
 | /scratch/''projectname''
 | 2Tb and 1M files per project
-| 7 days
+| 24 hours
 | style="text-align: center;" | no
 | style="text-align: center;" | yes

@@ Line 84: / Line 84: @@
 You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>.
 This will show your user quotas.  If you are a part of a group, you will have a shared group data folder.  To check your group quota, use:
-<code>/software/scripts/diskusage_report.py&nbsp;&#8209;&nbsp;groupname</code>.
+<code>/software/scripts/diskusage_report.py&nbsp;&#8209;g&nbsp;groupname</code>.
 You will not be able to write more data if you are over the hard limit.  If you do reach your quota, we will send you an e-mail with this information.

@@ Line 84: / Line 84: @@
 You can check how much space you have used on the various filesystems using: <code>/software/scripts/diskusage_report.py</code>.
 This will show your user quotas.  If you are a part of a group, you will have a shared group data folder.  To check your group quota, use:
-<code>/software/scripts/diskusage_report.py&nbsp;-g&nbsp;groupname</code>.
+<code>/software/scripts/diskusage_report.py&nbsp;&#8209;&nbsp;groupname</code>.
 You will not be able to write more data if you are over the hard limit.  If you do reach your quota, we will send you an e-mail with this information.

@@ Line 15: / Line 15: @@
 === Home directory ===
-Each user has a home directory in /dshome/''subdir''/.  The subdirectory (visitor, research, faculty, grad, etc.) will depend on the type of LDAP account you have.  This is primarily designed for your personal use, and only you have permission to access it.  It is ideal for managing scripts, source code and test data sets. It is not meant for large data storage.
+Each user has a home directory in /dshome/''subdirectory''/.  The subdirectory (visitor, research, faculty, grad, etc.) will depend on the type of LDAP account you have.  This is primarily designed for your personal use, and only you have permission to access it.  It is ideal for managing scripts, source code and test data sets. It is not meant for large data storage.
 === Data ===

@@ Line 11: / Line 11: @@
 == Filesystems ==
-There are several network filespaces that can be accessed from any of the nodes.  They each have separate purposes.  See also [[Transferring Data]].
+There are several different filespaces available to users.  They are shared filesystems that can be accessed from any of the nodes.  They each have separate purposes.  See also [[Transferring Data]].
 === Home directory ===
@@ Line 35: / Line 35: @@
 The scratch filesystem is intended to support data used during job execution.  It has a larger default quota, and can support a larger number of files.  '''Note''': this is temporary space, and is not backed up.   Data which has not been accessed in 60 days may be purged, though we will contact you prior to doing so.  Data needed for longer storage should be stored elsewhere.
 Delete files that you no longer need as soon as you are done with them, rather than leaving large amounts of data sitting untouched.
 == Quotas and Policies ==

@@ Line 1: / Line 1: @@
 == Overview ==
-DeepSense is a platform for AI/ML for oceans research data.  However, it is not meant for long term data storage.  Data will only be stored so long as your project is ongoing.  Once a project is completed, it is expected that the users will remove their data in a timely fashion.
+DeepSense is a platform for AI/ML for oceans research data.  All users will have a home directory, and access to various filesystems.  Each filesystem has a default [[#Quotas and Policies|quota]], with more space available upon request.  While some of the filesystems are backed up, it is the responsibility of the user to maintain their original data on their own site.
-Each filesystem has a default [[#Quotas and Policies|quota]], with more space available upon request.  While some of the filesystems are backed up, it is the responsibility of the user to maintain their original data on their own site.
+DeepSense is not meant for long term data storage.  Data will only be stored so long as your project is ongoing.  Once a project is completed, it is expected that the users will remove their data in a timely fashion.
-The filesystems provided are a shared resource.  It is expected that users make sensible use of the space, and follow the guidelines outlined here.  It is possible the quotas and policies will change in the future, but we will strive to provide plenty of notice.
+DeepSense is not intended to be used for data sharing.  While each user in your project/group will have access to shared space, it won't be accessible by any other users.  We do not host databases for sharing data, or for web access.
 == Filesystems ==