Data Storage

From DeepSense Docs
Revision as of 14:26, 1 December 2020 by Jnewport (talk | contribs) (Created page with " Here we outline some best practices for data storage. == Proper use of Filesystems == == Best Practices == * Small amounts of data may be transferred via the login nodes,...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Here we outline some best practices for data storage.

Proper use of Filesystems

Best Practices

  • Small amounts of data may be transferred via the login nodes, using scp or rsync
  • Medium amounts of data must be transferred using the protocol nodes
  • Large amounts of data can be transferred via the protocol nodes, using samba. Alternatively, you can bring an external hard drive to us and we can directly transfer your data
  • Regularly remove temporary data stored in the scratch filesystem, as this will be used for vast amounts of temporary data
  • Data no longer used should be removed, as DeepSense is not intended for long term storage
  • Check your space usage regularly to make sure you are below your quota
  • When your project/account are closed, please remove all data
  • To help us avoid restricting the storage policies, please use the space conscientiously