Difference between revisions of "Resources"

From DeepSense Docs
Jump to: navigation, search
(→‎AWS SageMaker Notebook Instance Resources)
 
(6 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
{|class="wikitable" style="text-align: center; color: black; font-style:bold"
+
 
−
|+'''<span style="font-size:100%>Compute Resources</span>'''
+
== AWS EC2 Cloud Compute Resources ==
 +
{|class="wikitable" style="text-align: left; color: black; font-style:bold"
 +
|+'''<span style="font-size:100%> Available accelerated computing instances</span>'''
 
|-
 
|-
−
|'''Compute Hosts'''
+
|'''Instance'''
−
|'''#'''
+
|'''GPUs'''
−
|'''Memory'''
+
|'''vCPU'''
−
|'''CPU'''
+
|'''Memory (GiB)'''
−
|'''GPU'''
+
|'''GPU Memory (GiB)'''
−
|'''Interconnect'''
+
|'''Instance Storage (GB)'''
−
|'''Operation System'''
+
|'''Network Performance'''
 +
|'''EBS Bandwidth (Gbps)'''
 
|-
 
|-
−
|Large Memory
+
|g4dn.xlarge
−
|20
+
|1
−
|512GB
+
|4
−
|style="text-align:left" | 20 Core IBM Power8 2.8GHz (ds-cmlm-01,...,ds-cmlm-20)
+
|16
−
|N/A
+
|16
−
|Mellanox SN 2700 –100GB Cluster Interconnect Switch
+
|1 x 125 NVMe SSD
−
|Redhat Enterprise 7.7
+
|Up to 25
 +
|Up to 3.5
 
|-
 
|-
−
|Huge Memory
+
|g4dn.2xlarge
−
|2
+
|1
−
|1TB
+
|8
−
|style="text-align:left" |20 Core IBM Power8 3.4GHz (ds-cmhm-03,ds-cmhm-04)
+
|32
−
|N/A
+
|16
−
|Mellanox SN 2700 –100GB Cluster Interconnect Switch
+
|1 x 225 NVMe SSD
−
|Redhat Enterprise 7.7
+
|Up to 25
 +
|Up to 3.5
 
|-
 
|-
−
|GPU
+
|g5.xlarge
−
|10
+
|1
−
|512GB
+
|4
−
|style="text-align:left" |20 Core IBM Power8NVL 4.0GHz (ds-cmgpu-01,...,ds-cmgpu-10)
+
|16
−
|2xP100
+
|24
−
|Mellanox SN 2700 –100GB Cluster Interconnect Switch
+
|1 x 250 NVMe SSD
−
|Redhat Enterprise 7.7
+
|Up to 10
 +
|Up to 3.5
 
|}
 
|}
  
−
Largest LSF job that can be hosted on a "512GB" node is 450GB,
+
{|class="wikitable" style="text-align: left; color: black; font-style:bold"
−
''i.e.'' <code>bsub -R "rusage[mem=450GB]"</code>.
+
|+'''<span style="font-size:100%> Available compute optimized instances</span>'''
−
Largest job that can be hosted on a "1TB" node is 960GB,
+
|-
−
''i.e.'' <code>bsub -R "rusage[mem=960GB]"</code>.
+
|'''Instance'''
 +
|'''vCPU'''
 +
|'''Memory (GiB)'''
 +
|'''Instance Storage (GB)'''
 +
|'''Network Performance'''
 +
|-
 +
| c5.xlarge
 +
| 4
 +
| 8
 +
| EBS-Only
 +
| Up to 10
 +
|-
 +
| c5.2xlarge
 +
|8
 +
|16
 +
|EBS-Only
 +
|Up to 10
 +
|}
  
−
{|class="wikitable" style="text-align: center; color: black; font-style:bold"
+
{|class="wikitable" style="text-align: left; color: black; font-style:bold"
−
|+'''<span style="font-size:100%>Storage Resources</span>'''
+
|+'''<span style="font-size:100%> Available general purpose computing instances</span>'''
 
|-
 
|-
−
|'''Name'''
+
|'''Instance'''
−
|'''Location'''
+
|'''vCPU'''
−
|'''Quota'''
+
|'''Memory (GiB)'''
−
|'''Function'''
+
|'''Instance Storage (GB)'''
 +
|'''Network Performance'''
 
|-
 
|-
−
|Home
+
| m5.xlarge
−
| /dshome
+
| 4
−
| 1Tb
+
| 16
−
| Personal scripts/code/test data
+
| EBS-Only
 +
| Up to 10
 
|-
 
|-
−
|Scratch
+
| m5.2xlarge
−
| /scratch
+
|8
−
| 2Tb
+
|32
−
| Temporary space
+
|EBS-Only
 +
|Up to 10
 +
|}
 +
 
 +
== AWS SageMaker Notebook Instance Resources ==
 +
{|class="wikitable" style="text-align: left; color: black; font-style:bold"
 +
|+'''<span style="font-size:100%> Available accelerated computing instances</span>'''
 
|-
 
|-
−
|Data
+
|'''Instance'''
−
| /data
+
|'''GPUs'''
−
| 2Tb
+
|'''vCPU'''
−
| Project group data
+
|'''Memory (GiB)'''
 +
|'''GPU Memory (GiB)'''
 +
|'''Instance Storage (GB)'''
 +
|'''Network Performance'''
 +
|'''EBS Bandwidth (Gbps)'''
 +
|-
 +
|ml.g4dn.xlarge (fast launch)
 +
|1
 +
|4
 +
|16
 +
|16
 +
|Elastic EBS
 +
|Up to 25
 +
|Up to 3.5
 +
|-
 +
|ml.g4dn.2xlarge
 +
|1
 +
|8
 +
|32
 +
|16
 +
|Elastic EBS
 +
|Up to 25
 +
|Up to 3.5
 +
|-
 +
| m5.xlarge (fast launch)
 +
|No GPU
 +
| 4
 +
| 16
 +
|No GPU
 +
| EBS-Only
 +
| Up to 10
 +
| Up to 3.5
 
|}
 
|}
−
See [[Storage policies]] for more information about the available shared file systems, storage policies, and backup policies.
+
 
 +
Contact support for more options.

Latest revision as of 19:07, 5 September 2024

AWS EC2 Cloud Compute Resources

Available accelerated computing instances
Instance GPUs vCPU Memory (GiB) GPU Memory (GiB) Instance Storage (GB) Network Performance EBS Bandwidth (Gbps)
g4dn.xlarge 1 4 16 16 1 x 125 NVMe SSD Up to 25 Up to 3.5
g4dn.2xlarge 1 8 32 16 1 x 225 NVMe SSD Up to 25 Up to 3.5
g5.xlarge 1 4 16 24 1 x 250 NVMe SSD Up to 10 Up to 3.5
Available compute optimized instances
Instance vCPU Memory (GiB) Instance Storage (GB) Network Performance
c5.xlarge 4 8 EBS-Only Up to 10
c5.2xlarge 8 16 EBS-Only Up to 10
Available general purpose computing instances
Instance vCPU Memory (GiB) Instance Storage (GB) Network Performance
m5.xlarge 4 16 EBS-Only Up to 10
m5.2xlarge 8 32 EBS-Only Up to 10

AWS SageMaker Notebook Instance Resources

Available accelerated computing instances
Instance GPUs vCPU Memory (GiB) GPU Memory (GiB) Instance Storage (GB) Network Performance EBS Bandwidth (Gbps)
ml.g4dn.xlarge (fast launch) 1 4 16 16 Elastic EBS Up to 25 Up to 3.5
ml.g4dn.2xlarge 1 8 32 16 Elastic EBS Up to 25 Up to 3.5
m5.xlarge (fast launch) No GPU 4 16 No GPU EBS-Only Up to 10 Up to 3.5

Contact support for more options.

Retrieved from "https://docs.deepsense.ca/index.php?title=Resources&oldid=706"