Difference between revisions of "DeepSense Documentation"

From DeepSense Docs
Jump to: navigation, search
(DeepSense Cloud Computing Services)
 
(16 intermediate revisions by 2 users not shown)
Line 1: Line 1:
'''
 
== Attention! We are reconstructing our wiki pages to update all the amazing cloud computing resources we are offering to our users. We are sorry that the pages are messy during the reconstruction. We will keep you updated. Stay tuned... ==
 
'''
 
 
  
 
'''Welcome to the DeepSense technical cloud documentation wiki'''.  This is the primary source for users with questions on the DeepSense cloud equipment and services. DeepSense uses cloud services from various cloud vendors for the development of AI projects. You'll now find all of our content on the sidebar.  Just below you can see the available cloud services, and information about any planned outages we may have.   
 
'''Welcome to the DeepSense technical cloud documentation wiki'''.  This is the primary source for users with questions on the DeepSense cloud equipment and services. DeepSense uses cloud services from various cloud vendors for the development of AI projects. You'll now find all of our content on the sidebar.  Just below you can see the available cloud services, and information about any planned outages we may have.   
Line 8: Line 4:
 
We continuously explore the best cloud solutions to the AI projects. We don't lock our solutions in any specific cloud vendors. The tables below show the cloud services we have tested and are developing projects on. More cloud services will be coming soon.
 
We continuously explore the best cloud solutions to the AI projects. We don't lock our solutions in any specific cloud vendors. The tables below show the cloud services we have tested and are developing projects on. More cloud services will be coming soon.
  
We routinely make changes and update the content.  If you see anything missing, or have any suggestions for content, we would appreciate hearing from you.  You can send us an email at ([mailto:support@deepsense.ca support@deepsense.ca]).
+
We routinely make changes and update the content.  If you see anything missing, or have any suggestions for content, we would appreciate hearing from you.  You can send us an email at ([mailto:info@deepsense.ca info@deepsense.ca]).
 
You can click on "Resources" on the navigation panel to find the technical details of the virtual machines and serverless computing services.
 
You can click on "Resources" on the navigation panel to find the technical details of the virtual machines and serverless computing services.
  
Line 21: Line 17:
 
|-
 
|-
 
|style="Color:green" | Available
 
|style="Color:green" | Available
| S3 (Simple Storage Service)
+
| S3 (Simple Storage Service)  
| Amazon S3 can be used to store and retrieve any amount of data. Mainly use it for backing up your data.
+
| Amazon S3 can be used to store and retrieve any amount of data. Mainly use it for long term data storage or backing up your data.
 
|-
 
|-
 
|style="Color:green" | Available
 
|style="Color:green" | Available
Line 31: Line 27:
 
| SageMaker Notebook
 
| SageMaker Notebook
 
| Amazon SageMaker notebook instance is a machine learning (ML) compute instance that runs the Jupyter Notebook App.
 
| Amazon SageMaker notebook instance is a machine learning (ML) compute instance that runs the Jupyter Notebook App.
 +
|-
 +
|style="Color:green" | Available
 +
| SageMaker Studio - AutoML
 +
| Amazon SageMaker Studio provides a single web-based visual interface where you can access purpose-built tools to perform all machine learning (ML) development steps.         
 +
|-
 +
|style="Color:green" | Available
 +
| SageMaker Endpoint
 +
| Amazon SageMaker Inference Endpoints are a powerful tool to deploy your machine learning models in the cloud and make predictions on new data.         
 +
|}
 +
 +
'''<span style="font-size:120%>Microsoft Azure</span>'''
 +
{|class="wikitable" style="text-align: center; color: black; font-style:bold"
 +
|'''Availability'''
 +
|style="width:20% | '''Service'''
 +
|style="width:70% | '''Usage'''
 +
|-
 +
|style="Color:green" | Available
 +
| Blob Storage
 +
| Azure Blob Storage is a store for objects capable of storing large amounts of unstructured data. Can be used for long term storage or backing up your data.
 +
|-
 +
|style="Color:green" | Available
 +
| Virtual Machine
 +
| Azure Virtual Machines are image service instances that provide on-demand and scalable computing resources for training models in a manually configured environment.
 +
|-
 +
|style="Color:green" | Available
 +
| Machine Learning Workspace
 +
| Azure Machine Learning is a cloud service for accelerating and managing the machine learning (ML) project lifecycle.         
 +
|}
 +
 +
'''<span style="font-size:120%>Google Cloud Platform (GCP)</span>'''
 +
{|class="wikitable" style="text-align: center; color: black; font-style:bold"
 +
|'''Availability'''
 +
|style="width:20% | '''Service'''
 +
|style="width:70% | '''Usage'''
 +
|-
 +
|style="Color:green" | Available
 +
| Cloud Storage
 +
| Cloud Storage is a service for storing your objects in Google Cloud. Mainly use it for long term storage or backing up your data.
 +
|-
 +
|style="Color:green" | Available
 +
| Compute Engine
 +
|
 +
Compute Engine is a customizable compute service that lets you create and run virtual machines for training models in a manually configured environment.
 +
|-
 +
|style="Color:orange" | Available Soon
 +
| Vertex AI Notebooks
 +
| Vertex AI Workbench managed notebooks instances are Google-managed end-to-end Jupyter notebook-based environment.
 +
|}
 +
 +
'''<span style="font-size:120%>HPC on AWS and Azure</span>'''
 +
{|class="wikitable" style="text-align: center; color: black; font-style:bold"
 +
|'''Availability'''
 +
|style="width:20% | '''Service'''
 +
|style="width:70% | '''Usage'''
 +
|-
 +
|style="Color:green" | Available
 +
| AWS ParallelCluster
 +
| AWS ParallelCluster is an AWS supported open source cluster management tool that helps you to deploy and manage high performance computing (HPC) clusters in the AWS Cloud.
 +
|-
 +
|style="Color:green" | Available
 +
| Azure CycleCloud
 +
| Azure CycleCloud is designed to enable enterprise IT organizations to provide secure and flexible cloud HPC and Big Compute environments to their end users.
 
|}
 
|}

Latest revision as of 18:41, 12 August 2024

Welcome to the DeepSense technical cloud documentation wiki. This is the primary source for users with questions on the DeepSense cloud equipment and services. DeepSense uses cloud services from various cloud vendors for the development of AI projects. You'll now find all of our content on the sidebar. Just below you can see the available cloud services, and information about any planned outages we may have. Due to the nature of "unlimited resources" of cloud computing, DeepSense doesn't limit any cloud services that the projects need. The cloud services listed in the following tables are our currently running resources. This doesn't necessarily indicate we cannot use other cloud resources. DeepSense users are encouraged to contact us to apply for required cloud computing services. We continuously explore the best cloud solutions to the AI projects. We don't lock our solutions in any specific cloud vendors. The tables below show the cloud services we have tested and are developing projects on. More cloud services will be coming soon.

We routinely make changes and update the content. If you see anything missing, or have any suggestions for content, we would appreciate hearing from you. You can send us an email at (info@deepsense.ca). You can click on "Resources" on the navigation panel to find the technical details of the virtual machines and serverless computing services.

DeepSense Cloud Computing Services

Amazon Web Services (AWS)

Availability Service Usage
Available S3 (Simple Storage Service) Amazon S3 can be used to store and retrieve any amount of data. Mainly use it for long term data storage or backing up your data.
Available EC2 (Elastic Compute Cloud) Amazon EC2 can be used to create virtual machines for training models in a manually configured environment.
Available SageMaker Notebook Amazon SageMaker notebook instance is a machine learning (ML) compute instance that runs the Jupyter Notebook App.
Available SageMaker Studio - AutoML Amazon SageMaker Studio provides a single web-based visual interface where you can access purpose-built tools to perform all machine learning (ML) development steps.
Available SageMaker Endpoint Amazon SageMaker Inference Endpoints are a powerful tool to deploy your machine learning models in the cloud and make predictions on new data.

Microsoft Azure

Availability Service Usage
Available Blob Storage Azure Blob Storage is a store for objects capable of storing large amounts of unstructured data. Can be used for long term storage or backing up your data.
Available Virtual Machine Azure Virtual Machines are image service instances that provide on-demand and scalable computing resources for training models in a manually configured environment.
Available Machine Learning Workspace Azure Machine Learning is a cloud service for accelerating and managing the machine learning (ML) project lifecycle.

Google Cloud Platform (GCP)

Availability Service Usage
Available Cloud Storage Cloud Storage is a service for storing your objects in Google Cloud. Mainly use it for long term storage or backing up your data.
Available Compute Engine

Compute Engine is a customizable compute service that lets you create and run virtual machines for training models in a manually configured environment.

Available Soon Vertex AI Notebooks Vertex AI Workbench managed notebooks instances are Google-managed end-to-end Jupyter notebook-based environment.

HPC on AWS and Azure

Availability Service Usage
Available AWS ParallelCluster AWS ParallelCluster is an AWS supported open source cluster management tool that helps you to deploy and manage high performance computing (HPC) clusters in the AWS Cloud.
Available Azure CycleCloud Azure CycleCloud is designed to enable enterprise IT organizations to provide secure and flexible cloud HPC and Big Compute environments to their end users.