Difference between revisions of "User Guide"

From DeepSense Docs
Jump to: navigation, search
Line 1: Line 1:
Welcome to the DeepSense cloud computing user guide. You don't have to have background of cloud computing, but it is helpful if you can have a 5 minute read of our wiki page "[[Introduction to Cloud Computing]]".
+
Welcome to the DeepSense cloud computing user guide. You don't have to have background of cloud computing, but it is helpful if you spend 5 minutes reading our wiki page "[[Introduction to Cloud Computing]]".
  
Unlike using on-premises systems, you don't have to have a Linux user account to ssh into a Linux boxes unless your workload would need a virtual machine. What you will have are IAM accounts on AWS, GCP, or Azure. DeepSense will setup virtual machines, severless Machine Learning compute platform, data processing pipeline, and unlimited data storage for users.
+
Unlike using on-premises systems, you don't have to have a Linux user account to ssh into a Linux boxes unless your workloads have to deploy to a virtual machine. What you will have are Identity and Access Management(IAM) accounts on AWS, GCP, or Azure. DeepSense will setup virtual machines, severless Machine Learning compute platform, data processing pipeline, and unlimited data storage for users. We will provide step by step guidance to help you develop your Machine Learning or data processing projects in cloud. You don't have to stick to any specific cloud. DeepSense will help you find the best solution to make your project development process straightforward in cloud.
  
 +
The process of developing your projects are:<br/>
 +
1. Users and DeepSense will discuss the background of your projects. Users will provide their technical requirements, for example, data type and size, CPU, memory, GPU, and so on.<br/>
 +
2. DeepSense will transfer your data to a cloud storage and set up the permission that only the owner of the data can access. Your data is encrypted both in transit and at rest.<br/>
 +
3. DeepSense will set up the environment according to your requirement and create an IAM account for you in the cloud.<br/>
 +
4. DeepSense will notify you when the set up is finished and provide detailed instructions how to develop your projects. Using cloud's Platform as a Service (PAAS), you only need to provide your code to train your models or process your data.<br/>
 +
5. According to the specific environment set up for you, please select corresponding instructions below to start developing your projects. You can also find the instructions in the section "[[How to develop Machine Learning projects on cloud]]" in the navigation menu on the left side of this page.<br/>
  
== Amazon Web Services (AWS) ==
+
== Using AWS Sagemaker==
* The cloud administrator will provide you with an IAM User account of AWS.
+
Please follow the instructions at "[[Using AWS Sagemaker]]".
* Based on the project requirements, you can select available [[Resources]] from the table.
 
* Access the account by following the instructions given here.
 
* For S3 storage, an S3 bucket will be provided if needed to store project data.
 
  
== Google Cloud Platform (GCP) ==
+
== Using AWS EC2 Virtual Machine ==
* Google HPC cloud toolkit still under development for DeepSense.
+
Please following the instructions at "[[Using AWS EC2]]".
 +
 
 +
We are configuring GCP Colab, High-Performance Computing clusters on GCP and AWS, and data processing pipeline on GCP and AWS. We will keep you updated.

Revision as of 22:57, 12 March 2023

Welcome to the DeepSense cloud computing user guide. You don't have to have background of cloud computing, but it is helpful if you spend 5 minutes reading our wiki page "Introduction to Cloud Computing".

Unlike using on-premises systems, you don't have to have a Linux user account to ssh into a Linux boxes unless your workloads have to deploy to a virtual machine. What you will have are Identity and Access Management(IAM) accounts on AWS, GCP, or Azure. DeepSense will setup virtual machines, severless Machine Learning compute platform, data processing pipeline, and unlimited data storage for users. We will provide step by step guidance to help you develop your Machine Learning or data processing projects in cloud. You don't have to stick to any specific cloud. DeepSense will help you find the best solution to make your project development process straightforward in cloud.

The process of developing your projects are:
1. Users and DeepSense will discuss the background of your projects. Users will provide their technical requirements, for example, data type and size, CPU, memory, GPU, and so on.
2. DeepSense will transfer your data to a cloud storage and set up the permission that only the owner of the data can access. Your data is encrypted both in transit and at rest.
3. DeepSense will set up the environment according to your requirement and create an IAM account for you in the cloud.
4. DeepSense will notify you when the set up is finished and provide detailed instructions how to develop your projects. Using cloud's Platform as a Service (PAAS), you only need to provide your code to train your models or process your data.
5. According to the specific environment set up for you, please select corresponding instructions below to start developing your projects. You can also find the instructions in the section "How to develop Machine Learning projects on cloud" in the navigation menu on the left side of this page.

Using AWS Sagemaker

Please follow the instructions at "Using AWS Sagemaker".

Using AWS EC2 Virtual Machine

Please following the instructions at "Using AWS EC2".

We are configuring GCP Colab, High-Performance Computing clusters on GCP and AWS, and data processing pipeline on GCP and AWS. We will keep you updated.