User Guide

From DeepSense Docs
Revision as of 22:59, 12 March 2023 by Lyang (talk | contribs)
Jump to: navigation, search

Welcome to the DeepSense cloud computing user guide. You don't have to have background of cloud computing, but it is helpful if you spend 5 minutes reading our wiki page "Introduction to Cloud Computing".

Unlike using on-premises systems, you don't have to have a Linux user account to ssh into a Linux boxes unless your workloads have to deploy to a virtual machine. What you will have are Identity and Access Management(IAM) accounts on AWS, GCP, or Azure. DeepSense will setup virtual machines, severless Machine Learning compute platform, data processing pipeline, and unlimited data storage for users. We will provide step by step guidance to help you develop your Machine Learning or data processing projects in cloud. You don't have to stick to any specific cloud. DeepSense will help you find the best solution to make your project development process straightforward in cloud.

The process of developing your projects are:
1. Users and DeepSense will discuss the background of your projects. Users will provide their technical requirements, for example, data type and size, CPU, memory, GPU, and so on.
2. DeepSense will transfer your data to a cloud storage and set up the permission that only the owner of the data can access. Your data is encrypted both in transit and at rest.
3. DeepSense will set up the environment according to your requirement and create an IAM account for you in the cloud.
4. DeepSense will notify you when the set up is finished and provide detailed instructions how to develop your projects. Using cloud's Platform as a Service (PAAS), you only need to provide your code to train your models or process your data.
5. According to the specific environment set up for you, please select corresponding instructions below to start developing your projects. You can also find the instructions in the section "How to develop Machine Learning projects on cloud" in the navigation menu on the left side of this page.

Using AWS Sagemaker

Please follow the instructions at "Using AWS Sagemaker".

Using AWS EC2 Virtual Machine

Please follow the instructions at "Using AWS EC2".

We are configuring GCP Colab, High-Performance Computing clusters on GCP and AWS, and data processing pipeline on GCP and AWS. So more cloud computing platforms will be coming soon. We will keep you updated.