Difference between revisions of "Using AWS EC2"
(Final changes for AWS EC2) |
(→Accessing DeepSense AWS Management Console) |
||
| (5 intermediate revisions by the same user not shown) | |||
| Line 10: | Line 10: | ||
EC2 provides the most comprehensive and comprehensive set of machine learning services and cloud infrastructure, putting machine learning in the hands of every developer, data scientist, and expert practitioner. We have used Amazon Deep Learning AMI in every instance to ensure we get all the necessary packeges and libraries so we can avoid time to set up the system and focus on working on model development. | EC2 provides the most comprehensive and comprehensive set of machine learning services and cloud infrastructure, putting machine learning in the hands of every developer, data scientist, and expert practitioner. We have used Amazon Deep Learning AMI in every instance to ensure we get all the necessary packeges and libraries so we can avoid time to set up the system and focus on working on model development. | ||
| + | |||
| + | == Accessing DeepSense AWS Management Console == | ||
| + | *Open web browser and navigate to the AWS Management Console login page. | ||
| + | *Enter the URL provided in AWS correspondence email and continue as Sign in as IAM user. | ||
| + | *Enter the IAM username in the "IAM user name" field. | ||
| + | *Enter the IAM user's temporary first password in the "Password" field provided by DeepSense AWS Admin. | ||
| + | *You will be redirected to change the password on first login, create a new password. | ||
| + | *After signing in to the AWS Management Console, locate the security credentials in the right top corner, where the account number and user name is written. | ||
| + | *Click on add MFA and follow the on-screen instructions to enable MFA. (https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_mfa_enable_virtual.html#enable-virt-mfa-for-iam-user) | ||
| + | *After setting MFA kindly sign out and then sign in again with new password you have created and use MFA to access the cloud resources. | ||
== Accessing DeepSense EC2 Instance by SSH == | == Accessing DeepSense EC2 Instance by SSH == | ||
* Prerequisites include providing your own newly created SSH public to the cloud system administrator. | * Prerequisites include providing your own newly created SSH public to the cloud system administrator. | ||
| − | + | * Go to EC2 service from search bar. | |
| − | + | * Select instances and find the Project Named instance. | |
| − | |||
| − | |||
| − | * Go to EC2 service from search bar | ||
| − | * Select instances and find the Project Named instance | ||
* Select the instance and go to actions. | * Select the instance and go to actions. | ||
| − | * Select Start instance | + | * Select Start instance. |
| − | * Select the option Connect and change tab to SSH client | + | * Select the option Connect and change tab to SSH client. |
| − | * Copy the SSH command with instance’s present dns | + | * Copy the SSH command with instance’s present dns address. |
| − | * Start your DalVPN to access the instance | + | * Start your DalVPN to access the instance. |
* Open Terminal and paste the SSH command and edit it as this: <code>'''ssh -i “privatekey_path” username@DNSaddress'''</code> | * Open Terminal and paste the SSH command and edit it as this: <code>'''ssh -i “privatekey_path” username@DNSaddress'''</code> | ||
| − | * You should have the access to instance now | + | * You should have the access to instance now. |
* Stop instance by console same way you started when your work is done or taking break. | * Stop instance by console same way you started when your work is done or taking break. | ||
| − | == How to | + | == How to activate Machine Learning Environment? == |
* After successful login from terminal through SSH you will have terminal access to your instance. | * After successful login from terminal through SSH you will have terminal access to your instance. | ||
| Line 38: | Line 44: | ||
The AWS Deep Learning AMI (DLAMI) is customised machine instance is available in the Amazon EC2 regions for a variety of instance types, ranging from a small CPU-only instance to the most recent high-powered multi-GPU instances. | The AWS Deep Learning AMI (DLAMI) is customised machine instance is available in the Amazon EC2 regions for a variety of instance types, ranging from a small CPU-only instance to the most recent high-powered multi-GPU instances. | ||
| − | * As all the GPU resourses are of NVIDIA, you can find out the GPU info by typing <code>nvidia- | + | * As all the GPU resourses are of NVIDIA, you can find out the GPU info by typing <code>nvidia-smi</code> |
* To activate the inbuilt environment write this command <code>activate tensorflow</code> or <code> activate pytorch</code>. | * To activate the inbuilt environment write this command <code>activate tensorflow</code> or <code> activate pytorch</code>. | ||
Latest revision as of 00:08, 15 August 2023
DeepSense has always been focused on providing enhanced solutions with security. So we provide an Amazon EC2 instance to anyone on our team who wants to use the GPU virtual machine's full environment. Amazon EC2 offers users a variety of instance types, software packages, instance storage, and operating systems, resulting in flexibility. Users can configure memory, CPU, and boot partition size on Amazon EC2, which is then optimised for the operating system and application. There are two layers of access: the AWS console and the pc terminal window, into which you will log in using SSH.
Contents
DeepSense AWS EC2 Instances
Find the available EC2 options on Resources
We acquired AWS EC2 for DeepSense in order to take advantage of its best services and use it as a Virtual Machine. This is ideal for running high-performance applications, long-running applications, and applications that must start immediately. If you use AWS EC2 instances, remember to backup your data to avoid losing it. Amazon EC2 offers users a variety of instance types, software packages, instance storage, and operating systems, resulting in flexibility. Users can configure memory, CPU, and boot partition size on Amazon EC2, which is then optimised for the operating system and application.
EC2 for Machine Learning
EC2 provides the most comprehensive and comprehensive set of machine learning services and cloud infrastructure, putting machine learning in the hands of every developer, data scientist, and expert practitioner. We have used Amazon Deep Learning AMI in every instance to ensure we get all the necessary packeges and libraries so we can avoid time to set up the system and focus on working on model development.
Accessing DeepSense AWS Management Console
- Open web browser and navigate to the AWS Management Console login page.
- Enter the URL provided in AWS correspondence email and continue as Sign in as IAM user.
- Enter the IAM username in the "IAM user name" field.
- Enter the IAM user's temporary first password in the "Password" field provided by DeepSense AWS Admin.
- You will be redirected to change the password on first login, create a new password.
- After signing in to the AWS Management Console, locate the security credentials in the right top corner, where the account number and user name is written.
- Click on add MFA and follow the on-screen instructions to enable MFA. (https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_mfa_enable_virtual.html#enable-virt-mfa-for-iam-user)
- After setting MFA kindly sign out and then sign in again with new password you have created and use MFA to access the cloud resources.
Accessing DeepSense EC2 Instance by SSH
- Prerequisites include providing your own newly created SSH public to the cloud system administrator.
- Go to EC2 service from search bar.
- Select instances and find the Project Named instance.
- Select the instance and go to actions.
- Select Start instance.
- Select the option Connect and change tab to SSH client.
- Copy the SSH command with instance’s present dns address.
- Start your DalVPN to access the instance.
- Open Terminal and paste the SSH command and edit it as this:
ssh -i “privatekey_path” username@DNSaddress - You should have the access to instance now.
- Stop instance by console same way you started when your work is done or taking break.
How to activate Machine Learning Environment?
- After successful login from terminal through SSH you will have terminal access to your instance.
- DeepSense virtual machines launched in the AWS Deep Learning AMI.
What is AWS DLAMI?
The AWS Deep Learning AMI (DLAMI) is customised machine instance is available in the Amazon EC2 regions for a variety of instance types, ranging from a small CPU-only instance to the most recent high-powered multi-GPU instances.
- As all the GPU resourses are of NVIDIA, you can find out the GPU info by typing
nvidia-smi - To activate the inbuilt environment write this command
activate tensorfloworactivate pytorch.
