Your Accounts - Revision history

Lyang at 13:36, 4 December 2020

2020-12-04T13:36:45Z

Lyang at 17:28, 1 December 2020

2020-12-01T17:28:20Z

Lyang at 17:26, 1 December 2020

2020-12-01T17:26:36Z

Lyang at 17:00, 1 December 2020

2020-12-01T17:00:47Z

Lyang: Created page with "Every DeepSense user has his/her own user account on DeepSense's platform. It is important a user understands his/her account. If a user understands and manages his/her accoun..."

2020-12-01T15:19:59Z

Created page with "Every DeepSense user has his/her own user account on DeepSense's platform. It is important a user understands his/her account. If a user understands and manages his/her accoun..."

New page

Every DeepSense user has his/her own user account on DeepSense's platform. It is important a user understands his/her account. If a user understands and manages his/her account well, he/she can save a lot of time while working in a HPC environment.

← Older revision		Revision as of 13:36, 4 December 2020
Line 66:		Line 66:

	You can do the same thing for login node 2. If you want to set passwordless ssh between the login node and other nodes in the cluster, you can generate the private and public keys on one login node. Then, put the generated pub key in the “.ssh/authorized_keys” file. Because your home directories are all shared across the cluster, you only need to do this on one node and all nodes can see your public key so you can ssh to them without a password.		You can do the same thing for login node 2. If you want to set passwordless ssh between the login node and other nodes in the cluster, you can generate the private and public keys on one login node. Then, put the generated pub key in the “.ssh/authorized_keys” file. Because your home directories are all shared across the cluster, you only need to do this on one node and all nodes can see your public key so you can ssh to them without a password.
		+
		+	== Jupyter notebooks or other programs fail trying to access a /run directory ==
		+
		+	The default login shell is BASH. Make sure the following parameter is in your .bashrc file in your home directory, as it prevents a problem where some types of jobs fail when run through the LSF queue. This should be done automatically the first time you log onto DeepSense.
		+
		+	<code>echo 'unset XDG_RUNTIME_DIR' >> ~/.bashrc</code>
		+
		+	This line has been added to the default .bashrc file for new users but older user accounts may need this step to be done manually.

@@ Line 26: / Line 26: @@
 Users may be tired of typing password again and again while logging on the head nodes and compute nodes. The following instruction helps users set up passwordless ssh between their local machine and DeepSense's head nodes, and DeepSense's head nodes and compute nodes.<br/>
 Basically, users need to generate a pair of private key and public key for a different system to allow passwordless ssh. The follow guide shows how to set up the passwordless ssh login from your local machine to the login 1 node of DeepSense.<br/>
-. Generate private and public keys
+=== Generate private and public keys ===
 In the terminal of your local machine, generate the private and public keys using the following command:
     ssh-keygen -t rsa
@@ Line 54: / Line 54: @@
      +-----------------+
 There is a directory called “.ssh” on both your local machine and DeepSense’s login nodes 1 and 2 in your home directory. You can go to the “.ssh” directory on your local machine to see if there are two files named “id_rsa” which is your private key and “id_rsa.pub” which is your public key. The private key is the key you keep only on your local machine. While you use the public key to let remote system know you would like to ssh to it using the pub key without a password. The next step tells you how to do this.
-. Put the public key on login 1 of DeepSense
+=== Put the public key on login 1 of DeepSense ===
 Get the contents of the public key on your local machine. You can use command “cat” to do this. For example:
            cat .ssh/id_rsa.pub
@@ Line 60: / Line 60: @@
 The actual key is not this short as shown above. It is just an example. You copy the whole contents of the public key.
 Now login the DS login node 1. You still have to use password at this moment. After you are on the system, open “.ssh/authorized_keys” and paste the public key you just copied to the last line of this file.
-. Set correct permission of authorized_keys
+=== Set correct permission of authorized_keys ===
 You already have the public key of you local machine on login node 1. But you will have to set the permission of the file “.ssh/authorized_keys”. Run the following command to set the permission:
   chmod 640 .ssh/authorized_keys

← Older revision		Revision as of 17:26, 1 December 2020
Line 22:		Line 22:

	export PATH=$PATH:~/examplesoftware/bin		export PATH=$PATH:~/examplesoftware/bin
		+
		+	== How to set up passwordless ssh ==
		+	Users may be tired of typing password again and again while logging on the head nodes and compute nodes. The following instruction helps users set up passwordless ssh between their local machine and DeepSense's head nodes, and DeepSense's head nodes and compute nodes.<br/>
		+	Basically, users need to generate a pair of private key and public key for a different system to allow passwordless ssh. The follow guide shows how to set up the passwordless ssh login from your local machine to the login 1 node of DeepSense.<br/>
		+	1. Generate private and public keys
		+	In the terminal of your local machine, generate the private and public keys using the following command:
		+	ssh-keygen -t rsa
		+
		+	You will see something similar to below:
		+	[username@your local machine ~]$ ssh-keygen -t rsa
		+	Generating public/private rsa key pair.
		+	Enter file in which to save the key (/home/username/.ssh/id_rsa): [Press enter key]
		+	Created directory '/home/username/.ssh'.
		+	Enter passphrase (empty for no passphrase): [Press enter key]
		+	Enter same passphrase again: [Press enter key]
		+	Your identification has been saved in /home/username/.ssh/id_rsa.
		+	Your public key has been saved in /home/username/.ssh/id_rsa.pub.
		+	The key fingerprint is:
		+	5f:ad:40:00:8a:d1:9b:99:b3:b0:f8:08:99:c3:ed:d3 username@your local machine
		+	The key's randomart image is:
		+	+--[ RSA 2048]----+
		+	\| ..oooE.++\|
		+	\| o. o.o \|
		+	\| .. . \|
		+	\| o . . o\|
		+	\| S . . + \|
		+	\| . . . o\|
		+	\| . o o ..\|
		+	\| + + \|
		+	\| +. \|
		+	+-----------------+
		+	There is a directory called “.ssh” on both your local machine and DeepSense’s login nodes 1 and 2 in your home directory. You can go to the “.ssh” directory on your local machine to see if there are two files named “id_rsa” which is your private key and “id_rsa.pub” which is your public key. The private key is the key you keep only on your local machine. While you use the public key to let remote system know you would like to ssh to it using the pub key without a password. The next step tells you how to do this.
		+	2. Put the public key on login 1 of DeepSense
		+	Get the contents of the public key on your local machine. You can use command “cat” to do this. For example:
		+	cat .ssh/id_rsa.pub
		+	ssh-rsa AAAA/ OOfh/BL+ESZ1GQ8Ms8kBPUmV/w== username from abc.com
		+	The actual key is not this short as shown above. It is just an example. You copy the whole contents of the public key.
		+	Now login the DS login node 1. You still have to use password at this moment. After you are on the system, open “.ssh/authorized_keys” and paste the public key you just copied to the last line of this file.
		+	3. Set correct permission of authorized_keys
		+	You already have the public key of you local machine on login node 1. But you will have to set the permission of the file “.ssh/authorized_keys”. Run the following command to set the permission:
		+	chmod 640 .ssh/authorized_keys
		+	Now, you should be able to ssh into login node 1 without a password.
		+
		+	You can do the same thing for login node 2. If you want to set passwordless ssh between the login node and other nodes in the cluster, you can generate the private and public keys on one login node. Then, put the generated pub key in the “.ssh/authorized_keys” file. Because your home directories are all shared across the cluster, you only need to do this on one node and all nodes can see your public key so you can ssh to them without a password.

← Older revision		Revision as of 17:00, 1 December 2020
Line 1:		Line 1:
	Every DeepSense user has his/her own user account on DeepSense's platform. It is important a user understands his/her account. If a user understands and manages his/her account well, he/she can save a lot of time while working in a HPC environment.		Every DeepSense user has his/her own user account on DeepSense's platform. It is important a user understands his/her account. If a user understands and manages his/her account well, he/she can save a lot of time while working in a HPC environment.
		+
		+	== How to manage your profile to make your environment work better ==
		+	Every user has a profile in his/her home directory. The file's name is '.bashrc'. It is automatically generated for you when your DeepSense account is created. The profile controls the environment variables and other profiles during a user's login session. There is a global profile on the system and a lot of environment variables and profiles have been setup for users such that users do not need to specify them in their own profiles. For example, a user can directly run C and C++ compiler 'gcc' without specifying the path of it.
		+	However, users may install software in their own home directories or use some installed software on our system, but the paths are not set in the global profile. In such a case, a user may want to set up some paths in his/her profile to make his/her work on our systems more convenient.
		+	To view the contents of your profile, you can use command 'cat ~/.bashrc'. To list the file, you will have to add parameters '-a' to the command 'ls' to see the filenames with a '.' at the beginning. For example:
		+
		+	[username@ds-lg-01 ~]$ ls -a</br>
		+	.
		+	..
		+	anaconda2
		+	anaconda3 .bash_history
		+	.bash_logout index.html
		+	.bash_profile iris_test.csv
		+	.bashrc iris_training.csv
		+
		+	If you would like to modify your profile, you can use command 'vi ~/.bashrc' or other editors to change the contents of the file. For example, if you installed anaconda3 in your home directory and you would like your login session to automatically source the environment of your installed anconda3, you can add the following line to the end of your profile:
		+
		+	Source ~/anaconda3/etc/profild.d/conda.sh
		+
		+	The above command assumes that anaconda3 is installed under your home directory. You may modify the path above when editing your profile. You can also add more paths to the environment variable PATH to run commands without specifying their absolute paths. For example, you installed a software called 'examplesoftware' and the binaries of the path is '~/examplesoftware/bin'. You can add the following line in your profile:
		+
		+	export PATH=$PATH:~/examplesoftware/bin