consortium-wiki/launching-remote-schrodinger-jobs-from-maestro.md
... ...
@@ -1,8 +1,7 @@
1 1
# launching remote schrodinger jobs from maestro
2 2
3 3
The maestro GUI supports running jobs on remote systems (usually ones with
4
-more computational resources). Setting this up requires 3 things: [setting up
5
-passwordless ssh](../boston-cmcd-faqs-and-discussion/setting-up-passwordless-ssh.md)
4
+more computational resources). Setting this up requires 3 things: [set up SSH with keys](faq-setting-up-key-based-ssh)
6 5
to the remote system; configuring `schrodinger.hosts` for the system; and
7 6
launching the jobs on the appropriate system.
8 7
... ...
@@ -13,7 +12,6 @@ directory; in `$HOME/.schrodinger`.
13 12
14 13
An example `schrodinger.hosts` file:
15 14
16
-
17 15
name: localhost
18 16
tmpdir: /tmp/
19 17
... ...
@@ -29,7 +27,4 @@ An example `schrodinger.hosts` file:
29 27
To launch a job on a remote system, the name under "Host" should match the
30 28
`name` line for the remote system in your `schrodinger.hosts`.
31 29
32
-
33
-
34
-![](../images/launching-remote-schrodinger-jobs-from-maestro-1.png)
35
-
30
+![](../images/launching-remote-schrodinger-jobs-from-maestro-1.png)
faq-remote-X11-beta.md
... ...
@@ -89,7 +89,7 @@ For all systems off of the sbgrid network it will be easiest if you use the [cmc
89 89
90 90
### Troubleshooting tips.
91 91
92
-Ideally you would have already set up [SSH Without a Password](faq-setting-up-passwordless-ssh)
92
+Ideally you would have already set up [SSH with keys](faq-setting-up-key-based-ssh)
93 93
94 94
Make sure you can ssh to the host without error. You should not need to type 'yes' for ssh keys, etc.
95 95
faq-setting-up-key-based-ssh.md
... ...
@@ -0,0 +1,52 @@
1
+# Setting up key based ssh
2
+ * ***NOTE***: All SBGrid bound Servers and Workstations on the SBGrid network in the Longwood area require 'pub' key to be ***uploaded*** to our authentication servers. Please follow the steps named "Generate SSH Keys" and "For Systems on the SBGrid network at Longwood" below.
3
+
4
+ Off Quad systems (at MCB, HU, Tufts, Sanofi) please following the steps named "Generate SSH Keys" and "For Off-Quad SBGrid Systems" below.
5
+
6
+### Generating SSH Keys
7
+
8
+***We reccommend using a password for ssh keys***
9
+
10
+ 1. You can generate ssh key-pair for local workstation from a Mac or Linux terminal: `ssh-keygen -t ed25519` or `ssh-keygen -t rsa`
11
+ 2. Press enter to accept the default location.
12
+ 3. Enter a password for the key pair.
13
+ 4. On both linux and Mac systems keys can be loaded with 'ssh-add .ssh/id_rsa'. You can see loaded keys with 'ssh-add -l'. The keys remain loaded until you log out.
14
+ 5. Macintosh systems with keys in default locations should get loaded automatically when connecting to systems
15
+
16
+
17
+#### For Off-Quad SBGrid Systems
18
+ 1. Copy public key (`~/.ssh/id_rsa.pub`) to remote system: `scp ~/.ssh/id_rsa.pub remotesys:~/` If this is the first connection to the remote system, type `yes` to accept the remote system key.
19
+ 2. Login to remote system, configure remote system to trust public key:
20
+
21
+ * `ssh remotesys`
22
+ * create ~/.ssh if it doesn't exist: `mkdir ~/.ssh`
23
+ * `cat ~/id_rsa.pub >> ~/.ssh/authorized_keys`
24
+ * `chmod 700 ~/.ssh`
25
+ * `chmod 640 ~/.ssh/authorized_keys`
26
+ 3. Logout of remote system, and repeat login to check that everything works correctly. If so, `~/id_rsa.pub` can be removed from the remote system.
27
+
28
+###For Systems on the SBGrid network in Longwood Medical area
29
+The 'pub' key ***must*** be uploaded to our authentication servers. These examples assume you copied the pub key to your Linux home directory, you can also copy and paste the entire contents of the .pub file between systems.
30
+
31
+You will need to run these commands on **xtal200.harvard.edu**. If you are a Consortium member use shell.sbgrid.org.
32
+
33
+ ipa user-mod $USER --sshpubkey="ssh-ed25519 AAAABBBBBBCCCCCZZZZZZZ qqq@mbp.local"
34
+
35
+OR
36
+
37
+ ipa user-mod $USER --sshpubkey="$(cat ~/.ssh/id_rsa.pub)"
38
+
39
+For multiple keys
40
+
41
+ ipa user-mod $USER --sshpubkey="$(cat ~/.ssh/id_rsa.pub)" --sshpubkey="$(cat ~/.ssh/id_ed25519.pub)"\
42
+ --sshpubkey="$(cat ~/.ssh/othersystem_id_rsa.pub)"
43
+
44
+If you are using csh/tcsh shell
45
+
46
+ ipa user-mod $USER --sshpubkey="`cat ~/.ssh/id_rsa.pub`"
47
+
48
+If you get a 'Kerberos Credential' error you will need to enter the following command, type your password and try again.
49
+
50
+ kinit $USER
51
+
52
+*Note*: The 'ipa' command is not available on most workstations, connect to xtal200.harvard.edu and perform the commands there.
faq-setting-up-passwordless-ssh.md
... ...
@@ -1,48 +0,0 @@
1
-# Setting up password-less ssh
2
- * ***NOTE***: All SBGrid bound Servers and Workstations on the SBGrid network in the Longwood area require 'pub' key to be ***uploaded*** to our authentication servers. Please follow the steps named "Generate SSH Keys" and "For Systems on the SBGrid network at Longwood" below.
3
-
4
- Off Quad systems (at MCB, HU, Tufts, Sanofi) please following the steps named "Generate SSH Keys" and "For Off-Quad SBGrid Systems" below.
5
-
6
-### Generating SSH Keys
7
-
8
-***We reccommend using a password for ssh keys***
9
-
10
- 1. You can generate ssh key-pair for local workstation from a Mac or Linux terminal: `ssh-keygen -t ed25519` or `ssh-keygen -t rsa`
11
- 2. Press enter to accept the default location.
12
- 3. Enter a password for the key pair.
13
- 4. On both linux and Mac systems keys can be loaded with 'ssh-add .ssh/id_rsa'. You can see loaded keys with 'ssh-add -l'. The keys remain loaded until you log out.
14
- 5. Macintosh systems with keys in default locations should get loaded automatically when connecting to systems
15
-
16
-
17
-#### For Off-Quad SBGrid Systems
18
- 1. Copy public key (`~/.ssh/id_rsa.pub`) to remote system: `scp ~/.ssh/id_rsa.pub remotesys:~/` If this is the first connection to the remote system, type `yes` to accept the remote system key.
19
- 2. Login to remote system, configure remote system to trust public key:
20
-
21
- * `ssh remotesys`
22
- * create ~/.ssh if it doesn't exist: `mkdir ~/.ssh`
23
- * `cat ~/id_rsa.pub >> ~/.ssh/authorized_keys`
24
- * `chmod 700 ~/.ssh`
25
- * `chmod 640 ~/.ssh/authorized_keys`
26
- 3. Logout of remote system, and repeat login to check that everything works correctly. If so, `~/id_rsa.pub` can be removed from the remote system.
27
-
28
-###For Systems on the SBGrid network at Longwood
29
-There is no need for ~/.ssh/authorized_keys, the file is ignored on all our linux systems on the SBGrid network at Longwood. The 'pub' key ***must*** be uploaded to our authentication servers. These examples assume you copied the pub key to your Linux home directory, you can also copy and paste the entire contents of the .pub file between systems.
30
-
31
-You will need to run these commands on **xtal200.harvard.edu**. If you are a Consortium member use shell.sbgrid.org.
32
-
33
- ipa user-mod $USER --sshpubkey="$(cat ~/.ssh/id_rsa.pub)"
34
-
35
-Or for multiple keys
36
-
37
- ipa user-mod $USER --sshpubkey="$(cat ~/.ssh/id_rsa.pub)" --sshpubkey="$(cat ~/.ssh/id_ed25519.pub)"\
38
- --sshpubkey="$(cat ~/.ssh/othersystem_id_rsa.pub)"
39
-
40
-If you are using csh/tcsh shell
41
-
42
- ipa user-mod $USER --sshpubkey="`cat ~/.ssh/id_rsa.pub`"
43
-
44
-If you get a 'Kerberos Credential' error you will need to enter the following command, type your password and try again.
45
-
46
- kinit $USER
47
-
48
-*Note*: The 'ipa' command is not available on most workstations, connect to xtal200.harvard.edu and perform the commands there.
faq-sshfs.md
... ...
@@ -4,7 +4,7 @@
4 4
5 5
Installation requires administrative privileges.
6 6
7
-Prior to installing, you should make sure that [password-less-ssh](faq-setting-up-passwordless-ssh) is configured correctly between the local system and the remote system.
7
+Prior to installing, you should make sure that [you can SSH with keys](faq-setting-up-key-based-ssh)
8 8
9 9
1. Download OSXFuse (`dmg`) (`pkg`) from <http://osxfuse.github.io>
10 10
2. Open OSXFuse `dmg` , run installer
... ...
@@ -35,7 +35,7 @@ mkdir ~/userdocs
35 35
/usr/local/bin/sshfs oconnor@xtal200.harvard.edu:/nfs/userdocs /Users/oconnor/userdocs -o volname=userdocs,reconnect,ServerAliveInterval=15,ServerAliveCountMax=3,idmap=user,auto_xattr,dev,suid,defer_permissions,noappledouble,noapplexattr
36 36
```
37 37
38
-You should mount one complete filesystem from the remote site, so this would be anything listed in /nfs for example. This avoids local Apple Finder issues. We give the volume a name `volname=userdocs` (shows mount point on your desktop), add some additional options for server connections, etc. If you are using an [password-less-ssh](faq-setting-up-passwordless-ssh) you would add it's path to the IdentityFile paramater - adding `,IdentityFile=$HOME/.ssh/id_rsa` to the end of the line.
38
+You should mount one complete filesystem from the remote site, so this would be anything listed in /nfs for example. This avoids local Apple Finder issues. We give the volume a name `volname=userdocs` (shows mount point on your desktop), add some additional options for server connections, etc. If you are using an [key-based-ssh](faq-setting-up-key-based-ssh) you would add it's path to the IdentityFile paramater - adding `,IdentityFile=$HOME/.ssh/id_rsa` to the end of the line.
39 39
40 40
### Unmounting remote filesystems
41 41
faqs.md
... ...
@@ -17,7 +17,7 @@ Frequently Answered Questions
17 17
* [Linux Remote Access](faq-remote-access-to-linux-computers)
18 18
* [OS X (Apple): Find MAC Address](faq-how-to-find-mac-address-on-os-x-gui)
19 19
* [Running jobs after you logged off (using Screen)](faq-running-remote-jobs-after-disconnecting)
20
-* [SSH Without a Password](faq-setting-up-passwordless-ssh)
20
+* [SSH with keys](faq-setting-up-key-based-ssh)
21 21
* [SBGrid Software](faq-using-sbgrid-programs)
22 22
* [Using Crystal Email](faq-using-your-crystal-harvard-edu-email-address)
23 23
* [Using Google Apps](faq-using-crystal-google-apps)