AWS.md
... ...
@@ -1,26 +1,39 @@
1 1
## SBGrid in AWS EC2
2 2
3
+SBGrid is easy to use in on cloud resources. This is a short guide to using SBGrid on AWS.
4
+
5
+<!-- TOC -->
6
+
7
+- [SBGrid in AWS EC2](#sbgrid-in-aws-ec2)
8
+ - [Compatible AMIs](#compatible-amis)
9
+ - [Prerequisites](#prerequisites)
10
+ - [Download the SBGrid command line interface](#download-the-sbgrid-command-line-interface)
11
+ - [Activate your installation](#activate-your-installation)
12
+ - [Install programs](#install-programs)
13
+ - [Run your software](#run-your-software)
14
+
15
+<!-- /TOC -->
16
+
3 17
### Compatible AMIs
18
+
4 19
```
5 20
__| __|_ )
6 21
_| ( / Amazon Linux AMI
7 22
___|\___|___|
8 23
```
9
-We recommend CentOS / RHEL 7 AMIs for the SBGrid software stack.
10
-Amazon AMIs appear to work well, but are not routinely tested.
11
-Debian / Ubuntu AMIs may work but are untested.
12
-If you have problems let us know.
24
+
25
+We recommend CentOS / RHEL 7 AMIs for the SBGrid software stack. Amazon AMIs appear to work well, but are not routinely tested. Debian / Ubuntu AMIs may work but are untested. If you have problems let us know.
13 26
14 27
For the example below we are using an Amazon Linux AMI, 2018.03.0 (HVM), SSD Volume Type - ami-14c5486b
15 28
16 29
### Prerequisites
17 30
18
-First login to your running instance and install **tcsh**.
19
-It is not provided on linux by default but is required by several SBGrid titles.
31
+First login to your running instance and install **tcsh**. It is not provided on linux by default but is required by several SBGrid titles.
20 32
21 33
sudo yum install tcsh
22 34
23 35
### Download the SBGrid command line interface
36
+
24 37
Download the SBGrid CLI installation manager.
25 38
26 39
```
... ...
@@ -29,6 +42,7 @@ tar -zxvf sbgrid-cli_2.2.9_linux.tar.gz
29 42
```
30 43
31 44
### Activate your installation
45
+
32 46
If you don't have a username and key, register here : [https://sbgrid.org/registration/register/](https://sbgrid.org/registration/register/)
33 47
34 48
```
... ...
@@ -37,13 +51,14 @@ If you don't have a username and key, register here : [https://sbgrid.org/regist
37 51
38 52
### Install programs
39 53
40
-relion as an example here -
54
+relion as an example here -
41 55
42 56
```
43 57
./sbgrid-cli install relion
44 58
```
45 59
46 60
### Run your software
61
+
47 62
Initialize the environment, and the instance is ready to go.
48 63
49 64
```
SBGrid-Wiki.md
... ...
@@ -5,40 +5,26 @@
5 5
/___/____/\___/_/ /_/\_,_/
6 6
C o n s o r t i u m
7 7
```
8
+
8 9
## Welcome to the SBGrid Consortium Wiki
9 10
10
-SBGrid is a global consortium of research labs in academia and industry using structural biology (cryoEM, X-ray crystallography and scattering, NMR, molecular dynamics, etc) to address scientific questions. Based at Harvard Medical School in Boston, MA, our team supports research computing for structural biologists with scientific software and computing support.
11
+SBGrid is a global consortium of research labs in academia and industry using structural biology (cryoEM, X-ray crystallography and scattering, NMR, molecular dynamics, etc) to address scientific questions. Based at Harvard Medical School in Boston, MA, our team supports research computing for structural biologists with scientific software and computing support.
11 12
12 13
This site provides information on how to install, use, and get help with your SBGrid software installation. Here you can also find information about SBGrid services. Please let us know if you have questions.
13 14
14
-### Recent Posts
15
-
16
-[2021.04.12 - new sbgrid-cli version, 2.2.9](sbgrid-cli)
17
-
18
-[2021.03.31 - new sbgrid-cli version, 2.2.8](sbgrid-cli)
19
-
20
-[2021.03.24 - new sbgrid-cli version, 2.2.5](sbgrid-cli)
21
-
22
-[2021.03.05 - new sbgrid-cli version, 2.2.2](sbgrid-cli)
23
-
24
-[2021.02.23 - new sbgrid-cli version, 2.2.1](sbgrid-cli)
25
-
26
-[2021.02.02 - new sbgrid-cli version, 2.1.5](sbgrid-cli)
27
-
28
-[2021.02.01 - new sbgrid-cli version, 2.1.4](sbgrid-cli)
29
-
30
-[2021.01.13 - new sbgrid-cli version, 2.1.3](sbgrid-cli)
15
+### Recent Wiki Posts
16
+- [2021.05.05 - SBGrid Installation Manager (GUI) version, 2.2.11](client_usage)
31 17
32
-[2021.01.12 - new sbgrid-cli version, 2.1.2](sbgrid-cli)
18
+- [2021.05.05 - new sbgrid-cli version, 2.2.11](sbgrid-cli)
33 19
34
-[2021.01.06 - new sbgrid-cli version, 2.1.1](sbgrid-cli)
20
+- [2021.04.12 - new sbgrid-cli version, 2.2.9](sbgrid-cli)
35 21
36
-[2020.12.01 - MacOS 11 "Big Sur" compatibility](big-sur)
22
+- [2020.12.01 - MacOS 11 "Big Sur" compatibility](big-sur)
37 23
38
-[2020.10.27 - Examples on changing COOT verions](coot)
24
+- [2020.10.27 - Examples on changing COOT verions](coot)
39 25
40
-[2020.11.13 - SBGrid Installation Mangager registration is here](https://sbgrid.org/registration/register/)
26
+- [2020.11.13 - SBGrid Installation Mangager registration is here](https://sbgrid.org/registration/register/)
41 27
42
-[2020.11.13 - SBGrid Installation Mangager downloads](client_downloads)
28
+- [2020.11.13 - SBGrid Installation Mangager downloads](client_downloads)
43 29
44
-[2020.11.13 - MacOS 10.15 catalina is supported](catalina)
30
+- [2020.11.13 - MacOS 10.15 catalina is supported](catalina)
_Sidebar.md
... ...
@@ -1,39 +1,45 @@
1 1
![SBGrid](images/sbgrid_small_logo.gif) **[SBGrid Wiki](Home)**
2 2
3 3
Installing Software
4
-* [Overview](installation_overview)
5
-* [Site installation](managing_install)
6
-* [Graphical installation manager](client_install)
7
-* [Command line installation manager](sbgrid-cli)
8
-* [Installation on macOS 10.15+ (Catalina, Big Sur)](catalina)
9
-* [Apple Silicon Support](big_sur)
4
+
5
+- [Overview](installation_overview)
6
+- [Site installation](managing_install)
7
+- [Graphical installation manager](client_install)
8
+- [Command line installation manager](sbgrid-cli)
9
+- [Installation on macOS 10.15+ (Catalina, Big Sur)](catalina)
10
+- [Apple Silicon Support](big_sur)
10 11
11 12
Using the SBGrid Environment
12
-* [Getting Started with SBGrid](getting_started)
13
-* [Managing Software Versions](versions)
14
-* [SBGrid Capsules Environment](capsules)
15
-* [SBGrid Legacy Environment](monolithic)
16
-* [Modulefiles for SBGrid](modulefiles)
13
+
14
+- [Getting Started with SBGrid](getting_started)
15
+- [Managing Software Versions](versions)
16
+- [SBGrid Capsules Environment](capsules)
17
+- [SBGrid Legacy Environment](monolithic)
18
+- [Modulefiles for SBGrid](modulefiles)
17 19
18 20
Getting Help
19
-* [Software Help and Requests](help)
20
-* [Software Usage Examples](examples)
21
+
22
+- [Software Help and Requests](help)
23
+- [Software Usage Examples](examples)
21 24
22 25
Support for Site Administrators
23
-* [Preparing Workstations to run the Software](workstation_setup)
24
-* [Managing your Installation](managing_install)
25
-* [Administrator Software Version Overrides](admin_overrides)
26
-* [Admins Mailing List](mailinglist)
26
+
27
+- [Preparing Workstations to run the Software](workstation_setup)
28
+- [Managing your Installation](managing_install)
29
+- [Administrator Software Version Overrides](admin_overrides)
30
+- [Admins Mailing List](mailinglist)
27 31
28 32
Support for Developers
29
-* [Resources for Developers](developers)
33
+
34
+- [Resources for Developers](developers)
30 35
31 36
Hardware Support Notes
32
-* [Recommended Hardware](recommended)
33
-* [GPU computing](gpu)
34
-* [Setup Stereo 3D](stereo)
35
-* [SBGrid on AWS EC2](AWS)
37
+
38
+- [Recommended Hardware](recommended)
39
+- [GPU computing](gpu)
40
+- [Setup Stereo 3D](stereo)
41
+- [SBGrid on AWS EC2](AWS)
36 42
37 43
Portals
38
-* [Data Processing After WSMR](wsmr-worked)
39
-* [SBGrid SHARP server](sharp)
44
+
45
+- [Data Processing After WSMR](wsmr-worked)
admin_overrides.md
... ...
@@ -1,5 +1,5 @@
1
-
2 1
## Site Administrator Overrides
2
+
3 3
SBGrid installations allow site-level software control for Administrators
4 4
5 5
- [Site Administrator Overrides](#site-administrator-overrides)
... ...
@@ -8,6 +8,7 @@ SBGrid installations allow site-level software control for Administrators
8 8
- [Precedence](#precedence)
9 9
10 10
### Software Blacklist
11
+
11 12
Site administrators can prevent the shell initialization files from configuring software on a host by creating an empty file at
12 13
13 14
**/programs/local/conf/disabled-hosts/<hostname>**
... ...
@@ -15,22 +16,24 @@ Site administrators can prevent the shell initialization files from configuring
15 16
where **<hostname>** is the output of the //hostname -s// command. This is useful for encouraging users not to run jobs on bastion hosts, file servers, etc.
16 17
17 18
### Administrator Software Version Overrides
19
+
18 20
Most of the software titles installed in the SBGrid Suite have several versions available. Typically, we try to provide at least three versions of each software package, although very old or very new applications may have fewer versions.
19 21
20 22
There are two methods for site admins to configure version overrides using files placed in a **/programs/local/conf/** directory.
21 23
22 24
- Site-wide Version Overrides
23
-A file named **site.conf** will be read when any SBGrid shell is initialized from the installation.
25
+ A file named **site.conf** will be read when any SBGrid shell is initialized from the installation.
24 26
25 27
- Per-host Version Overrides
26
-A file named **<hostname.conf>**, where **<hostname>** is the output of the //hostname -s// command, will be read after the site.conf on the host matching that hostname.
28
+ A file named **<hostname.conf>**, where **<hostname>** is the output of the //hostname -s// command, will be read after the site.conf on the host matching that hostname.
27 29
28 30
### Precedence
29
-There are three files that will be examined for version overrides during shell initialization. In order from lowest to highest precedence:
30 31
31
- * /programs/local/conf/site.conf
32
- * /programs/local/conf/<hostname.conf>
33
- * $HOME/.sbgrid.conf
32
+There are three files that will be examined for version overrides during shell initialization. In order from lowest to highest precedence:
33
+
34
+- /programs/local/conf/site.conf
35
+- /programs/local/conf/<hostname.conf>
36
+- $HOME/.sbgrid.conf
34 37
35 38
The overrides are reported during shell initialization:
36 39
big-sur.md
... ...
@@ -2,21 +2,30 @@
2 2
3 3
Apple has released MacOS 11.0 "Big Sur". This OS includes compatibilty for Apple's new 'Apple Silicon' ARM-based computers as well as numerous changes and security enhancements. Because this is a major update, we reccommend waiting to upgrade any system required for scientific data processing. MacOS 10.14 "Mojave" or 10.15 "Catalina" are currently supported by SBGrid.
4 4
5
-### Apple M1 Silicon
5
+<!-- TOC -->
6
+
7
+- [MacOS 11.0 Big Sur](#macos-110-big-sur)
8
+ - [Apple M1 Silicon](#apple-m1-silicon)
9
+ - [Installing SBGrid on Big Sur](#installing-sbgrid-on-big-sur)
10
+ - [Known issues](#known-issues)
11
+
12
+<!-- /TOC -->
13
+
14
+### Apple M1 Silicon
15
+
6 16
ARM64 compatibility
7 17
8
-Apple released the first of its new ARM64 "apple silicon" macs this month. We are testing the SBGrid software stack on the M1 chip and, so far, compatibility and performance look very good. Most of the SBGrid applications work on the new M1 CPU with macOS 11 and Apple's Rosetta compatibility environment. Standards like COOT, PyMOL, Chimera, CCP4, and PHENIX work seamlessly, but there are exceptions (CCPEM, RELION). We expect to support most titles on BigSur with the new M1 hardware early in 2021.
18
+Apple released the first of its new ARM64 "apple silicon" macs with the "M1" CPU. We are testing the SBGrid software stack on the M1 chip and, so far, compatibility and performance look very good. Most of the SBGrid applications work on the new M1 CPU with macOS 11 and Apple's Rosetta compatibility environment. Standards like COOT, PyMOL, Chimera, CCP4, and PHENIX work seamlessly, but there are exceptions (CCPEM, RELION). We expect to support most titles on BigSur with the new M1 hardware early in 2021.
9 19
10
-## Installing SBGrid on Big Sur
20
+### Installing SBGrid on Big Sur
11 21
12 22
Installation of SBGrid on Big Sur is basically the same as on Catalina. Due to Apple's filesystem protections and our current requirement of a symlink at `/programs`, a `/etc/synthetic.conf` file is necessary. See the [installation page for macOS Catalina for more info](catalina)
13 23
14 24
### Known issues
15
- - Filesystem access issues in PEET
16
- - Ilastik 1.3.3 and earlier are no supported. Support coming in 1.4.
17
- - No 32-bit support (dropped in Catalina) means no support for nmrDraw, other 32-bit applications.
18
- - Rosetta ( from Baker lab, not Apple Rosetta2 ) fails
19
- - CCP-EM ( possibly fixed in latest nightly)
20
- - No compatible release of Schrodinger is currently available
21
- - No GUI in FLTK applications (like RELION)
22
- - Xquartz window border takes a few seconds to appear. It does appear eventually.
25
+
26
+- Ilastik 1.3.3 and earlier are no supported. Support coming in 1.4.
27
+- No 32-bit support (dropped in Catalina) means no support for nmrDraw, other 32-bit applications.
28
+- Rosetta fails ( from Baker lab, not Apple Rosetta2 ). Needs to be recompiled with clang.
29
+- CCP-EM ( possibly fixed in latest nightly)
30
+- No GUI in FLTK applications (like RELION)
31
+- Xquartz window border takes a few seconds to appear. It does appear eventually. Possibly fixed in XQuartz 2.8 series.
capsules.md
... ...
@@ -1,7 +1,8 @@
1 1
# SBGrid software environment
2 2
3
+SBGrid Capsules is a new software environment which is significantly faster than the older 'monolithic' shell environment. This environment includes added features for users to manage their software. Older features (such as version selection) are still present but improved. Old scripts should run unaltered and no new commands are required.
4
+
3 5
- [SBGrid software environment](#sbgrid-software-environment)
4
- - [Overview](#overview)
5 6
- [Notable features of Capsules](#notable-features-of-capsules)
6 7
- [Getting started](#getting-started)
7 8
- [sbcap - Example](#sbcap---example)
... ...
@@ -12,35 +13,33 @@
12 13
- [EXAMPLES:](#examples)
13 14
14 15
<a name="overview"></a>
15
-## Overview
16
-
17
-SBGrid Capsules is a new software environment which is significantly faster than the older 'monolithic' shell environment.
18
-This environment includes added features for users to manage their software.
19
-Older features (such as version selection) are still present but improved.
20
-Old scripts should run unaltered and no new commands are required.
21 16
22 17
### Notable features of Capsules
23 18
24
- - Specify software version on the fly by setting single environment variable
25
- - Single path entry, minimal environment
26
- - Compatile with existing software stacks, modules
19
+- Specify software version on the fly by setting single environment variable
20
+- Single path entry, minimal environment
21
+- Compatile with existing software stacks, modules
27 22
28 23
**Check out Carol Herre's [presentation on Capsules on SBGrid TV](https://www.youtube.com/watch?v=baexe9R128A)**
29 24
30 25
<a name="getting-started"></a>
26
+
31 27
## Getting started
32 28
33
-You can switch from the legacy SBGrid environment to the new with the *sbcap* command. *sbcap on* will enable the capsule environment.
34
-You can always return to the legacy configuration with the *sbcap off* command and *sbcap reset* returns the setting to the default.
29
+You can switch from the legacy SBGrid environment to the new with the _sbcap_ command. _sbcap on_ will enable the capsule environment.
30
+You can always return to the legacy configuration with the _sbcap off_ command and _sbcap reset_ returns the setting to the default.
35 31
36 32
The sbcap setting is persistent across shells - You don't need to do this for every shell.
37 33
38 34
<a name="getting-started_sbcap-example"></a>
35
+
39 36
### sbcap - Example
37
+
40 38
```
41 39
user@linux ~
42 40
$ sbcap on
43 41
```
42
+
44 43
You will see a notice that you are using the new environment
45 44
46 45
```
... ...
@@ -56,7 +55,7 @@ You will see a notice that you are using the new environment
56 55
$
57 56
```
58 57
59
-You can check your capsule status with **sbcap status**.
58
+You can check your capsule status with **sbcap status**.
60 59
61 60
```
62 61
$ sbcap status
... ...
@@ -64,7 +63,9 @@ Active
64 63
```
65 64
66 65
<a name="usage-capsule-environment-for-sbgrid"></a>
66
+
67 67
## Usage - Capsule Environment for SBGrid
68
+
68 69
```
69 70
Usage: sbgrid-exectable [ --sbwhich | --sbenv | --sbman | --sbapp:[adlshrH] | --sbcitation | --sbticket | --sbhelp ]
70 71
... ...
@@ -84,9 +85,10 @@ Usage: sbgrid-exectable [ --sbwhich | --sbenv | --sbman | --sbapp:[adlshrH] | -
84 85
```
85 86
86 87
<a name="usage-capsule-environment-for-sbgrid_overrides-managing-versions"></a>
88
+
87 89
### Overrides - managing versions :
88 90
89
-Version overrides may be defined in the ~/.sbgrid.conf file, which will be used each time the sbgrid.[sh|csh] file are sourced. A version override can also be instantiated by simply defining the APP_M prior to capsule execution.
91
+Version overrides may be defined in the ~/.sbgrid.conf file, which will be used each time the sbgrid.[sh|csh] file are sourced. A version override can also be instantiated by simply defining the APP_M prior to capsule execution.
90 92
91 93
Setting the version - EXAMPLE
92 94
... ...
@@ -103,41 +105,46 @@ We can change this by setting the variable BUSTER_X to 20151214 and calling sbwh
103 105
bash-4.1$ env BUSTER_X=20151214 refine --sbwhich
104 106
/programs/x86_64-linux/buster/20151214/autoBUSTER/bin/linux64/refine
105 107
```
106
-This can also be accomplished by simply setting BUSTER_X=20151214 in the shell or adding the line BUSTER_X=20151214 to your ~/.sbgrid.conf file as [described here](overrides). Note that case is important for the variable names. All SBGrid variable names are ALL CAPS.
108
+
109
+This can also be accomplished by simply setting BUSTER_X=20151214 in the shell or adding the line BUSTER_X=20151214 to your ~/.sbgrid.conf file as [described here](overrides). Note that case is important for the variable names. All SBGrid variable names are ALL CAPS.
107 110
108 111
<a name="usage-capsule-environment-for-sbgrid_managing-duplicate-executables"></a>
112
+
109 113
### Managing Duplicate Executables
110
-In some cases an executable may exist in multiple applications, i.e. the program *fft* exists in CCP4 **and** Tigris. A default application is already defined based on what executable would be used in the legacy environment, but the user can choose to override this selectively or permanently.
114
+
115
+In some cases an executable may exist in multiple applications, i.e. the program _fft_ exists in CCP4 **and** Tigris. A default application is already defined based on what executable would be used in the legacy environment, but the user can choose to override this selectively or permanently.
111 116
112 117
You can override the default in 4 ways. They are
113 118
114 119
1. Command Line arguments select the application for a single command :
115
- **--sbapp:a <appname>** runs the executable from "appname" or
116
- **--sbapp:s** select application from a list
120
+ **--sbapp:a <appname>** runs the executable from "appname" or
121
+ **--sbapp:s** select application from a list
117 122
118
-2. Environment variable of the form ```_<EXECUTABLE>```, an underscore followed by executable in UPPER CASE. e.g. ```_XIA2=dials``` will use xia2 executable from "dials".
123
+2. Environment variable of the form `_<EXECUTABLE>`, an underscore followed by executable in UPPER CASE. e.g. `_XIA2=dials` will use xia2 executable from "dials".
119 124
120
-3. A User Config_file in *~/.sbgrid_capsule/<execname>*. e.g. echo dials > ~/.sbgrid_capsule/xia2 will uset the shell to always use the xia2 from "dials"
125
+3. A User Config*file in *~/.sbgrid*capsule/<execname>*. e.g. echo dials > ~/.sbgrid_capsule/xia2 will uset the shell to always use the xia2 from "dials"
121 126
122
-4. A localsite file in *${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname*
127
+4. A localsite file in _${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname_
123 128
124 129
<a name="usage-capsule-environment-for-sbgrid_managing-duplicate-userpath"></a>
130
+
125 131
### Managing Duplicate with userpath
126 132
127
-Sometimes a duplicate occurs with an executable that is outside of the SBGrid or BioGrids software tree. For example xterm on x86_64-linux is provided by sbgrid and usually provided by the operating system. A user may use the "userpath" directive to select the one that is accessible from the PATH prior to sourcing the SBGrid/BioGrids environment.
133
+Sometimes a duplicate occurs with an executable that is outside of the SBGrid or BioGrids software tree. For example xterm on x86_64-linux is provided by sbgrid and usually provided by the operating system. A user may use the "userpath" directive to select the one that is accessible from the PATH prior to sourcing the SBGrid/BioGrids environment.
128 134
129 135
1. Command Line arguments select the application for a single command :
130
- **--sbapp:s** select application from a list
131
-
132
-2. Environment variable of the form ```_<EXECUTABLE>```, an underscore followed by executable in UPPER CASE. e.g. ```_XTERM=userpath``` will use xterm from the user's original path.
136
+ **--sbapp:s** select application from a list
133 137
134
-3. A User Config_file in *~/.sbgrid_capsule/<execname>*. e.g. ```echo userpath > ~/.sbgrid_capsule/xterm ``` will set the SBGrid/BioGrids shells to always use the user's path.
138
+2. Environment variable of the form `_<EXECUTABLE>`, an underscore followed by executable in UPPER CASE. e.g. `_XTERM=userpath` will use xterm from the user's original path.
135 139
136
-4. A localsite file in *${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname*
140
+3. A User Config*file in *~/.sbgrid*capsule/<execname>*. e.g. `echo userpath > ~/.sbgrid_capsule/xterm ` will set the SBGrid/BioGrids shells to always use the user's path.
137 141
142
+4. A localsite file in _${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname_
138 143
139 144
<a name="usage-capsule-environment-for-sbgrid_examples"></a>
145
+
140 146
### EXAMPLES:
147
+
141 148
Which executable am I using?
142 149
143 150
-bash-4.1 refine --sbwhich
... ...
@@ -155,10 +162,12 @@ refine is present in buster and eman. Where is the eman executable?
155 162
/programs/x86_64-linux/eman/1.9/bin/refine
156 163
157 164
or
165
+
158 166
```
159 167
-bash-4.1$ env _REFINE=eman refine --sbwhich
160 168
/programs/x86_64-linux/eman/1.9/bin/refine
161 169
```
170
+
162 171
I'd like set the eman refine as my default version
163 172
164 173
-bash-4.1$ echo eman > ~/.sbgrid_capsule/refine
... ...
@@ -177,8 +186,8 @@ List all 'refine' executables and select ( and run ) the version from buster
177 186
Please select application 1
178 187
/programs/x86_64-linux/buster/20160324/autoBUSTER/bin/linux64/refine
179 188
180
-
181 189
List all applications that provide xterm, select userpath, make it my default
190
+
182 191
```
183 192
-bash-4.1$ xterm --sbwhich
184 193
/programs/x86_64-linux/system/xterm/327/bin/xterm
... ...
@@ -186,10 +195,10 @@ List all applications that provide xterm, select userpath, make it my default
186 195
-bash-4.1$ xterm --sbapp:l
187 196
xterm
188 197
/usr/bin/xterm
189
-
198
+
190 199
-bash-4.1$ env _XTERM=userpath xterm --sbwhich
191 200
/usr/bin/xterm
192
-
201
+
193 202
-bash-4.1$ xterm --sbapp:s --sbwhich
194 203
1) xterm
195 204
2) userpath
... ...
@@ -201,4 +210,3 @@ List all applications that provide xterm, select userpath, make it my default
201 210
```
202 211
203 212
Please report any bugs to bugs@sbgrid.org
204
-
cli_v2-old.md
... ...
@@ -1,27 +1,30 @@
1 1
# THIS PAGE IS DEPRECATED
2
+
2 3
The information here is likey to be out of date.
3 4
4 5
## SBGrid command line installation manager - v2.1.2
5 6
6
-## How do I get it?
7
+## How do I get it?
8
+
7 9
[LINUX : sbgrid-cli_2.1.2_linux.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.1.2_linux.tar.gz)
8 10
9 11
[macOS : sbgrid-cli_2.1.2_macos.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.1.2_macos.tar.gz)
10 12
11 13
## Supported OSes
12
-[Linux (CentOS/RHEL 7 or 8 recommended) or Apple OSX computers running MacOSX v10.13 - 10.15.](operatingsystems)
13 14
15
+[Linux (CentOS/RHEL 7 or 8 recommended) or Apple OSX computers running MacOSX v10.13 - 10.15.](operatingsystems)
14 16
15
-MacOS 10.15 Catalina can be used, but a work-around is required to add the /programs path.
17
+MacOS 10.15 Catalina can be used, but a work-around is required to add the /programs path.
16 18
See [here for more info :](catalina)
17 19
18 20
### Pre-installation requirements
21
+
19 22
**Admin access required on your computer.**
20
- The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs.
21
- While admin privileges are not required to run the application, you will likely need admin privileges to create /opt/sbgrid and /programs .
23
+The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs.
24
+While admin privileges are not required to run the application, you will likely need admin privileges to create /opt/sbgrid and /programs .
22 25
23 26
```
24
- $ ./sbgrid-cli
27
+ $ ./sbgrid-cli
25 28
Usage: sbgrid-cli [command] [options]
26 29
27 30
Commands:
... ...
@@ -67,10 +70,12 @@ Commands:
67 70
```
68 71
69 72
## General Usage
70
-The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above.
73
+
74
+The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above.
71 75
Each subcommand can also take a -h or --help argument to show usage info.
72 76
73 77
### Activation
78
+
74 79
To install the software, you must have valid credentials provided by SBGrid.
75 80
76 81
Activate with the 'activate' subcommand
... ...
@@ -88,11 +93,11 @@ Options:
88 93
-h, --help output usage information
89 94
```
90 95
91
-Trouble activating? See Troubleshooting options further down this page.
96
+Trouble activating? See Troubleshooting options further down this page.
92 97
93 98
**reactivate**
94 99
95
-*reactivate* can restore from a saved config file. See below.
100
+_reactivate_ can restore from a saved config file. See below.
96 101
97 102
```
98 103
$ ./sbgrid-cli reactivate -h
... ...
@@ -107,9 +112,9 @@ Options:
107 112
-h, --help output usage information
108 113
```
109 114
110
-### Listing available titles, status
115
+### Listing available titles, status
111 116
112
-The *sbgrid list* command will show all available titles. They are normally colored by their installation status.
117
+The _sbgrid list_ command will show all available titles. They are normally colored by their installation status.
113 118
Available options :
114 119
115 120
**list**
... ...
@@ -130,7 +135,7 @@ Options:
130 135
131 136
**updates**
132 137
133
-Shows available updated version and titles
138
+Shows available updated version and titles
134 139
135 140
```
136 141
./sbgrid-cli updates
... ...
@@ -138,8 +143,8 @@ Shows available updated version and titles
138 143
139 144
**obsolete**
140 145
141
-Shows obsolete versions that will be removed.
142
-Obsolete versions are previously installed versions no longer included in the SBGrid installation.
146
+Shows obsolete versions that will be removed.
147
+Obsolete versions are previously installed versions no longer included in the SBGrid installation.
143 148
144 149
```
145 150
./sbgrid-cli obsolete
... ...
@@ -149,10 +154,10 @@ Obsolete versions are previously installed versions no longer included in the SB
149 154
150 155
**info**
151 156
152
-The *info* flag shows information about each title, including a description and links to documentation can be show with the *sbgrid info <title>* command. See example below.
157
+The _info_ flag shows information about each title, including a description and links to documentation can be show with the _sbgrid info <title>_ command. See example below.
153 158
154 159
```
155
-Usage: info [options] [title] [otherTitles...]
160
+Usage: info [options] [title] [otherTitles...]
156 161
157 162
print software title(s) metadata
158 163
... ...
@@ -162,10 +167,10 @@ Options:
162 167
-h, --help output usage information
163 168
```
164 169
165
-For example, info for RELION :
170
+For example, info for RELION :
166 171
167 172
```
168
- $ ./sbgrid-cli info relion
173
+ $ ./sbgrid-cli info relion
169 174
Fetching requested info...
170 175
------------------------------------------------------------------------------------
171 176
Package information for relion (i386-mac):
... ...
@@ -190,22 +195,22 @@ Description:
190 195
(REgularised LIkelihood OptimisatioN) a stand-alone computer program for Maximum A Posteriori (MAP) refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy.
191 196
192 197
Technical notes:
193
-**GPU-accelerated RELION : ** RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux.
198
+**GPU-accelerated RELION : ** RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux.
194 199
For general information on running GPU accelerated applications from SBGrid, please see here : https://sbgrid.org/wiki/gpu</a>
195 200
196
-CUDA builds of RELION are designated by a '_cu<cuda_version>' suffix in the version of the application.
197
-For example, 2.0.4_cu7.5 is linked against CUDA v7.5 libraries and is not recommended for Pascal architecture Nvidia hardware (GTX 1080 and higher). 2.0.4_cu8.0 is built with CUDA 8.0 which supports Pascal architecture GPUs. The '_SP' designation indicates 'single precision' CPU builds. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware.
201
+CUDA builds of RELION are designated by a '_cu<cuda_version>' suffix in the version of the application.
202
+For example, 2.0.4_cu7.5 is linked against CUDA v7.5 libraries and is not recommended for Pascal architecture Nvidia hardware (GTX 1080 and higher). 2.0.4_cu8.0 is built with CUDA 8.0 which supports Pascal architecture GPUs. The '_SP' designation indicates 'single precision' CPU builds. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware.
198 203
199 204
**RELION and MPI : **
200 205
RELION uses the 'mpirun' executable to manage MPI ranks. SBGrid includes two OpenMPI versions, 2.1.2 (default) and 1.8.4 (legacy).
201
-The OpenMPI mpirun executable must match the version of OpenMPI used to build RELION.
202
-For example, RELION versions 2.1_cu*.0 use OpenMPI version 2.1.2 and must use mpirun from 2.1.2.
206
+The OpenMPI mpirun executable must match the version of OpenMPI used to build RELION.
207
+For example, RELION versions 2.1_cu*.0 use OpenMPI version 2.1.2 and must use mpirun from 2.1.2.
203 208
204
-Older RELION versions require an override in $HOME/.sbgrid.conf to set the older OpenMPI version to 1.8.4. Add
209
+Older RELION versions require an override in $HOME/.sbgrid.conf to set the older OpenMPI version to 1.8.4. Add
205 210
206 211
OPENMPI_X=1.8.4"
207 212
208
-to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun.
213
+to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun.
209 214
You can also use the 'mpirun.relion' executable in place of mpirun to use the MPI that matches the currently configured version of RELION.
210 215
211 216
Links:
... ...
@@ -216,7 +221,7 @@ Links:
216 221
217 222
### Installing and removing
218 223
219
-Install and remove titles with the *sbgrid install <title>* and *sbgrid remove <title>* command. Each of these commands can take multiple titles with versions at one time.
224
+Install and remove titles with the _sbgrid install <title>_ and _sbgrid remove <title>_ command. Each of these commands can take multiple titles with versions at one time.
220 225
221 226
**install**
222 227
... ...
@@ -236,13 +241,13 @@ Options:
236 241
237 242
**Install examples :**
238 243
239
-Install a single default version of an application :
244
+Install a single default version of an application :
240 245
241 246
```
242
-./sbgrid-cli install relion
247
+./sbgrid-cli install relion
243 248
```
244 249
245
-Install a specific version of a relion :
250
+Install a specific version of a relion :
246 251
247 252
```
248 253
./sbgrid-cli install relion@3.0.8
... ...
@@ -254,7 +259,7 @@ Install all versions of relion :
254 259
./sbgrid-cli install relion@all
255 260
```
256 261
257
-Install the 'Electron Microscopy' collection of titles (see above *list* command to list *collections*):
262
+Install the 'Electron Microscopy' collection of titles (see above _list_ command to list _collections_):
258 263
259 264
```
260 265
$ ./sbgrid-cli install -c 'Electron Microscopy'
... ...
@@ -274,7 +279,7 @@ Install all versions of all titles ( The full collection):
274 279
275 280
**remove**
276 281
277
-Same options as install flag above.
282
+Same options as install flag above.
278 283
279 284
```
280 285
remove software title(s)
... ...
@@ -302,7 +307,7 @@ Updates are performed when default titles change to a new version or bugs are fi
302 307
303 308
### Remove obsolete titles
304 309
305
-Use the obsolete flag to list or remove obsolete versions or titles
310
+Use the obsolete flag to list or remove obsolete versions or titles
306 311
307 312
**obsolete**
308 313
... ...
@@ -323,13 +328,13 @@ Options:
323 328
324 329
The advanced modes perform multiple actions and are designed for automated use for a managed 'rolling release' installation.
325 330
326
-**clean**
331
+**clean**
327 332
328 333
Removes all obsolete software versions and titles
329 334
330
-**admin**
335
+**admin**
331 336
332
-Run periodic installation, update and removal. Installs all new titles, updates where appropriate and cleans up (removes) obsolete versions
337
+Run periodic installation, update and removal. Installs all new titles, updates where appropriate and cleans up (removes) obsolete versions
333 338
334 339
```
335 340
Usage: admin [options]
... ...
@@ -342,72 +347,72 @@ Options:
342 347
-h, --help output usage information
343 348
```
344 349
345
-For example running
350
+For example running
346 351
347 352
```
348
-./sbgrid-cli admin
353
+./sbgrid-cli admin
349 354
```
350 355
351
-will install all default, update all installed titles and remove all obsolete versions while
356
+will install all default, update all installed titles and remove all obsolete versions while
352 357
353 358
```
354 359
./sbgrid-cli admin -a
355 360
```
356 361
357
-will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions.
362
+will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions.
358 363
This
359 364
365
+**rebuild**
360 366
361
-**rebuild**
362
-
363
-*rebuild* rebuilds the installation environment configuration files.
367
+_rebuild_ rebuilds the installation environment configuration files.
364 368
365
-**crontab**
369
+**crontab**
366 370
367
-Writes a basic script for crontab for *admin* functionality
371
+Writes a basic script for crontab for _admin_ functionality
368 372
369 373
**save**
370 374
371
-The *save* flag saves the current configuration so it can be restored at a later stage or replicated on another machine (or in the cloud).
372
-
375
+The _save_ flag saves the current configuration so it can be restored at a later stage or replicated on another machine (or in the cloud).
373 376
374 377
## Troubleshooting and diagnostics
375 378
376
-**check-connection**
379
+**check-connection**
377 380
connectivity checks
378 381
379
-**diag**
382
+**diag**
380 383
troubleshooting and diagnostics
381 384
382
-**verify**
385
+**verify**
383 386
list missing software versions and .rc files
384 387
385 388
## Installing software for multiple platforms
386 389
387
-On linux, add the --darwin command to install / remove for macOS .
388
-Conversely, use the --linux command to install / remove for Linux while on macOS.
390
+On linux, add the --darwin command to install / remove for macOS .
391
+Conversely, use the --linux command to install / remove for Linux while on macOS.
389 392
390 393
```
391 394
--linux specify linux as platform
392 395
--darwin specify macOS as platform
393 396
```
394
-The platform flag is implied for the platform used to install the software.
395 397
398
+The platform flag is implied for the platform used to install the software.
396 399
397 400
### Software Version Management in the SBGrid environment
401
+
398 402
If you have a single version of an application installed, explicit version selection in your environment is not needed.
399 403
400
-In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*. This is standard for the SBGrid software environment.
404
+In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when it is installed, unless configured otherwise in _~/.sbgrid.conf_. This is standard for the SBGrid software environment.
401 405
402
-In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment.
406
+In the case of multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file. This is the same as in the standard SBGrid environment.
403 407
404 408
**Version priority in the shell**
405
- 1. *~/.sbgrid.conf*
406
- 2. Installed single version
407
- 3. Installed Default version
408
- 4. Latest installed release
409 409
410
-There is more info on how to do that here --> [SBGrid version overrides](versions)
410
+1. _~/.sbgrid.conf_
411
+2. Installed single version
412
+3. Installed Default version
413
+4. Latest installed release
414
+
415
+There is more info on how to do that here --> [SBGrid version overrides](versions)
411 416
412 417
### Running SBGrid software
413 418
... ...
@@ -421,6 +426,6 @@ or in tcsh
421 426
422 427
### Known Issues
423 428
424
-* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
429
+- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
425 430
426 431
For help or to report issues, please email *bugs@sbgrid.org.*
client_CLI_install-old.md
... ...
@@ -1,28 +1,33 @@
1 1
# THIS PAGE IS DEPRECATED
2
+
2 3
The information here is likey to be out of date.
4
+See [sbgrid-cli V2](cli_v2)
3 5
4 6
## SBGrid command line installation manager
5 7
8
+- [THIS PAGE IS DEPRECATED](#this-page-is-deprecated)
9
+ - [SBGrid command line installation manager](#sbgrid-command-line-installation-manager)
6 10
- [Installation](#installation)
7
- - [Pre-installation requirements](#installation_pre-installation-requirements)
8
- - [Binary releases : MacOS and Linux Installation](#installation_binary-releases)
9
- - [Installation on an external drive or USB key](#installation_installation-on-an-external-drive-or-usb-key)
11
+ - [Pre-installation requirements](#pre-installation-requirements)
12
+ - [Binary releases](#binary-releases)
13
+ - [Installation on an external drive or USB key](#installation-on-an-external-drive-or-usb-key)
10 14
- [General Usage](#general-usage)
11
- - [Activation](#general-usage_activation)
12
- - [Listing available titles](#general-usage_listing-available-titles)
13
- - [Getting Information](#general-getting-information-about-titles)
14
- - [Installing and Removing Titles](#general-usage_installing-and-removing)
15
- - [Updating packages](#general-usage_updating-titles)
16
- - [Example : Installing Albula](#general-usage_example-installing-albula)
17
- - [Example : Removing Albula](#general-usage_example-removing-albula)
18
- - [Version selection](#general-usage_version-selection)
19
- - [Software Version Management in the SBGrid environment](#general-usage_software-version-management-in-the-sbgrid-environment)
20
- - [Running SBGrid software](#general-usage_running-sbgrid-software)
21
- - [Known Issues](#general-usage_known-issues)
15
+ - [Activation](#activation)
16
+ - [Listing available titles](#listing-available-titles)
17
+ - [Getting Information about titles](#getting-information-about-titles)
18
+ - [Installing and removing](#installing-and-removing)
19
+ - [Updating titles](#updating-titles)
20
+ - [Example : Installing Albula](#example--installing-albula)
21
+ - [Example : Removing Albula](#example--removing-albula)
22
+ - [Version selection](#version-selection)
23
+ - [Software Version Management in the SBGrid environment](#software-version-management-in-the-sbgrid-environment)
24
+ - [Running SBGrid software](#running-sbgrid-software)
25
+ - [Known Issues](#known-issues)
22 26
23 27
## Installation
28
+
24 29
The SBGrid software stack can be installed using our command line program for [Linux (CentOS/RHEL 7 or 8 recommended) or Apple OSX computers running MacOSX v10.13 - 10.15.](operatingsystems)
25
-CentOS 6 is no longer supported.
30
+CentOS 6 is no longer supported.
26 31
27 32
Two software installers are available. Binary releases are available for MacOS and CentOS operating systems.
28 33
... ...
@@ -31,19 +36,21 @@ The SBGrid installation manager requires an individual account. To get started,
31 36
**Check out [Jason Key's presentation on SBGrid installation tools](https://www.youtube.com/watch?v=sAxIzWhWX5o&t=1s)**
32 37
33 38
### Pre-installation requirements
39
+
34 40
**Admin access required on your computer.**
35
- The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. While admin privileges are not required to run the application, you will need admin privileges to create /opt/sbgrid and /programs. The install manager currently relies on 'sudo' for these tasks and should in installed from an account with sudo privileges. While not strictly required, we recommend a dedicated 'sbgrid' user account for software management. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and possibly inadvertantly deleted by software updates.
41
+The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. While admin privileges are not required to run the application, you will need admin privileges to create /opt/sbgrid and /programs. The install manager currently relies on 'sudo' for these tasks and should in installed from an account with sudo privileges. While not strictly required, we recommend a dedicated 'sbgrid' user account for software management. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and possibly inadvertantly deleted by software updates.
36 42
37 43
**Existing SBGrid installations must be renamed or removed.**
38
- If you have previously installed SBGrid software on your computer at /programs or at /opt/sbgrid, these directories should be removed or renamed. The manager will create these on first run.
44
+If you have previously installed SBGrid software on your computer at /programs or at /opt/sbgrid, these directories should be removed or renamed. The manager will create these on first run.
39 45
40 46
**Hard Drive Space**
41
- Depending on what you install, ensure you have enough free hard drive space on your machine.
47
+Depending on what you install, ensure you have enough free hard drive space on your machine.
42 48
43
-**For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.**
44
- Some packages are quite large and can be slow to download, especially over WiFi.
49
+**For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.**
50
+Some packages are quite large and can be slow to download, especially over WiFi.
45 51
46 52
### Binary releases
53
+
47 54
Binary releases of the install manager are recommended - there is minimal installation needed for these binaries and they can be run from any location with no dependencies. Untar the archive, make the file executable if necessary, and run from your preferred location.
48 55
49 56
[Mac : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Darwin.tgz)
... ...
@@ -98,23 +105,25 @@ sbgrid: error: too few arguments
98 105
```
99 106
100 107
### Installation on an external drive or USB key
108
+
101 109
Currently the installer application installs the software tree in /opt/sbgrid and uses a symlink at /programs. This link is required for the software to work, but in principle the software can be located anywhere and linked to /opt/sbgrid. This functionality is not yet included in the SBGrid application, but can be set up manually with a symlink.
102 110
103 111
An installation can be made on an external drive if you first do an install (into /opt/sbgrid), then move it and symlink to the new location.
104 112
105
-**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is */Volumes/sbgrid_installation*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application.
113
+**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is _/Volumes/sbgrid_installation_. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application.
106 114
107
-Next move */opt/sbgrid* to the USB key at */Volumes/sbgrid_installation*. You will likely need sudo for this.
115
+Next move _/opt/sbgrid_ to the USB key at _/Volumes/sbgrid_installation_. You will likely need sudo for this.
108 116
109 117
$ sudo mv /opt/sbgrid /Volumes/sbgrid_installation/.
110 118
111
-Now we have */Volumes/sbgrid_installation/sbgrid*. Create a symlink from */opt/sbgrid* to */Volumes/sbgrid_installation/sbgrid*.
119
+Now we have _/Volumes/sbgrid_installation/sbgrid_. Create a symlink from _/opt/sbgrid_ to _/Volumes/sbgrid_installation/sbgrid_.
112 120
113 121
$ sudo ln -s /Volumes/sbgrid_installation/sbgrid /opt/sbgrid
114 122
115
-The symlink at */programs* still points to */opt/sbgrid*, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive.
123
+The symlink at _/programs_ still points to _/opt/sbgrid_, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive.
116 124
117 125
## General Usage
126
+
118 127
The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example, the 'install' subcommand can take several arguments :
119 128
120 129
```
... ...
@@ -132,9 +141,11 @@ optional arguments:
132 141
```
133 142
134 143
### Activation
144
+
135 145
To install the software, you must have valid credentials provided by SBGrid.
136 146
137 147
Activate with the 'activate' subcommand
148
+
138 149
```
139 150
usage: sbgrid activate [-h] [--multibranch] site user key
140 151
... ...
@@ -151,18 +162,18 @@ optional arguments:
151 162
152 163
```
153 164
154
-The *--multibranch* option allows for installation of Linux or Mac software on server that should host both platforms, usually for access of NFS. This must be set at activation. Once set, Linux and Mac titles will be installed.
165
+The _--multibranch_ option allows for installation of Linux or Mac software on server that should host both platforms, usually for access of NFS. This must be set at activation. Once set, Linux and Mac titles will be installed.
155 166
156 167
### Listing available titles
157 168
158
-The *sbgrid list* command will show all available titles colored by their installation status. Installed titles are green, those with available updates are blue, and titles to be removed are red. Software is listed by 'Collection'.
169
+The _sbgrid list_ command will show all available titles colored by their installation status. Installed titles are green, those with available updates are blue, and titles to be removed are red. Software is listed by 'Collection'.
159 170
160 171
```
161 172
$ ./sbgrid list
162 173
-- Crystallography -------------------------------------------------------------------------------------------------------------------------
163 174
3dna eden pdb_redo solveresolve
164 175
adxv eiger2cbf pdb-validation-suite somore
165
-albula elves
176
+albula elves
166 177
...
167 178
-- NMR -------------------------------------------------------------------------------------------------------------------------------------
168 179
aqua gamma nmrview remediator
... ...
@@ -184,11 +195,11 @@ crop relion
184 195
185 196
### Getting Information about titles
186 197
187
-Information about each title, including a description and links to documentation can be show with the *sbgrid info <title>* command. See example below.
198
+Information about each title, including a description and links to documentation can be show with the _sbgrid info <title>_ command. See example below.
188 199
189 200
### Installing and removing
190 201
191
-Install and remove titles with the *sbgrid install <title>* and *sbgrid remove <title>* command. Each of these commands can take multiple titles with versions at one time.
202
+Install and remove titles with the _sbgrid install <title>_ and _sbgrid remove <title>_ command. Each of these commands can take multiple titles with versions at one time.
192 203
193 204
```
194 205
$ ./sbgrid info epmr
... ...
@@ -213,6 +224,7 @@ Links:
213 224
Manual: http://www.epmr.info/UsersGuide.html
214 225
215 226
```
227
+
216 228
```
217 229
$ ./sbgrid info adxv
218 230
Package: adxv
... ...
@@ -241,6 +253,7 @@ Links:
241 253
Website: http://www.scripps.edu/tainer/arvai/adxv.html
242 254
Manual: http://www.scripps.edu/tainer/arvai/adxv/AdxvUserManual.pdf
243 255
```
256
+
244 257
```
245 258
$ ./sbgrid install adxv epmr epmr@16.01
246 259
adxv@1.9.12 installed
... ...
@@ -249,11 +262,12 @@ epmr@16.01 installed
249 262
Updating installation configuration...
250 263
251 264
```
265
+
252 266
When a version string is not specified, the default version is installed or removed.
253 267
254 268
### Updating titles
255 269
256
-Show titles with a pending update with the *sbgrid updates* command. Updates can be applied with the *sbgrid update <title>* or *sbgrid update-all* commands.
270
+Show titles with a pending update with the _sbgrid updates_ command. Updates can be applied with the _sbgrid update <title>_ or _sbgrid update-all_ commands.
257 271
258 272
### Example : Installing Albula
259 273
... ...
@@ -325,7 +339,7 @@ Package removed!
325 339
326 340
Default versions are installed by default for each application, though individual versions can be selected for each title.
327 341
328
-To do so, include the version after the title followed the version. To see what versions are available, use the *sbgrid info <title>* command. Let;s us the title epmr as an example here:
342
+To do so, include the version after the title followed the version. To see what versions are available, use the _sbgrid info <title>_ command. Let;s us the title epmr as an example here:
329 343
330 344
$ sbgrid info epmr
331 345
... ...
@@ -386,9 +400,10 @@ Available versions:
386 400
387 401
```
388 402
389
-Confirm with the *sbwhich* command
403
+Confirm with the _sbwhich_ command
390 404
391 405
$ sbwhich epmr
406
+
392 407
```
393 408
/programs/i386-mac/epmr/11.02/epmr
394 409
```
... ...
@@ -396,19 +411,21 @@ Confirm with the *sbwhich* command
396 411
Reload the sbgrid shell to use the new version ( or set the environment variable EPMR_M=11.02 ).
397 412
398 413
### Software Version Management in the SBGrid environment
414
+
399 415
If you have a single version of an application installed, explicit version selection in your environment is not needed.
400 416
401
-In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*.
417
+In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when it is installed, unless configured otherwise in _~/.sbgrid.conf_.
402 418
403
-In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment.
419
+In the case of multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file. This is the same as in the standard SBGrid environment.
404 420
405 421
**Version priority in the shell**
406
- 1. *~/.sbgrid.conf*
407
- 2. Installed single version
408
- 3. Installed Default version
409
- 4. Latest installed release
410 422
411
-There is more info on how to do that here --> [SBGrid version overrides](versions)
423
+1. _~/.sbgrid.conf_
424
+2. Installed single version
425
+3. Installed Default version
426
+4. Latest installed release
427
+
428
+There is more info on how to do that here --> [SBGrid version overrides](versions)
412 429
413 430
### Running SBGrid software
414 431
... ...
@@ -420,9 +437,8 @@ or in tcsh
420 437
421 438
$ source /programs/sbgrid.cshrc
422 439
423
-
424 440
### Known Issues
425 441
426
-* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
442
+- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
427 443
428 444
For help, email *bugs@sbgrid.org.*
client_downloads.md
... ...
@@ -1,41 +1,58 @@
1
+## SBGrid Installation Manager - Downloads
1 2
2
-## SBGrid installation manager
3
+<!-- TOC -->
3 4
4
-### MacOS Graphical installation manager
5
-![SBGrid](images/thumbnail_gui.png)
5
+- [SBGrid Installation Manager - Downloads](#sbgrid-installation-manager---downloads)
6
+ - [Requirements](#requirements)
7
+ - [SBGrid Installation Manager for MacOS and Linux, v2.2.11](#sbgrid-installation-manager-for-macos-and-linux-v2211)
8
+ - [SBGrid Command-line Installation Manager for MacOS and Linux, v2.2.11](#sbgrid-command-line-installation-manager-for-macos-and-linux-v2211)
9
+ - [LEGACY command line installation manager for MacOS and Linux, v1.0.695](#legacy-command-line-installation-manager-for-macos-and-linux-v10695)
10
+ - [Legacy MacOS Graphical installation manager](#legacy-macos-graphical-installation-manager)
6 11
7
-[Latest build : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg)
12
+<!-- /TOC -->
8 13
9
-This is our original GUI manager for MacOS.
10
-See [this page](client_install) for additional installation and usage info.
14
+### Requirements
11 15
12
-To install, first mount the .dmg disk image on your Mac. Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired.
16
+SBGrid can be installed on computers running Linux or macOS operating systems. [CentOS/RHEL 7 or 8 is recommended for linux, or MacOSX v10.13 - macOS 11.0 for Macs.](operatingsystems). CentOS 6 has reached "End-of-Life" and is no longer supported. macOS 10.15 "Catalina" and macOS 11.0 "Big Sur" can be used, but an `/etc/syntetic.conf` file is required to create the `/programs` path. The GUI Installation Manager will create this for you. See [here for more info :](catalina)
13 17
14
-You may be prompted that the appication is from an "Unidentified Developer". On MacOS, if you try to open an app that is not signed by an Apple-registered developer, you will be prompted by a warning dialog. This doesn’t necessarily mean that something’s wrong with the app. Some apps were written by developers who are not members of the Apple developers program.
18
+The SBGrid installation manager requires an account. Set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/)
19
+
20
+### SBGrid Installation Manager for MacOS and Linux, v2.2.11
21
+
22
+- [Linux : SBGrid_Installation_Manager-2.2.11.AppImage](https://sbgrid.org/wiki/downloads/SBGrid_Installation_Manager-2.2.11.AppImage)
23
+
24
+- [macOS : SBGrid_Installation_Manager-2.2.11.dmg](https://sbgrid.org/wiki/downloads/SBGrid_Installation_Manager-2.2.11.dmg)
25
+
26
+See [this page](client_usage) for usage info.
27
+
28
+### SBGrid Command-line Installation Manager for MacOS and Linux, v2.2.11
15 29
16
-### Command line manager for MacOS and Linux, v2.1.2
30
+- [Linux : sbgrid-cli_2.2.11_linux.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.11_linux.tar.gz)
17 31
18
-[macOS : 2.1.2, 2020-05-31](downloads/sbgrid-cli_2.1.2_macos.tar.gz)
32
+- [macOS : sbgrid-cli_2.2.11_macos.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.11_macos.tar.gz)
19 33
20
-[Linux : 2.1.2, 2020-05-31](downloads/sbgrid-cli_2.1.2_linux.tar.gz)
34
+See [this page](cli_v2) for usage info.
21 35
22
-This is the new command line application with advanced features.
23
-See [this page](cli_v2) for usage info.
36
+---
24 37
25
-### Command line manager for MacOS and Linux, v1.0.695
38
+### LEGACY command line installation manager for MacOS and Linux, v1.0.695
26 39
27
-[macOS : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Darwin.tgz)
40
+- [macOS : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Darwin.tgz)
28 41
29
-[Linux : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Linux.tgz)
42
+- [Linux : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Linux.tgz)
30 43
31
-This is the original SBGrid CLI install manager.
32
-[More info can be found here](client_CLI_usage).
44
+This is the original SBGrid CLI installation manager. This version is deprecated and is no longer supported.
33 45
34
-Minimal installation required for these binaries and they can be run from any location with no dependencies.
35
-Untar the archive, make the file executable if necessary and run from your preferred location.
46
+Minimal installation required for these binaries and they can be run from any location with no dependencies. Untar the archive, make the file executable if necessary and run from your preferred location.
36 47
37
-### GUI manager 2.0 for MacOS and Linux
48
+### Legacy MacOS Graphical installation manager
38 49
39
-Coming in 2021!
40
-Interested in beta testing? Email bugs@sbgrid.org
41
-![SBGrid](images/new_client_thumb.png)
50
+- [macOS : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg)
51
+
52
+This is our original GUI manager for MacOS. Usage is deprecated and is no longer supported. See [this page](client_install_legacy) for additional installation and usage info.
53
+
54
+![SBGrid](images/thumbnail_gui.png)
55
+
56
+To install, first mount the .dmg disk image on your Mac. Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired.
57
+
58
+You may be prompted that the appication is from an "Unidentified Developer". On MacOS, if you try to open an app that is not signed by an Apple-registered developer, you will be prompted by a warning dialog. This doesn’t necessarily mean that something’s wrong with the app. Some apps were written by developers who are not members of the Apple developers program.
client_install.md
... ...
@@ -1,166 +1,80 @@
1
-## SBGrid installation manager
1
+## SBGrid Installation Manager GUI : Installation and Usage
2 2
3
-The SBGrid installation manager is available as command-line tool for macOS and Linux, and as a graphical application for macOS. The command-line and graphical versions are not mutually exclusive - they can be used interchangeably on mac.
3
+This page covers the usage of the installation manager graphical user interface (GUI). This application is available for Linux and macOS computers. For more information on our latest command-line interface (CLI) installation manager, [see here](sbgrid-cli). Latest versions are [available for download here](client_downloads.md)
4 4
5
-For the latest command-line application, [see here](sbgrid-cli).
6
-For the graphical version, see below.
5
+<!-- TOC -->
7 6
8
-**NOTE for BIOGRIDS users** - [ Instructions for BioGrids installation can be found here ](https://biogrids.org/wiki/client_install). BioGrids is a scientific software collection focused on Bioinformatics tools. It is distinct from SBGrid which is focused on structural biology applications. Please see here for more info : [biogrids.org](https://biogrids.org).
7
+- [SBGrid Installation Manager GUI : Installation and Usage](#sbgrid-installation-manager-gui--installation-and-usage)
8
+ - [Requirements and recommendations](#requirements-and-recommendations)
9
+ - [Activation](#activation)
10
+ - [GUI Home Pane](#gui-home-pane)
11
+ - [Installed Pane](#installed-pane)
12
+ - [Programs Pane](#programs-pane)
13
+ - [Tasks Pane](#tasks-pane)
14
+ - [Installing, Upgrading and Removing software](#installing-upgrading-and-removing-software)
15
+ - [Docs and Contact Panes](#docs-and-contact-panes)
9 16
10
-![](images/client_all.png)
17
+<!-- /TOC -->
11 18
12
-Looking to get started with the SBGrid installation manager? First, set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/)
19
+### Requirements and recommendations
13 20
14
- - [Installation](#installation)
15
- - [Pre-installation](#installation_pre-installation)
16
- - [Download, Installation and Activation](#installation_download-installation-and-activation)
17
- - [Installation on an external drive or USB key](#installation_installation-on-an-external-drive-or-usb-key)
18
- - [Usage](#usage)
19
- - [General](#usage_general)
20
- - [Example : Installing Albula](#usage_example-installing-albula)
21
- - [Example : Removing Albula](#usage_example-removing-albula)
22
- - [Version selection](#usage_version-selection)
23
- - [Versions and the SBGrid environment](#usage_versions-and-the-sbgrid-environment)
24
- - [Running the software](#usage_running-the-software)
25
- - [Questions, Problems and Known Issues](#usage-questions-problems-and-known-issues)
21
+The SBGrid installation manager will install the software collection to `/opt/sbgrid` by default. A symlink from `/programs` to the installation directory is required and this step does require admin priveleges. **Admin privileges are not required to run the applications**, only for the initial installation, specifically the creation of /opt/sbgrid and for `/programs` (required).
26 22
27
-## Installation
23
+The Installation Manger uses 'sudo' for priveleged installation tasks. As such, it should be used from an account with sudo privileges if this functionality is desired. This is the default for admin accouunts on macOS.
28 24
29
-### Pre-installation
25
+The SBGrid installation manager requires an account with the SBGrid Consortium. If your lab or institution is a consortium member, you can set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/)
30 26
31
-**1. Admin access required.**
32
- The SBGrid installation manager will install the software tree to */opt/sbgrid* and create a symlink from this directory to */programs*. While admin privileges are not required to run the application, you will need admin privileges to create */opt/sbgrid* and */programs* .
27
+The SBGrid installation manager is available in graphical and command-line flavors for macOS and Linux. The command-line and graphical versions are interchange and can be used for the same installation. You can find both of these on the [Download page here](client_downloads). The `sbgrid-cli` command-line version provides advanced configuration features not included the GUI release.
33 28
34
-**2. Existing installations must be renamed or removed.**
35
- If you have previously installed SBGrid software on your computer at */programs* or at */opt/sbgrid*, these directories should be removed or renamed. The manager will create these on first run.
29
+### Activation
36 30
37
-**3. Hard Drive Space**
38
- Depending on what you install, ensure that you have enough free hard drive space on your machine.
31
+The first step to install the SBGrid software is to activate an account. This only has to be done one time per installation. You won't need to enter credentials after this step.
39 32
40
-**4. XQuartz is required for many graphical applications on MacOS.**
41
- To use many of the graphical applications (COOT, CCP4, nmrDraw, etc), install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/).
33
+![](images/GUI-v2-1-activation.png)
34
+Enter credentials and click the "Activate" button. You will be presented with confirmation dialogs to set up the installation.
42 35
43
-**5. For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.**
44
- Some packages are quite large and can be slow to download, especially over WiFi.
36
+On macOS, you will see :
37
+![](images/GUI-v2-1-priv.png)
38
+This permission is only needed to create `/opt/sbgrid`
45 39
40
+![](images/GUI-v2-2-synthetic.png)
41
+A `/etc/synthetic.conf` is required to create the root-level symlink to `/programs` on macOS. A reboot is required after installation.
46 42
47
-### Download, Installation and activation
43
+### GUI Home Pane
48 44
49
-For macOS Catalina (10.15 and later), a work-around is required for installation. Please see [this page for more info](catalina).
50
-For 10.14 "Mojave" and earlier, this step is not required.
45
+![](images/GUI-v2-3-home.png)
46
+This is the home page of the Installation Manager. it features a list of new and updated software, SBGrid News ( Upcoming webinars, events and member tales). The panel left allows the user to select from 6 different panes for managing software. Those a described below.
51 47
52
-**1. Download the latest SBGrid installation manager from here.**
48
+### Installed Pane
53 49
54
- [Latest build : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg)
50
+The `Installed` button changes to the installed software pane.
51
+![](images/GUI-v2-4-installed.png)
52
+This window (above) shows installed titles. In this case, only the base installation is present - the SBGrid Installer is the only title installed.
55 53
56
-**2. Mount the .dmg disk image on your Mac.** Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired.
54
+![](images/GUI-v2-4.5-infopane.png)
55
+By clicking the title text, a window pane reveals the details of the installed title.
57 56
58
-You may be prompted to that the appication is from an "Unidentified Developer". If you try to open an app that is not signed by an Apple-registered developer, you this a warning dialog. This doesn’t necessarily mean that something’s wrong with the app, some apps were written by developers who are not members of the Apple developers program.
57
+### Programs Pane
59 58
60
-**3. Enter your site, user name, and key.** You should have received these by email.
59
+![](images/GUI-v2-5-programs.png)
60
+The programs pane shows all available programs. Software can be added/removed upgraded from this pane. These operations are queued in the task list.
61 61
62
-![activation](images/client_activation.png)
62
+![](images/GUI-v2-6-addedtask.png)
63 63
64
-On activation you will be prompted to provide admin credentials for your mac. This is to create the */opt/sbgrid* directory and */programs* symlink.
64
+### Tasks Pane
65 65
66
-![activation](images/client_permissions.png)
66
+All operations are added to the task list and wil be queud for execution. These can be removed if needed.
67 67
68
-**4. On successful activation, you should see the manager populate with software titles.** If not, please close the application and try again. If activation continues to fail, you may have an old SBGrid installation at */programs* or */opt/sbgrid*. These should be removed. You may also be blocked from accessing SBGrid servers on port 873 and port 8080 by your institution's firewall. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
69
-For help, email *bugs@sbgrid.org.*
68
+![](images/GUI-v2-7-tasklist.png)
69
+Before tasks are applied, they are listed as "pending".
70 70
71
-### Installation on an external drive or USB key
72
-Currently the installer application installs the software tree in */opt/sbgrid* and uses a symlink at */programs*. The */programs* link is required for the software to work, but in principle the software can be anywhere by linking */opt/sbgrid* to the desired installation point. This functionality is not yet included in the SBGrid application, but can be set up manually post-install with a symlink. First do an install (into */opt/sbgrid*), then move it to the desired localtion. Then symlink to the new location from */opt/sbgrid*.
71
+![](images/GUI-v2-9-runningtask1.png)
72
+Tasks are applied and will run in parallel. A Scrollbar indicates progress.
73 73
74
-**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the small SSDs that come in Mac laptops. To install on an external drive in this way, first mount it on your computer. For this example, the mount is */Volumes/sbgrid_programs*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application.
74
+### Installing, Upgrading and Removing software
75 75
76
-Next move **/opt/sbgrid** to the USB key at */Volumes/sbgrid_programs*. You will likely need sudo for this.
76
+Software is queued for installation / removal / upgrade by clicking on the blue / red / green text associated with the application title.
77 77
78
- sudo mv /opt/sbgrid /Volumes/sbgrid_programs/.
78
+### Docs and Contact Panes
79 79
80
-Now we have */Volumes/sbgrid_programs/sbgrid*. Create a symlink from **/opt/sbgrid** to */Volumes/sbgrid_programs/sbgrid*.
81
-
82
- sudo ln -s /Volumes/sbgrid_programs/sbgrid /opt/sbgrid
83
-
84
-The symlink at **/programs** still points to **/opt/sbgrid**, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive.
85
-
86
-## Usage
87
-
88
-**Instructions for installing the SBGrid software installation client can be found here** --> [Installation Instructions](client_install)
89
-
90
-### General
91
-The SBGrid software installation manager is a GUI-based installer for the SBGrid software collection. The application allows for selected applications to be installed in the familiar SBGrid environment.
92
-
93
- ![installed](images/client_install.png)
94
-
95
-The manager GUI is displays software 'Collections' on the right panel with folder icons under the 'Packages' heading. These Collections control the list of titles displayed in the center 'main' panel.
96
-
97
-The first of two of these 'Collections' are shortcut meta-collections of the local machine. The first is the currently installed titles. The second icon, Updates, shows updates available from SBGrid. 'Pending' is a collection of pending installs and removals. Below these shortcuts are packages are grouped by primary scientific uses. Installation status is also indicated in theses collections.
98
-
99
-Information about each title, including a description and links to documentation are shown in the upper right panel when that title is selected in the main pane.
100
-
101
-Once packages have been configured for installation and/or removal by selecting their checkbox, clicking the 'Apply Changes' button will perform update the titles, adding pending installations and removing pending deletions.
102
-
103
-### Example : Installing Albula
104
-Check the box to select Albula, then click the 'Apply Changes' button.
105
-Notice the text turns green for pending installations. Pending updates are Orange.
106
-![apply](images/client_apply2.png)
107
-
108
-### Example : Removing Albula
109
-Uncheck the box for Albula. Removals are shown in red text.
110
-![apply](images/client_remove1.png)
111
-
112
-Click apply changes. Albula will be removed.
113
-![apply](images/client_remove2.png)
114
-
115
-### Version selection
116
-
117
-Default versions are installed by default for each application, though individual versions can be selected for each title. To do so, show the version pane by selecting **"Show all package versions"** from the **"View"** menu. Then, in the bottom right, select a desired version with the check boxes. Multiple versions of a given title can be installed and are indicated in the main panel.
118
-
119
-Enable version panel
120
-![all](images/client_versions1.png)
121
-
122
-Check old/non-default versions
123
-![all](images/client_versions2.png)
124
-
125
-
126
-### Versions and the SBGrid environment
127
-If you have a single version of an application installed, explicitly version selection in your environment will not be needed. In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when installed, unless configured otherwise in *~/.sbgrid.conf*.
128
-
129
-If you have multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use either an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file as in the standard SBGrid environment.
130
-
131
-**Version priority in the shell**
132
- 1. *~/.sbgrid.conf*
133
- 2. Installed Default version
134
- 3. Latest installed release
135
-
136
-You can do open the configuration file by selecting the *"Edit Configuration File"* from the *"SBGrid Installer"* menu.
137
-
138
-![all](images/client_config1.png)
139
-
140
-This will open a text editor with a sample configuration file, or your *~/.sbgrid.conf* file if you have one already.
141
-
142
-![all](images/client_config2.png)
143
-
144
-There is more info on how to do that here --> [SBGrid version overrides](versions)
145
-
146
-
147
-### Running the software
148
-
149
-To run the software, you can click the "SBGrid Shell" button for an initialized bash shell.
150
-
151
-You may also run the software from another terminal on your machine.
152
-To use the software at the terminal in bash, open a new terminal and run
153
-
154
- source /programs/sbgrid.shrc
155
-
156
-or in tcsh
157
-
158
- source /programs/sbgrid.cshrc
159
-
160
-### Questions, Problems and Known Issues
161
-For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*.
162
-If relevant, please include a screenshot of the GUI if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report.
163
-
164
-* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available.
165
-
166
-* **Activation Failed**. In some cases the Authorization dialog for admin privileges does not appear during activation. This causes the manager activation to fail. This is usually due to a previously existing */programs* directory or symlink from a prior installation. This must be removed for activation to be successful. Other users have reported successful activation after a restart.
80
+These panes provide access to our wiki and bug reporting pages. We intend to expand content on these in future releases.
client_install_legacy.md
... ...
@@ -0,0 +1,171 @@
1
+## SBGrid installation manager
2
+
3
+The SBGrid installation manager is available as command-line tool for macOS and Linux, and as a graphical application for macOS. The command-line and graphical versions are not mutually exclusive - they can be used interchangeably on mac.
4
+
5
+For the latest command-line application, [see here](sbgrid-cli).
6
+For the graphical version, see below.
7
+
8
+**NOTE for BIOGRIDS users** - [ Instructions for BioGrids installation can be found here ](https://biogrids.org/wiki/client_install). BioGrids is a scientific software collection focused on Bioinformatics tools. It is distinct from SBGrid which is focused on structural biology applications. Please see here for more info : [biogrids.org](https://biogrids.org).
9
+
10
+![](images/client_all.png)
11
+
12
+Looking to get started with the SBGrid installation manager? First, set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/)
13
+
14
+- [SBGrid installation manager](#sbgrid-installation-manager)
15
+- [Installation](#installation)
16
+ - [Pre-installation](#pre-installation)
17
+ - [Download, Installation and activation](#download-installation-and-activation)
18
+ - [Installation on an external drive or USB key](#installation-on-an-external-drive-or-usb-key)
19
+- [Usage](#usage)
20
+ - [General](#general)
21
+ - [Example : Installing Albula](#example--installing-albula)
22
+ - [Example : Removing Albula](#example--removing-albula)
23
+ - [Version selection](#version-selection)
24
+ - [Versions and the SBGrid environment](#versions-and-the-sbgrid-environment)
25
+ - [Running the software](#running-the-software)
26
+ - [Questions, Problems and Known Issues](#questions-problems-and-known-issues)
27
+
28
+## Installation
29
+
30
+### Pre-installation
31
+
32
+**1. Admin access required.**
33
+The SBGrid installation manager will install the software tree to _/opt/sbgrid_ and create a symlink from this directory to _/programs_. While admin privileges are not required to run the application, you will need admin privileges to create _/opt/sbgrid_ and _/programs_ .
34
+
35
+**2. Existing installations must be renamed or removed.**
36
+If you have previously installed SBGrid software on your computer at _/programs_ or at _/opt/sbgrid_, these directories should be removed or renamed. The manager will create these on first run.
37
+
38
+**3. Hard Drive Space**
39
+Depending on what you install, ensure that you have enough free hard drive space on your machine.
40
+
41
+**4. XQuartz is required for many graphical applications on MacOS.**
42
+To use many of the graphical applications (COOT, CCP4, nmrDraw, etc), install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/).
43
+
44
+**5. For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.**
45
+Some packages are quite large and can be slow to download, especially over WiFi.
46
+
47
+### Download, Installation and activation
48
+
49
+For macOS Catalina (10.15 and later), a work-around is required for installation. Please see [this page for more info](catalina).
50
+For 10.14 "Mojave" and earlier, this step is not required.
51
+
52
+**1. Download the latest SBGrid installation manager from here.**
53
+
54
+[Latest build : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg)
55
+
56
+**2. Mount the .dmg disk image on your Mac.** Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired.
57
+
58
+You may be prompted to that the appication is from an "Unidentified Developer". If you try to open an app that is not signed by an Apple-registered developer, you this a warning dialog. This doesn’t necessarily mean that something’s wrong with the app, some apps were written by developers who are not members of the Apple developers program.
59
+
60
+**3. Enter your site, user name, and key.** You should have received these by email.
61
+
62
+![activation](images/client_activation.png)
63
+
64
+On activation you will be prompted to provide admin credentials for your mac. This is to create the _/opt/sbgrid_ directory and _/programs_ symlink.
65
+
66
+![activation](images/client_permissions.png)
67
+
68
+**4. On successful activation, you should see the manager populate with software titles.** If not, please close the application and try again. If activation continues to fail, you may have an old SBGrid installation at _/programs_ or _/opt/sbgrid_. These should be removed. You may also be blocked from accessing SBGrid servers on port 873 and port 8080 by your institution's firewall. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
69
+For help, email *bugs@sbgrid.org.*
70
+
71
+### Installation on an external drive or USB key
72
+
73
+Currently the installer application installs the software tree in _/opt/sbgrid_ and uses a symlink at _/programs_. The _/programs_ link is required for the software to work, but in principle the software can be anywhere by linking _/opt/sbgrid_ to the desired installation point. This functionality is not yet included in the SBGrid application, but can be set up manually post-install with a symlink. First do an install (into _/opt/sbgrid_), then move it to the desired localtion. Then symlink to the new location from _/opt/sbgrid_.
74
+
75
+**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the small SSDs that come in Mac laptops. To install on an external drive in this way, first mount it on your computer. For this example, the mount is _/Volumes/sbgrid_programs_. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application.
76
+
77
+Next move **/opt/sbgrid** to the USB key at _/Volumes/sbgrid_programs_. You will likely need sudo for this.
78
+
79
+ sudo mv /opt/sbgrid /Volumes/sbgrid_programs/.
80
+
81
+Now we have _/Volumes/sbgrid_programs/sbgrid_. Create a symlink from **/opt/sbgrid** to _/Volumes/sbgrid_programs/sbgrid_.
82
+
83
+ sudo ln -s /Volumes/sbgrid_programs/sbgrid /opt/sbgrid
84
+
85
+The symlink at **/programs** still points to **/opt/sbgrid**, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive.
86
+
87
+## Usage
88
+
89
+**Instructions for installing the SBGrid software installation client can be found here** --> [Installation Instructions](client_install)
90
+
91
+### General
92
+
93
+The SBGrid software installation manager is a GUI-based installer for the SBGrid software collection. The application allows for selected applications to be installed in the familiar SBGrid environment.
94
+
95
+![installed](images/client_install.png)
96
+
97
+The manager GUI is displays software 'Collections' on the right panel with folder icons under the 'Packages' heading. These Collections control the list of titles displayed in the center 'main' panel.
98
+
99
+The first of two of these 'Collections' are shortcut meta-collections of the local machine. The first is the currently installed titles. The second icon, Updates, shows updates available from SBGrid. 'Pending' is a collection of pending installs and removals. Below these shortcuts are packages are grouped by primary scientific uses. Installation status is also indicated in theses collections.
100
+
101
+Information about each title, including a description and links to documentation are shown in the upper right panel when that title is selected in the main pane.
102
+
103
+Once packages have been configured for installation and/or removal by selecting their checkbox, clicking the 'Apply Changes' button will perform update the titles, adding pending installations and removing pending deletions.
104
+
105
+### Example : Installing Albula
106
+
107
+Check the box to select Albula, then click the 'Apply Changes' button.
108
+Notice the text turns green for pending installations. Pending updates are Orange.
109
+![apply](images/client_apply2.png)
110
+
111
+### Example : Removing Albula
112
+
113
+Uncheck the box for Albula. Removals are shown in red text.
114
+![apply](images/client_remove1.png)
115
+
116
+Click apply changes. Albula will be removed.
117
+![apply](images/client_remove2.png)
118
+
119
+### Version selection
120
+
121
+Default versions are installed by default for each application, though individual versions can be selected for each title. To do so, show the version pane by selecting **"Show all package versions"** from the **"View"** menu. Then, in the bottom right, select a desired version with the check boxes. Multiple versions of a given title can be installed and are indicated in the main panel.
122
+
123
+Enable version panel
124
+![all](images/client_versions1.png)
125
+
126
+Check old/non-default versions
127
+![all](images/client_versions2.png)
128
+
129
+### Versions and the SBGrid environment
130
+
131
+If you have a single version of an application installed, explicitly version selection in your environment will not be needed. In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when installed, unless configured otherwise in _~/.sbgrid.conf_.
132
+
133
+If you have multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use either an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file as in the standard SBGrid environment.
134
+
135
+**Version priority in the shell**
136
+
137
+1. _~/.sbgrid.conf_
138
+2. Installed Default version
139
+3. Latest installed release
140
+
141
+You can do open the configuration file by selecting the _"Edit Configuration File"_ from the _"SBGrid Installer"_ menu.
142
+
143
+![all](images/client_config1.png)
144
+
145
+This will open a text editor with a sample configuration file, or your _~/.sbgrid.conf_ file if you have one already.
146
+
147
+![all](images/client_config2.png)
148
+
149
+There is more info on how to do that here --> [SBGrid version overrides](versions)
150
+
151
+### Running the software
152
+
153
+To run the software, you can click the "SBGrid Shell" button for an initialized bash shell.
154
+
155
+You may also run the software from another terminal on your machine.
156
+To use the software at the terminal in bash, open a new terminal and run
157
+
158
+ source /programs/sbgrid.shrc
159
+
160
+or in tcsh
161
+
162
+ source /programs/sbgrid.cshrc
163
+
164
+### Questions, Problems and Known Issues
165
+
166
+For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*.
167
+If relevant, please include a screenshot of the GUI if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report.
168
+
169
+- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available.
170
+
171
+- **Activation Failed**. In some cases the Authorization dialog for admin privileges does not appear during activation. This causes the manager activation to fail. This is usually due to a previously existing _/programs_ directory or symlink from a prior installation. This must be removed for activation to be successful. Other users have reported successful activation after a restart.
coot.md
... ...
@@ -1,24 +1,36 @@
1 1
# Managing COOT title and version in SBGrid
2
+
2 3
COOT is present in several titles and many versions in SBGrid. Selecting the application and version of the `coot` executable can be accomplished on-the-fly in a single step in the SBGrid capsule environment. Here are some examples of managing COOT in SBGrid capsules, but this should work for any application with duplicate executables and multiple versions.
3 4
4
-To confirm that capsules are enabled, run
5
+To confirm that capsules are enabled, run
5 6
6 7
```
7
-sbcap status
8
+sbcap status
8 9
```
9 10
10
-If capsules are enabled, the output should be :
11
+If capsules are enabled, the output should be :
11 12
12 13
```
13
- $ sbcap status
14
+ $ sbcap status
14 15
Active
15 16
```
16 17
17
-If capsules are InActive, they can be enable with the `sbcap on` command followed by `source /programs/sbgrid.shrc` or `.cshrc` for tcsh users.
18
+If capsules are InActive, they can be enable with the `sbcap on` command followed by `source /programs/sbgrid.shrc` or `.cshrc` for tcsh users.
19
+
20
+<!-- TOC -->
21
+
22
+- [Managing COOT title and version in SBGrid](#managing-coot-title-and-version-in-sbgrid)
23
+ - ["Which COOT am I using?"](#which-coot-am-i-using)
24
+ - ["What titles provide 'coot' executables?"](#what-titles-provide-coot-executables)
25
+ - ["What version does this coot executable come from?"](#what-version-does-this-coot-executable-come-from)
26
+ - [Changing the application that provides coot - overriding default titles](#changing-the-application-that-provides-coot---overriding-default-titles)
27
+ - [Setting the version](#setting-the-version)
18 28
29
+<!-- /TOC -->
19 30
20 31
### "Which COOT am I using?"
21
-The `sbwhich` command will show which `coot` executable is in use :
32
+
33
+The `sbwhich` command will show which `coot` executable is in use :
22 34
23 35
```
24 36
$ sbwhich coot
... ...
@@ -32,33 +44,34 @@ $ coot --sbwhich
32 44
/programs/x86_64-linux/ccp4/7.1/ccp4-7.1/bin/coot
33 45
```
34 46
35
-By default we use the CCP4 release of COOT in SBGrid. This version is stable, supported and the same for MacOS and Linux. But it is easy to change.
47
+By default we use the CCP4 release of COOT in SBGrid. This version is stable, supported and the same for MacOS and Linux. But it is easy to change.
48
+
49
+### "What titles provide 'coot' executables?"
36 50
37
-### "What titles provide 'coot' executables?"
38 51
SBGrid capsules provide an additional set of flags for all executables, prefixed with `--sbapp:`. For more info see the [documentation for capsules here.](capsules) To list all the installed tiles that provide `coot`, use `--sbapp:l`
39 52
40 53
```
41
-$ coot --sbapp:l
54
+$ coot --sbapp:l
42 55
ccp4
43 56
ccpem
44 57
coot
45 58
```
46 59
47
-The executable `coot` is present in the titles **ccp4, ccpem, and coot**.
60
+The executable `coot` is present in the titles **ccp4, ccpem, and coot**.
48 61
49 62
To see all the titles with details use `--sbapp:L`
50 63
51 64
```
52 65
$ coot --sbapp:L
53 66
54
- Titles containing coot
67
+ Titles containing coot
55 68
Title 1 of 3: Version information for: /programs/x86_64-linux/ccp4
56 69
57 70
Default version: 7.1
58 71
In-use version: 7.1
59 72
60 73
Installed versions: 7.1 7.1.006 7.0 7.0.078 6.3.0
61
-Other available versions: 7.1.006 7.0 7.0.078 6.3.0
74
+Other available versions: 7.1.006 7.0 7.0.078 6.3.0
62 75
Overrides use this shell variable: CCP4_X
63 76
64 77
Title 2 of 3: Version information for: /programs/x86_64-linux/ccpem
... ...
@@ -67,7 +80,7 @@ Default version: 1.4.1
67 80
In-use version: 1.4.1
68 81
69 82
Installed versions: 1.4.1 1.4.0 1.3.0 20200722
70
-Other available versions: 1.4.0 1.3.0 20200722
83
+Other available versions: 1.4.0 1.3.0 20200722
71 84
Overrides use this shell variable: CCPEM_X
72 85
73 86
Title 3 of 3: Version information for: /programs/x86_64-linux/coot
... ...
@@ -76,12 +89,13 @@ Default version: 0.9.1
76 89
In-use version: 0.9.1
77 90
78 91
Installed versions: 0.9.1 0.8.9.2-pre-revision-7884 0.8.9 0.8.8
79
-Other available versions: 0.8.9.2-pre-revision-7884 0.8.9 0.8.8
92
+Other available versions: 0.8.9.2-pre-revision-7884 0.8.9 0.8.8
80 93
Overrides use this shell variable: COOT_X │···········
81
-```
94
+```
82 95
83
-### "What version does this coot executable come from?"
84
-Using `sbapp:d` will print the title and version along with the available versions for the title.
96
+### "What version does this coot executable come from?"
97
+
98
+Using `sbapp:d` will print the title and version along with the available versions for the title.
85 99
86 100
```
87 101
$ coot --sbapp:d
... ...
@@ -94,14 +108,15 @@ Default version: 7.1
94 108
In-use version: 7.1
95 109
96 110
Installed versions: 7.1 7.1.006 7.0 7.0.078 6.3.0
97
-Other available versions: 7.1.006 7.0 7.0.078 6.3.0
98
-Overrides use this shell variable: CCP4_X │···········
111
+Other available versions: 7.1.006 7.0 7.0.078 6.3.0
112
+Overrides use this shell variable: CCP4_X │···········
99 113
```
100 114
101 115
We are running `coot` from ccp4 version 7.1 and there are several other versions available.
102 116
103 117
### Changing the application that provides coot - overriding default titles
104
-SBGrid uses CCP4's `coot` by default, but that can be changed with a configuration file in the ~/.sbgrid_capsules directory. A default title can be specified for any duplicate executable by creating a file with the **name of the executable** that contains a single line with the name of the application. For coot this would be:
118
+
119
+SBGrid uses CCP4's `coot` by default, but that can be changed with a configuration file in the ~/.sbgrid_capsules directory. A default title can be specified for any duplicate executable by creating a file with the **name of the executable** that contains a single line with the name of the application. For coot this would be:
105 120
106 121
mkdir -p ~/.sbgrid_capsule
107 122
echo coot > ~/.sbgrid_capsule/coot
... ...
@@ -109,11 +124,11 @@ SBGrid uses CCP4's `coot` by default, but that can be changed with a configurati
109 124
If we do this, we can see:
110 125
111 126
```
112
-$ coot --sbwhich
127
+$ coot --sbwhich
113 128
/programs/x86_64-linux/coot/0.9.1/bin/coot
114 129
```
115 130
116
-Now `coot` comes from the applciation title **coot**. The default version there is 0.9.1.
131
+Now `coot` comes from the applciation title **coot**. The default version there is 0.9.1.
117 132
118 133
Let's switch to CCPEM as the provider of the `coot` program.
119 134
To do that we just edit the configuration file:
... ...
@@ -121,10 +136,10 @@ To do that we just edit the configuration file:
121 136
```
122 137
$ echo ccpem > ~/.sbgrid_capsule/coot
123 138
124
-$ coot --sbwhich
139
+$ coot --sbwhich
125 140
/programs/x86_64-linux/ccpem/1.4.1/bin/coot
126 141
127
- $ coot --version
142
+ $ coot --version
128 143
0.9-pre (revision-count 0)
129 144
[with guile 1.8.8 embedded]
130 145
[with python 2.7.15 embedded]
... ...
@@ -133,17 +148,18 @@ Binary type: Linux-x86_64-scientific-linux-6.10-python-gtk2
133 148
```
134 149
135 150
### Setting the version
151
+
136 152
The version of a title is set by the `<TITLE_X>` variable where `<TITLE>` is the title of an application in uppercase. You can see this variable in the `sbgrid-info -l` output.
137 153
138 154
```
139
- $ sbgrid-info -l ccpem
155
+ $ sbgrid-info -l ccpem
140 156
Version information for: /programs/x86_64-linux/ccpem
141 157
142 158
Default version: 1.4.1
143 159
In-use version: 1.4.1
144 160
145 161
Installed versions: 1.4.1 1.4.0 1.3.0 20200722
146
-Other available versions: 1.4.0 1.3.0 20200722
162
+Other available versions: 1.4.0 1.3.0 20200722
147 163
Overrides use this shell variable: CCPEM_X
148 164
```
149 165
... ...
@@ -157,12 +173,12 @@ To use coot from CCPEM version 1.3.0, we set the CCPEM_X variable to 1.3.0
157 173
```
158 174
159 175
`coot` has a --version flag that can be used to confirm the version
160
-Set the title for the `coot` executable to "coot" to use Paul Emsley's builds for linux :
176
+Set the title for the `coot` executable to "coot" to use Paul Emsley's builds for linux :
161 177
162 178
```
163 179
echo coot > ~/.sbgrid_capsule/coot
164 180
165
- $ coot --version
181
+ $ coot --version
166 182
0.9.1 (revision-count 10157)
167 183
[with guile 1.8.8 embedded]
168 184
[with python 2.7.15 embedded]
... ...
@@ -175,20 +191,20 @@ This is the latest version. To switch to an older version, just set the COOT_X v
175 191
```
176 192
$ export COOT_X=0.8.8
177 193
178
- $ coot --version
194
+ $ coot --version
179 195
0.8.8 (revision-count 6690)
180 196
[with guile 1.8.8 embedded]
181 197
```
182 198
183
-To return to using `coot` from CCP4, the SBGrid default, remove the config file:
199
+To return to using `coot` from CCP4, the SBGrid default, remove the config file:
184 200
185 201
```
186 202
$rm ~/.sbgrid_capsule/coot
187
-
203
+
188 204
$ coot --sbwhich
189 205
/programs/x86_64-linux/ccp4/7.1/ccp4-7.1/bin/coot
190 206
191
- $ coot --version
207
+ $ coot --version
192 208
0.9 (revision-count 9932)
193 209
[with guile 1.8.8 embedded]
194 210
[with python 2.7.16 embedded]
... ...
@@ -196,8 +212,8 @@ Builder_info: CCP4, Oxfordshire
196 212
Binary type: Linux-x86_64-scientific-linux-6.10-python-gtk2
197 213
```
198 214
199
-The version of `coot` changes to the version provided by the CCP4 version specified by CCP4_X.
215
+The version of `coot` changes to the version provided by the CCP4 version specified by CCP4_X.
200 216
201
-For more info, see [capsules](capsules), and [version manangement](overrides).
217
+For more info, see [capsules](capsules), and [version manangement](overrides).
202 218
203 219
For questions or to report bugs, please email bugs@sbgrid.org
developers.md
... ...
@@ -1,27 +1,35 @@
1 1
## SBGrid Developer Support Program
2
+
2 3
In an effort to show our appreciation for their hard work and to encourage the continuing development and support of cutting edge structural biology software, SBGrid offers a Developer Support Program featuring a wide array of benefits for structural biology software developers.
3 4
4
-- [Support Letters](#sbgrid-developer-support-program_support-letters)
5
-- [Software Beta Testing](#sbgrid-developer-support-program_software-beta-testing)
6
-- [Annual Software Awards](#sbgrid-developer-support-program_annual-software-awards)
7
-- [Stretch Your Resources](#sbgrid-developer-support-program_stretch-your-resources)
8
-- [Broad Exposure for Your Software](#sbgrid-developer-support-program_broad-exposure-for-your-software)
9
-- [Connect With Users](#sbgrid-developer-support-program_connect-with-users)
5
+- [SBGrid Developer Support Program](#sbgrid-developer-support-program)
6
+ - [Support Letters](#support-letters)
7
+ - [Software Beta Testing](#software-beta-testing)
8
+ - [Annual Software Awards](#annual-software-awards)
9
+ - [Stretch Your Resources](#stretch-your-resources)
10
+ - [Broad Exposure for Your Software](#broad-exposure-for-your-software)
11
+ - [Connect With Users](#connect-with-users)
12
+
13
+### Support Letters
10 14
11
-### Support Letters
12
-When applying for grants or financial support please let us know! We can provide support letters on behalf of members of SBGrid Consortium. Letters would include details about our membership, number of computers that can access your software, operating systems used by our community, etc. Please use the [contact form](http://sbgrid.org/contact.php|contact) on the SBGrid website.
15
+When applying for grants or financial support please let us know! We can provide support letters on behalf of members of SBGrid Consortium. Letters would include details about our membership, number of computers that can access your software, operating systems used by our community, etc. Please use the [contact form](http://sbgrid.org/contact.php|contact) on the SBGrid website.
13 16
14 17
### Software Beta Testing
18
+
15 19
You are welcome to use SBGrid laboratories to beta-test your software. Just let us know when the new beta is available, and we will install it for all participating laboratories or a limited subset that you choose.
16 20
17
-### Annual Software Awards
21
+### Annual Software Awards
22
+
18 23
Members of SBGrid Consortium vote in an annual poll to select their favorite structural biology application. Paul Emsley was the winner of the first poll. He won a Macbook Air laptop for his application Coot.
19 24
20
-### Stretch Your Resources
21
-First level software support is provided by the SBGrid non-profit center at Harvard Medical School. All members of the consortium communicate with the service center for assistance with software installation, upgrades, and basic troubleshooting. For many of the mundane problems involving installation, operating system portability and environmental set up, SBGrid members will never need to contact you for support. Your expertise with the software be best utilized answering questions and working on problems that directly involve the science behind your application.
25
+### Stretch Your Resources
26
+
27
+First level software support is provided by the SBGrid non-profit center at Harvard Medical School. All members of the consortium communicate with the service center for assistance with software installation, upgrades, and basic troubleshooting. For many of the mundane problems involving installation, operating system portability and environmental set up, SBGrid members will never need to contact you for support. Your expertise with the software be best utilized answering questions and working on problems that directly involve the science behind your application.
28
+
29
+### Broad Exposure for Your Software
30
+
31
+More than 300+ structural biology laboratories from 90 institutions in 19 countries participate in the Consortium including the labs of many HHMI investigators and a few Nobel Prize winners. Deployment of your application can be customized to include only non-profit labs or broadened to include industry labs as well. Please visit the Consortium website for the full list of participating groups that can benefit from rapid access to your software. Please note that most SBGrid Consortium laboratories standardize on hardware and operating systems, which simplifies the installation and support process.
22 32
23
-### Broad Exposure for Your Software
24
-More than 300+ structural biology laboratories from 90 institutions in 19 countries participate in the Consortium including the labs of many HHMI investigators and a few Nobel Prize winners. Deployment of your application can be customized to include only non-profit labs or broadened to include industry labs as well. Please visit the Consortium website for the full list of participating groups that can benefit from rapid access to your software. Please note that most SBGrid Consortium laboratories standardize on hardware and operating systems, which simplifies the installation and support process.
33
+### Connect With Users
25 34
26
-### Connect With Users
27 35
Announcing a new version of your software? We can use webex to broadcast your presentation to all laboratories participating in our consortium. We can also disseminate information about your application to our community in our monthly newsletter. Visiting Boston? Please let us know because we'd love to schedule a seminar for members of our local structural biology community.
downloads/SBGrid_Installation_Manager-2.2.11.AppImage
... ...
Binary files /dev/null and b/downloads/SBGrid_Installation_Manager-2.2.11.AppImage differ
downloads/SBGrid_Installation_Manager-2.2.11.dmg
... ...
Binary files /dev/null and b/downloads/SBGrid_Installation_Manager-2.2.11.dmg differ
examples.md
... ...
@@ -1,12 +1,12 @@
1 1
## Usage examples for SBGrid applications
2 2
3
-The following pages provide usage info and examples for select applications in the SBGrid environment. For access to documentation, manuals, application websites, etc, please visit : [https://sbgrid.org/software](https://sbgrid.org/software/)
3
+The following pages provide usage info and examples for select applications in the SBGrid environment. For access to documentation, manuals, application websites, etc, please visit : [https://sbgrid.org/software](https://sbgrid.org/software/)
4 4
5
- - [Arp/Warp registration](examples/arpwarp_registration)
6
- - [EMAN2 with Theano for Neural Network Particle Picking](examples/EMAN2_w_theano)
7
- - [HADDOCK](examples/haddock)
8
- - [Local Reconstruction in SCIPION](examples/localrec_w_scipion)
9
- - [Locscale](examples/locscale)
10
- - [PHENIX - phenix.rosetta_refine](examples/phenix.rosetta_refine)
11
- - [SCIPION - running tutorials without write privileges](examples/running_scipion_tutorials)
12
- - [DIALS - Version control in DIALS](examples/DIALS_version_control)
... ...
\ No newline at end of file
0
+- [Arp/Warp registration](examples/arpwarp_registration)
1
+- [EMAN2 with Theano for Neural Network Particle Picking](examples/EMAN2_w_theano)
2
+- [HADDOCK](examples/haddock)
3
+- [Local Reconstruction in SCIPION](examples/localrec_w_scipion)
4
+- [Locscale](examples/locscale)
5
+- [PHENIX - phenix.rosetta_refine](examples/phenix.rosetta_refine)
6
+- [SCIPION - running tutorials without write privileges](examples/running_scipion_tutorials)
7
+- [DIALS - Version control in DIALS](examples/DIALS_version_control)
getting_started.md
... ...
@@ -1,10 +1,12 @@
1 1
## Getting Started
2 2
3
-- [Using the SBGrid software collection](#getting-started_using-the-sbgrid-software-collection)
4
-- [Making the shell configuration automatic](#getting-started_making-the-shell-configuration-automatic)
5
-- [Setting an alias](#getting-started_setting-an-alias)
3
+- [Getting Started](#getting-started)
4
+ - [Using the SBGrid software collection](#using-the-sbgrid-software-collection)
5
+ - [Making the shell configuration automatic](#making-the-shell-configuration-automatic)
6
+ - [Setting an alias](#setting-an-alias)
6 7
7 8
### Using the SBGrid software collection
9
+
8 10
The SBGrid software collection can be found installed at **/programs**.
9 11
All software in the SBGrid collection is run from the the command line in a terminal. Do set up the shell environment the terminal to run the programs, you will need to initialize the SBGrid environment.
10 12
... ...
@@ -33,7 +35,7 @@ For Bash, in **~/.bashrc**, add :
33 35
For tcsh, in **~/.tcshrc** or **~/.cshrc**, add :
34 36
35 37
if ( -e /programs/sbgrid.cshrc ) then
36
- source /programs/sbgrid.cshrc
38
+ source /programs/sbgrid.cshrc
37 39
endif
38 40
39 41
### Setting an alias
gpu.md
... ...
@@ -1,22 +1,32 @@
1 1
## GPU computing
2 2
3 3
GPU-accelerated computing uses a graphics processing unit (GPU) to accelerate computations in computer programs. Several applications in the SBGrid programs tree are GPU-accelerated. Some examples are RELION, GCTF, MotionCor2, Gautomatch, IMOD, AmberTools, etc. Here's what you need to take advantage of a GPU:
4
-### Requirements for GPU (CUDA) applications
5 4
6
-**NVIDIA Hardware**
5
+<!-- TOC -->
6
+
7
+- [GPU computing](#gpu-computing)
8
+- [Requirements for GPU (CUDA) applications](#requirements-for-gpu-cuda-applications)
9
+ - [NVIDIA Hardware](#nvidia-hardware)
10
+ - [Hardware Drivers](#hardware-drivers)
11
+
12
+<!-- /TOC -->
13
+
14
+## Requirements for GPU (CUDA) applications
15
+
16
+### NVIDIA Hardware
7 17
8 18
To use GPU-accelerated applications, you will need an NVIDIA GPU. We don't currently support other co-processors (Xeon Phi, AMD). If you think we should, let us know at bugs@sbgrid.org .
9 19
10
- Not all GPUs are created equal - some applications are restricted to GPUs with a certain 'Compute Capability (i.e. of 3.5 or greater)'. You can check your card's rating and find more information on GPU computing here : [https://developer.nvidia.com/cuda-gpus](https://developer.nvidia.com/cuda-gpus)
20
+Not all GPUs are created equal - some applications are restricted to GPUs with a certain 'Compute Capability (i.e. of 3.5 or greater)'. You can check your card's rating and find more information on GPU computing here : [https://developer.nvidia.com/cuda-gpus](https://developer.nvidia.com/cuda-gpus)
11 21
12
-**Drivers**
22
+### Hardware Drivers
13 23
14 24
You linux workstation must have the proper drivers for your GPU. You can find drivers for your card here : [https://developer.nvidia.com/cuda-zone](https://developer.nvidia.com/cuda-zone)
15 25
16 26
We currently support applications that rely on versions of CUDA 7.5 to 10 and these libraries are included with the SBGrid distribution. CUDA libraries do not need to be installed locally - they will not be used by SBGrid software. However, it is important to have a recent driver version if possible.
17 27
18
-For information about GPU hardware and CUDA / driver version compatibility, [see this table at nvidia.com](https://docs.nvidia.com/deploy/cuda-compatibility/index.html#binary-compatibility__table-toolkit-driver)
28
+For information about GPU hardware and CUDA / driver version compatibility, [see this table at nvidia.com](https://docs.nvidia.com/deploy/cuda-compatibility/index.html#binary-compatibility__table-toolkit-driver)
19 29
20
-For more information on GPUs and RELION, check Erik Lindahl's blog at the Department of Biochemistry & Biophysics, Stockholm University, [http://www.cryoem.se/relion-gpu](http://www.cryoem.se/relion-gpu)
30
+For more information on GPUs and RELION, check Erik Lindahl's blog at the Department of Biochemistry & Biophysics, Stockholm University, [http://www.cryoem.se/relion-gpu](http://www.cryoem.se/relion-gpu)
21 31
22 32
GPU questions? Want to use GPU support in an application and it's not working? Please email *bugs@sbgrid.org*
help.md
... ...
@@ -1,15 +1,17 @@
1 1
## Software Help
2 2
3
-If you are having a problem with software included in the SBGrid suite or think you've discovered an application bug, please use the [SBGrid](http://sbgrid.org/bugs) web form to alert us to the problem. You can also email bugs@sbgrid.org with details on the problem, but the web form is the preferred method.
3
+If you are having a problem with software included in the SBGrid suite or think you've discovered an application bug, please use the [SBGrid](http://sbgrid.org/bugs) web form to alert us to the problem. You can also email bugs@sbgrid.org with details on the problem, but the web form is the preferred method.
4 4
5 5
If the problem with the software started after an update, you can configure your SBGrid environment to [use an older version of the software](overrides).
6 6
7 7
### New Software and Software Updates
8
+
8 9
To request a new software package or an update to an existing package, please use the [Software](http://sbgrid.org/req) Update/Installation Request form]].
9 10
10
-We try to accommodate most requests for new software, but we do occasionally run into difficulties. Despite most of our software being free for academics, some developers insist that each lab download and install their own software. We are happy to provide developers with the list of SBGrid members that have access to their software, but that doesn't always satisfy their requirements.
11
+We try to accommodate most requests for new software, but we do occasionally run into difficulties. Despite most of our software being free for academics, some developers insist that each lab download and install their own software. We are happy to provide developers with the list of SBGrid members that have access to their software, but that doesn't always satisfy their requirements.
11 12
12 13
Even when things go smoothly, license requests and working out licensing details with developers can take some time, so please don't wait until the last minute before requesting software you anticipate you may need for your project.
13 14
14 15
### Newsletter
15
-SBGrid sends a monthly newsletter with information concerning software updates, upcoming webinars, talks and other items of interest to our community. The archive of previous newsletters is available online at the [SBGrid Newsletter Archive](https://sbgrid.org/newsletters/).
16
+
17
+SBGrid sends a monthly newsletter with information concerning software updates, upcoming webinars, talks and other items of interest to our community. The archive of previous newsletters is available online at the [SBGrid Newsletter Archive](https://sbgrid.org/newsletters/).
images/GUI-v2-1-activation.png
... ...
Binary files /dev/null and b/images/GUI-v2-1-activation.png differ
images/GUI-v2-1-priv.png
... ...
Binary files /dev/null and b/images/GUI-v2-1-priv.png differ
images/GUI-v2-2-synthetic.png
... ...
Binary files /dev/null and b/images/GUI-v2-2-synthetic.png differ
images/GUI-v2-3-home.png
... ...
Binary files /dev/null and b/images/GUI-v2-3-home.png differ
images/GUI-v2-4-installed.png
... ...
Binary files /dev/null and b/images/GUI-v2-4-installed.png differ
images/GUI-v2-4.5-infopane.png
... ...
Binary files /dev/null and b/images/GUI-v2-4.5-infopane.png differ
images/GUI-v2-5-programs.png
... ...
Binary files /dev/null and b/images/GUI-v2-5-programs.png differ
images/GUI-v2-6-addedtask.png
... ...
Binary files /dev/null and b/images/GUI-v2-6-addedtask.png differ
images/GUI-v2-7-tasklist.png
... ...
Binary files /dev/null and b/images/GUI-v2-7-tasklist.png differ
images/GUI-v2-8-approvetasks.png
... ...
Binary files /dev/null and b/images/GUI-v2-8-approvetasks.png differ
images/GUI-v2-9-reinstall.png
... ...
Binary files /dev/null and b/images/GUI-v2-9-reinstall.png differ
images/GUI-v2-9-runningtasks1.png
... ...
Binary files /dev/null and b/images/GUI-v2-9-runningtasks1.png differ
installation_admin.md
... ...
@@ -1,7 +1,24 @@
1
-##Managing Your Software Installation
1
+## Managing Your SBGrid Site Installation
2 2
3
-### *sbgrid-admin* Utility
4
-The *sbgrid-admin* utility used to install the complete software collection. A download link is provided in the initial site set up email, and the script is included in the installation itself at */programs/share/sbgrid/bin/sbgrid-admin*. It includes built-in help:
3
+<!-- TOC -->
4
+
5
+- [Managing Your SBGrid Site Installation](#managing-your-sbgrid-site-installation)
6
+ - [The sbgrid-admin Utility](#the-sbgrid-admin-utility)
7
+ - [Usage](#usage)
8
+ - [Configuration Options](#configuration-options)
9
+ - [Rsync Transaction Logging](#rsync-transaction-logging)
10
+
11
+<!-- /TOC -->
12
+
13
+### The sbgrid-admin Utility
14
+
15
+The sbgrid-admin utility used to install the complete software collection in what we refer to as a "Site installation". This is ideal for large labs, shared and departmental installations that use a shared network file storage for their programs. The installation is updated automatically on a monthly basis. [This installation is large and can take some time to install.](size_graph).
16
+
17
+A download link is provided in the initial site set up email, and the script is included in the installation itself at _/programs/share/sbgrid/bin/sbgrid-admin_.
18
+
19
+### Usage
20
+
21
+sbgrid-admin includes built-in help:
5 22
6 23
```
7 24
$ sbgrid-admin -h
... ...
@@ -19,33 +36,34 @@ Usage: sbgrid-admin [-chirstu]
19 36
-u Force manual update of an existing installation.
20 37
```
21 38
22
-The most commonly used option is *sbgrid-admin -u* to force a manual update. This will synchronize your local installation with the SBGrid master installation hosted at Harvard Medical School.
39
+The most commonly used option is _sbgrid-admin -u_ to force a manual update. This will synchronize your local installation with the SBGrid master installation hosted at Harvard Medical School.
40
+
41
+The SBGrid software configuration files use both static and dynamically generated files. The main shell initialization files, **/programs/sbgrid.cshrc** and **/programs/sbgrid.shrc** are static files, but the operating-system specific configurations are dynamically generated and customized for the packages available at your site. _sbgrid-admin -r_ will regenerate the branch-specific configuration files should you accidentally delete or alter them.
23 42
24
-The SBGrid software configuration files use both static and dynamically generated files. The main shell initialization files, **/programs/sbgrid.cshrc** and **/programs/sbgrid.shrc** are static files, but the operating-system specific configurations are dynamically generated and customized for the packages available at your site. *sbgrid-admin -r* will regenerate the branch-specific configuration files should you accidentally delete or alter them.
43
+### Configuration Options
25 44
26
- Configuration Options
27
-The *sbgrid-admin* script has some additional configuration options to accommodate the installation requirements at different sites.
45
+The _sbgrid-admin_ script has some additional configuration options to accommodate the installation requirements at different sites.
28 46
29
-The ~sbgrid/.sbgridrc configuration file for the *sbgrid-admin* script must contain a sitename and site key. All other configurations are optional.
47
+The ~sbgrid/.sbgridrc configuration file for the _sbgrid-admin_ script must contain a sitename and site key. All other configurations are optional.
30 48
31
-Options take the form of *OPTION_NAME="setting"*.
49
+Options take the form of _OPTION_NAME="setting"_.
32 50
33
-| **Option** |** Example** | **Description** |
34
-|:------------- |:-------------:| :---------------|
35
-| SB_SITENAME | sbgrid-bene | The site name for your installation provided by SBGrid |
36
-| SB_SITEKEY | xyxyxyxyxyxyxy | The installation key for your site provided by SBGrid |
37
-| INSTALL_TARGET| /nfs/programs | The installation directory for the software |
38
-| RSYNC_ARGS | "--port 8080"| Advanced arguments to rsync. Can be used to workaround blocked rsync ports. |
39
-| HTTP_PROXY | host.name:port | Proxy hostname and port for use by rsync and curl |
40
-| POST_UPDATE_SCRIPT | /absolute/path/to/script|Optional script to be run after a successful software update |
41
-| CRON_SCHEDULE | 5 1 * * * | Set a custom cron schedule |
51
+| **Option** | ** Example** | **Description** |
52
+| :----------------- | :----------------------: | :-------------------------------------------------------------------------- |
53
+| SB_SITENAME | sbgrid-bene | The site name for your installation provided by SBGrid |
54
+| SB_SITEKEY | xyxyxyxyxyxyxy | The installation key for your site provided by SBGrid |
55
+| INSTALL_TARGET | /nfs/programs | The installation directory for the software |
56
+| RSYNC_ARGS | "--port 8080" | Advanced arguments to rsync. Can be used to workaround blocked rsync ports. |
57
+| HTTP_PROXY | host.name:port | Proxy hostname and port for use by rsync and curl |
58
+| POST_UPDATE_SCRIPT | /absolute/path/to/script | Optional script to be run after a successful software update |
59
+| CRON_SCHEDULE | 5 1 \* \* \* | Set a custom cron schedule |
42 60
61
+### Rsync Transaction Logging
43 62
44
- Rsync Transaction Logging
45 63
If you want a date-stamped log of all rsync downloads, deletions and updates, you can add a line like this to the ~sbgrid/.sbgridrc file:
46 64
47 65
```
48 66
RSYNC_ARGS="--log-file=$HOME/logs/sbgrid-admin-`date +%Y%m%d`.log"
49 67
```
50 68
51
-This will create a date-stamped log file any time an actual change to the software tree happens. In general this should not be necessary, but for troubleshooting purposes it can be useful.
69
+This will create a date-stamped log file any time an actual change to the software tree happens. In general this should not be necessary, but for troubleshooting purposes it can be useful.
installation_overview.md
... ...
@@ -1,53 +1,69 @@
1 1
## Installing the SBGrid software collection
2
-[Installing the software](#installing-the-software)
3
- - [Complete site installation](#installing-the-software_site-installation)
4
- - [Graphic installation for MacOS](#installing-the-software_graphical-installation-for-macos)
5
- - [Command Line installation manager](#installing-the-software_command-line-installation-manager-for-linux-and-macos)
6 2
7
-[Supported Operating Systems](#supported-operating-systems)
8
- - [Linux](#supported-operating-systems_linux)
9
- - [OS X Intel](#supported-operating-systems_os-x-intel)
3
+### Installing the software
10 4
11
-## Installing the software
12 5
The SBGrid Software Suite contains 440+ Scientific software applications for [Linux and OS X](operatingsystems).
13 6
14
-The software can be installed using one of 3 methods:
7
+The software can be installed using one of 3 methods:
8
+- The `sbgrid-admin` script is used for [Site installation](installation_admin)
9
+- `sbgrid-cli` which is the [SBGrid package manager](sbgrid-cli)
10
+- [SBGrid installation manager graphical interface](client_install).
11
+---
12
+<!-- TOC -->
13
+
14
+- [Installing the SBGrid software collection](#installing-the-sbgrid-software-collection)
15
+ - [Installing the software](#installing-the-software)
16
+- [- SBGrid installation manager graphical interface.](#--sbgrid-installation-manager-graphical-interface)
17
+ - [Site installation](#site-installation)
18
+ - [Graphical installation for MacOS](#graphical-installation-for-macos)
19
+ - [Command line installation manager for Linux and MacOS](#command-line-installation-manager-for-linux-and-macos)
20
+- [Supported Operating Systems](#supported-operating-systems)
21
+ - [Linux](#linux)
22
+ - [OS X Intel](#os-x-intel)
23
+
24
+<!-- /TOC -->
15 25
16 26
### Site installation
27
+
17 28
[A script-based installation that includes the complete software collection for Linux and/or MacOS.](installation_admin)
18 29
19 30
This is ideal for large labs, shared and departmental installations that use a shared network file storage for their programs. The installation is updated automatically on a monthly basis. [This installation is large and can take some time to install.](size_graph)
20 31
21 32
### Graphical installation for MacOS
33
+
22 34
[A Graphical stand-alone installation manager for MacOS](client_install)
23 35
24 36
The MacOS GUI installation manager allows users to select the applications they need when they need them through a MacOS-native graphical application. Applications are updated on a rolling basis and are available to the user at their convenience. Updates are reported when available, but are managed by the user.
25 37
26 38
### Command line installation manager for Linux and MacOS
39
+
27 40
[Command line installation using the SBGrid package managager program for Linux and MacOS ](client_CLI_install)
28 41
29 42
The SBGrid CLI tool allows users to choose the titles they wish to install using a command-line driven package manager. Applications can be installed and updated as convenient. Updates are released on a rolling basis and can be installed by the user as necessary. This program can be made automatic or used in manual mode.
30 43
31
-Member labs may use any/all of the installation types above for as many Computers as they require. 
44
+Member labs may use any/all of the installation types above for as many Computers as they require.
32 45
33 46
## Supported Operating Systems
34
-The SBGrid Software Suite can run on Linux and macOS/OS X machines.
47
+
48
+The SBGrid Software Suite can run on Linux and macOS/OS X machines.
35 49
36 50
### Linux
37
-We build and test software under 64-bit CentOS 7. The majority of our Linux users are using the Red Hat / CentOS / Scientific Linux / Fedora distributions. We also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on these distributions, but it is known to work. We will work to resolve problems reported by users of these Linux distributions.
51
+
52
+We build and test software under 64-bit CentOS 7. The majority of our Linux users are using the Red Hat / CentOS / Scientific Linux / Fedora distributions. We also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on these distributions, but it is known to work. We will work to resolve problems reported by users of these Linux distributions.
38 53
39 54
We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 7 and 8). Only 64-bit versions of linux are supported (though 32-bit software is included in the collection). As of January 2015, we are no longer updating the 32-bit software branch, though we will work to resolve reported problems. We also have a library of IRIX and PowerPC software. If those titles are needed, make a request at bugs@sbgrid.org.
40 55
41 56
Currently Supported:
42 57
43
-* Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux.
44
-* We are no longer building software for RHEL 5.x or 6.x, but compatible applications will remain in the software tree. We will respond to support requests for these and we will resolve problems where possible.
58
+- Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux.
59
+- We are no longer building software for RHEL 5.x or 6.x, but compatible applications will remain in the software tree. We will respond to support requests for these and we will resolve problems where possible.
60
+
61
+### OS X Intel
45 62
46
-### OS X Intel
47 63
We build and test the programs under the most five most recent OS X releases.
48 64
49 65
Currently Supported:
50 66
51
-* OS X Intel 10.13 - 10.15
52
-* As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications.
53
-* "Apple Silicon" macs can run most of the software in the collection on macOS 11 "Big Sur. Few native applications are currently available, but most software works in our early testing.
... ...
\ No newline at end of file
0
+- OS X Intel 10.13 - 10.15
1
+- As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications.
2
+- "Apple Silicon" macs can run most of the software in the collection on macOS 11 "Big Sur. Few native applications are currently available, but most software works in our early testing.
laptopinstall.md
... ...
@@ -4,8 +4,8 @@ If you would like to install SBGrid tools on a machine that is frequently discon
4 4
5 5
We have a GUI-based installation client for MacOS that allows software to be selected, installed, and updated on demand from SBGrid servers. There is also a command-line client for MacOS and Linux that will allow installation and upgrade of individual titles from the command line.
6 6
7
- - [Information on installation of our MacOS GUI.](client_install)
7
+- [Information on installation of our MacOS GUI.](client_install)
8 8
9
- - [Information on installation of our command-line tools for MacOS and Linux](client_CLI_install).
9
+- [Information on installation of our command-line tools for MacOS and Linux](client_CLI_install).
10 10
11
-Our sbgrid-laptop installation shell-script is no longer supported.
11
+Our sbgrid-laptop installation shell-script is no longer supported.
mailinglist.md
... ...
@@ -1,5 +1,5 @@
1 1
## Mailing List for Site Administrators
2 2
3
-We have a small mailing list for technical users and site administrators.
3
+We have a small mailing list for technical users and site administrators.
4 4
5 5
Email accounts@sbgrid.org and we'll add you to the list.
managing_install.md
... ...
@@ -1,17 +1,19 @@
1 1
## Site Configuration
2
- - [Configuration](#configuration)
3
- - [Pre-Installation](#pre-installation)
4
- - [Approximate size per Branch](#pre-installation_approximate-size-per-branch)
5
- - [Installation](#installation)
6
- - [Post-Installation Steps](#post-installation-steps)
7
- - [SGI IRIX Software Branch](#sgi-irix-software-branch)
2
+
3
+- [Site Configuration](#site-configuration)
4
+- [Configuration](#configuration)
5
+- [Pre-Installation](#pre-installation)
6
+ - [Approximate size per Branch](#approximate-size-per-branch)
7
+- [Installation](#installation)
8
+- [Post-Installation Steps](#post-installation-steps)
9
+- [SGI IRIX Software Branch](#sgi-irix-software-branch)
8 10
9 11
## Configuration
10 12
11 13
The SBGrid Software Suite is designed to be installed on a single computer at your site, which will then share that installation with all the workstations on your network via NFS.
12 14
We refer to this computer as the site "master" server.
13 15
14
-The master server will require at least 500 GB of free disk space on a case-sensitive file system and must run some variety of UNIX. The installation script will download the software branches you select, and then install a cron job that will run regularly to check for updates.
16
+The master server will require at least 500 GB of free disk space on a case-sensitive file system and must run some variety of UNIX. The installation script will download the software branches you select, and then install a cron job that will run regularly to check for updates.
15 17
16 18
Software installation and update are initiated from your local server at your site and downloaded from our servers. http is used to query our servers to check for update, and rsync is used to download the updates. Outbound HTTP, and RSYNC is necessary.
17 19
... ...
@@ -20,19 +22,19 @@ Software installation and update are initiated from your local server at your si
20 22
## Pre-Installation
21 23
22 24
| Installation Requirements | |
23
-| ------------------------- | ----------------------------------------------------|
25
+| ------------------------- | --------------------------------------------------- |
24 26
| Hard Drive Space | ~1 Tb recommended for full installation |
25 27
| Operating System | Linux, OS X and other UNIX |
26 28
| Privileges | Root account (Linux) or Administrator account (Mac) |
27 29
| network | Outbound http, rsync (ports 80 and 873, 8080) |
28 30
29
-
30 31
### Approximate size per Branch
32
+
31 33
| Branch | size |
32 34
| ------------ | ------ |
33
-| i386-mac | 300 Gb |
34
-| x86_64-linux | 450 Gb |
35
-| shared files | 15 Gb |
35
+| i386-mac | 300 Gb |
36
+| x86_64-linux | 450 Gb |
37
+| shared files | 15 Gb |
36 38
37 39
[Size breakdown of titles in a typical installation](size_graph)
38 40
... ...
@@ -46,24 +48,23 @@ Once the email has been received and your information has been entered into our
46 48
47 49
## Installation
48 50
49
- A site installation is performed using the [sbgrid-admin](installation_admin) utility.
51
+A site installation is performed using the [sbgrid-admin](installation_admin) utility.
50 52
51
- 1. Create an 'sbgrid' user on the machine that will host your software installation. This should be a normal, unprivileged user account.
52
- 2. Log in as this 'sbgrid' user.
53
- 3. Download the installation script from the URL provided in the account creation email.
54
- 4. Make it executable: `chmod +x sbgrid-admin`
55
- 5. Run the script: `./sbgrid-admin -i`
56
- 6. The script will walk you through configuring your installation, downloading the software and installing a cron job that will keep the software updated at your site. You will need the **site name** and **install key** provided in the account creation email. The installation may take anywhere from several hours to a day, depending on your network and the number of applications available to your site.
53
+1. Create an 'sbgrid' user on the machine that will host your software installation. This should be a normal, unprivileged user account.
54
+2. Log in as this 'sbgrid' user.
55
+3. Download the installation script from the URL provided in the account creation email.
56
+4. Make it executable: `chmod +x sbgrid-admin`
57
+5. Run the script: `./sbgrid-admin -i`
58
+6. The script will walk you through configuring your installation, downloading the software and installing a cron job that will keep the software updated at your site. You will need the **site name** and **install key** provided in the account creation email. The installation may take anywhere from several hours to a day, depending on your network and the number of applications available to your site.
57 59
58 60
## Post-Installation Steps
59 61
60
- 1. Add a symlink in the root directory of each machine that wants to use the software. The installation script will print the suggested syntax for the command.`ln -s /path/to/sbgrid/installation /programs`
61
- 2. Any user that wishes to use the software needs to configure their shell to initialize the SBGrid shell environment. For bash and other sh-compliant shells, add the following line to your ~/.bash_profile or ~/.bashrc: `. /programs/sbgrid.shrc` For csh and tcsh, add the following line to your ~/.cshrc: `source /programs/sbgrid.cshrc`
62
- 3. For some linux distributions, the shipped version of tcsh does not support shell variables longer than 4096 characters. Since the current PATH in our default shell initialization is larger than that, you will need to update tcsh. RPMs for Red Hat 4/5 and CentOS 4/5 are provided at /programs/i386-linux/system/RPMS.
63
-
62
+1. Add a symlink in the root directory of each machine that wants to use the software. The installation script will print the suggested syntax for the command.`ln -s /path/to/sbgrid/installation /programs`
63
+2. Any user that wishes to use the software needs to configure their shell to initialize the SBGrid shell environment. For bash and other sh-compliant shells, add the following line to your ~/.bash_profile or ~/.bashrc: `. /programs/sbgrid.shrc` For csh and tcsh, add the following line to your ~/.cshrc: `source /programs/sbgrid.cshrc`
64
+3. For some linux distributions, the shipped version of tcsh does not support shell variables longer than 4096 characters. Since the current PATH in our default shell initialization is larger than that, you will need to update tcsh. RPMs for Red Hat 4/5 and CentOS 4/5 are provided at /programs/i386-linux/system/RPMS.
64 65
65
-## SGI IRIX Software Branch
66
+## SGI IRIX Software Branch
66 67
67
-Since the IRIX software branch is frozen and no longer receiving updates, it is not installed and updated in the same manner as the active software branches. In order to install the IRIX software branch, please run: `./sbgrid-admin -s`
68
+Since the IRIX software branch is frozen and no longer receiving updates, it is not installed and updated in the same manner as the active software branches. In order to install the IRIX software branch, please run: `./sbgrid-admin -s`
68 69
69
-Note that the IRIX branch is only compatible with *tcsh*; there is no sh-compatible configuration for this branch.
70
+Note that the IRIX branch is only compatible with _tcsh_; there is no sh-compatible configuration for this branch.
mirrors.md
... ...
@@ -1,3 +1,3 @@
1 1
# SBGrid Mirrors
2 2
3
-For the benefit of the local SBGrid community, we recommend the following to access frequently-used open source software. If you would like for us to add a mirror, please [contact us](help@sbgrid.org).
3
+For the benefit of the local SBGrid community, we recommend the following to access frequently-used open source software. If you would like for us to add a mirror, please [contact us](help@sbgrid.org).
modulefiles.md
... ...
@@ -1,46 +1,44 @@
1
-#SBGrid/BioGrids Module Files
1
+# SBGrid/BioGrids Module Files
2 2
3
-- [Overview](#overview)
4
-- [Accessing Modules](#accessing-modules)
5
-- [Verify](#verify)
6
-- [Load](#load)
7
-- [Unload](#unload)
8
-- [Issues](#issues)
9
-
10
-<a name="overview"></a>
11 3
## Overview
12 4
13
-Modulefiles for loading and unloading the sbgrid or biogrids environment are available in /programs/share/modulefiles/x86_64-linux and /programs/share/modulefiles/i386-mac. The module files are designed to work with an existing module/lmod setup. Loading the sbgrid/biogrids module initializes the entire sbgrid/biogrids environment and is used instead of the "source" command. If you are using modules then you should remove the source lines, such as "source sbgrid.shrc", from your startup rc files.
5
+Modulefiles for loading and unloading the sbgrid or biogrids environment are available in /programs/share/modulefiles/x86_64-linux and /programs/share/modulefiles/i386-mac. The module files are designed to work with an existing module/lmod setup. Loading the sbgrid/biogrids module initializes the entire sbgrid/biogrids environment and is used instead of the "source" command. If you are using modules then you should remove the source lines, such as "source sbgrid.shrc", from your startup rc files.
6
+<!-- TOC -->
7
+
8
+- [SBGrid/BioGrids Module Files](#sbgridbiogrids-module-files)
9
+ - [Overview](#overview)
10
+ - [Accessing Modules](#accessing-modules)
11
+ - [Verify](#verify)
12
+ - [Load](#load)
13
+ - [Unload](#unload)
14
+ - [Reporting Issues](#reporting-issues)
14 15
15
-<a name="access"></a>
16
+<!-- /TOC -->
16 17
## Accessing Modules
17 18
18
-To access the files you need to update your **MODULEPATH** environment variable.
19
+To access the files you need to update your **MODULEPATH** environment variable.
19 20
20 21
in bash
21
-
22
+
22 23
export MODULEPATH=/programs/share/modulefiles/x86_64-linux:"$MODULEPATH"
23
-
24
+
24 25
in tcsh
25 26
26 27
setenv MODULEPATH /programs/share/modulefiles/x86_64-linux:"$MODULEPATH"
27 28
28 29
The above command may be added to your shell startup files or your site Administrator may update the system wide path.
29
-
30
-<a name="verify"></a>
30
+
31 31
## Verify
32 32
33
-***module avail*** will show you what modules are available for loading. If your MODULEPATH is correct you should see the sbgrid/rc and/or the biogrids/rc module.
33
+**_module avail_** will show you what modules are available for loading. If your MODULEPATH is correct you should see the sbgrid/rc and/or the biogrids/rc module.
34 34
35 35
$ module avail sbgrid
36 36
---------------------- /programs/share/modulefiles/i386-mac --------------------------
37 37
sbgrid/rc
38 38
39
-
40
-<a name="load"></a>
41 39
## Load
42 40
43
-Loading the sbgrid/biogrids module initializes the entire environment and not individual applications. The module determines if you are using bash or tcsh and loads the shell appropriate environment using the same command for both tcsh and bash.
41
+Loading the sbgrid/biogrids module initializes the entire environment and not individual applications. The module determines if you are using bash or tcsh and loads the shell appropriate environment using the same command for both tcsh and bash.
44 42
45 43
$ module load sbgrid
46 44
Loading SBGrid
... ...
@@ -51,21 +49,13 @@ Loading the sbgrid/biogrids module initializes the entire environment and not in
51 49
... "remainder of startup message"
52 50
$
53 51
54
-
55
-<a name="unload"></a>
56 52
## Unload
57 53
58
-You can remove the sbgrid/biogrids environment with the ***module unload*** command. This removes any grid specific environment settings. If after loading sbgrid you load additonal modules, these modules will not be removed. To see what modules you have loaded you can use ***module list***.
54
+You can remove the sbgrid/biogrids environment with the **_module unload_** command. This removes any grid specific environment settings. If after loading sbgrid you load additonal modules, these modules will not be removed. To see what modules you have loaded you can use **_module list_**.
59 55
60 56
$ module unload sbgrid
61 57
UnLoading SBGrid
62 58
63
-<a name="issues"></a>
64
-## Issues
59
+## Reporting Issues
65 60
66 61
Please report any issues to bugs@sbgrid.org
67
-
68
-
69
-
70
-
71
-
monolithic.md
... ...
@@ -1,11 +1,10 @@
1 1
# SBGrid software environment
2
+
2 3
## Overview
3 4
4 5
The SBGrid 'Monolithic' software environment provides access to all installed packages using standard shell PATH with minimal required dependencies. [Standard system libraries should be sufficient to run all applications.](workstation_setup) The environment includes added features for users to manage their software version selection.
5 6
6
-
7
-You can switch between the legacy SBGrid environment and the new [capsule](capsules) environment with the *sbcap* command. *sbcap on* will enable the capsule environment.
8
-You can always return to the legacy configuration with the *sbcap off* command.
7
+You can switch between the legacy SBGrid environment and the default [capsule](capsules) environment with the _sbcap_ command. _sbcap on_ will enable the capsule environment. You can always return to the legacy configuration with the _sbcap off_ command.
9 8
10 9
The sbcap setting is persistent across shells - You don't need to do this for every shell.
11 10
operatingsystems.md
... ...
@@ -2,28 +2,50 @@
2 2
3 3
The SBGrid Software Suite can run on Linux and macOS/OS X.
4 4
5
+<!-- TOC -->
6
+
7
+- [Supported Operating Systems](#supported-operating-systems)
8
+ - [Linux](#linux)
9
+ - [OS X Intel](#os-x-intel)
10
+ - [OS X Arm, "Apple Silicon"](#os-x-arm-apple-silicon)
11
+ - [Windows Intel](#windows-intel)
12
+ - [OS X PowerPC](#os-x-powerpc)
13
+ - [IRIX](#irix)
14
+
15
+<!-- /TOC -->
5 16
### Linux
6
-We build and test software under 64-bit CentOS 7 and 8. The majority of our Linux users are using Red Hat or CentOS distributions, but we also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on distributions other than CentOS, but the software is known to work, and we will work to resolve problems reported by users of these Linux distributions.
7 17
8
-We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 7 and 8). Only 64-bit versions of linux are supported. As of January 2015, we are no longer updating the 32-bit software branch.
18
+We build and test software under 64-bit CentOS 7 and 8. The majority of our Linux users are using Red Hat or CentOS distributions, but labs also use Ubuntu, Debian and OpenSuSE with SBGrid. We don't explicitly test the software on distributions other than CentOS, but the software is known to work. We will work to resolve problems reported by users of these Linux distributions where possible on a best-effort basis.
9 19
10
-Currently Supported:
20
+We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 7 and 8).
11 21
12
-* Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux.
13
-* We are no longer building software for RHEL 5.x or 6.x.
22
+- Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux.
23
+- We are no longer building software for RHEL/CentOS 5.x or 6.x.
14 24
15
-## OS X Intel
16
-We build and test the programs under the most five most recent OS X releases.
25
+### OS X Intel
26
+
27
+We build and test the programs under the most four most recent OS X releases.
28
+MacOS 10.14 was the last release to support 32-bit binaries. If your work requires 32-bit software, this is the last OS release that will allow that software to run.
17 29
18 30
Currently Supported:
19 31
20
-* OS X Intel 10.13 - 10.15
21
-* As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications available.
32
+- OS X Intel 10.13 - 11
33
+- As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications available. Also note that there are [known issues with macOS 11](big-sur).
34
+
35
+### OS X Arm, "Apple Silicon"
36
+
37
+There are few native applications for Apple CPUs in the software collection, but most applications work through Apple's Rosetta2 compatility environment. Notable exceptions are applications compiled with Intel compilers (Rosetta, RELION).
38
+
39
+### Windows Intel
40
+
41
+Windows provides Linux compatibility environment called "Windows Subsystem for Linux" (WSL), based on Ubuntu. WSL is still under active development. We suspect it is possible to get most SBGrid applications working with WSL, but we have no experience with Windows can can't provide support. But if you have success here, let us know.
42
+
43
+### OS X PowerPC
44
+
45
+The OS X PowerPC branch is currently frozen and is obsolete.
46
+The applications are archived and available on request.
22 47
23
-## OS X PowerPC
24
-The OS X PowerPC branch is currently frozen.
25
-The applications are available on request.
48
+### IRIX
26 49
27
-## IRIX
28
-The IRIX programs branch is currently frozen.
29
-The applications are available on request.
50
+The IRIX programs branch is currently frozen and is obsolete.
51
+The applications are archived and available on request.
overrides.md
... ...
@@ -1,64 +1,69 @@
1 1
# Overriding Software Versions
2 2
3
-Most of the software titles installed in the SBGrid software collection have several versions available. We try to provide at least three versions of each software package, although very old or very new applications may have fewer versions.
4
-
5
-## Display Available Versions
6
-
7
-To list the available versions of a software title, you can use the *sbgrid-info* utility. Running *sbgrid-info -l* will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this:
3
+Most of the software titles installed in the SBGrid software collection have several versions available. We try to provide at least three versions of each software package, although very old or very new applications may have more or fewer versions respectively.
4
+<!-- TOC -->
8 5
6
+- [Overriding Software Versions](#overriding-software-versions)
7
+ - [Display Available Versions](#display-available-versions)
8
+ - [Overriding Default Versions](#overriding-default-versions)
9
+ - [Disabling a Software Package](#disabling-a-software-package)
9 10
10
- $ sbgrid-info -l ccp4
11
- Version information for: /programs/x86_64-linux/ccp4
11
+<!-- /TOC -->
12
+## Display Available Versions
12 13
13
- Default version: 7.0
14
- In-use version: 6.5
15
- Other available versions: 6.4.0 6.3.0
16
- Overrides use this shell variable: CCP4_X
14
+To list the available versions of a software title, you can use the _sbgrid-info_ utility. Running _sbgrid-info -l_ will list the versions for your current platform. From a Linux machine, a search for PyMOL versions looks like this:
17 15
16
+ $ sbgrid-info -l pymol
17
+ Version information for: /programs/x86_64-linux/pymol
18 18
19
-Running *sbgrid-info -L* will print the available versions for both of the current platforms (macOS and x86_64 Linux).
19
+ Default version: 2.4.1_198
20
+ In-use version: 2.4.1_198
20 21
22
+ Installed versions: 2.4.1_198 2.2.3 1.8.6.0 1.7.6.6
23
+ Other available versions: 2.2.3 1.8.6.0 1.7.6.6
24
+ Overrides use this shell variable: PYMOL_X
21 25
22
- $ sbgrid-info -L gnuplot
23
- Version information for: /programs/x86_64-linux/gnuplot
26
+Running _sbgrid-info -L_ will print the available versions for both of the current platforms (macOS and x86_64 Linux).
24 27
25
- Default version: 4.6.4
26
- In-use version: 4.6.4
27
- Other available versions: 4.6.0 4.4.3 4.2.6
28
- Overrides use this shell variable: GNUPLOT_X
28
+ $ sbgrid-info -L gnuplot
29
+ Version information for: /programs/x86_64-linux/gnuplot
29 30
30
- Version information for: /programs/i386-mac/gnuplot
31
+ Default version: 4.6.4
32
+ In-use version: 4.6.4
33
+ Other available versions: 4.6.0 4.4.3 4.2.6
34
+ Overrides use this shell variable: GNUPLOT_X
31 35
32
- Default version: 4.6.4
33
- Other available versions: 4.4.3 4.2.6 4.6.0
34
- Overrides use this shell variable: GNUPLOT_M
36
+ Version information for: /programs/i386-mac/gnuplot
35 37
38
+ Default version: 4.6.4
39
+ Other available versions: 4.4.3 4.2.6 4.6.0
40
+ Overrides use this shell variable: GNUPLOT_M
36 41
37 42
## Overriding Default Versions
38 43
39
-To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version.
44
+To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version.
40 45
41
-The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this:
46
+The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this:
42 47
43
-`APPLICATION_X=1.2`
48
+`<APPLICATION>_X=1.2`
44 49
45
-APPLICATION_X is the name of the application followed by an underscore and the shorthand initial for the architecture. All SBGrid application variables are capitalized. The last field on the line is the software version number you want to use. The initials for each software branch are:
50
+where `<APPLICATION>_X` is the name of the application followed by an underscore and the shorthand initial for the architecture. All SBGrid application variables are capitalized. The last field on the line is the software version number you want to use. The initials for each software branch are:
46 51
47 52
| Software Directory | Shorthand Initial |
48 53
| ------------------ | ----------------- |
49
-| x86_64-linux | _X |
50
-| i386-mac | _M |
51
-
52
-To quickly open the overrides file in your default $EDITOR, you can run *sbgrid-overrides -e*.
54
+| x86_64-linux | \_X |
55
+| i386-mac | \_M |
53 56
54
-When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well.
57
+To quickly open the overrides file in your default $EDITOR, you can run _sbgrid-overrides -e_.
55 58
56
-The example output below shows CCP4 on linux being changed from the default version:
59
+When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well.
57 60
58
- Configuration options in effect for this shell:
59
- Variable Setting Configuration
60
- CCP4_M 6.3.0 personal
61
+The example output below shows PyMOL on linux being changed from the default version on macOS:
61 62
63
+ Configuration options in effect for this shell:
64
+ Variable Setting Configuration
65
+ PYMOL_M 2.2.3 personal
62 66
63 67
## Disabling a Software Package
68
+
64 69
To disable a specific software package, set its version to "disable" in your ~/.sbgrid.conf file.
recommended.md
... ...
@@ -1,7 +1,17 @@
1 1
# Recommended Hardware
2 2
3
+<!-- TOC -->
4
+
5
+- [Recommended Hardware](#recommended-hardware)
6
+ - [Linux Workstations](#linux-workstations)
7
+ - [Apple Workstations](#apple-workstations)
8
+
9
+<!-- /TOC -->
10
+
3 11
## Linux Workstations
12
+
4 13
SBGrid's preferred hardware vendor is [ThinkMate](http://thinkmate.com) and we have some [recommended configurations](http://www.thinkmate.com/sbgrid) for structural biology computing. Please feel free to contact us at help@sbgrid.org regarding upcoming hardware purchases if you have questions - we'd be happy to advise.
5 14
6 15
## Apple Workstations
7
-Any Apple machine can be a capable computer for structural biology. The basic Apple educational discount is available through their online web store, and your institution may have negotiated an even better deal with their Apple representative. SBGrid has several labs that run exclusively on Macs and OS X.
16
+
17
+Any Apple machine can be a capable computer for structural biology. The basic Apple educational discount is available through their online web store, and your institution may have negotiated an arrangement with their Apple representative. SBGrid has several labs that run exclusively on Macs and OS X, though these are not advised for CryoEM data processing.
sbgrid-cli.md
... ...
@@ -1,43 +1,60 @@
1
-## SBGrid command line installation manager, sbgrid-cli
1
+## SBGrid Installation Manager CLI : Installation and Usage
2 2
3 3
`sbgrid-cli` is a command line installation manager for the SBGrid software collection.
4
+This page covers the usage of the installation manager graphical user interface (CLI). For more information on the latest graphical interface (GUI), [see here](sbgrid-gui).
4 5
5
-SBGrid can be installed on computers running Linux or macOS operating systems.
6
-[CentOS/RHEL 7 or 8 is recommended for linux, or MacOSX v10.13 - macOS 10.15 for Macs.](operatingsystems).
7
-CentOS 6 has reached "End-of-Life" and is no longer supported. macOS 10.15 "Catalina" and macOS 11.0 "Big Sur" can be used, but an `/etc/syntetic.conf` file is required to create the `/programs` path. See [here for more info :](catalina)
8
-
9
-The SBGrid installation manager requires an account.
6
+The SBGrid installation manager requires an account.
10 7
Set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/)
11 8
9
+The SBGrid installation manager is available in graphical and command-line flavors for macOS and Linux. The command-line and graphical versions are interchange and can be used for the same installation. You can find these on the [Download page here](client_downloads).
10
+
11
+<!-- TOC -->
12
+
13
+- [SBGrid Installation Manager CLI : Installation and Usage](#sbgrid-installation-manager-cli--installation-and-usage)
14
+ - [Requirements and recommendations](#requirements-and-recommendations)
15
+ - [Installation](#installation)
16
+- [General Usage](#general-usage)
17
+ - [Activation](#activation)
18
+ - [Restoring from a saved config : reactivate](#restoring-from-a-saved-config--reactivate)
19
+ - [Listing available titles, status](#listing-available-titles-status)
20
+ - [Getting Information about titles](#getting-information-about-titles)
21
+ - [Installing and removing](#installing-and-removing)
22
+ - [Updating titles](#updating-titles)
23
+ - [Remove obsolete titles](#remove-obsolete-titles)
24
+ - [Additional subcommands](#additional-subcommands)
25
+ - [Troubleshooting and diagnostics](#troubleshooting-and-diagnostics)
26
+ - [Installing software for multiple platforms](#installing-software-for-multiple-platforms)
27
+ - [Logging](#logging)
28
+ - [Software Version Management in the SBGrid environment](#software-version-management-in-the-sbgrid-environment)
29
+ - [Running SBGrid software](#running-sbgrid-software)
30
+ - [Known Issues](#known-issues)
31
+ - [Deprecated releases](#deprecated-releases)
32
+
33
+<!-- /TOC -->
34
+
12 35
### Requirements and recommendations
13
- `sbgrid-cli` is single binary executable and should work on most modern Linux distributions.
14 36
15
- The SBGrid installation manager will install the software collection to `/opt/sbgrid` by default (though this can be changed). A symlink from `/programs` to the installation directory is required and this step does require admin priveleges. **Admin privileges are not required to run the applications**. This is only for the initial installation, specifically the creation of /opt/sbgrid (if desired) and for `/programs` (required).
16
-
17
- The `sbgrid-cli` install manager uses 'sudo' for priveleged installation tasks. As such, it should be used from an account with sudo privileges if this functionality is desired. Alternatively, software installation can be competed without sudo and the `/programs` link can be added manually later. The software will not be functional without this path.
18
-
19
- While not strictly required, we recommend a dedicated 'sbgrid' user account for software management, particularly on multiuser systems. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and lost inadvertantly during software updates. The `sbgrid-cli` program will add and remove software. **If data files are accidentally saved into the software collection, they are likely to be lost.**
37
+`sbgrid-cli` is single binary executable and should work on most modern Linux distributions.
20 38
21
-### Latest version : v2.2.9
22
-
23
-[LINUX : sbgrid-cli_2.2.9_linux.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.9_linux.tar.gz)
39
+The SBGrid installation manager will install the software collection to `/opt/sbgrid` by default (though this can be changed). A symlink from `/programs` to the installation directory is required and this step does require admin priveleges. **Admin privileges are not required to run the applications**. This is only for the initial installation, specifically the creation of /opt/sbgrid (if desired) and for `/programs` (required).
24 40
25
-[macOS : sbgrid-cli_2.2.9_macos.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.9_macos.tar.gz)
41
+The `sbgrid-cli` install manager uses 'sudo' for priveleged installation tasks. As such, it should be used from an account with sudo privileges if this functionality is desired. Alternatively, software installation can be completed without sudo and the `/programs` link can be added manually later. The software will not be functional without this path.
26 42
43
+While not strictly required, we recommend a dedicated 'sbgrid' user account for software management, particularly on multiuser systems. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and lost inadvertantly during software updates. The `sbgrid-cli` program will add and remove software. **If user data files are accidentally saved into the software collection, they are likely to be lost.**
27 44
28 45
### Installation
29 46
30 47
The `sbgrid-cli` program is a single executable and does not have any dependencies or requirements.
31
-Untar the archive on the command line with :
48
+Untar the archive on the command line with :
32 49
33 50
```
34 51
tar -zxf <archive_file.tar.gz>
35 52
```
36 53
37
-where the "archive file" is the name of the tar.gz file downloaded from the links above.
38
-
54
+where the "archive file" is the name of the tar.gz file downloaded from the links above.
55
+
39 56
**MAC USERS PLEASE NOTE**
40
-If you encounter a pop-up warning about an "unidentified developer", you need to strip apple's quarantine extended attribute from the `sbgrid-cli` executable. This is easy to do.
57
+If you encounter a pop-up warning about an "unidentified developer", you need to strip apple's quarantine extended attribute from the `sbgrid-cli` executable. This is easy to do.
41 58
42 59
First, cancel the dialog and then run this in your terminal:
43 60
... ...
@@ -47,54 +64,56 @@ xattr -d com.apple.quarantine sbgrid-cli
47 64
48 65
You should then be able to run the application normally without warnings.
49 66
50
-------------
67
+---
68
+
51 69
## General Usage
52
-![](images/sbgrid-cli_usage_2.1.3.png)
53 70
54
-The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example :
71
+![](images/sbgrid-cli_usage_2.1.3.png)
55 72
73
+The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example :
56 74
57 75
```
58 76
$ sbgrid-cli install --help
59 77
```
60 78
61
-will produce the help info for the `install` subcommand.
79
+will produce the help info for the `install` subcommand.
62 80
63 81
### Activation
82
+
64 83
To install the software, you must activate your installation with valid credentials provided by SBGrid. This process is only required for the initial installation of the software and is not required to add/remove/upgrade titles.
65 84
66 85
Activate with the `activate` subcommand
67 86
68 87
```
69
- $ sbgrid-cli activate --help
88
+ $ sbgrid-cli activate --help
70 89
71
- SBGrid Installer 2.2.9 f593932a17 —
90
+ SBGrid Installer 2.2.9 f593932a17 —
72 91
_______ _____ _ __
73 92
/ __/ _ )/ ___/___(_)__/ /
74 93
_\ \/ _ / (_ / __/ / _ /
75 94
/___/____/\___/_/ /_/\_,_/
76 95
C o n s o r t i u m
77
-
96
+
78 97
79 98
USAGE — activate
80
-
99
+
81 100
▸ sbgrid-cli activate [site] [user] [key] [OPTIONS...]
82 101
83 102
84 103
ARGUMENTS
85 104
86
- [site] The installation site provided in your activation
87
- credentials
88
- [user] The username provided in your activation credentials
89
- [key] The activation key provided in your activation
90
- credentials
105
+ [site] The installation site provided in your activation
106
+ credentials
107
+ [user] The username provided in your activation credentials
108
+ [key] The activation key provided in your activation
109
+ credentials
91 110
92 111
OPTIONS
93 112
94
- -k, --credential-key <key> Activate with a single credential key
95
- --darwin Specify macOS as a platform
96
- --no-link No symlink creation, no sudo prompt.
97
- --linux Specify Linux as a platform
113
+ -k, --credential-key <key> Activate with a single credential key
114
+ --darwin Specify macOS as a platform
115
+ --no-link No symlink creation, no sudo prompt.
116
+ --linux Specify Linux as a platform
98 117
--skip-folder-checking Skips checking if a folder with programs already exists
99 118
-t, --target <target> Specify a custom installation target
100 119
... ...
@@ -108,23 +127,23 @@ skips creatation of a symlink at `/programs`. Useful for installs without sudo
108 127
109 128
**--skip-folder-checking**
110 129
111
-skips the check for software that is already installed. Will overwrite existing installations.
130
+skips the check for software that is already installed. Will overwrite existing installations.
112 131
113 132
**--target <target>**
114 133
115 134
Set the install directory to a different path than `/opt/sbgrid`
116 135
117
-Trouble activating? See Troubleshooting options further down this page.
136
+Trouble activating? See Troubleshooting options further down this page.
118 137
119 138
### Restoring from a saved config : reactivate
120 139
121
-**reactivate** subcommand can restore from a saved config file. This config includes all titles and versions from a saved installation. Useful for moving installations or reproducing installations.
140
+**reactivate** subcommand can restore from a saved config file. This config includes all titles and versions from a saved installation. Useful for moving installations or reproducing installations.
122 141
123 142
```
124 143
$ sbgrid-cli reactivate <configPath> [OPTIONS...]
125 144
```
126 145
127
-### Listing available titles, status
146
+### Listing available titles, status
128 147
129 148
The `sbgrid-cli list` command will show all available titles. They are normally colored by their installation status.
130 149
Available options :
... ...
@@ -132,37 +151,37 @@ Available options :
132 151
**list**
133 152
134 153
```
135
--a, --all-versions List all available versions for a title
136
--c, --collections List the available software collections
137
--d, --default-versions List only the default version for a title
138
---long-format Use the long format to display the title list
139
---one-column Format the output into a single column
154
+-a, --all-versions List all available versions for a title
155
+-c, --collections List the available software collections
156
+-d, --default-versions List only the default version for a title
157
+--long-format Use the long format to display the title list
158
+--one-column Format the output into a single column
140 159
```
141 160
142 161
The `list` subcommand has several options
143 162
144 163
```
145 164
USAGE — list
146
-
165
+
147 166
▸ sbgrid-cli list [title...] [OPTIONS...]
148 167
149 168
150 169
ARGUMENTS
151 170
152
- [title...] The names of the software titles to list
171
+ [title...] The names of the software titles to list
153 172
154 173
OPTIONS
155 174
156
- -a, --all-versions List all available versions for a title
157
- -c, --collections List the available software collections
158
- --darwin Specify macOS as a platform
159
- -d, --default-versions List only the default version for a title
160
- --linux Specify Linux as a platform
161
- --long-format Use the long format to display the title list
162
- --one-column Format the output into a single column
175
+ -a, --all-versions List all available versions for a title
176
+ -c, --collections List the available software collections
177
+ --darwin Specify macOS as a platform
178
+ -d, --default-versions List only the default version for a title
179
+ --linux Specify Linux as a platform
180
+ --long-format Use the long format to display the title list
181
+ --one-column Format the output into a single column
163 182
```
164 183
165
-Note `--collections` can be used to see subsets of software as listed at [https://sbgrid.org/software/](https://sbgrid.org/software/).
184
+Note `--collections` can be used to see subsets of software as listed at [https://sbgrid.org/software/](https://sbgrid.org/software/).
166 185
167 186
**updates**
168 187
... ...
@@ -179,12 +198,12 @@ The following installed packages have updates available (x86_64-linux):
179 198
- r@3.6.2 (patch for installed version)
180 199
```
181 200
182
-Updates are either new default versions (new default), or updates to an existing version (patch for installed version). The patch versions are usually bug or configuration fixes.
201
+Updates are either new default versions (new default), or updates to an existing version (patch for installed version). The patch versions are usually bug or configuration fixes.
183 202
184 203
**obsolete**
185 204
186
-Shows obsolete versions that will be removed.
187
-Obsolete versions are previously installed versions no longer included in the SBGrid installation.
205
+Shows obsolete versions that will be removed.
206
+Obsolete versions are previously installed versions no longer included in the SBGrid installation.
188 207
189 208
```
190 209
$ sbgrid-cli obsolete [OPTIONS...]
... ...
@@ -194,16 +213,16 @@ Obsolete versions are previously installed versions no longer included in the SB
194 213
195 214
**info**
196 215
197
-The *info* subcommand shows information about each title, including a description and links to documentation can be show with the `sbgrid-cli info <title>` command. See example below.
216
+The _info_ subcommand shows information about each title, including a description and links to documentation can be show with the `sbgrid-cli info <title>` command. See example below.
198 217
199 218
```
200 219
$ sbgrid-cli info <title...> [OPTIONS...]
201 220
```
202 221
203
-For example, info for *RELION* :
222
+For example, info for _RELION_ :
204 223
205 224
```
206
- $ sbgrid-cli info relion
225
+ $ sbgrid-cli info relion
207 226
------------------------------------------------------------------------------------
208 227
Package information for relion (x86_64-linux):
209 228
... ...
@@ -241,11 +260,11 @@ Description:
241 260
class averages in cryo-electron microscopy.
242 261
243 262
Technical notes:
244
-## SBGrid Usage Info RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux. For general information on running GPU accelerated applications from SBGrid, please see here : https://sbgrid.org/wiki/gpuCUDA builds of RELION re designated by a '_cu' suffix in the version of the application. For example, 3.1.0_cu9.2 is linked against CUDA v9.2 libraries. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware.RELION builds without CUDA support are compiled with Intel 2019.5 with accelation options and Intel math libraries. ### RELION and MPI versionsRELION uses the 'mpirun' executable to manage MPI "ranks" for parallel processing. SBGrid includes several OpenMPI versions which are matched to specific RELION versions. When called from the SBGrid capsule environment, the relion GUI is configured to use the correct version of OpenMPI to manage parallel processing. When calling RELION binaries from the command line, the `mpirun.relion` executable can be used. `mpirun.relion` is configured to used the correct version of OpenMPI for each version of RELION. The 3.1.* versions for RELION use the default configuration of OpenMPI (3.1.6 on Linux, 2.1.3 on macOS) and do not require the version to be defined. Older releases use OpenMPI 2.1.2 which should be specified in $HOME/.sbgrid.conf. To set the OpenMPI version, add : OPENMPI_X=2.1.2"to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun. As noted above, you can also use the `mpirun.relion` executable in place of `mpirun` to use the MPI that matches the currently configured version of RELION. In this case, no other configuration is needed.Version 3.1.0_cu8.0 is compiled to support legacy CPUs (pre-Haswell). OpenMPI 3.1.6_compat is also needed for this version.Versions 3.1.0_cu8.0_slurm20 3.1-beta_cu8.0_slurm20 and 3.0.8_cu8.0_slurm20 support Slurm v20 PMI library. ## Recent Changes2.2.9111 : Add 3.1.1 RELION versions20200703 : Add 3.1.0 release version20200629 : reconfigure RELION gui to automatically use correct 'mpirun' in capsules.20200610 : rebuild of 3.1-beta releases with OpenMPI 3.1.6 from commit 5997001.
263
+ SBGrid Usage Info RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux. For general information on running GPU accelerated applications from SBGrid, please see here : https://sbgrid.org/wiki/gpuCUDA builds of RELION re designated by a '_cu' suffix in the version of the application. For example, 3.1.0_cu9.2 is linked against CUDA v9.2 libraries. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware.RELION builds without CUDA support are compiled with Intel 2019.5 with accelation options and Intel math libraries. RELION and MPI versionsRELION uses the 'mpirun' executable to manage MPI "ranks" for parallel processing. SBGrid includes several OpenMPI versions which are matched to specific RELION versions. When called from the SBGrid capsule environment, the relion GUI is configured to use the correct version of OpenMPI to manage parallel processing. When calling RELION binaries from the command line, the `mpirun.relion` executable can be used. `mpirun.relion` is configured to used the correct version of OpenMPI for each version of RELION. The 3.1.* versions for RELION use the default configuration of OpenMPI (3.1.6 on Linux, 2.1.3 on macOS) and do not require the version to be defined. Older releases use OpenMPI 2.1.2 which should be specified in $HOME/.sbgrid.conf. To set the OpenMPI version, add : OPENMPI_X=2.1.2"to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun. As noted above, you can also use the `mpirun.relion` executable in place of `mpirun` to use the MPI that matches the currently configured version of RELION. In this case, no other configuration is needed.Version 3.1.0_cu8.0 is compiled to support legacy CPUs (pre-Haswell). OpenMPI 3.1.6_compat is also needed for this version.Versions 3.1.0_cu8.0_slurm20 3.1-beta_cu8.0_slurm20 and 3.0.8_cu8.0_slurm20 support Slurm v20 PMI library. Recent Changes2.2.9111 : Add 3.1.1 RELION versions20200703 : Add 3.1.0 release version20200629 : reconfigure RELION gui to automatically use correct 'mpirun' in capsules.20200610 : rebuild of 3.1-beta releases with OpenMPI 3.1.6 from commit 5997001.
245 264
246
-## Known Issues20200610 : Empty values in GUI during autopicking can be interpreted as Text instead of Float values. ## Deprecated versionsThe following verions are deprecated and will be removed in a future SBGrid update.20200706: 3.0.8_cu10.1 3.0.8_cu9.2 3.0.8_avx2 3.1-beta_cu9.2 3.1-beta_cu10.1
265
+Known Issues20200610 : Empty values in GUI during autopicking can be interpreted as Text instead of Float values. Deprecated versionsThe following verions are deprecated and will be removed in a future SBGrid update.20200706: 3.0.8_cu10.1 3.0.8_cu9.2 3.0.8_avx2 3.1-beta_cu9.2 3.1-beta_cu10.1
247 266
248
-## (c) Copyright 2008, Structural Biology Grid (www.sbgrid.org)## Last Update to this document# Jason Key 0a6b896 2020-11-15 18:39:38 -0500
267
+(c) Copyright 2008, Structural Biology Grid (www.sbgrid.org) Last Update to this document# Jason Key 0a6b896 2020-11-15 18:39:38 -0500
249 268
250 269
Links:
251 270
Website: http://www2.mrc-lmb.cam.ac.uk/relion/index.php/Main_Page
... ...
@@ -253,11 +272,11 @@ Links:
253 272
Forumhelp: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A0=CCPEM
254 273
```
255 274
256
-The `info` subcommand includes all version info, dependencies ( which are automatically installed), technical notes and relevant links.
275
+The `info` subcommand includes all version info, dependencies ( which are automatically installed), technical notes and relevant links.
257 276
258 277
### Installing and removing
259 278
260
-Install and remove titles with the `sbgrid-cli install <title>` and `sbgrid-cli remove <title>` command. Each of these commands can take multiple titles with versions at one time.
279
+Install and remove titles with the `sbgrid-cli install <title>` and `sbgrid-cli remove <title>` command. Each of these commands can take multiple titles with versions at one time.
261 280
262 281
**install**
263 282
... ...
@@ -266,26 +285,26 @@ Install and remove titles with the `sbgrid-cli install <title>` and `sbgrid-cli
266 285
267 286
ARGUMENTS
268 287
269
- [title...] The name(s) of the software title(s) to install. To
288
+ [title...] The name(s) of the software title(s) to install. To
270 289
specify a non-default version, append @ and the version
271
- number to the name of the title (e.g. xyz@1.2.3).
290
+ number to the name of the title (e.g. xyz@1.2.3).
272 291
273 292
OPTIONS
274 293
275
- --all-titles Installs all the available titles
276
- --all-versions This will install all the available versions for a
277
- specified title or collection
278
- -c, --collection <title> The title of a software collection to install
279
- --darwin Specify macOS as a platform
280
- --linux Specify Linux as a platform
281
- -j, --num-workers <num-workers> Run installation tasks in parallel
282
- number, default: 1
283
- --reinstall Force the reinstallation of already installed packages
294
+ --all-titles Installs all the available titles
295
+ --all-versions This will install all the available versions for a
296
+ specified title or collection
297
+ -c, --collection <title> The title of a software collection to install
298
+ --darwin Specify macOS as a platform
299
+ --linux Specify Linux as a platform
300
+ -j, --num-workers <num-workers> Run installation tasks in parallel
301
+ number, default: 1
302
+ --reinstall Force the reinstallation of already installed packages
284 303
```
285 304
286 305
**Installation Examples**
287 306
288
-Install a single default version of an application, *adxv* :
307
+Install a single default version of an application, _adxv_ :
289 308
290 309
```
291 310
$ sbgrid-cli install adxv
... ...
@@ -298,19 +317,19 @@ info: (2/2) Setting up your installation...
298 317
$
299 318
```
300 319
301
-Install a specific version of a *adxv* :
320
+Install a specific version of a _adxv_ :
302 321
303 322
```
304 323
$ sbgrid-cli install adxv@1.9.11
305 324
```
306 325
307
-Install all versions of *adxv* :
326
+Install all versions of _adxv_ :
308 327
309 328
```
310 329
$ sbgrid-cli install adxv --all-versions
311 330
```
312 331
313
-Install the 'Electron Microscopy' collection of titles (see above *list* command to list *collections*):
332
+Install the 'Electron Microscopy' collection of titles (see above _list_ command to list _collections_):
314 333
315 334
```
316 335
$ sbgrid-cli install -c 'Electron Microscopy'
... ...
@@ -332,7 +351,7 @@ Note the `--reinstall` flag can be added to all commands to reinstall titles tha
332 351
333 352
**remove**
334 353
335
-Same options as install subcommand above.
354
+Same options as install subcommand above.
336 355
337 356
```
338 357
$ sbgrid-cli remove [title...] [OPTIONS...]
... ...
@@ -350,7 +369,7 @@ $ sbgrid-cli update relion
350 369
351 370
### Remove obsolete titles
352 371
353
-Use the clean subcommand to list or remove obsolete versions or titles
372
+Use the clean subcommand to list or remove obsolete versions or titles
354 373
355 374
**clean**
356 375
... ...
@@ -360,33 +379,32 @@ $ sbgrid-cli clean [OPTIONS...]
360 379
361 380
### Additional subcommands
362 381
363
-`sbgrid-cli` provides additional subcommands for automated software colletion maintenance and troubleshooting.
382
+`sbgrid-cli` provides additional subcommands for automated software colletion maintenance and troubleshooting.
364 383
365
-**admin**
384
+**admin**
366 385
367
-Run periodic installation, update and removal. Installs all new titles, updates where appropriate and removes obsolete versions
386
+Run periodic installation, update and removal. Installs all new titles, updates where appropriate and removes obsolete versions
368 387
369 388
```
370 389
$ sbgrid-cli admin
371 390
```
372 391
373
-For example running
392
+For example running
374 393
375 394
```
376
-$ sbgrid-cli admin
395
+$ sbgrid-cli admin
377 396
```
378 397
379
-will install all default, update all installed titles and remove all obsolete versions while
398
+will install all default, update all installed titles and remove all obsolete versions while
380 399
381 400
```
382 401
$ sbgrid-cli admin --all-versions
383 402
```
384 403
385
-will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions.
404
+will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions.
386 405
This
387 406
388
-
389
-**rebuild**
407
+**rebuild**
390 408
391 409
`rebuild` rebuilds the installation environment configuration files. Usually this step is automatic but can be run manually for troubleshooting.
392 410
... ...
@@ -394,23 +412,22 @@ This
394 412
$ sbgrid-cli rebuild
395 413
```
396 414
397
-**crontab**
415
+**crontab**
398 416
399
-Writes a basic script for crontab for *admin* functionality
417
+Writes a basic script for crontab for _admin_ functionality
400 418
401 419
**save**
402 420
403
-The *save* subcommand saves the current configuration so it can be restored at a later stage or replicated on another machine or in the cloud.
404
-
421
+The _save_ subcommand saves the current configuration so it can be restored at a later stage or replicated on another machine or in the cloud.
405 422
406 423
### Troubleshooting and diagnostics
407 424
408
-**check-connection**
425
+**check-connection**
409 426
410 427
Provides network diagnostics for connectivity to SBGrid at Harvard Medical School.
411 428
412 429
```
413
- $ sbgrid-cli check-connection
430
+ $ sbgrid-cli check-connection
414 431
info: (1/1) Checking connection...
415 432
info: Checking services...
416 433
info: Checking sync2.sbgrid.org (port: 8080) ...
... ...
@@ -421,22 +438,24 @@ info: Checking sbgrid.org (HTTP) ...
421 438
info: Connectivity test succeeded, all remote services are reachable
422 439
```
423 440
424
-**diag**
425
-Run troubleshooting and diagnostic tests for the software collection.
441
+**diag**
442
+Run troubleshooting and diagnostic tests for the software collection.
426 443
427
-**verify**
428
-Lists missing software versions and .rc files.
444
+**verify**
445
+Lists missing software versions and .rc files.
429 446
430 447
### Installing software for multiple platforms
431
-On linux, add the --darwin command to install / remove for macOS .
432
-Conversely, use the --linux command to install / remove for Linux while on macOS.
433
-These flags can be added to many of the subcommands to limit to Linux or macOS.
448
+
449
+On linux, add the --darwin command to install / remove for macOS .
450
+Conversely, use the --linux command to install / remove for Linux while on macOS.
451
+These flags can be added to many of the subcommands to limit to Linux or macOS.
434 452
Useful for servers that share a software stack over NFS.
435 453
436 454
```
437 455
$ sbgrid-cli list --darwin
438 456
```
439
-This will list all software available for macOS.
457
+
458
+This will list all software available for macOS.
440 459
The platform flag ( `--linux` or `--darwin`) is implied for the platform used to install the software, i.e. on linux, `--linux` is redundant.
441 460
442 461
### Logging
... ...
@@ -444,19 +463,21 @@ The platform flag ( `--linux` or `--darwin`) is implied for the platform used to
444 463
`sbgrid-cli` writes log files to `$HOME/.sbgrid/logs`
445 464
446 465
### Software Version Management in the SBGrid environment
466
+
447 467
If you have a single version of an application installed, explicit version selection in your environment is not needed.
448 468
449
-In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*.
469
+In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when it is installed, unless configured otherwise in _~/.sbgrid.conf_.
450 470
451
-In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment.
471
+In the case of multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file. This is the same as in the standard SBGrid environment.
452 472
453 473
**Version priority in the shell**
454
- 1. *~/.sbgrid.conf*
455
- 2. Installed single version
456
- 3. Installed Default version
457
- 4. Latest installed release
458 474
459
-There is more info on how to manage versions here --> [SBGrid version overrides](versions)
475
+1. _~/.sbgrid.conf_
476
+2. Installed single version
477
+3. Installed Default version
478
+4. Latest installed release
479
+
480
+There is more info on how to manage versions here --> [SBGrid version overrides](versions)
460 481
461 482
### Running SBGrid software
462 483
... ...
@@ -468,12 +489,11 @@ or in tcsh
468 489
469 490
$ source /programs/sbgrid.cshrc
470 491
471
-For more info on system configuration for SBGrid software, please check here ---> [Workstation setup](workstation_setup).
492
+For more info on system configuration for SBGrid software, please check here ---> [Workstation setup](workstation_setup).
472 493
473 494
### Known Issues
474 495
475
- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
476
-
496
+**rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
477 497
478 498
### Deprecated releases
479 499
sbgrid-gui.md
... ...
@@ -0,0 +1 @@
1
+client_install.md
... ...
\ No newline at end of file
schrodinger_remote.md
... ...
@@ -12,14 +12,13 @@ The schrodinger.hosts file should be located (or created) in your home directory
12 12
13 13
An example schrodinger.hosts file:
14 14
15
-
16 15
name: localhost
17 16
tmpdir: /tmp/
18 17
19 18
# remote system
20
- name: sbgrid-zorin
21
- user: my_remote_username
22
- host: zorin.sbgrid.org
19
+ name: <my_schrodinger_host>
20
+ user: <my_remote_username>
21
+ host: <my_remote_hostname>
23 22
tmpdir: /tmp
24 23
processors: 32
25 24
sharp.md
... ...
@@ -1,7 +1,5 @@
1 1
## SBGrid Sharp server
2 2
3
-Due to decreased user demand and security considerations, SBGrid no longer maintains a user-accessible server for Global Phasing's application Sharp/AutoSharp.
4
-We now include Sharp in the SBGrid programs collection and it can be accessed through the CCP4 interface. A license from Global Phasing is required and must be locally installed.
3
+Due to decreased user demand and security considerations, SBGrid no longer maintains a user-accessible server for Global Phasing's application Sharp/AutoSharp. We now include Sharp in the SBGrid programs collection and it can be accessed through the CCP4 interface. A license from Global Phasing is required and must be locally installed.
5 4
6
-For more information see [here](https://sbgrid.org/software/titles/sharpautosharp)
7
-Documentation for using Sharp can be found [here](http://www.globalphasing.com/sharp/manual/)
5
+For more information see [here](https://sbgrid.org/software/titles/sharpautosharp). Documentation for using Sharp can be found [here](http://www.globalphasing.com/sharp/manual/)
size_graph.md
... ...
@@ -9,6 +9,7 @@
9 9
```
10 10
11 11
### x86_64-linux
12
+
12 13
**TITLES LARGER THAN 1GB :**
13 14
14 15
```
... ...
@@ -98,10 +99,11 @@
98 99
1.0G cns/ [+ ]
99 100
1.0G modeller/ [+ ]
100 101
1.0G julia/ [+ ]
101
- 1.0G cryoid/ [+ ]
102
+ 1.0G cryoid/ [+ ]
102 103
```
103 104
104 105
### i386-mac
106
+
105 107
**TITLES LARGER THAN 1GB :**
106 108
107 109
```
... ...
@@ -161,6 +163,7 @@
161 163
```
162 164
163 165
### share
166
+
164 167
**TITLES LARGER THAN 1GB :**
165 168
166 169
```
... ...
@@ -168,4 +171,4 @@
168 171
9.4G morda/ [++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ]
169 172
5.6G texlive/ [+++++++++++++++++++++++++++++++++ ]
170 173
5.1G balbes/ [++++++++++++++++++++++++++++++ ]
171
-```
... ...
\ No newline at end of file
0
+```
stereo.md
... ...
@@ -1,10 +1,5 @@
1 1
## General
2 2
3
-### 3D Stereo on RHEL/CentOS 6 systems
4
-
5
-Nvidia 3d stereo on RHEL 6 is reasonably straight-forward.
6
-Take a look [here](xorg_conf) for an example xorg.conf file. This configuration if for a Quadro 4000 card and a 1920x1080 display. Your settings may vary depending on your hardware.
7
-
8 3
### 3D Stereo on RHEL/CentOS 7 systems with Gnome 3
9 4
10 5
Nvidia 3D stereo typically requires disabling the Composite extension in X.org. Unfortunately, this extension is required to run Gnome 3 and the gdm login mangager supplied as the default desktop in CentOS and many other linux distributions.
... ...
@@ -16,69 +11,46 @@ The MATE Desktop Environment is the continuation of GNOME 2 which is the default
16 11
17 12
To change to MATE on CentOS7 systems, first, install the Extra Packages for Enterprise Linux (EPEL) repo:
18 13
19
-
20
- yum install epel-release
21
-
14
+ yum install epel-release
22 15
23 16
Then install the nvidia drivers from epel
24 17
25
-
26
- yum install kmod-nvidia
27
-
18
+ yum install kmod-nvidia
28 19
29 20
You may find you need these packages as well
30 21
31
-
32
- yum install mesa-libGLU-9.0.0-4.el7.x86_64 libXScrnSaver-1.2.2-6.1.el7.x86_64
33
-
22
+ yum install mesa-libGLU-9.0.0-4.el7.x86_64 libXScrnSaver-1.2.2-6.1.el7.x86_64
34 23
35 24
Next, install lightdm which doesn't require the composite extension.
36 25
37
-
38
- yum install lightdm
39
-
26
+ yum install lightdm
40 27
41 28
From there we do a couple of groupinstalls
42 29
You may have these rpms installed already, but just for good measure
43 30
44
-
45
- yum group install "X Window System"
46
-
31
+ yum group install "X Window System"
47 32
48 33
then
49 34
50
-
51
- yum groupinstall "MATE Desktop"
52
-
35
+ yum groupinstall "MATE Desktop"
53 36
54 37
Toggle from gdm to lightdm in systemd using systemctl.
55 38
To see what you are using as a 'display manager', check this link
56 39
57
-
58
- ls -l /etc/systemd/system/display-manager.service
59
-
40
+ ls -l /etc/systemd/system/display-manager.service
60 41
61 42
This is likely pointing to gdm and should be changed to point to lightdm.
62 43
You can change that with systemctl.
63 44
64
-
65
- systemctl disable gdm
66
- systemctl enable lightdm
67
-
45
+ systemctl disable gdm
46
+ systemctl enable lightdm
68 47
69 48
And then this will reload you changes, similar to changing runlevels with sysinitV
70 49
50
+ systemctl isolate graphical.target
71 51
72
- systemctl isolate graphical.target
73
-
74
-
75
-Make sure to select MATE from the drop menu as your graphical before you login.
76
-
77
-## Mac OS X
78
-
79
-* X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/) to run X11-based applications.
52
+Make sure to select MATE from the drop menu as your graphical before you login.
80 53
81
-## Laptops
54
+## Mac OS X
82 55
83
-* You can create a local installation to take along with you.
84
-http://www.sbgrid.org/wiki/laptopinstall
56
+- We are not aware of Stereo viewing options for macOS computers at this time.
versions.md
... ...
@@ -4,47 +4,43 @@ Most of the software titles installed in the SBGrid software collection have sev
4 4
5 5
## Display Available Versions
6 6
7
-To list the available versions of a software title, you can use the *sbgrid* utility. Running *sbgrid -l* will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this:
7
+To list the available versions of a software title, you can use the _sbgrid_ utility. Running _sbgrid -l_ will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this:
8 8
9
+ $ sbgrid-info -l ccp4
10
+ Version information for: /programs/x86_64-linux/ccp4
9 11
10
- $ sbgrid-info -l ccp4
11
- Version information for: /programs/x86_64-linux/ccp4
12
+ Default version: 7.0
13
+ In-use version: 6.5
14
+ Other available versions: 6.4.0 6.3.0
15
+ Overrides use this shell variable: CCP4_X
12 16
13
- Default version: 7.0
14
- In-use version: 6.5
15
- Other available versions: 6.4.0 6.3.0
16
- Overrides use this shell variable: CCP4_X
17
+Running _sbgrid-info -L_ will print the available versions for the three current platforms (OS X PowerPC and Intel, Linux).
17 18
19
+ $ sbgrid-info -L gnuplot
20
+ Version information for: /programs/x86_64-linux/gnuplot
18 21
19
-Running *sbgrid-info -L* will print the available versions for the three current platforms (OS X PowerPC and Intel, Linux).
22
+ Default version: 4.6.4
23
+ In-use version: 4.6.4
24
+ Other available versions: 4.6.0 4.4.3 4.2.6
25
+ Overrides use this shell variable: GNUPLOT_X
20 26
27
+ Version information for: /programs/i386-linux/gnuplot
21 28
22
- $ sbgrid-info -L gnuplot
23
- Version information for: /programs/x86_64-linux/gnuplot
29
+ Default version: 4.6.0
30
+ Other available versions: 4.4.3 4.2.6
31
+ Overrides use this shell variable: GNUPLOT_L
24 32
25
- Default version: 4.6.4
26
- In-use version: 4.6.4
27
- Other available versions: 4.6.0 4.4.3 4.2.6
28
- Overrides use this shell variable: GNUPLOT_X
29
-
30
- Version information for: /programs/i386-linux/gnuplot
31
-
32
- Default version: 4.6.0
33
- Other available versions: 4.4.3 4.2.6
34
- Overrides use this shell variable: GNUPLOT_L
35
-
36
- Version information for: /programs/i386-mac/gnuplot
37
-
38
- Default version: 4.6.4
39
- Other available versions: 4.4.3 4.2.6 4.6.0
40
- Overrides use this shell variable: GNUPLOT_M
33
+ Version information for: /programs/i386-mac/gnuplot
41 34
35
+ Default version: 4.6.4
36
+ Other available versions: 4.4.3 4.2.6 4.6.0
37
+ Overrides use this shell variable: GNUPLOT_M
42 38
43 39
## Overriding Default Versions
44 40
45
-To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version.
41
+To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version.
46 42
47
-The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this:
43
+The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this:
48 44
49 45
`APPLICATION_X=1.2`
50 46
... ...
@@ -52,18 +48,19 @@ APPLICATION_X is the name of the application followed by an underscore and the s
52 48
53 49
| Software Directory | Shorthand Initial |
54 50
| ------------------ | ----------------- |
55
-| x86_64-linux | _X |
56
-| i386-mac | _M |
51
+| x86_64-linux | \_X |
52
+| i386-mac | \_M |
57 53
58
-To quickly open the overrides file in your default $EDITOR, you can run *sbgrid-overrides -e*.
54
+To quickly open the overrides file in your default $EDITOR, you can run _sbgrid-overrides -e_.
59 55
60
-When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well.
56
+When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well.
61 57
62 58
The example output below shows CCP4 on linux being changed from the default version:
63 59
64
- Configuration options in effect for this shell:
65
- Variable Setting Configuration
66
- CCP4_M 6.3.0 personal
60
+ Configuration options in effect for this shell:
61
+ Variable Setting Configuration
62
+ CCP4_M 6.3.0 personal
67 63
68 64
## Disabling a Software Package
65
+
69 66
To disable a specific software package, set its version to "disable" in your ~/.sbgrid.conf file.
workstation_setup.md
... ...
@@ -1,32 +1,30 @@
1 1
## General
2 2
3
-* You should use a network installation for workstations and servers if at all possible. NFS, SMB and AFP all work for sharing a single installation among multiple machines. The decreased admin overhead, bandwidth and disk savings of sharing a single installation is a significant benefit.
3
+- You should use a network installation for workstations and servers if at all possible. NFS, SMB and AFP all work for sharing a single installation among multiple machines. The decreased admin overhead, bandwidth and disk savings of sharing a single installation is a significant benefit.
4 4
5 5
## Linux
6
-Information on configuring 3D stereo can be found [here](stereo)
7 6
8
-* All Linux machines need installations of a recent version (6.17+) of csh/tcsh. Red Hat Enterprise Linux 6 and other recent distributions usually have an up to date version.
7
+Information on configuring 3D stereo can be found [here](stereo)
9 8
10
-* SELinux must be disabled.
9
+- All Linux machines need installations of a recent version (6.17+) of csh/tcsh. Red Hat Enterprise Linux 6 and other recent distributions usually have an up to date version.
11 10
12
-* 64-bit machines need a number of 32-bit compatibility packages due to a number of legacy packages that are only available as 32-bit applications. Additional fonts for Tcl/Tk, Motif and Xview applications are also encouraged.
11
+- 64-bit machines need a number of 32-bit compatibility packages due to a number of legacy packages that are only available as 32-bit applications. Additional fonts for Tcl/Tk, Motif and Xview applications are also encouraged.
13 12
14 13
Packages for RHEL 7, and 8 and compatible machines:
15 14
16
- yum install glibc.i686 gnome-terminal libgcc.i686 libX11.i686 libXaw.i686 libXext.i686 \
17
- ncurses.i686 redhat-lsb.i686 xorg-x11-fonts-75dpi xorg-x11-fonts-100dpi xorg-x11-fonts-ISO8859-1-75dpi \
18
- xorg-x11-fonts-ISO8859-1-100dpi xorg-x11-fonts-misc libXScrnSaver freetype.i686 \
19
- fontconfig.i686 zlib.i686 libstdc++.i686 glx-utils
20
-
21
-In addition to the above, on RHEL8, CentOS8 and similar distributions, you will need
15
+ yum install glibc.i686 gnome-terminal libgcc.i686 libX11.i686 libXaw.i686 libXext.i686 \
16
+ ncurses.i686 redhat-lsb.i686 xorg-x11-fonts-75dpi xorg-x11-fonts-100dpi xorg-x11-fonts-ISO8859-1-75dpi \
17
+ xorg-x11-fonts-ISO8859-1-100dpi xorg-x11-fonts-misc libXScrnSaver freetype.i686 \
18
+ fontconfig.i686 zlib.i686 libstdc++.i686 glx-utils
22 19
23
- yum install libnsl
20
+In addition to the above, on RHEL8, CentOS8 and similar distributions, you will need
24 21
25
-* gnome-terminal is required for [hkl2map](https://www.sbgrid.org/software/titles/hkl2map).
26
-* The same 32-bit requirement applies for 64-bit Debian and Ubuntu machines. This is supported via the [Multiarch](https://wiki.debian.org/Multiarch/HOWTO) system. You'll need at least the following packages to run most of the software. Please email us if you discover we have left some out.
27
-`apt-get install libc6-i386 lsb tcsh gawk libjpeg62 curl libx11-6:i386 libxext6:i386`
22
+ yum install libnsl
28 23
29
-## Mac OS X
24
+- gnome-terminal is required for [hkl2map](https://www.sbgrid.org/software/titles/hkl2map).
25
+- The same 32-bit requirement applies for 64-bit Debian and Ubuntu machines. This is supported via the [Multiarch](https://wiki.debian.org/Multiarch/HOWTO) system. You'll need at least the following packages to run most of the software. Please email us if you discover we have left some out.
26
+ `apt-get install libc6-i386 lsb tcsh gawk libjpeg62 curl libx11-6:i386 libxext6:i386`
30 27
31
-* * X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/) to run X11-based applications.
28
+## Mac OS X
32 29
30
+- - X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/) to run X11-based applications.
wsmr-worked.md
... ...
@@ -1,35 +1,40 @@
1 1
# Data Processing after WS-MR
2 2
3 3
## 1 Verify Results for Search Models
4
-The first follow-up step for a search model resulting from WSMR is to repeat MR locally.
4
+
5
+The first follow-up step for a search model resulting from WSMR is to repeat MR locally.
5 6
6 7
To download one of the search models; first click the "Load Top 100 Hits" button, click one of the yellow circles in the resulting plot, and then use the download link for the model.
7 8
8
-* * *
9
+---
10
+
9 11
![](images/data-processing-after-ws-mr-1.jpg)
10
-* * *
12
+
13
+---
14
+
11 15
![](images/data-processing-after-ws-mr-2.png)
12
-* * *
16
+
17
+---
13 18
14 19
A typical input deck (`MR01.in` for this example) for `phaser` would look something like this (with the paths to your input `MTZ` and `PDB` files adjusted appropriately):
15 20
16
- ROOT MR01
17
- MODE MR_AUTO
18
- HKLIn reflections.mtz
19
- LABIn F=FP SIGF=SIGFP
20
- ENSEmble SearchModel PDB model.pdb IDENtity 0.3
21
- COMPosition PERCENTAGE 0.50
22
- RESOlution HIGH 3.1
23
- SEARch ENSEmble SearchModel NUM 1
24
- SGALternative SELECT ALL
21
+ ROOT MR01
22
+ MODE MR_AUTO
23
+ HKLIn reflections.mtz
24
+ LABIn F=FP SIGF=SIGFP
25
+ ENSEmble SearchModel PDB model.pdb IDENtity 0.3
26
+ COMPosition PERCENTAGE 0.50
27
+ RESOlution HIGH 3.1
28
+ SEARch ENSEmble SearchModel NUM 1
29
+ SGALternative SELECT ALL
25 30
26
-This can be run with versions of `phaser` distributed with `CCP4` or `PHENIX` (with `phaser < MR01.in > MR01.out` or `phenix.phaser < MR01.in > MR01.out` respectively). The statistics (LLG and Z-scores) from local runs may differ due to differences in `phaser` versions.
31
+This can be run with versions of `phaser` distributed with `CCP4` or `PHENIX` (with `phaser < MR01.in > MR01.out` or `phenix.phaser < MR01.in > MR01.out` respectively). The statistics (LLG and Z-scores) from local runs may differ due to differences in `phaser` versions.
27 32
28 33
The `SGALternative` card is only necessary if you're checking alternative space-groups.
29 34
30 35
## 2 Expand Search
31 36
32
-WSMR searches for a single copy of the search model - however there may be multiple copies of the model in the ASU. If so, the next step is the increase the `NUM` value for the `SEARch` card. When in doubt, it's better to set this too hight rather than too low - `phaser` will stop when unable to locate additional copies.
37
+WSMR searches for a single copy of the search model - however there may be multiple copies of the model in the ASU. If so, the next step is the increase the `NUM` value for the `SEARch` card. When in doubt, it's better to set this too hight rather than too low - `phaser` will stop when unable to locate additional copies.
33 38
34 39
## 3 Autobuild
35 40
... ...
@@ -41,7 +46,6 @@ Using the `PHENIX` autobuilder:
41 46
42 47
The input model (`MR_Results.pdb`) for the autobuilder is the final result modeles from the initial or expanded MR search.
43 48
44
-The input `MTZ` file should be the original amplitudes (or intensities) used for searching, *not* the results from `phaser`. If phaser was run with the `SGALternative` card, make sure the spacegroup of this `MTZ` matches that of the search solutions.
49
+The input `MTZ` file should be the original amplitudes (or intensities) used for searching, _not_ the results from `phaser`. If phaser was run with the `SGALternative` card, make sure the spacegroup of this `MTZ` matches that of the search solutions.
45 50
46 51
The `nproc=4` option should only be used if there are four (or more) available cores - when using the `rebuild_in_place` option, `phenix.autobuild` can't take advantage of more than 4 processors.
47
-