1946ecf63151782dedab839c63b36a7f6ada3fc9
AWS.md
... | ... | @@ -1,26 +1,39 @@ |
1 | 1 | ## SBGrid in AWS EC2 |
2 | 2 | |
3 | +SBGrid is easy to use in on cloud resources. This is a short guide to using SBGrid on AWS. |
|
4 | + |
|
5 | +<!-- TOC --> |
|
6 | + |
|
7 | +- [SBGrid in AWS EC2](#sbgrid-in-aws-ec2) |
|
8 | + - [Compatible AMIs](#compatible-amis) |
|
9 | + - [Prerequisites](#prerequisites) |
|
10 | + - [Download the SBGrid command line interface](#download-the-sbgrid-command-line-interface) |
|
11 | + - [Activate your installation](#activate-your-installation) |
|
12 | + - [Install programs](#install-programs) |
|
13 | + - [Run your software](#run-your-software) |
|
14 | + |
|
15 | +<!-- /TOC --> |
|
16 | + |
|
3 | 17 | ### Compatible AMIs |
18 | + |
|
4 | 19 | ``` |
5 | 20 | __| __|_ ) |
6 | 21 | _| ( / Amazon Linux AMI |
7 | 22 | ___|\___|___| |
8 | 23 | ``` |
9 | -We recommend CentOS / RHEL 7 AMIs for the SBGrid software stack. |
|
10 | -Amazon AMIs appear to work well, but are not routinely tested. |
|
11 | -Debian / Ubuntu AMIs may work but are untested. |
|
12 | -If you have problems let us know. |
|
24 | + |
|
25 | +We recommend CentOS / RHEL 7 AMIs for the SBGrid software stack. Amazon AMIs appear to work well, but are not routinely tested. Debian / Ubuntu AMIs may work but are untested. If you have problems let us know. |
|
13 | 26 | |
14 | 27 | For the example below we are using an Amazon Linux AMI, 2018.03.0 (HVM), SSD Volume Type - ami-14c5486b |
15 | 28 | |
16 | 29 | ### Prerequisites |
17 | 30 | |
18 | -First login to your running instance and install **tcsh**. |
|
19 | -It is not provided on linux by default but is required by several SBGrid titles. |
|
31 | +First login to your running instance and install **tcsh**. It is not provided on linux by default but is required by several SBGrid titles. |
|
20 | 32 | |
21 | 33 | sudo yum install tcsh |
22 | 34 | |
23 | 35 | ### Download the SBGrid command line interface |
36 | + |
|
24 | 37 | Download the SBGrid CLI installation manager. |
25 | 38 | |
26 | 39 | ``` |
... | ... | @@ -29,6 +42,7 @@ tar -zxvf sbgrid-cli_2.2.9_linux.tar.gz |
29 | 42 | ``` |
30 | 43 | |
31 | 44 | ### Activate your installation |
45 | + |
|
32 | 46 | If you don't have a username and key, register here : [https://sbgrid.org/registration/register/](https://sbgrid.org/registration/register/) |
33 | 47 | |
34 | 48 | ``` |
... | ... | @@ -37,13 +51,14 @@ If you don't have a username and key, register here : [https://sbgrid.org/regist |
37 | 51 | |
38 | 52 | ### Install programs |
39 | 53 | |
40 | -relion as an example here - |
|
54 | +relion as an example here - |
|
41 | 55 | |
42 | 56 | ``` |
43 | 57 | ./sbgrid-cli install relion |
44 | 58 | ``` |
45 | 59 | |
46 | 60 | ### Run your software |
61 | + |
|
47 | 62 | Initialize the environment, and the instance is ready to go. |
48 | 63 | |
49 | 64 | ``` |
SBGrid-Wiki.md
... | ... | @@ -5,40 +5,26 @@ |
5 | 5 | /___/____/\___/_/ /_/\_,_/ |
6 | 6 | C o n s o r t i u m |
7 | 7 | ``` |
8 | + |
|
8 | 9 | ## Welcome to the SBGrid Consortium Wiki |
9 | 10 | |
10 | -SBGrid is a global consortium of research labs in academia and industry using structural biology (cryoEM, X-ray crystallography and scattering, NMR, molecular dynamics, etc) to address scientific questions. Based at Harvard Medical School in Boston, MA, our team supports research computing for structural biologists with scientific software and computing support. |
|
11 | +SBGrid is a global consortium of research labs in academia and industry using structural biology (cryoEM, X-ray crystallography and scattering, NMR, molecular dynamics, etc) to address scientific questions. Based at Harvard Medical School in Boston, MA, our team supports research computing for structural biologists with scientific software and computing support. |
|
11 | 12 | |
12 | 13 | This site provides information on how to install, use, and get help with your SBGrid software installation. Here you can also find information about SBGrid services. Please let us know if you have questions. |
13 | 14 | |
14 | -### Recent Posts |
|
15 | - |
|
16 | -[2021.04.12 - new sbgrid-cli version, 2.2.9](sbgrid-cli) |
|
17 | - |
|
18 | -[2021.03.31 - new sbgrid-cli version, 2.2.8](sbgrid-cli) |
|
19 | - |
|
20 | -[2021.03.24 - new sbgrid-cli version, 2.2.5](sbgrid-cli) |
|
21 | - |
|
22 | -[2021.03.05 - new sbgrid-cli version, 2.2.2](sbgrid-cli) |
|
23 | - |
|
24 | -[2021.02.23 - new sbgrid-cli version, 2.2.1](sbgrid-cli) |
|
25 | - |
|
26 | -[2021.02.02 - new sbgrid-cli version, 2.1.5](sbgrid-cli) |
|
27 | - |
|
28 | -[2021.02.01 - new sbgrid-cli version, 2.1.4](sbgrid-cli) |
|
29 | - |
|
30 | -[2021.01.13 - new sbgrid-cli version, 2.1.3](sbgrid-cli) |
|
15 | +### Recent Wiki Posts |
|
16 | +- [2021.05.05 - SBGrid Installation Manager (GUI) version, 2.2.11](client_usage) |
|
31 | 17 | |
32 | -[2021.01.12 - new sbgrid-cli version, 2.1.2](sbgrid-cli) |
|
18 | +- [2021.05.05 - new sbgrid-cli version, 2.2.11](sbgrid-cli) |
|
33 | 19 | |
34 | -[2021.01.06 - new sbgrid-cli version, 2.1.1](sbgrid-cli) |
|
20 | +- [2021.04.12 - new sbgrid-cli version, 2.2.9](sbgrid-cli) |
|
35 | 21 | |
36 | -[2020.12.01 - MacOS 11 "Big Sur" compatibility](big-sur) |
|
22 | +- [2020.12.01 - MacOS 11 "Big Sur" compatibility](big-sur) |
|
37 | 23 | |
38 | -[2020.10.27 - Examples on changing COOT verions](coot) |
|
24 | +- [2020.10.27 - Examples on changing COOT verions](coot) |
|
39 | 25 | |
40 | -[2020.11.13 - SBGrid Installation Mangager registration is here](https://sbgrid.org/registration/register/) |
|
26 | +- [2020.11.13 - SBGrid Installation Mangager registration is here](https://sbgrid.org/registration/register/) |
|
41 | 27 | |
42 | -[2020.11.13 - SBGrid Installation Mangager downloads](client_downloads) |
|
28 | +- [2020.11.13 - SBGrid Installation Mangager downloads](client_downloads) |
|
43 | 29 | |
44 | -[2020.11.13 - MacOS 10.15 catalina is supported](catalina) |
|
30 | +- [2020.11.13 - MacOS 10.15 catalina is supported](catalina) |
_Sidebar.md
... | ... | @@ -1,39 +1,45 @@ |
1 | 1 | ![SBGrid](images/sbgrid_small_logo.gif) **[SBGrid Wiki](Home)** |
2 | 2 | |
3 | 3 | Installing Software |
4 | -* [Overview](installation_overview) |
|
5 | -* [Site installation](managing_install) |
|
6 | -* [Graphical installation manager](client_install) |
|
7 | -* [Command line installation manager](sbgrid-cli) |
|
8 | -* [Installation on macOS 10.15+ (Catalina, Big Sur)](catalina) |
|
9 | -* [Apple Silicon Support](big_sur) |
|
4 | + |
|
5 | +- [Overview](installation_overview) |
|
6 | +- [Site installation](managing_install) |
|
7 | +- [Graphical installation manager](client_install) |
|
8 | +- [Command line installation manager](sbgrid-cli) |
|
9 | +- [Installation on macOS 10.15+ (Catalina, Big Sur)](catalina) |
|
10 | +- [Apple Silicon Support](big_sur) |
|
10 | 11 | |
11 | 12 | Using the SBGrid Environment |
12 | -* [Getting Started with SBGrid](getting_started) |
|
13 | -* [Managing Software Versions](versions) |
|
14 | -* [SBGrid Capsules Environment](capsules) |
|
15 | -* [SBGrid Legacy Environment](monolithic) |
|
16 | -* [Modulefiles for SBGrid](modulefiles) |
|
13 | + |
|
14 | +- [Getting Started with SBGrid](getting_started) |
|
15 | +- [Managing Software Versions](versions) |
|
16 | +- [SBGrid Capsules Environment](capsules) |
|
17 | +- [SBGrid Legacy Environment](monolithic) |
|
18 | +- [Modulefiles for SBGrid](modulefiles) |
|
17 | 19 | |
18 | 20 | Getting Help |
19 | -* [Software Help and Requests](help) |
|
20 | -* [Software Usage Examples](examples) |
|
21 | + |
|
22 | +- [Software Help and Requests](help) |
|
23 | +- [Software Usage Examples](examples) |
|
21 | 24 | |
22 | 25 | Support for Site Administrators |
23 | -* [Preparing Workstations to run the Software](workstation_setup) |
|
24 | -* [Managing your Installation](managing_install) |
|
25 | -* [Administrator Software Version Overrides](admin_overrides) |
|
26 | -* [Admins Mailing List](mailinglist) |
|
26 | + |
|
27 | +- [Preparing Workstations to run the Software](workstation_setup) |
|
28 | +- [Managing your Installation](managing_install) |
|
29 | +- [Administrator Software Version Overrides](admin_overrides) |
|
30 | +- [Admins Mailing List](mailinglist) |
|
27 | 31 | |
28 | 32 | Support for Developers |
29 | -* [Resources for Developers](developers) |
|
33 | + |
|
34 | +- [Resources for Developers](developers) |
|
30 | 35 | |
31 | 36 | Hardware Support Notes |
32 | -* [Recommended Hardware](recommended) |
|
33 | -* [GPU computing](gpu) |
|
34 | -* [Setup Stereo 3D](stereo) |
|
35 | -* [SBGrid on AWS EC2](AWS) |
|
37 | + |
|
38 | +- [Recommended Hardware](recommended) |
|
39 | +- [GPU computing](gpu) |
|
40 | +- [Setup Stereo 3D](stereo) |
|
41 | +- [SBGrid on AWS EC2](AWS) |
|
36 | 42 | |
37 | 43 | Portals |
38 | -* [Data Processing After WSMR](wsmr-worked) |
|
39 | -* [SBGrid SHARP server](sharp) |
|
44 | + |
|
45 | +- [Data Processing After WSMR](wsmr-worked) |
admin_overrides.md
... | ... | @@ -1,5 +1,5 @@ |
1 | - |
|
2 | 1 | ## Site Administrator Overrides |
2 | + |
|
3 | 3 | SBGrid installations allow site-level software control for Administrators |
4 | 4 | |
5 | 5 | - [Site Administrator Overrides](#site-administrator-overrides) |
... | ... | @@ -8,6 +8,7 @@ SBGrid installations allow site-level software control for Administrators |
8 | 8 | - [Precedence](#precedence) |
9 | 9 | |
10 | 10 | ### Software Blacklist |
11 | + |
|
11 | 12 | Site administrators can prevent the shell initialization files from configuring software on a host by creating an empty file at |
12 | 13 | |
13 | 14 | **/programs/local/conf/disabled-hosts/<hostname>** |
... | ... | @@ -15,22 +16,24 @@ Site administrators can prevent the shell initialization files from configuring |
15 | 16 | where **<hostname>** is the output of the //hostname -s// command. This is useful for encouraging users not to run jobs on bastion hosts, file servers, etc. |
16 | 17 | |
17 | 18 | ### Administrator Software Version Overrides |
19 | + |
|
18 | 20 | Most of the software titles installed in the SBGrid Suite have several versions available. Typically, we try to provide at least three versions of each software package, although very old or very new applications may have fewer versions. |
19 | 21 | |
20 | 22 | There are two methods for site admins to configure version overrides using files placed in a **/programs/local/conf/** directory. |
21 | 23 | |
22 | 24 | - Site-wide Version Overrides |
23 | -A file named **site.conf** will be read when any SBGrid shell is initialized from the installation. |
|
25 | + A file named **site.conf** will be read when any SBGrid shell is initialized from the installation. |
|
24 | 26 | |
25 | 27 | - Per-host Version Overrides |
26 | -A file named **<hostname.conf>**, where **<hostname>** is the output of the //hostname -s// command, will be read after the site.conf on the host matching that hostname. |
|
28 | + A file named **<hostname.conf>**, where **<hostname>** is the output of the //hostname -s// command, will be read after the site.conf on the host matching that hostname. |
|
27 | 29 | |
28 | 30 | ### Precedence |
29 | -There are three files that will be examined for version overrides during shell initialization. In order from lowest to highest precedence: |
|
30 | 31 | |
31 | - * /programs/local/conf/site.conf |
|
32 | - * /programs/local/conf/<hostname.conf> |
|
33 | - * $HOME/.sbgrid.conf |
|
32 | +There are three files that will be examined for version overrides during shell initialization. In order from lowest to highest precedence: |
|
33 | + |
|
34 | +- /programs/local/conf/site.conf |
|
35 | +- /programs/local/conf/<hostname.conf> |
|
36 | +- $HOME/.sbgrid.conf |
|
34 | 37 | |
35 | 38 | The overrides are reported during shell initialization: |
36 | 39 |
big-sur.md
... | ... | @@ -2,21 +2,30 @@ |
2 | 2 | |
3 | 3 | Apple has released MacOS 11.0 "Big Sur". This OS includes compatibilty for Apple's new 'Apple Silicon' ARM-based computers as well as numerous changes and security enhancements. Because this is a major update, we reccommend waiting to upgrade any system required for scientific data processing. MacOS 10.14 "Mojave" or 10.15 "Catalina" are currently supported by SBGrid. |
4 | 4 | |
5 | -### Apple M1 Silicon |
|
5 | +<!-- TOC --> |
|
6 | + |
|
7 | +- [MacOS 11.0 Big Sur](#macos-110-big-sur) |
|
8 | + - [Apple M1 Silicon](#apple-m1-silicon) |
|
9 | + - [Installing SBGrid on Big Sur](#installing-sbgrid-on-big-sur) |
|
10 | + - [Known issues](#known-issues) |
|
11 | + |
|
12 | +<!-- /TOC --> |
|
13 | + |
|
14 | +### Apple M1 Silicon |
|
15 | + |
|
6 | 16 | ARM64 compatibility |
7 | 17 | |
8 | -Apple released the first of its new ARM64 "apple silicon" macs this month. We are testing the SBGrid software stack on the M1 chip and, so far, compatibility and performance look very good. Most of the SBGrid applications work on the new M1 CPU with macOS 11 and Apple's Rosetta compatibility environment. Standards like COOT, PyMOL, Chimera, CCP4, and PHENIX work seamlessly, but there are exceptions (CCPEM, RELION). We expect to support most titles on BigSur with the new M1 hardware early in 2021. |
|
18 | +Apple released the first of its new ARM64 "apple silicon" macs with the "M1" CPU. We are testing the SBGrid software stack on the M1 chip and, so far, compatibility and performance look very good. Most of the SBGrid applications work on the new M1 CPU with macOS 11 and Apple's Rosetta compatibility environment. Standards like COOT, PyMOL, Chimera, CCP4, and PHENIX work seamlessly, but there are exceptions (CCPEM, RELION). We expect to support most titles on BigSur with the new M1 hardware early in 2021. |
|
9 | 19 | |
10 | -## Installing SBGrid on Big Sur |
|
20 | +### Installing SBGrid on Big Sur |
|
11 | 21 | |
12 | 22 | Installation of SBGrid on Big Sur is basically the same as on Catalina. Due to Apple's filesystem protections and our current requirement of a symlink at `/programs`, a `/etc/synthetic.conf` file is necessary. See the [installation page for macOS Catalina for more info](catalina) |
13 | 23 | |
14 | 24 | ### Known issues |
15 | - - Filesystem access issues in PEET |
|
16 | - - Ilastik 1.3.3 and earlier are no supported. Support coming in 1.4. |
|
17 | - - No 32-bit support (dropped in Catalina) means no support for nmrDraw, other 32-bit applications. |
|
18 | - - Rosetta ( from Baker lab, not Apple Rosetta2 ) fails |
|
19 | - - CCP-EM ( possibly fixed in latest nightly) |
|
20 | - - No compatible release of Schrodinger is currently available |
|
21 | - - No GUI in FLTK applications (like RELION) |
|
22 | - - Xquartz window border takes a few seconds to appear. It does appear eventually. |
|
25 | + |
|
26 | +- Ilastik 1.3.3 and earlier are no supported. Support coming in 1.4. |
|
27 | +- No 32-bit support (dropped in Catalina) means no support for nmrDraw, other 32-bit applications. |
|
28 | +- Rosetta fails ( from Baker lab, not Apple Rosetta2 ). Needs to be recompiled with clang. |
|
29 | +- CCP-EM ( possibly fixed in latest nightly) |
|
30 | +- No GUI in FLTK applications (like RELION) |
|
31 | +- Xquartz window border takes a few seconds to appear. It does appear eventually. Possibly fixed in XQuartz 2.8 series. |
capsules.md
... | ... | @@ -1,7 +1,8 @@ |
1 | 1 | # SBGrid software environment |
2 | 2 | |
3 | +SBGrid Capsules is a new software environment which is significantly faster than the older 'monolithic' shell environment. This environment includes added features for users to manage their software. Older features (such as version selection) are still present but improved. Old scripts should run unaltered and no new commands are required. |
|
4 | + |
|
3 | 5 | - [SBGrid software environment](#sbgrid-software-environment) |
4 | - - [Overview](#overview) |
|
5 | 6 | - [Notable features of Capsules](#notable-features-of-capsules) |
6 | 7 | - [Getting started](#getting-started) |
7 | 8 | - [sbcap - Example](#sbcap---example) |
... | ... | @@ -12,35 +13,33 @@ |
12 | 13 | - [EXAMPLES:](#examples) |
13 | 14 | |
14 | 15 | <a name="overview"></a> |
15 | -## Overview |
|
16 | - |
|
17 | -SBGrid Capsules is a new software environment which is significantly faster than the older 'monolithic' shell environment. |
|
18 | -This environment includes added features for users to manage their software. |
|
19 | -Older features (such as version selection) are still present but improved. |
|
20 | -Old scripts should run unaltered and no new commands are required. |
|
21 | 16 | |
22 | 17 | ### Notable features of Capsules |
23 | 18 | |
24 | - - Specify software version on the fly by setting single environment variable |
|
25 | - - Single path entry, minimal environment |
|
26 | - - Compatile with existing software stacks, modules |
|
19 | +- Specify software version on the fly by setting single environment variable |
|
20 | +- Single path entry, minimal environment |
|
21 | +- Compatile with existing software stacks, modules |
|
27 | 22 | |
28 | 23 | **Check out Carol Herre's [presentation on Capsules on SBGrid TV](https://www.youtube.com/watch?v=baexe9R128A)** |
29 | 24 | |
30 | 25 | <a name="getting-started"></a> |
26 | + |
|
31 | 27 | ## Getting started |
32 | 28 | |
33 | -You can switch from the legacy SBGrid environment to the new with the *sbcap* command. *sbcap on* will enable the capsule environment. |
|
34 | -You can always return to the legacy configuration with the *sbcap off* command and *sbcap reset* returns the setting to the default. |
|
29 | +You can switch from the legacy SBGrid environment to the new with the _sbcap_ command. _sbcap on_ will enable the capsule environment. |
|
30 | +You can always return to the legacy configuration with the _sbcap off_ command and _sbcap reset_ returns the setting to the default. |
|
35 | 31 | |
36 | 32 | The sbcap setting is persistent across shells - You don't need to do this for every shell. |
37 | 33 | |
38 | 34 | <a name="getting-started_sbcap-example"></a> |
35 | + |
|
39 | 36 | ### sbcap - Example |
37 | + |
|
40 | 38 | ``` |
41 | 39 | user@linux ~ |
42 | 40 | $ sbcap on |
43 | 41 | ``` |
42 | + |
|
44 | 43 | You will see a notice that you are using the new environment |
45 | 44 | |
46 | 45 | ``` |
... | ... | @@ -56,7 +55,7 @@ You will see a notice that you are using the new environment |
56 | 55 | $ |
57 | 56 | ``` |
58 | 57 | |
59 | -You can check your capsule status with **sbcap status**. |
|
58 | +You can check your capsule status with **sbcap status**. |
|
60 | 59 | |
61 | 60 | ``` |
62 | 61 | $ sbcap status |
... | ... | @@ -64,7 +63,9 @@ Active |
64 | 63 | ``` |
65 | 64 | |
66 | 65 | <a name="usage-capsule-environment-for-sbgrid"></a> |
66 | + |
|
67 | 67 | ## Usage - Capsule Environment for SBGrid |
68 | + |
|
68 | 69 | ``` |
69 | 70 | Usage: sbgrid-exectable [ --sbwhich | --sbenv | --sbman | --sbapp:[adlshrH] | --sbcitation | --sbticket | --sbhelp ] |
70 | 71 | |
... | ... | @@ -84,9 +85,10 @@ Usage: sbgrid-exectable [ --sbwhich | --sbenv | --sbman | --sbapp:[adlshrH] | - |
84 | 85 | ``` |
85 | 86 | |
86 | 87 | <a name="usage-capsule-environment-for-sbgrid_overrides-managing-versions"></a> |
88 | + |
|
87 | 89 | ### Overrides - managing versions : |
88 | 90 | |
89 | -Version overrides may be defined in the ~/.sbgrid.conf file, which will be used each time the sbgrid.[sh|csh] file are sourced. A version override can also be instantiated by simply defining the APP_M prior to capsule execution. |
|
91 | +Version overrides may be defined in the ~/.sbgrid.conf file, which will be used each time the sbgrid.[sh|csh] file are sourced. A version override can also be instantiated by simply defining the APP_M prior to capsule execution. |
|
90 | 92 | |
91 | 93 | Setting the version - EXAMPLE |
92 | 94 | |
... | ... | @@ -103,41 +105,46 @@ We can change this by setting the variable BUSTER_X to 20151214 and calling sbwh |
103 | 105 | bash-4.1$ env BUSTER_X=20151214 refine --sbwhich |
104 | 106 | /programs/x86_64-linux/buster/20151214/autoBUSTER/bin/linux64/refine |
105 | 107 | ``` |
106 | -This can also be accomplished by simply setting BUSTER_X=20151214 in the shell or adding the line BUSTER_X=20151214 to your ~/.sbgrid.conf file as [described here](overrides). Note that case is important for the variable names. All SBGrid variable names are ALL CAPS. |
|
108 | + |
|
109 | +This can also be accomplished by simply setting BUSTER_X=20151214 in the shell or adding the line BUSTER_X=20151214 to your ~/.sbgrid.conf file as [described here](overrides). Note that case is important for the variable names. All SBGrid variable names are ALL CAPS. |
|
107 | 110 | |
108 | 111 | <a name="usage-capsule-environment-for-sbgrid_managing-duplicate-executables"></a> |
112 | + |
|
109 | 113 | ### Managing Duplicate Executables |
110 | -In some cases an executable may exist in multiple applications, i.e. the program *fft* exists in CCP4 **and** Tigris. A default application is already defined based on what executable would be used in the legacy environment, but the user can choose to override this selectively or permanently. |
|
114 | + |
|
115 | +In some cases an executable may exist in multiple applications, i.e. the program _fft_ exists in CCP4 **and** Tigris. A default application is already defined based on what executable would be used in the legacy environment, but the user can choose to override this selectively or permanently. |
|
111 | 116 | |
112 | 117 | You can override the default in 4 ways. They are |
113 | 118 | |
114 | 119 | 1. Command Line arguments select the application for a single command : |
115 | - **--sbapp:a <appname>** runs the executable from "appname" or |
|
116 | - **--sbapp:s** select application from a list |
|
120 | + **--sbapp:a <appname>** runs the executable from "appname" or |
|
121 | + **--sbapp:s** select application from a list |
|
117 | 122 | |
118 | -2. Environment variable of the form ```_<EXECUTABLE>```, an underscore followed by executable in UPPER CASE. e.g. ```_XIA2=dials``` will use xia2 executable from "dials". |
|
123 | +2. Environment variable of the form `_<EXECUTABLE>`, an underscore followed by executable in UPPER CASE. e.g. `_XIA2=dials` will use xia2 executable from "dials". |
|
119 | 124 | |
120 | -3. A User Config_file in *~/.sbgrid_capsule/<execname>*. e.g. echo dials > ~/.sbgrid_capsule/xia2 will uset the shell to always use the xia2 from "dials" |
|
125 | +3. A User Config*file in *~/.sbgrid*capsule/<execname>*. e.g. echo dials > ~/.sbgrid_capsule/xia2 will uset the shell to always use the xia2 from "dials" |
|
121 | 126 | |
122 | -4. A localsite file in *${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname* |
|
127 | +4. A localsite file in _${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname_ |
|
123 | 128 | |
124 | 129 | <a name="usage-capsule-environment-for-sbgrid_managing-duplicate-userpath"></a> |
130 | + |
|
125 | 131 | ### Managing Duplicate with userpath |
126 | 132 | |
127 | -Sometimes a duplicate occurs with an executable that is outside of the SBGrid or BioGrids software tree. For example xterm on x86_64-linux is provided by sbgrid and usually provided by the operating system. A user may use the "userpath" directive to select the one that is accessible from the PATH prior to sourcing the SBGrid/BioGrids environment. |
|
133 | +Sometimes a duplicate occurs with an executable that is outside of the SBGrid or BioGrids software tree. For example xterm on x86_64-linux is provided by sbgrid and usually provided by the operating system. A user may use the "userpath" directive to select the one that is accessible from the PATH prior to sourcing the SBGrid/BioGrids environment. |
|
128 | 134 | |
129 | 135 | 1. Command Line arguments select the application for a single command : |
130 | - **--sbapp:s** select application from a list |
|
131 | - |
|
132 | -2. Environment variable of the form ```_<EXECUTABLE>```, an underscore followed by executable in UPPER CASE. e.g. ```_XTERM=userpath``` will use xterm from the user's original path. |
|
136 | + **--sbapp:s** select application from a list |
|
133 | 137 | |
134 | -3. A User Config_file in *~/.sbgrid_capsule/<execname>*. e.g. ```echo userpath > ~/.sbgrid_capsule/xterm ``` will set the SBGrid/BioGrids shells to always use the user's path. |
|
138 | +2. Environment variable of the form `_<EXECUTABLE>`, an underscore followed by executable in UPPER CASE. e.g. `_XTERM=userpath` will use xterm from the user's original path. |
|
135 | 139 | |
136 | -4. A localsite file in *${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname* |
|
140 | +3. A User Config*file in *~/.sbgrid*capsule/<execname>*. e.g. `echo userpath > ~/.sbgrid_capsule/xterm ` will set the SBGrid/BioGrids shells to always use the user's path. |
|
137 | 141 | |
142 | +4. A localsite file in _${SB_BASE}/local/capsule/${SB_ARCH}/defaults/execname_ |
|
138 | 143 | |
139 | 144 | <a name="usage-capsule-environment-for-sbgrid_examples"></a> |
145 | + |
|
140 | 146 | ### EXAMPLES: |
147 | + |
|
141 | 148 | Which executable am I using? |
142 | 149 | |
143 | 150 | -bash-4.1 refine --sbwhich |
... | ... | @@ -155,10 +162,12 @@ refine is present in buster and eman. Where is the eman executable? |
155 | 162 | /programs/x86_64-linux/eman/1.9/bin/refine |
156 | 163 | |
157 | 164 | or |
165 | + |
|
158 | 166 | ``` |
159 | 167 | -bash-4.1$ env _REFINE=eman refine --sbwhich |
160 | 168 | /programs/x86_64-linux/eman/1.9/bin/refine |
161 | 169 | ``` |
170 | + |
|
162 | 171 | I'd like set the eman refine as my default version |
163 | 172 | |
164 | 173 | -bash-4.1$ echo eman > ~/.sbgrid_capsule/refine |
... | ... | @@ -177,8 +186,8 @@ List all 'refine' executables and select ( and run ) the version from buster |
177 | 186 | Please select application 1 |
178 | 187 | /programs/x86_64-linux/buster/20160324/autoBUSTER/bin/linux64/refine |
179 | 188 | |
180 | - |
|
181 | 189 | List all applications that provide xterm, select userpath, make it my default |
190 | + |
|
182 | 191 | ``` |
183 | 192 | -bash-4.1$ xterm --sbwhich |
184 | 193 | /programs/x86_64-linux/system/xterm/327/bin/xterm |
... | ... | @@ -186,10 +195,10 @@ List all applications that provide xterm, select userpath, make it my default |
186 | 195 | -bash-4.1$ xterm --sbapp:l |
187 | 196 | xterm |
188 | 197 | /usr/bin/xterm |
189 | - |
|
198 | + |
|
190 | 199 | -bash-4.1$ env _XTERM=userpath xterm --sbwhich |
191 | 200 | /usr/bin/xterm |
192 | - |
|
201 | + |
|
193 | 202 | -bash-4.1$ xterm --sbapp:s --sbwhich |
194 | 203 | 1) xterm |
195 | 204 | 2) userpath |
... | ... | @@ -201,4 +210,3 @@ List all applications that provide xterm, select userpath, make it my default |
201 | 210 | ``` |
202 | 211 | |
203 | 212 | Please report any bugs to bugs@sbgrid.org |
204 | - |
cli_v2-old.md
... | ... | @@ -1,27 +1,30 @@ |
1 | 1 | # THIS PAGE IS DEPRECATED |
2 | + |
|
2 | 3 | The information here is likey to be out of date. |
3 | 4 | |
4 | 5 | ## SBGrid command line installation manager - v2.1.2 |
5 | 6 | |
6 | -## How do I get it? |
|
7 | +## How do I get it? |
|
8 | + |
|
7 | 9 | [LINUX : sbgrid-cli_2.1.2_linux.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.1.2_linux.tar.gz) |
8 | 10 | |
9 | 11 | [macOS : sbgrid-cli_2.1.2_macos.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.1.2_macos.tar.gz) |
10 | 12 | |
11 | 13 | ## Supported OSes |
12 | -[Linux (CentOS/RHEL 7 or 8 recommended) or Apple OSX computers running MacOSX v10.13 - 10.15.](operatingsystems) |
|
13 | 14 | |
15 | +[Linux (CentOS/RHEL 7 or 8 recommended) or Apple OSX computers running MacOSX v10.13 - 10.15.](operatingsystems) |
|
14 | 16 | |
15 | -MacOS 10.15 Catalina can be used, but a work-around is required to add the /programs path. |
|
17 | +MacOS 10.15 Catalina can be used, but a work-around is required to add the /programs path. |
|
16 | 18 | See [here for more info :](catalina) |
17 | 19 | |
18 | 20 | ### Pre-installation requirements |
21 | + |
|
19 | 22 | **Admin access required on your computer.** |
20 | - The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. |
|
21 | - While admin privileges are not required to run the application, you will likely need admin privileges to create /opt/sbgrid and /programs . |
|
23 | +The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. |
|
24 | +While admin privileges are not required to run the application, you will likely need admin privileges to create /opt/sbgrid and /programs . |
|
22 | 25 | |
23 | 26 | ``` |
24 | - $ ./sbgrid-cli |
|
27 | + $ ./sbgrid-cli |
|
25 | 28 | Usage: sbgrid-cli [command] [options] |
26 | 29 | |
27 | 30 | Commands: |
... | ... | @@ -67,10 +70,12 @@ Commands: |
67 | 70 | ``` |
68 | 71 | |
69 | 72 | ## General Usage |
70 | -The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. |
|
73 | + |
|
74 | +The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. |
|
71 | 75 | Each subcommand can also take a -h or --help argument to show usage info. |
72 | 76 | |
73 | 77 | ### Activation |
78 | + |
|
74 | 79 | To install the software, you must have valid credentials provided by SBGrid. |
75 | 80 | |
76 | 81 | Activate with the 'activate' subcommand |
... | ... | @@ -88,11 +93,11 @@ Options: |
88 | 93 | -h, --help output usage information |
89 | 94 | ``` |
90 | 95 | |
91 | -Trouble activating? See Troubleshooting options further down this page. |
|
96 | +Trouble activating? See Troubleshooting options further down this page. |
|
92 | 97 | |
93 | 98 | **reactivate** |
94 | 99 | |
95 | -*reactivate* can restore from a saved config file. See below. |
|
100 | +_reactivate_ can restore from a saved config file. See below. |
|
96 | 101 | |
97 | 102 | ``` |
98 | 103 | $ ./sbgrid-cli reactivate -h |
... | ... | @@ -107,9 +112,9 @@ Options: |
107 | 112 | -h, --help output usage information |
108 | 113 | ``` |
109 | 114 | |
110 | -### Listing available titles, status |
|
115 | +### Listing available titles, status |
|
111 | 116 | |
112 | -The *sbgrid list* command will show all available titles. They are normally colored by their installation status. |
|
117 | +The _sbgrid list_ command will show all available titles. They are normally colored by their installation status. |
|
113 | 118 | Available options : |
114 | 119 | |
115 | 120 | **list** |
... | ... | @@ -130,7 +135,7 @@ Options: |
130 | 135 | |
131 | 136 | **updates** |
132 | 137 | |
133 | -Shows available updated version and titles |
|
138 | +Shows available updated version and titles |
|
134 | 139 | |
135 | 140 | ``` |
136 | 141 | ./sbgrid-cli updates |
... | ... | @@ -138,8 +143,8 @@ Shows available updated version and titles |
138 | 143 | |
139 | 144 | **obsolete** |
140 | 145 | |
141 | -Shows obsolete versions that will be removed. |
|
142 | -Obsolete versions are previously installed versions no longer included in the SBGrid installation. |
|
146 | +Shows obsolete versions that will be removed. |
|
147 | +Obsolete versions are previously installed versions no longer included in the SBGrid installation. |
|
143 | 148 | |
144 | 149 | ``` |
145 | 150 | ./sbgrid-cli obsolete |
... | ... | @@ -149,10 +154,10 @@ Obsolete versions are previously installed versions no longer included in the SB |
149 | 154 | |
150 | 155 | **info** |
151 | 156 | |
152 | -The *info* flag shows information about each title, including a description and links to documentation can be show with the *sbgrid info <title>* command. See example below. |
|
157 | +The _info_ flag shows information about each title, including a description and links to documentation can be show with the _sbgrid info <title>_ command. See example below. |
|
153 | 158 | |
154 | 159 | ``` |
155 | -Usage: info [options] [title] [otherTitles...] |
|
160 | +Usage: info [options] [title] [otherTitles...] |
|
156 | 161 | |
157 | 162 | print software title(s) metadata |
158 | 163 | |
... | ... | @@ -162,10 +167,10 @@ Options: |
162 | 167 | -h, --help output usage information |
163 | 168 | ``` |
164 | 169 | |
165 | -For example, info for RELION : |
|
170 | +For example, info for RELION : |
|
166 | 171 | |
167 | 172 | ``` |
168 | - $ ./sbgrid-cli info relion |
|
173 | + $ ./sbgrid-cli info relion |
|
169 | 174 | Fetching requested info... |
170 | 175 | ------------------------------------------------------------------------------------ |
171 | 176 | Package information for relion (i386-mac): |
... | ... | @@ -190,22 +195,22 @@ Description: |
190 | 195 | (REgularised LIkelihood OptimisatioN) a stand-alone computer program for Maximum A Posteriori (MAP) refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy. |
191 | 196 | |
192 | 197 | Technical notes: |
193 | -**GPU-accelerated RELION : ** RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux. |
|
198 | +**GPU-accelerated RELION : ** RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux. |
|
194 | 199 | For general information on running GPU accelerated applications from SBGrid, please see here : https://sbgrid.org/wiki/gpu</a> |
195 | 200 | |
196 | -CUDA builds of RELION are designated by a '_cu<cuda_version>' suffix in the version of the application. |
|
197 | -For example, 2.0.4_cu7.5 is linked against CUDA v7.5 libraries and is not recommended for Pascal architecture Nvidia hardware (GTX 1080 and higher). 2.0.4_cu8.0 is built with CUDA 8.0 which supports Pascal architecture GPUs. The '_SP' designation indicates 'single precision' CPU builds. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware. |
|
201 | +CUDA builds of RELION are designated by a '_cu<cuda_version>' suffix in the version of the application. |
|
202 | +For example, 2.0.4_cu7.5 is linked against CUDA v7.5 libraries and is not recommended for Pascal architecture Nvidia hardware (GTX 1080 and higher). 2.0.4_cu8.0 is built with CUDA 8.0 which supports Pascal architecture GPUs. The '_SP' designation indicates 'single precision' CPU builds. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware. |
|
198 | 203 | |
199 | 204 | **RELION and MPI : ** |
200 | 205 | RELION uses the 'mpirun' executable to manage MPI ranks. SBGrid includes two OpenMPI versions, 2.1.2 (default) and 1.8.4 (legacy). |
201 | -The OpenMPI mpirun executable must match the version of OpenMPI used to build RELION. |
|
202 | -For example, RELION versions 2.1_cu*.0 use OpenMPI version 2.1.2 and must use mpirun from 2.1.2. |
|
206 | +The OpenMPI mpirun executable must match the version of OpenMPI used to build RELION. |
|
207 | +For example, RELION versions 2.1_cu*.0 use OpenMPI version 2.1.2 and must use mpirun from 2.1.2. |
|
203 | 208 | |
204 | -Older RELION versions require an override in $HOME/.sbgrid.conf to set the older OpenMPI version to 1.8.4. Add |
|
209 | +Older RELION versions require an override in $HOME/.sbgrid.conf to set the older OpenMPI version to 1.8.4. Add |
|
205 | 210 | |
206 | 211 | OPENMPI_X=1.8.4" |
207 | 212 | |
208 | -to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun. |
|
213 | +to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun. |
|
209 | 214 | You can also use the 'mpirun.relion' executable in place of mpirun to use the MPI that matches the currently configured version of RELION. |
210 | 215 | |
211 | 216 | Links: |
... | ... | @@ -216,7 +221,7 @@ Links: |
216 | 221 | |
217 | 222 | ### Installing and removing |
218 | 223 | |
219 | -Install and remove titles with the *sbgrid install <title>* and *sbgrid remove <title>* command. Each of these commands can take multiple titles with versions at one time. |
|
224 | +Install and remove titles with the _sbgrid install <title>_ and _sbgrid remove <title>_ command. Each of these commands can take multiple titles with versions at one time. |
|
220 | 225 | |
221 | 226 | **install** |
222 | 227 | |
... | ... | @@ -236,13 +241,13 @@ Options: |
236 | 241 | |
237 | 242 | **Install examples :** |
238 | 243 | |
239 | -Install a single default version of an application : |
|
244 | +Install a single default version of an application : |
|
240 | 245 | |
241 | 246 | ``` |
242 | -./sbgrid-cli install relion |
|
247 | +./sbgrid-cli install relion |
|
243 | 248 | ``` |
244 | 249 | |
245 | -Install a specific version of a relion : |
|
250 | +Install a specific version of a relion : |
|
246 | 251 | |
247 | 252 | ``` |
248 | 253 | ./sbgrid-cli install relion@3.0.8 |
... | ... | @@ -254,7 +259,7 @@ Install all versions of relion : |
254 | 259 | ./sbgrid-cli install relion@all |
255 | 260 | ``` |
256 | 261 | |
257 | -Install the 'Electron Microscopy' collection of titles (see above *list* command to list *collections*): |
|
262 | +Install the 'Electron Microscopy' collection of titles (see above _list_ command to list _collections_): |
|
258 | 263 | |
259 | 264 | ``` |
260 | 265 | $ ./sbgrid-cli install -c 'Electron Microscopy' |
... | ... | @@ -274,7 +279,7 @@ Install all versions of all titles ( The full collection): |
274 | 279 | |
275 | 280 | **remove** |
276 | 281 | |
277 | -Same options as install flag above. |
|
282 | +Same options as install flag above. |
|
278 | 283 | |
279 | 284 | ``` |
280 | 285 | remove software title(s) |
... | ... | @@ -302,7 +307,7 @@ Updates are performed when default titles change to a new version or bugs are fi |
302 | 307 | |
303 | 308 | ### Remove obsolete titles |
304 | 309 | |
305 | -Use the obsolete flag to list or remove obsolete versions or titles |
|
310 | +Use the obsolete flag to list or remove obsolete versions or titles |
|
306 | 311 | |
307 | 312 | **obsolete** |
308 | 313 | |
... | ... | @@ -323,13 +328,13 @@ Options: |
323 | 328 | |
324 | 329 | The advanced modes perform multiple actions and are designed for automated use for a managed 'rolling release' installation. |
325 | 330 | |
326 | -**clean** |
|
331 | +**clean** |
|
327 | 332 | |
328 | 333 | Removes all obsolete software versions and titles |
329 | 334 | |
330 | -**admin** |
|
335 | +**admin** |
|
331 | 336 | |
332 | -Run periodic installation, update and removal. Installs all new titles, updates where appropriate and cleans up (removes) obsolete versions |
|
337 | +Run periodic installation, update and removal. Installs all new titles, updates where appropriate and cleans up (removes) obsolete versions |
|
333 | 338 | |
334 | 339 | ``` |
335 | 340 | Usage: admin [options] |
... | ... | @@ -342,72 +347,72 @@ Options: |
342 | 347 | -h, --help output usage information |
343 | 348 | ``` |
344 | 349 | |
345 | -For example running |
|
350 | +For example running |
|
346 | 351 | |
347 | 352 | ``` |
348 | -./sbgrid-cli admin |
|
353 | +./sbgrid-cli admin |
|
349 | 354 | ``` |
350 | 355 | |
351 | -will install all default, update all installed titles and remove all obsolete versions while |
|
356 | +will install all default, update all installed titles and remove all obsolete versions while |
|
352 | 357 | |
353 | 358 | ``` |
354 | 359 | ./sbgrid-cli admin -a |
355 | 360 | ``` |
356 | 361 | |
357 | -will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions. |
|
362 | +will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions. |
|
358 | 363 | This |
359 | 364 | |
365 | +**rebuild** |
|
360 | 366 | |
361 | -**rebuild** |
|
362 | - |
|
363 | -*rebuild* rebuilds the installation environment configuration files. |
|
367 | +_rebuild_ rebuilds the installation environment configuration files. |
|
364 | 368 | |
365 | -**crontab** |
|
369 | +**crontab** |
|
366 | 370 | |
367 | -Writes a basic script for crontab for *admin* functionality |
|
371 | +Writes a basic script for crontab for _admin_ functionality |
|
368 | 372 | |
369 | 373 | **save** |
370 | 374 | |
371 | -The *save* flag saves the current configuration so it can be restored at a later stage or replicated on another machine (or in the cloud). |
|
372 | - |
|
375 | +The _save_ flag saves the current configuration so it can be restored at a later stage or replicated on another machine (or in the cloud). |
|
373 | 376 | |
374 | 377 | ## Troubleshooting and diagnostics |
375 | 378 | |
376 | -**check-connection** |
|
379 | +**check-connection** |
|
377 | 380 | connectivity checks |
378 | 381 | |
379 | -**diag** |
|
382 | +**diag** |
|
380 | 383 | troubleshooting and diagnostics |
381 | 384 | |
382 | -**verify** |
|
385 | +**verify** |
|
383 | 386 | list missing software versions and .rc files |
384 | 387 | |
385 | 388 | ## Installing software for multiple platforms |
386 | 389 | |
387 | -On linux, add the --darwin command to install / remove for macOS . |
|
388 | -Conversely, use the --linux command to install / remove for Linux while on macOS. |
|
390 | +On linux, add the --darwin command to install / remove for macOS . |
|
391 | +Conversely, use the --linux command to install / remove for Linux while on macOS. |
|
389 | 392 | |
390 | 393 | ``` |
391 | 394 | --linux specify linux as platform |
392 | 395 | --darwin specify macOS as platform |
393 | 396 | ``` |
394 | -The platform flag is implied for the platform used to install the software. |
|
395 | 397 | |
398 | +The platform flag is implied for the platform used to install the software. |
|
396 | 399 | |
397 | 400 | ### Software Version Management in the SBGrid environment |
401 | + |
|
398 | 402 | If you have a single version of an application installed, explicit version selection in your environment is not needed. |
399 | 403 | |
400 | -In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*. This is standard for the SBGrid software environment. |
|
404 | +In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when it is installed, unless configured otherwise in _~/.sbgrid.conf_. This is standard for the SBGrid software environment. |
|
401 | 405 | |
402 | -In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment. |
|
406 | +In the case of multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file. This is the same as in the standard SBGrid environment. |
|
403 | 407 | |
404 | 408 | **Version priority in the shell** |
405 | - 1. *~/.sbgrid.conf* |
|
406 | - 2. Installed single version |
|
407 | - 3. Installed Default version |
|
408 | - 4. Latest installed release |
|
409 | 409 | |
410 | -There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
410 | +1. _~/.sbgrid.conf_ |
|
411 | +2. Installed single version |
|
412 | +3. Installed Default version |
|
413 | +4. Latest installed release |
|
414 | + |
|
415 | +There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
411 | 416 | |
412 | 417 | ### Running SBGrid software |
413 | 418 | |
... | ... | @@ -421,6 +426,6 @@ or in tcsh |
421 | 426 | |
422 | 427 | ### Known Issues |
423 | 428 | |
424 | -* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
429 | +- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
425 | 430 | |
426 | 431 | For help or to report issues, please email *bugs@sbgrid.org.* |
client_CLI_install-old.md
... | ... | @@ -1,28 +1,33 @@ |
1 | 1 | # THIS PAGE IS DEPRECATED |
2 | + |
|
2 | 3 | The information here is likey to be out of date. |
4 | +See [sbgrid-cli V2](cli_v2) |
|
3 | 5 | |
4 | 6 | ## SBGrid command line installation manager |
5 | 7 | |
8 | +- [THIS PAGE IS DEPRECATED](#this-page-is-deprecated) |
|
9 | + - [SBGrid command line installation manager](#sbgrid-command-line-installation-manager) |
|
6 | 10 | - [Installation](#installation) |
7 | - - [Pre-installation requirements](#installation_pre-installation-requirements) |
|
8 | - - [Binary releases : MacOS and Linux Installation](#installation_binary-releases) |
|
9 | - - [Installation on an external drive or USB key](#installation_installation-on-an-external-drive-or-usb-key) |
|
11 | + - [Pre-installation requirements](#pre-installation-requirements) |
|
12 | + - [Binary releases](#binary-releases) |
|
13 | + - [Installation on an external drive or USB key](#installation-on-an-external-drive-or-usb-key) |
|
10 | 14 | - [General Usage](#general-usage) |
11 | - - [Activation](#general-usage_activation) |
|
12 | - - [Listing available titles](#general-usage_listing-available-titles) |
|
13 | - - [Getting Information](#general-getting-information-about-titles) |
|
14 | - - [Installing and Removing Titles](#general-usage_installing-and-removing) |
|
15 | - - [Updating packages](#general-usage_updating-titles) |
|
16 | - - [Example : Installing Albula](#general-usage_example-installing-albula) |
|
17 | - - [Example : Removing Albula](#general-usage_example-removing-albula) |
|
18 | - - [Version selection](#general-usage_version-selection) |
|
19 | - - [Software Version Management in the SBGrid environment](#general-usage_software-version-management-in-the-sbgrid-environment) |
|
20 | - - [Running SBGrid software](#general-usage_running-sbgrid-software) |
|
21 | - - [Known Issues](#general-usage_known-issues) |
|
15 | + - [Activation](#activation) |
|
16 | + - [Listing available titles](#listing-available-titles) |
|
17 | + - [Getting Information about titles](#getting-information-about-titles) |
|
18 | + - [Installing and removing](#installing-and-removing) |
|
19 | + - [Updating titles](#updating-titles) |
|
20 | + - [Example : Installing Albula](#example--installing-albula) |
|
21 | + - [Example : Removing Albula](#example--removing-albula) |
|
22 | + - [Version selection](#version-selection) |
|
23 | + - [Software Version Management in the SBGrid environment](#software-version-management-in-the-sbgrid-environment) |
|
24 | + - [Running SBGrid software](#running-sbgrid-software) |
|
25 | + - [Known Issues](#known-issues) |
|
22 | 26 | |
23 | 27 | ## Installation |
28 | + |
|
24 | 29 | The SBGrid software stack can be installed using our command line program for [Linux (CentOS/RHEL 7 or 8 recommended) or Apple OSX computers running MacOSX v10.13 - 10.15.](operatingsystems) |
25 | -CentOS 6 is no longer supported. |
|
30 | +CentOS 6 is no longer supported. |
|
26 | 31 | |
27 | 32 | Two software installers are available. Binary releases are available for MacOS and CentOS operating systems. |
28 | 33 | |
... | ... | @@ -31,19 +36,21 @@ The SBGrid installation manager requires an individual account. To get started, |
31 | 36 | **Check out [Jason Key's presentation on SBGrid installation tools](https://www.youtube.com/watch?v=sAxIzWhWX5o&t=1s)** |
32 | 37 | |
33 | 38 | ### Pre-installation requirements |
39 | + |
|
34 | 40 | **Admin access required on your computer.** |
35 | - The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. While admin privileges are not required to run the application, you will need admin privileges to create /opt/sbgrid and /programs. The install manager currently relies on 'sudo' for these tasks and should in installed from an account with sudo privileges. While not strictly required, we recommend a dedicated 'sbgrid' user account for software management. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and possibly inadvertantly deleted by software updates. |
|
41 | +The SBGrid installation manager will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. While admin privileges are not required to run the application, you will need admin privileges to create /opt/sbgrid and /programs. The install manager currently relies on 'sudo' for these tasks and should in installed from an account with sudo privileges. While not strictly required, we recommend a dedicated 'sbgrid' user account for software management. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and possibly inadvertantly deleted by software updates. |
|
36 | 42 | |
37 | 43 | **Existing SBGrid installations must be renamed or removed.** |
38 | - If you have previously installed SBGrid software on your computer at /programs or at /opt/sbgrid, these directories should be removed or renamed. The manager will create these on first run. |
|
44 | +If you have previously installed SBGrid software on your computer at /programs or at /opt/sbgrid, these directories should be removed or renamed. The manager will create these on first run. |
|
39 | 45 | |
40 | 46 | **Hard Drive Space** |
41 | - Depending on what you install, ensure you have enough free hard drive space on your machine. |
|
47 | +Depending on what you install, ensure you have enough free hard drive space on your machine. |
|
42 | 48 | |
43 | -**For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.** |
|
44 | - Some packages are quite large and can be slow to download, especially over WiFi. |
|
49 | +**For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.** |
|
50 | +Some packages are quite large and can be slow to download, especially over WiFi. |
|
45 | 51 | |
46 | 52 | ### Binary releases |
53 | + |
|
47 | 54 | Binary releases of the install manager are recommended - there is minimal installation needed for these binaries and they can be run from any location with no dependencies. Untar the archive, make the file executable if necessary, and run from your preferred location. |
48 | 55 | |
49 | 56 | [Mac : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Darwin.tgz) |
... | ... | @@ -98,23 +105,25 @@ sbgrid: error: too few arguments |
98 | 105 | ``` |
99 | 106 | |
100 | 107 | ### Installation on an external drive or USB key |
108 | + |
|
101 | 109 | Currently the installer application installs the software tree in /opt/sbgrid and uses a symlink at /programs. This link is required for the software to work, but in principle the software can be located anywhere and linked to /opt/sbgrid. This functionality is not yet included in the SBGrid application, but can be set up manually with a symlink. |
102 | 110 | |
103 | 111 | An installation can be made on an external drive if you first do an install (into /opt/sbgrid), then move it and symlink to the new location. |
104 | 112 | |
105 | -**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is */Volumes/sbgrid_installation*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application. |
|
113 | +**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is _/Volumes/sbgrid_installation_. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application. |
|
106 | 114 | |
107 | -Next move */opt/sbgrid* to the USB key at */Volumes/sbgrid_installation*. You will likely need sudo for this. |
|
115 | +Next move _/opt/sbgrid_ to the USB key at _/Volumes/sbgrid_installation_. You will likely need sudo for this. |
|
108 | 116 | |
109 | 117 | $ sudo mv /opt/sbgrid /Volumes/sbgrid_installation/. |
110 | 118 | |
111 | -Now we have */Volumes/sbgrid_installation/sbgrid*. Create a symlink from */opt/sbgrid* to */Volumes/sbgrid_installation/sbgrid*. |
|
119 | +Now we have _/Volumes/sbgrid_installation/sbgrid_. Create a symlink from _/opt/sbgrid_ to _/Volumes/sbgrid_installation/sbgrid_. |
|
112 | 120 | |
113 | 121 | $ sudo ln -s /Volumes/sbgrid_installation/sbgrid /opt/sbgrid |
114 | 122 | |
115 | -The symlink at */programs* still points to */opt/sbgrid*, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive. |
|
123 | +The symlink at _/programs_ still points to _/opt/sbgrid_, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive. |
|
116 | 124 | |
117 | 125 | ## General Usage |
126 | + |
|
118 | 127 | The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example, the 'install' subcommand can take several arguments : |
119 | 128 | |
120 | 129 | ``` |
... | ... | @@ -132,9 +141,11 @@ optional arguments: |
132 | 141 | ``` |
133 | 142 | |
134 | 143 | ### Activation |
144 | + |
|
135 | 145 | To install the software, you must have valid credentials provided by SBGrid. |
136 | 146 | |
137 | 147 | Activate with the 'activate' subcommand |
148 | + |
|
138 | 149 | ``` |
139 | 150 | usage: sbgrid activate [-h] [--multibranch] site user key |
140 | 151 | |
... | ... | @@ -151,18 +162,18 @@ optional arguments: |
151 | 162 | |
152 | 163 | ``` |
153 | 164 | |
154 | -The *--multibranch* option allows for installation of Linux or Mac software on server that should host both platforms, usually for access of NFS. This must be set at activation. Once set, Linux and Mac titles will be installed. |
|
165 | +The _--multibranch_ option allows for installation of Linux or Mac software on server that should host both platforms, usually for access of NFS. This must be set at activation. Once set, Linux and Mac titles will be installed. |
|
155 | 166 | |
156 | 167 | ### Listing available titles |
157 | 168 | |
158 | -The *sbgrid list* command will show all available titles colored by their installation status. Installed titles are green, those with available updates are blue, and titles to be removed are red. Software is listed by 'Collection'. |
|
169 | +The _sbgrid list_ command will show all available titles colored by their installation status. Installed titles are green, those with available updates are blue, and titles to be removed are red. Software is listed by 'Collection'. |
|
159 | 170 | |
160 | 171 | ``` |
161 | 172 | $ ./sbgrid list |
162 | 173 | -- Crystallography ------------------------------------------------------------------------------------------------------------------------- |
163 | 174 | 3dna eden pdb_redo solveresolve |
164 | 175 | adxv eiger2cbf pdb-validation-suite somore |
165 | -albula elves |
|
176 | +albula elves |
|
166 | 177 | ... |
167 | 178 | -- NMR ------------------------------------------------------------------------------------------------------------------------------------- |
168 | 179 | aqua gamma nmrview remediator |
... | ... | @@ -184,11 +195,11 @@ crop relion |
184 | 195 | |
185 | 196 | ### Getting Information about titles |
186 | 197 | |
187 | -Information about each title, including a description and links to documentation can be show with the *sbgrid info <title>* command. See example below. |
|
198 | +Information about each title, including a description and links to documentation can be show with the _sbgrid info <title>_ command. See example below. |
|
188 | 199 | |
189 | 200 | ### Installing and removing |
190 | 201 | |
191 | -Install and remove titles with the *sbgrid install <title>* and *sbgrid remove <title>* command. Each of these commands can take multiple titles with versions at one time. |
|
202 | +Install and remove titles with the _sbgrid install <title>_ and _sbgrid remove <title>_ command. Each of these commands can take multiple titles with versions at one time. |
|
192 | 203 | |
193 | 204 | ``` |
194 | 205 | $ ./sbgrid info epmr |
... | ... | @@ -213,6 +224,7 @@ Links: |
213 | 224 | Manual: http://www.epmr.info/UsersGuide.html |
214 | 225 | |
215 | 226 | ``` |
227 | + |
|
216 | 228 | ``` |
217 | 229 | $ ./sbgrid info adxv |
218 | 230 | Package: adxv |
... | ... | @@ -241,6 +253,7 @@ Links: |
241 | 253 | Website: http://www.scripps.edu/tainer/arvai/adxv.html |
242 | 254 | Manual: http://www.scripps.edu/tainer/arvai/adxv/AdxvUserManual.pdf |
243 | 255 | ``` |
256 | + |
|
244 | 257 | ``` |
245 | 258 | $ ./sbgrid install adxv epmr epmr@16.01 |
246 | 259 | adxv@1.9.12 installed |
... | ... | @@ -249,11 +262,12 @@ epmr@16.01 installed |
249 | 262 | Updating installation configuration... |
250 | 263 | |
251 | 264 | ``` |
265 | + |
|
252 | 266 | When a version string is not specified, the default version is installed or removed. |
253 | 267 | |
254 | 268 | ### Updating titles |
255 | 269 | |
256 | -Show titles with a pending update with the *sbgrid updates* command. Updates can be applied with the *sbgrid update <title>* or *sbgrid update-all* commands. |
|
270 | +Show titles with a pending update with the _sbgrid updates_ command. Updates can be applied with the _sbgrid update <title>_ or _sbgrid update-all_ commands. |
|
257 | 271 | |
258 | 272 | ### Example : Installing Albula |
259 | 273 | |
... | ... | @@ -325,7 +339,7 @@ Package removed! |
325 | 339 | |
326 | 340 | Default versions are installed by default for each application, though individual versions can be selected for each title. |
327 | 341 | |
328 | -To do so, include the version after the title followed the version. To see what versions are available, use the *sbgrid info <title>* command. Let;s us the title epmr as an example here: |
|
342 | +To do so, include the version after the title followed the version. To see what versions are available, use the _sbgrid info <title>_ command. Let;s us the title epmr as an example here: |
|
329 | 343 | |
330 | 344 | $ sbgrid info epmr |
331 | 345 | |
... | ... | @@ -386,9 +400,10 @@ Available versions: |
386 | 400 | |
387 | 401 | ``` |
388 | 402 | |
389 | -Confirm with the *sbwhich* command |
|
403 | +Confirm with the _sbwhich_ command |
|
390 | 404 | |
391 | 405 | $ sbwhich epmr |
406 | + |
|
392 | 407 | ``` |
393 | 408 | /programs/i386-mac/epmr/11.02/epmr |
394 | 409 | ``` |
... | ... | @@ -396,19 +411,21 @@ Confirm with the *sbwhich* command |
396 | 411 | Reload the sbgrid shell to use the new version ( or set the environment variable EPMR_M=11.02 ). |
397 | 412 | |
398 | 413 | ### Software Version Management in the SBGrid environment |
414 | + |
|
399 | 415 | If you have a single version of an application installed, explicit version selection in your environment is not needed. |
400 | 416 | |
401 | -In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*. |
|
417 | +In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when it is installed, unless configured otherwise in _~/.sbgrid.conf_. |
|
402 | 418 | |
403 | -In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment. |
|
419 | +In the case of multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file. This is the same as in the standard SBGrid environment. |
|
404 | 420 | |
405 | 421 | **Version priority in the shell** |
406 | - 1. *~/.sbgrid.conf* |
|
407 | - 2. Installed single version |
|
408 | - 3. Installed Default version |
|
409 | - 4. Latest installed release |
|
410 | 422 | |
411 | -There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
423 | +1. _~/.sbgrid.conf_ |
|
424 | +2. Installed single version |
|
425 | +3. Installed Default version |
|
426 | +4. Latest installed release |
|
427 | + |
|
428 | +There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
412 | 429 | |
413 | 430 | ### Running SBGrid software |
414 | 431 | |
... | ... | @@ -420,9 +437,8 @@ or in tcsh |
420 | 437 | |
421 | 438 | $ source /programs/sbgrid.cshrc |
422 | 439 | |
423 | - |
|
424 | 440 | ### Known Issues |
425 | 441 | |
426 | -* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
442 | +- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
427 | 443 | |
428 | 444 | For help, email *bugs@sbgrid.org.* |
client_downloads.md
... | ... | @@ -1,41 +1,58 @@ |
1 | +## SBGrid Installation Manager - Downloads |
|
1 | 2 | |
2 | -## SBGrid installation manager |
|
3 | +<!-- TOC --> |
|
3 | 4 | |
4 | -### MacOS Graphical installation manager |
|
5 | -![SBGrid](images/thumbnail_gui.png) |
|
5 | +- [SBGrid Installation Manager - Downloads](#sbgrid-installation-manager---downloads) |
|
6 | + - [Requirements](#requirements) |
|
7 | + - [SBGrid Installation Manager for MacOS and Linux, v2.2.11](#sbgrid-installation-manager-for-macos-and-linux-v2211) |
|
8 | + - [SBGrid Command-line Installation Manager for MacOS and Linux, v2.2.11](#sbgrid-command-line-installation-manager-for-macos-and-linux-v2211) |
|
9 | + - [LEGACY command line installation manager for MacOS and Linux, v1.0.695](#legacy-command-line-installation-manager-for-macos-and-linux-v10695) |
|
10 | + - [Legacy MacOS Graphical installation manager](#legacy-macos-graphical-installation-manager) |
|
6 | 11 | |
7 | -[Latest build : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg) |
|
12 | +<!-- /TOC --> |
|
8 | 13 | |
9 | -This is our original GUI manager for MacOS. |
|
10 | -See [this page](client_install) for additional installation and usage info. |
|
14 | +### Requirements |
|
11 | 15 | |
12 | -To install, first mount the .dmg disk image on your Mac. Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired. |
|
16 | +SBGrid can be installed on computers running Linux or macOS operating systems. [CentOS/RHEL 7 or 8 is recommended for linux, or MacOSX v10.13 - macOS 11.0 for Macs.](operatingsystems). CentOS 6 has reached "End-of-Life" and is no longer supported. macOS 10.15 "Catalina" and macOS 11.0 "Big Sur" can be used, but an `/etc/syntetic.conf` file is required to create the `/programs` path. The GUI Installation Manager will create this for you. See [here for more info :](catalina) |
|
13 | 17 | |
14 | -You may be prompted that the appication is from an "Unidentified Developer". On MacOS, if you try to open an app that is not signed by an Apple-registered developer, you will be prompted by a warning dialog. This doesn’t necessarily mean that something’s wrong with the app. Some apps were written by developers who are not members of the Apple developers program. |
|
18 | +The SBGrid installation manager requires an account. Set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/) |
|
19 | + |
|
20 | +### SBGrid Installation Manager for MacOS and Linux, v2.2.11 |
|
21 | + |
|
22 | +- [Linux : SBGrid_Installation_Manager-2.2.11.AppImage](https://sbgrid.org/wiki/downloads/SBGrid_Installation_Manager-2.2.11.AppImage) |
|
23 | + |
|
24 | +- [macOS : SBGrid_Installation_Manager-2.2.11.dmg](https://sbgrid.org/wiki/downloads/SBGrid_Installation_Manager-2.2.11.dmg) |
|
25 | + |
|
26 | +See [this page](client_usage) for usage info. |
|
27 | + |
|
28 | +### SBGrid Command-line Installation Manager for MacOS and Linux, v2.2.11 |
|
15 | 29 | |
16 | -### Command line manager for MacOS and Linux, v2.1.2 |
|
30 | +- [Linux : sbgrid-cli_2.2.11_linux.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.11_linux.tar.gz) |
|
17 | 31 | |
18 | -[macOS : 2.1.2, 2020-05-31](downloads/sbgrid-cli_2.1.2_macos.tar.gz) |
|
32 | +- [macOS : sbgrid-cli_2.2.11_macos.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.11_macos.tar.gz) |
|
19 | 33 | |
20 | -[Linux : 2.1.2, 2020-05-31](downloads/sbgrid-cli_2.1.2_linux.tar.gz) |
|
34 | +See [this page](cli_v2) for usage info. |
|
21 | 35 | |
22 | -This is the new command line application with advanced features. |
|
23 | -See [this page](cli_v2) for usage info. |
|
36 | +--- |
|
24 | 37 | |
25 | -### Command line manager for MacOS and Linux, v1.0.695 |
|
38 | +### LEGACY command line installation manager for MacOS and Linux, v1.0.695 |
|
26 | 39 | |
27 | -[macOS : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Darwin.tgz) |
|
40 | +- [macOS : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Darwin.tgz) |
|
28 | 41 | |
29 | -[Linux : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Linux.tgz) |
|
42 | +- [Linux : 1.0.695, 2020-05-31](downloads/sbgrid-1.0.695-Linux.tgz) |
|
30 | 43 | |
31 | -This is the original SBGrid CLI install manager. |
|
32 | -[More info can be found here](client_CLI_usage). |
|
44 | +This is the original SBGrid CLI installation manager. This version is deprecated and is no longer supported. |
|
33 | 45 | |
34 | -Minimal installation required for these binaries and they can be run from any location with no dependencies. |
|
35 | -Untar the archive, make the file executable if necessary and run from your preferred location. |
|
46 | +Minimal installation required for these binaries and they can be run from any location with no dependencies. Untar the archive, make the file executable if necessary and run from your preferred location. |
|
36 | 47 | |
37 | -### GUI manager 2.0 for MacOS and Linux |
|
48 | +### Legacy MacOS Graphical installation manager |
|
38 | 49 | |
39 | -Coming in 2021! |
|
40 | -Interested in beta testing? Email bugs@sbgrid.org |
|
41 | -![SBGrid](images/new_client_thumb.png) |
|
50 | +- [macOS : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg) |
|
51 | + |
|
52 | +This is our original GUI manager for MacOS. Usage is deprecated and is no longer supported. See [this page](client_install_legacy) for additional installation and usage info. |
|
53 | + |
|
54 | +![SBGrid](images/thumbnail_gui.png) |
|
55 | + |
|
56 | +To install, first mount the .dmg disk image on your Mac. Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired. |
|
57 | + |
|
58 | +You may be prompted that the appication is from an "Unidentified Developer". On MacOS, if you try to open an app that is not signed by an Apple-registered developer, you will be prompted by a warning dialog. This doesn’t necessarily mean that something’s wrong with the app. Some apps were written by developers who are not members of the Apple developers program. |
client_install.md
... | ... | @@ -1,166 +1,80 @@ |
1 | -## SBGrid installation manager |
|
1 | +## SBGrid Installation Manager GUI : Installation and Usage |
|
2 | 2 | |
3 | -The SBGrid installation manager is available as command-line tool for macOS and Linux, and as a graphical application for macOS. The command-line and graphical versions are not mutually exclusive - they can be used interchangeably on mac. |
|
3 | +This page covers the usage of the installation manager graphical user interface (GUI). This application is available for Linux and macOS computers. For more information on our latest command-line interface (CLI) installation manager, [see here](sbgrid-cli). Latest versions are [available for download here](client_downloads.md) |
|
4 | 4 | |
5 | -For the latest command-line application, [see here](sbgrid-cli). |
|
6 | -For the graphical version, see below. |
|
5 | +<!-- TOC --> |
|
7 | 6 | |
8 | -**NOTE for BIOGRIDS users** - [ Instructions for BioGrids installation can be found here ](https://biogrids.org/wiki/client_install). BioGrids is a scientific software collection focused on Bioinformatics tools. It is distinct from SBGrid which is focused on structural biology applications. Please see here for more info : [biogrids.org](https://biogrids.org). |
|
7 | +- [SBGrid Installation Manager GUI : Installation and Usage](#sbgrid-installation-manager-gui--installation-and-usage) |
|
8 | + - [Requirements and recommendations](#requirements-and-recommendations) |
|
9 | + - [Activation](#activation) |
|
10 | + - [GUI Home Pane](#gui-home-pane) |
|
11 | + - [Installed Pane](#installed-pane) |
|
12 | + - [Programs Pane](#programs-pane) |
|
13 | + - [Tasks Pane](#tasks-pane) |
|
14 | + - [Installing, Upgrading and Removing software](#installing-upgrading-and-removing-software) |
|
15 | + - [Docs and Contact Panes](#docs-and-contact-panes) |
|
9 | 16 | |
10 | -![](images/client_all.png) |
|
17 | +<!-- /TOC --> |
|
11 | 18 | |
12 | -Looking to get started with the SBGrid installation manager? First, set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/) |
|
19 | +### Requirements and recommendations |
|
13 | 20 | |
14 | - - [Installation](#installation) |
|
15 | - - [Pre-installation](#installation_pre-installation) |
|
16 | - - [Download, Installation and Activation](#installation_download-installation-and-activation) |
|
17 | - - [Installation on an external drive or USB key](#installation_installation-on-an-external-drive-or-usb-key) |
|
18 | - - [Usage](#usage) |
|
19 | - - [General](#usage_general) |
|
20 | - - [Example : Installing Albula](#usage_example-installing-albula) |
|
21 | - - [Example : Removing Albula](#usage_example-removing-albula) |
|
22 | - - [Version selection](#usage_version-selection) |
|
23 | - - [Versions and the SBGrid environment](#usage_versions-and-the-sbgrid-environment) |
|
24 | - - [Running the software](#usage_running-the-software) |
|
25 | - - [Questions, Problems and Known Issues](#usage-questions-problems-and-known-issues) |
|
21 | +The SBGrid installation manager will install the software collection to `/opt/sbgrid` by default. A symlink from `/programs` to the installation directory is required and this step does require admin priveleges. **Admin privileges are not required to run the applications**, only for the initial installation, specifically the creation of /opt/sbgrid and for `/programs` (required). |
|
26 | 22 | |
27 | -## Installation |
|
23 | +The Installation Manger uses 'sudo' for priveleged installation tasks. As such, it should be used from an account with sudo privileges if this functionality is desired. This is the default for admin accouunts on macOS. |
|
28 | 24 | |
29 | -### Pre-installation |
|
25 | +The SBGrid installation manager requires an account with the SBGrid Consortium. If your lab or institution is a consortium member, you can set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/) |
|
30 | 26 | |
31 | -**1. Admin access required.** |
|
32 | - The SBGrid installation manager will install the software tree to */opt/sbgrid* and create a symlink from this directory to */programs*. While admin privileges are not required to run the application, you will need admin privileges to create */opt/sbgrid* and */programs* . |
|
27 | +The SBGrid installation manager is available in graphical and command-line flavors for macOS and Linux. The command-line and graphical versions are interchange and can be used for the same installation. You can find both of these on the [Download page here](client_downloads). The `sbgrid-cli` command-line version provides advanced configuration features not included the GUI release. |
|
33 | 28 | |
34 | -**2. Existing installations must be renamed or removed.** |
|
35 | - If you have previously installed SBGrid software on your computer at */programs* or at */opt/sbgrid*, these directories should be removed or renamed. The manager will create these on first run. |
|
29 | +### Activation |
|
36 | 30 | |
37 | -**3. Hard Drive Space** |
|
38 | - Depending on what you install, ensure that you have enough free hard drive space on your machine. |
|
31 | +The first step to install the SBGrid software is to activate an account. This only has to be done one time per installation. You won't need to enter credentials after this step. |
|
39 | 32 | |
40 | -**4. XQuartz is required for many graphical applications on MacOS.** |
|
41 | - To use many of the graphical applications (COOT, CCP4, nmrDraw, etc), install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/). |
|
33 | +![](images/GUI-v2-1-activation.png) |
|
34 | +Enter credentials and click the "Activate" button. You will be presented with confirmation dialogs to set up the installation. |
|
42 | 35 | |
43 | -**5. For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.** |
|
44 | - Some packages are quite large and can be slow to download, especially over WiFi. |
|
36 | +On macOS, you will see : |
|
37 | +![](images/GUI-v2-1-priv.png) |
|
38 | +This permission is only needed to create `/opt/sbgrid` |
|
45 | 39 | |
40 | +![](images/GUI-v2-2-synthetic.png) |
|
41 | +A `/etc/synthetic.conf` is required to create the root-level symlink to `/programs` on macOS. A reboot is required after installation. |
|
46 | 42 | |
47 | -### Download, Installation and activation |
|
43 | +### GUI Home Pane |
|
48 | 44 | |
49 | -For macOS Catalina (10.15 and later), a work-around is required for installation. Please see [this page for more info](catalina). |
|
50 | -For 10.14 "Mojave" and earlier, this step is not required. |
|
45 | +![](images/GUI-v2-3-home.png) |
|
46 | +This is the home page of the Installation Manager. it features a list of new and updated software, SBGrid News ( Upcoming webinars, events and member tales). The panel left allows the user to select from 6 different panes for managing software. Those a described below. |
|
51 | 47 | |
52 | -**1. Download the latest SBGrid installation manager from here.** |
|
48 | +### Installed Pane |
|
53 | 49 | |
54 | - [Latest build : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg) |
|
50 | +The `Installed` button changes to the installed software pane. |
|
51 | +![](images/GUI-v2-4-installed.png) |
|
52 | +This window (above) shows installed titles. In this case, only the base installation is present - the SBGrid Installer is the only title installed. |
|
55 | 53 | |
56 | -**2. Mount the .dmg disk image on your Mac.** Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired. |
|
54 | +![](images/GUI-v2-4.5-infopane.png) |
|
55 | +By clicking the title text, a window pane reveals the details of the installed title. |
|
57 | 56 | |
58 | -You may be prompted to that the appication is from an "Unidentified Developer". If you try to open an app that is not signed by an Apple-registered developer, you this a warning dialog. This doesn’t necessarily mean that something’s wrong with the app, some apps were written by developers who are not members of the Apple developers program. |
|
57 | +### Programs Pane |
|
59 | 58 | |
60 | -**3. Enter your site, user name, and key.** You should have received these by email. |
|
59 | +![](images/GUI-v2-5-programs.png) |
|
60 | +The programs pane shows all available programs. Software can be added/removed upgraded from this pane. These operations are queued in the task list. |
|
61 | 61 | |
62 | -![activation](images/client_activation.png) |
|
62 | +![](images/GUI-v2-6-addedtask.png) |
|
63 | 63 | |
64 | -On activation you will be prompted to provide admin credentials for your mac. This is to create the */opt/sbgrid* directory and */programs* symlink. |
|
64 | +### Tasks Pane |
|
65 | 65 | |
66 | -![activation](images/client_permissions.png) |
|
66 | +All operations are added to the task list and wil be queud for execution. These can be removed if needed. |
|
67 | 67 | |
68 | -**4. On successful activation, you should see the manager populate with software titles.** If not, please close the application and try again. If activation continues to fail, you may have an old SBGrid installation at */programs* or */opt/sbgrid*. These should be removed. You may also be blocked from accessing SBGrid servers on port 873 and port 8080 by your institution's firewall. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
69 | -For help, email *bugs@sbgrid.org.* |
|
68 | +![](images/GUI-v2-7-tasklist.png) |
|
69 | +Before tasks are applied, they are listed as "pending". |
|
70 | 70 | |
71 | -### Installation on an external drive or USB key |
|
72 | -Currently the installer application installs the software tree in */opt/sbgrid* and uses a symlink at */programs*. The */programs* link is required for the software to work, but in principle the software can be anywhere by linking */opt/sbgrid* to the desired installation point. This functionality is not yet included in the SBGrid application, but can be set up manually post-install with a symlink. First do an install (into */opt/sbgrid*), then move it to the desired localtion. Then symlink to the new location from */opt/sbgrid*. |
|
71 | +![](images/GUI-v2-9-runningtask1.png) |
|
72 | +Tasks are applied and will run in parallel. A Scrollbar indicates progress. |
|
73 | 73 | |
74 | -**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the small SSDs that come in Mac laptops. To install on an external drive in this way, first mount it on your computer. For this example, the mount is */Volumes/sbgrid_programs*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application. |
|
74 | +### Installing, Upgrading and Removing software |
|
75 | 75 | |
76 | -Next move **/opt/sbgrid** to the USB key at */Volumes/sbgrid_programs*. You will likely need sudo for this. |
|
76 | +Software is queued for installation / removal / upgrade by clicking on the blue / red / green text associated with the application title. |
|
77 | 77 | |
78 | - sudo mv /opt/sbgrid /Volumes/sbgrid_programs/. |
|
78 | +### Docs and Contact Panes |
|
79 | 79 | |
80 | -Now we have */Volumes/sbgrid_programs/sbgrid*. Create a symlink from **/opt/sbgrid** to */Volumes/sbgrid_programs/sbgrid*. |
|
81 | - |
|
82 | - sudo ln -s /Volumes/sbgrid_programs/sbgrid /opt/sbgrid |
|
83 | - |
|
84 | -The symlink at **/programs** still points to **/opt/sbgrid**, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive. |
|
85 | - |
|
86 | -## Usage |
|
87 | - |
|
88 | -**Instructions for installing the SBGrid software installation client can be found here** --> [Installation Instructions](client_install) |
|
89 | - |
|
90 | -### General |
|
91 | -The SBGrid software installation manager is a GUI-based installer for the SBGrid software collection. The application allows for selected applications to be installed in the familiar SBGrid environment. |
|
92 | - |
|
93 | - ![installed](images/client_install.png) |
|
94 | - |
|
95 | -The manager GUI is displays software 'Collections' on the right panel with folder icons under the 'Packages' heading. These Collections control the list of titles displayed in the center 'main' panel. |
|
96 | - |
|
97 | -The first of two of these 'Collections' are shortcut meta-collections of the local machine. The first is the currently installed titles. The second icon, Updates, shows updates available from SBGrid. 'Pending' is a collection of pending installs and removals. Below these shortcuts are packages are grouped by primary scientific uses. Installation status is also indicated in theses collections. |
|
98 | - |
|
99 | -Information about each title, including a description and links to documentation are shown in the upper right panel when that title is selected in the main pane. |
|
100 | - |
|
101 | -Once packages have been configured for installation and/or removal by selecting their checkbox, clicking the 'Apply Changes' button will perform update the titles, adding pending installations and removing pending deletions. |
|
102 | - |
|
103 | -### Example : Installing Albula |
|
104 | -Check the box to select Albula, then click the 'Apply Changes' button. |
|
105 | -Notice the text turns green for pending installations. Pending updates are Orange. |
|
106 | -![apply](images/client_apply2.png) |
|
107 | - |
|
108 | -### Example : Removing Albula |
|
109 | -Uncheck the box for Albula. Removals are shown in red text. |
|
110 | -![apply](images/client_remove1.png) |
|
111 | - |
|
112 | -Click apply changes. Albula will be removed. |
|
113 | -![apply](images/client_remove2.png) |
|
114 | - |
|
115 | -### Version selection |
|
116 | - |
|
117 | -Default versions are installed by default for each application, though individual versions can be selected for each title. To do so, show the version pane by selecting **"Show all package versions"** from the **"View"** menu. Then, in the bottom right, select a desired version with the check boxes. Multiple versions of a given title can be installed and are indicated in the main panel. |
|
118 | - |
|
119 | -Enable version panel |
|
120 | -![all](images/client_versions1.png) |
|
121 | - |
|
122 | -Check old/non-default versions |
|
123 | -![all](images/client_versions2.png) |
|
124 | - |
|
125 | - |
|
126 | -### Versions and the SBGrid environment |
|
127 | -If you have a single version of an application installed, explicitly version selection in your environment will not be needed. In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when installed, unless configured otherwise in *~/.sbgrid.conf*. |
|
128 | - |
|
129 | -If you have multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use either an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file as in the standard SBGrid environment. |
|
130 | - |
|
131 | -**Version priority in the shell** |
|
132 | - 1. *~/.sbgrid.conf* |
|
133 | - 2. Installed Default version |
|
134 | - 3. Latest installed release |
|
135 | - |
|
136 | -You can do open the configuration file by selecting the *"Edit Configuration File"* from the *"SBGrid Installer"* menu. |
|
137 | - |
|
138 | -![all](images/client_config1.png) |
|
139 | - |
|
140 | -This will open a text editor with a sample configuration file, or your *~/.sbgrid.conf* file if you have one already. |
|
141 | - |
|
142 | -![all](images/client_config2.png) |
|
143 | - |
|
144 | -There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
145 | - |
|
146 | - |
|
147 | -### Running the software |
|
148 | - |
|
149 | -To run the software, you can click the "SBGrid Shell" button for an initialized bash shell. |
|
150 | - |
|
151 | -You may also run the software from another terminal on your machine. |
|
152 | -To use the software at the terminal in bash, open a new terminal and run |
|
153 | - |
|
154 | - source /programs/sbgrid.shrc |
|
155 | - |
|
156 | -or in tcsh |
|
157 | - |
|
158 | - source /programs/sbgrid.cshrc |
|
159 | - |
|
160 | -### Questions, Problems and Known Issues |
|
161 | -For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*. |
|
162 | -If relevant, please include a screenshot of the GUI if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report. |
|
163 | - |
|
164 | -* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. |
|
165 | - |
|
166 | -* **Activation Failed**. In some cases the Authorization dialog for admin privileges does not appear during activation. This causes the manager activation to fail. This is usually due to a previously existing */programs* directory or symlink from a prior installation. This must be removed for activation to be successful. Other users have reported successful activation after a restart. |
|
80 | +These panes provide access to our wiki and bug reporting pages. We intend to expand content on these in future releases. |
client_install_legacy.md
... | ... | @@ -0,0 +1,171 @@ |
1 | +## SBGrid installation manager |
|
2 | + |
|
3 | +The SBGrid installation manager is available as command-line tool for macOS and Linux, and as a graphical application for macOS. The command-line and graphical versions are not mutually exclusive - they can be used interchangeably on mac. |
|
4 | + |
|
5 | +For the latest command-line application, [see here](sbgrid-cli). |
|
6 | +For the graphical version, see below. |
|
7 | + |
|
8 | +**NOTE for BIOGRIDS users** - [ Instructions for BioGrids installation can be found here ](https://biogrids.org/wiki/client_install). BioGrids is a scientific software collection focused on Bioinformatics tools. It is distinct from SBGrid which is focused on structural biology applications. Please see here for more info : [biogrids.org](https://biogrids.org). |
|
9 | + |
|
10 | +![](images/client_all.png) |
|
11 | + |
|
12 | +Looking to get started with the SBGrid installation manager? First, set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/) |
|
13 | + |
|
14 | +- [SBGrid installation manager](#sbgrid-installation-manager) |
|
15 | +- [Installation](#installation) |
|
16 | + - [Pre-installation](#pre-installation) |
|
17 | + - [Download, Installation and activation](#download-installation-and-activation) |
|
18 | + - [Installation on an external drive or USB key](#installation-on-an-external-drive-or-usb-key) |
|
19 | +- [Usage](#usage) |
|
20 | + - [General](#general) |
|
21 | + - [Example : Installing Albula](#example--installing-albula) |
|
22 | + - [Example : Removing Albula](#example--removing-albula) |
|
23 | + - [Version selection](#version-selection) |
|
24 | + - [Versions and the SBGrid environment](#versions-and-the-sbgrid-environment) |
|
25 | + - [Running the software](#running-the-software) |
|
26 | + - [Questions, Problems and Known Issues](#questions-problems-and-known-issues) |
|
27 | + |
|
28 | +## Installation |
|
29 | + |
|
30 | +### Pre-installation |
|
31 | + |
|
32 | +**1. Admin access required.** |
|
33 | +The SBGrid installation manager will install the software tree to _/opt/sbgrid_ and create a symlink from this directory to _/programs_. While admin privileges are not required to run the application, you will need admin privileges to create _/opt/sbgrid_ and _/programs_ . |
|
34 | + |
|
35 | +**2. Existing installations must be renamed or removed.** |
|
36 | +If you have previously installed SBGrid software on your computer at _/programs_ or at _/opt/sbgrid_, these directories should be removed or renamed. The manager will create these on first run. |
|
37 | + |
|
38 | +**3. Hard Drive Space** |
|
39 | +Depending on what you install, ensure that you have enough free hard drive space on your machine. |
|
40 | + |
|
41 | +**4. XQuartz is required for many graphical applications on MacOS.** |
|
42 | +To use many of the graphical applications (COOT, CCP4, nmrDraw, etc), install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/). |
|
43 | + |
|
44 | +**5. For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.** |
|
45 | +Some packages are quite large and can be slow to download, especially over WiFi. |
|
46 | + |
|
47 | +### Download, Installation and activation |
|
48 | + |
|
49 | +For macOS Catalina (10.15 and later), a work-around is required for installation. Please see [this page for more info](catalina). |
|
50 | +For 10.14 "Mojave" and earlier, this step is not required. |
|
51 | + |
|
52 | +**1. Download the latest SBGrid installation manager from here.** |
|
53 | + |
|
54 | +[Latest build : 1.0.695, 2020-05-31](downloads/SBGrid_Installer-1.0.695.dmg) |
|
55 | + |
|
56 | +**2. Mount the .dmg disk image on your Mac.** Copy the 'SBGrid installer.app' to a convenient location - it does not need to be in /Applications. The .app bundle can be run directly from the mounted dmg image with no installation if desired. |
|
57 | + |
|
58 | +You may be prompted to that the appication is from an "Unidentified Developer". If you try to open an app that is not signed by an Apple-registered developer, you this a warning dialog. This doesn’t necessarily mean that something’s wrong with the app, some apps were written by developers who are not members of the Apple developers program. |
|
59 | + |
|
60 | +**3. Enter your site, user name, and key.** You should have received these by email. |
|
61 | + |
|
62 | +![activation](images/client_activation.png) |
|
63 | + |
|
64 | +On activation you will be prompted to provide admin credentials for your mac. This is to create the _/opt/sbgrid_ directory and _/programs_ symlink. |
|
65 | + |
|
66 | +![activation](images/client_permissions.png) |
|
67 | + |
|
68 | +**4. On successful activation, you should see the manager populate with software titles.** If not, please close the application and try again. If activation continues to fail, you may have an old SBGrid installation at _/programs_ or _/opt/sbgrid_. These should be removed. You may also be blocked from accessing SBGrid servers on port 873 and port 8080 by your institution's firewall. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
69 | +For help, email *bugs@sbgrid.org.* |
|
70 | + |
|
71 | +### Installation on an external drive or USB key |
|
72 | + |
|
73 | +Currently the installer application installs the software tree in _/opt/sbgrid_ and uses a symlink at _/programs_. The _/programs_ link is required for the software to work, but in principle the software can be anywhere by linking _/opt/sbgrid_ to the desired installation point. This functionality is not yet included in the SBGrid application, but can be set up manually post-install with a symlink. First do an install (into _/opt/sbgrid_), then move it to the desired localtion. Then symlink to the new location from _/opt/sbgrid_. |
|
74 | + |
|
75 | +**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the small SSDs that come in Mac laptops. To install on an external drive in this way, first mount it on your computer. For this example, the mount is _/Volumes/sbgrid_programs_. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application. |
|
76 | + |
|
77 | +Next move **/opt/sbgrid** to the USB key at _/Volumes/sbgrid_programs_. You will likely need sudo for this. |
|
78 | + |
|
79 | + sudo mv /opt/sbgrid /Volumes/sbgrid_programs/. |
|
80 | + |
|
81 | +Now we have _/Volumes/sbgrid_programs/sbgrid_. Create a symlink from **/opt/sbgrid** to _/Volumes/sbgrid_programs/sbgrid_. |
|
82 | + |
|
83 | + sudo ln -s /Volumes/sbgrid_programs/sbgrid /opt/sbgrid |
|
84 | + |
|
85 | +The symlink at **/programs** still points to **/opt/sbgrid**, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive. |
|
86 | + |
|
87 | +## Usage |
|
88 | + |
|
89 | +**Instructions for installing the SBGrid software installation client can be found here** --> [Installation Instructions](client_install) |
|
90 | + |
|
91 | +### General |
|
92 | + |
|
93 | +The SBGrid software installation manager is a GUI-based installer for the SBGrid software collection. The application allows for selected applications to be installed in the familiar SBGrid environment. |
|
94 | + |
|
95 | +![installed](images/client_install.png) |
|
96 | + |
|
97 | +The manager GUI is displays software 'Collections' on the right panel with folder icons under the 'Packages' heading. These Collections control the list of titles displayed in the center 'main' panel. |
|
98 | + |
|
99 | +The first of two of these 'Collections' are shortcut meta-collections of the local machine. The first is the currently installed titles. The second icon, Updates, shows updates available from SBGrid. 'Pending' is a collection of pending installs and removals. Below these shortcuts are packages are grouped by primary scientific uses. Installation status is also indicated in theses collections. |
|
100 | + |
|
101 | +Information about each title, including a description and links to documentation are shown in the upper right panel when that title is selected in the main pane. |
|
102 | + |
|
103 | +Once packages have been configured for installation and/or removal by selecting their checkbox, clicking the 'Apply Changes' button will perform update the titles, adding pending installations and removing pending deletions. |
|
104 | + |
|
105 | +### Example : Installing Albula |
|
106 | + |
|
107 | +Check the box to select Albula, then click the 'Apply Changes' button. |
|
108 | +Notice the text turns green for pending installations. Pending updates are Orange. |
|
109 | +![apply](images/client_apply2.png) |
|
110 | + |
|
111 | +### Example : Removing Albula |
|
112 | + |
|
113 | +Uncheck the box for Albula. Removals are shown in red text. |
|
114 | +![apply](images/client_remove1.png) |
|
115 | + |
|
116 | +Click apply changes. Albula will be removed. |
|
117 | +![apply](images/client_remove2.png) |
|
118 | + |
|
119 | +### Version selection |
|
120 | + |
|
121 | +Default versions are installed by default for each application, though individual versions can be selected for each title. To do so, show the version pane by selecting **"Show all package versions"** from the **"View"** menu. Then, in the bottom right, select a desired version with the check boxes. Multiple versions of a given title can be installed and are indicated in the main panel. |
|
122 | + |
|
123 | +Enable version panel |
|
124 | +![all](images/client_versions1.png) |
|
125 | + |
|
126 | +Check old/non-default versions |
|
127 | +![all](images/client_versions2.png) |
|
128 | + |
|
129 | +### Versions and the SBGrid environment |
|
130 | + |
|
131 | +If you have a single version of an application installed, explicitly version selection in your environment will not be needed. In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when installed, unless configured otherwise in _~/.sbgrid.conf_. |
|
132 | + |
|
133 | +If you have multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use either an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file as in the standard SBGrid environment. |
|
134 | + |
|
135 | +**Version priority in the shell** |
|
136 | + |
|
137 | +1. _~/.sbgrid.conf_ |
|
138 | +2. Installed Default version |
|
139 | +3. Latest installed release |
|
140 | + |
|
141 | +You can do open the configuration file by selecting the _"Edit Configuration File"_ from the _"SBGrid Installer"_ menu. |
|
142 | + |
|
143 | +![all](images/client_config1.png) |
|
144 | + |
|
145 | +This will open a text editor with a sample configuration file, or your _~/.sbgrid.conf_ file if you have one already. |
|
146 | + |
|
147 | +![all](images/client_config2.png) |
|
148 | + |
|
149 | +There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
150 | + |
|
151 | +### Running the software |
|
152 | + |
|
153 | +To run the software, you can click the "SBGrid Shell" button for an initialized bash shell. |
|
154 | + |
|
155 | +You may also run the software from another terminal on your machine. |
|
156 | +To use the software at the terminal in bash, open a new terminal and run |
|
157 | + |
|
158 | + source /programs/sbgrid.shrc |
|
159 | + |
|
160 | +or in tcsh |
|
161 | + |
|
162 | + source /programs/sbgrid.cshrc |
|
163 | + |
|
164 | +### Questions, Problems and Known Issues |
|
165 | + |
|
166 | +For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*. |
|
167 | +If relevant, please include a screenshot of the GUI if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report. |
|
168 | + |
|
169 | +- **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. |
|
170 | + |
|
171 | +- **Activation Failed**. In some cases the Authorization dialog for admin privileges does not appear during activation. This causes the manager activation to fail. This is usually due to a previously existing _/programs_ directory or symlink from a prior installation. This must be removed for activation to be successful. Other users have reported successful activation after a restart. |
coot.md
... | ... | @@ -1,24 +1,36 @@ |
1 | 1 | # Managing COOT title and version in SBGrid |
2 | + |
|
2 | 3 | COOT is present in several titles and many versions in SBGrid. Selecting the application and version of the `coot` executable can be accomplished on-the-fly in a single step in the SBGrid capsule environment. Here are some examples of managing COOT in SBGrid capsules, but this should work for any application with duplicate executables and multiple versions. |
3 | 4 | |
4 | -To confirm that capsules are enabled, run |
|
5 | +To confirm that capsules are enabled, run |
|
5 | 6 | |
6 | 7 | ``` |
7 | -sbcap status |
|
8 | +sbcap status |
|
8 | 9 | ``` |
9 | 10 | |
10 | -If capsules are enabled, the output should be : |
|
11 | +If capsules are enabled, the output should be : |
|
11 | 12 | |
12 | 13 | ``` |
13 | - $ sbcap status |
|
14 | + $ sbcap status |
|
14 | 15 | Active |
15 | 16 | ``` |
16 | 17 | |
17 | -If capsules are InActive, they can be enable with the `sbcap on` command followed by `source /programs/sbgrid.shrc` or `.cshrc` for tcsh users. |
|
18 | +If capsules are InActive, they can be enable with the `sbcap on` command followed by `source /programs/sbgrid.shrc` or `.cshrc` for tcsh users. |
|
19 | + |
|
20 | +<!-- TOC --> |
|
21 | + |
|
22 | +- [Managing COOT title and version in SBGrid](#managing-coot-title-and-version-in-sbgrid) |
|
23 | + - ["Which COOT am I using?"](#which-coot-am-i-using) |
|
24 | + - ["What titles provide 'coot' executables?"](#what-titles-provide-coot-executables) |
|
25 | + - ["What version does this coot executable come from?"](#what-version-does-this-coot-executable-come-from) |
|
26 | + - [Changing the application that provides coot - overriding default titles](#changing-the-application-that-provides-coot---overriding-default-titles) |
|
27 | + - [Setting the version](#setting-the-version) |
|
18 | 28 | |
29 | +<!-- /TOC --> |
|
19 | 30 | |
20 | 31 | ### "Which COOT am I using?" |
21 | -The `sbwhich` command will show which `coot` executable is in use : |
|
32 | + |
|
33 | +The `sbwhich` command will show which `coot` executable is in use : |
|
22 | 34 | |
23 | 35 | ``` |
24 | 36 | $ sbwhich coot |
... | ... | @@ -32,33 +44,34 @@ $ coot --sbwhich |
32 | 44 | /programs/x86_64-linux/ccp4/7.1/ccp4-7.1/bin/coot |
33 | 45 | ``` |
34 | 46 | |
35 | -By default we use the CCP4 release of COOT in SBGrid. This version is stable, supported and the same for MacOS and Linux. But it is easy to change. |
|
47 | +By default we use the CCP4 release of COOT in SBGrid. This version is stable, supported and the same for MacOS and Linux. But it is easy to change. |
|
48 | + |
|
49 | +### "What titles provide 'coot' executables?" |
|
36 | 50 | |
37 | -### "What titles provide 'coot' executables?" |
|
38 | 51 | SBGrid capsules provide an additional set of flags for all executables, prefixed with `--sbapp:`. For more info see the [documentation for capsules here.](capsules) To list all the installed tiles that provide `coot`, use `--sbapp:l` |
39 | 52 | |
40 | 53 | ``` |
41 | -$ coot --sbapp:l |
|
54 | +$ coot --sbapp:l |
|
42 | 55 | ccp4 |
43 | 56 | ccpem |
44 | 57 | coot |
45 | 58 | ``` |
46 | 59 | |
47 | -The executable `coot` is present in the titles **ccp4, ccpem, and coot**. |
|
60 | +The executable `coot` is present in the titles **ccp4, ccpem, and coot**. |
|
48 | 61 | |
49 | 62 | To see all the titles with details use `--sbapp:L` |
50 | 63 | |
51 | 64 | ``` |
52 | 65 | $ coot --sbapp:L |
53 | 66 | |
54 | - Titles containing coot |
|
67 | + Titles containing coot |
|
55 | 68 | Title 1 of 3: Version information for: /programs/x86_64-linux/ccp4 |
56 | 69 | |
57 | 70 | Default version: 7.1 |
58 | 71 | In-use version: 7.1 |
59 | 72 | |
60 | 73 | Installed versions: 7.1 7.1.006 7.0 7.0.078 6.3.0 |
61 | -Other available versions: 7.1.006 7.0 7.0.078 6.3.0 |
|
74 | +Other available versions: 7.1.006 7.0 7.0.078 6.3.0 |
|
62 | 75 | Overrides use this shell variable: CCP4_X |
63 | 76 | |
64 | 77 | Title 2 of 3: Version information for: /programs/x86_64-linux/ccpem |
... | ... | @@ -67,7 +80,7 @@ Default version: 1.4.1 |
67 | 80 | In-use version: 1.4.1 |
68 | 81 | |
69 | 82 | Installed versions: 1.4.1 1.4.0 1.3.0 20200722 |
70 | -Other available versions: 1.4.0 1.3.0 20200722 |
|
83 | +Other available versions: 1.4.0 1.3.0 20200722 |
|
71 | 84 | Overrides use this shell variable: CCPEM_X |
72 | 85 | |
73 | 86 | Title 3 of 3: Version information for: /programs/x86_64-linux/coot |
... | ... | @@ -76,12 +89,13 @@ Default version: 0.9.1 |
76 | 89 | In-use version: 0.9.1 |
77 | 90 | |
78 | 91 | Installed versions: 0.9.1 0.8.9.2-pre-revision-7884 0.8.9 0.8.8 |
79 | -Other available versions: 0.8.9.2-pre-revision-7884 0.8.9 0.8.8 |
|
92 | +Other available versions: 0.8.9.2-pre-revision-7884 0.8.9 0.8.8 |
|
80 | 93 | Overrides use this shell variable: COOT_X │··········· |
81 | -``` |
|
94 | +``` |
|
82 | 95 | |
83 | -### "What version does this coot executable come from?" |
|
84 | -Using `sbapp:d` will print the title and version along with the available versions for the title. |
|
96 | +### "What version does this coot executable come from?" |
|
97 | + |
|
98 | +Using `sbapp:d` will print the title and version along with the available versions for the title. |
|
85 | 99 | |
86 | 100 | ``` |
87 | 101 | $ coot --sbapp:d |
... | ... | @@ -94,14 +108,15 @@ Default version: 7.1 |
94 | 108 | In-use version: 7.1 |
95 | 109 | |
96 | 110 | Installed versions: 7.1 7.1.006 7.0 7.0.078 6.3.0 |
97 | -Other available versions: 7.1.006 7.0 7.0.078 6.3.0 |
|
98 | -Overrides use this shell variable: CCP4_X │··········· |
|
111 | +Other available versions: 7.1.006 7.0 7.0.078 6.3.0 |
|
112 | +Overrides use this shell variable: CCP4_X │··········· |
|
99 | 113 | ``` |
100 | 114 | |
101 | 115 | We are running `coot` from ccp4 version 7.1 and there are several other versions available. |
102 | 116 | |
103 | 117 | ### Changing the application that provides coot - overriding default titles |
104 | -SBGrid uses CCP4's `coot` by default, but that can be changed with a configuration file in the ~/.sbgrid_capsules directory. A default title can be specified for any duplicate executable by creating a file with the **name of the executable** that contains a single line with the name of the application. For coot this would be: |
|
118 | + |
|
119 | +SBGrid uses CCP4's `coot` by default, but that can be changed with a configuration file in the ~/.sbgrid_capsules directory. A default title can be specified for any duplicate executable by creating a file with the **name of the executable** that contains a single line with the name of the application. For coot this would be: |
|
105 | 120 | |
106 | 121 | mkdir -p ~/.sbgrid_capsule |
107 | 122 | echo coot > ~/.sbgrid_capsule/coot |
... | ... | @@ -109,11 +124,11 @@ SBGrid uses CCP4's `coot` by default, but that can be changed with a configurati |
109 | 124 | If we do this, we can see: |
110 | 125 | |
111 | 126 | ``` |
112 | -$ coot --sbwhich |
|
127 | +$ coot --sbwhich |
|
113 | 128 | /programs/x86_64-linux/coot/0.9.1/bin/coot |
114 | 129 | ``` |
115 | 130 | |
116 | -Now `coot` comes from the applciation title **coot**. The default version there is 0.9.1. |
|
131 | +Now `coot` comes from the applciation title **coot**. The default version there is 0.9.1. |
|
117 | 132 | |
118 | 133 | Let's switch to CCPEM as the provider of the `coot` program. |
119 | 134 | To do that we just edit the configuration file: |
... | ... | @@ -121,10 +136,10 @@ To do that we just edit the configuration file: |
121 | 136 | ``` |
122 | 137 | $ echo ccpem > ~/.sbgrid_capsule/coot |
123 | 138 | |
124 | -$ coot --sbwhich |
|
139 | +$ coot --sbwhich |
|
125 | 140 | /programs/x86_64-linux/ccpem/1.4.1/bin/coot |
126 | 141 | |
127 | - $ coot --version |
|
142 | + $ coot --version |
|
128 | 143 | 0.9-pre (revision-count 0) |
129 | 144 | [with guile 1.8.8 embedded] |
130 | 145 | [with python 2.7.15 embedded] |
... | ... | @@ -133,17 +148,18 @@ Binary type: Linux-x86_64-scientific-linux-6.10-python-gtk2 |
133 | 148 | ``` |
134 | 149 | |
135 | 150 | ### Setting the version |
151 | + |
|
136 | 152 | The version of a title is set by the `<TITLE_X>` variable where `<TITLE>` is the title of an application in uppercase. You can see this variable in the `sbgrid-info -l` output. |
137 | 153 | |
138 | 154 | ``` |
139 | - $ sbgrid-info -l ccpem |
|
155 | + $ sbgrid-info -l ccpem |
|
140 | 156 | Version information for: /programs/x86_64-linux/ccpem |
141 | 157 | |
142 | 158 | Default version: 1.4.1 |
143 | 159 | In-use version: 1.4.1 |
144 | 160 | |
145 | 161 | Installed versions: 1.4.1 1.4.0 1.3.0 20200722 |
146 | -Other available versions: 1.4.0 1.3.0 20200722 |
|
162 | +Other available versions: 1.4.0 1.3.0 20200722 |
|
147 | 163 | Overrides use this shell variable: CCPEM_X |
148 | 164 | ``` |
149 | 165 | |
... | ... | @@ -157,12 +173,12 @@ To use coot from CCPEM version 1.3.0, we set the CCPEM_X variable to 1.3.0 |
157 | 173 | ``` |
158 | 174 | |
159 | 175 | `coot` has a --version flag that can be used to confirm the version |
160 | -Set the title for the `coot` executable to "coot" to use Paul Emsley's builds for linux : |
|
176 | +Set the title for the `coot` executable to "coot" to use Paul Emsley's builds for linux : |
|
161 | 177 | |
162 | 178 | ``` |
163 | 179 | echo coot > ~/.sbgrid_capsule/coot |
164 | 180 | |
165 | - $ coot --version |
|
181 | + $ coot --version |
|
166 | 182 | 0.9.1 (revision-count 10157) |
167 | 183 | [with guile 1.8.8 embedded] |
168 | 184 | [with python 2.7.15 embedded] |
... | ... | @@ -175,20 +191,20 @@ This is the latest version. To switch to an older version, just set the COOT_X v |
175 | 191 | ``` |
176 | 192 | $ export COOT_X=0.8.8 |
177 | 193 | |
178 | - $ coot --version |
|
194 | + $ coot --version |
|
179 | 195 | 0.8.8 (revision-count 6690) |
180 | 196 | [with guile 1.8.8 embedded] |
181 | 197 | ``` |
182 | 198 | |
183 | -To return to using `coot` from CCP4, the SBGrid default, remove the config file: |
|
199 | +To return to using `coot` from CCP4, the SBGrid default, remove the config file: |
|
184 | 200 | |
185 | 201 | ``` |
186 | 202 | $rm ~/.sbgrid_capsule/coot |
187 | - |
|
203 | + |
|
188 | 204 | $ coot --sbwhich |
189 | 205 | /programs/x86_64-linux/ccp4/7.1/ccp4-7.1/bin/coot |
190 | 206 | |
191 | - $ coot --version |
|
207 | + $ coot --version |
|
192 | 208 | 0.9 (revision-count 9932) |
193 | 209 | [with guile 1.8.8 embedded] |
194 | 210 | [with python 2.7.16 embedded] |
... | ... | @@ -196,8 +212,8 @@ Builder_info: CCP4, Oxfordshire |
196 | 212 | Binary type: Linux-x86_64-scientific-linux-6.10-python-gtk2 |
197 | 213 | ``` |
198 | 214 | |
199 | -The version of `coot` changes to the version provided by the CCP4 version specified by CCP4_X. |
|
215 | +The version of `coot` changes to the version provided by the CCP4 version specified by CCP4_X. |
|
200 | 216 | |
201 | -For more info, see [capsules](capsules), and [version manangement](overrides). |
|
217 | +For more info, see [capsules](capsules), and [version manangement](overrides). |
|
202 | 218 | |
203 | 219 | For questions or to report bugs, please email bugs@sbgrid.org |
developers.md
... | ... | @@ -1,27 +1,35 @@ |
1 | 1 | ## SBGrid Developer Support Program |
2 | + |
|
2 | 3 | In an effort to show our appreciation for their hard work and to encourage the continuing development and support of cutting edge structural biology software, SBGrid offers a Developer Support Program featuring a wide array of benefits for structural biology software developers. |
3 | 4 | |
4 | -- [Support Letters](#sbgrid-developer-support-program_support-letters) |
|
5 | -- [Software Beta Testing](#sbgrid-developer-support-program_software-beta-testing) |
|
6 | -- [Annual Software Awards](#sbgrid-developer-support-program_annual-software-awards) |
|
7 | -- [Stretch Your Resources](#sbgrid-developer-support-program_stretch-your-resources) |
|
8 | -- [Broad Exposure for Your Software](#sbgrid-developer-support-program_broad-exposure-for-your-software) |
|
9 | -- [Connect With Users](#sbgrid-developer-support-program_connect-with-users) |
|
5 | +- [SBGrid Developer Support Program](#sbgrid-developer-support-program) |
|
6 | + - [Support Letters](#support-letters) |
|
7 | + - [Software Beta Testing](#software-beta-testing) |
|
8 | + - [Annual Software Awards](#annual-software-awards) |
|
9 | + - [Stretch Your Resources](#stretch-your-resources) |
|
10 | + - [Broad Exposure for Your Software](#broad-exposure-for-your-software) |
|
11 | + - [Connect With Users](#connect-with-users) |
|
12 | + |
|
13 | +### Support Letters |
|
10 | 14 | |
11 | -### Support Letters |
|
12 | -When applying for grants or financial support please let us know! We can provide support letters on behalf of members of SBGrid Consortium. Letters would include details about our membership, number of computers that can access your software, operating systems used by our community, etc. Please use the [contact form](http://sbgrid.org/contact.php|contact) on the SBGrid website. |
|
15 | +When applying for grants or financial support please let us know! We can provide support letters on behalf of members of SBGrid Consortium. Letters would include details about our membership, number of computers that can access your software, operating systems used by our community, etc. Please use the [contact form](http://sbgrid.org/contact.php|contact) on the SBGrid website. |
|
13 | 16 | |
14 | 17 | ### Software Beta Testing |
18 | + |
|
15 | 19 | You are welcome to use SBGrid laboratories to beta-test your software. Just let us know when the new beta is available, and we will install it for all participating laboratories or a limited subset that you choose. |
16 | 20 | |
17 | -### Annual Software Awards |
|
21 | +### Annual Software Awards |
|
22 | + |
|
18 | 23 | Members of SBGrid Consortium vote in an annual poll to select their favorite structural biology application. Paul Emsley was the winner of the first poll. He won a Macbook Air laptop for his application Coot. |
19 | 24 | |
20 | -### Stretch Your Resources |
|
21 | -First level software support is provided by the SBGrid non-profit center at Harvard Medical School. All members of the consortium communicate with the service center for assistance with software installation, upgrades, and basic troubleshooting. For many of the mundane problems involving installation, operating system portability and environmental set up, SBGrid members will never need to contact you for support. Your expertise with the software be best utilized answering questions and working on problems that directly involve the science behind your application. |
|
25 | +### Stretch Your Resources |
|
26 | + |
|
27 | +First level software support is provided by the SBGrid non-profit center at Harvard Medical School. All members of the consortium communicate with the service center for assistance with software installation, upgrades, and basic troubleshooting. For many of the mundane problems involving installation, operating system portability and environmental set up, SBGrid members will never need to contact you for support. Your expertise with the software be best utilized answering questions and working on problems that directly involve the science behind your application. |
|
28 | + |
|
29 | +### Broad Exposure for Your Software |
|
30 | + |
|
31 | +More than 300+ structural biology laboratories from 90 institutions in 19 countries participate in the Consortium including the labs of many HHMI investigators and a few Nobel Prize winners. Deployment of your application can be customized to include only non-profit labs or broadened to include industry labs as well. Please visit the Consortium website for the full list of participating groups that can benefit from rapid access to your software. Please note that most SBGrid Consortium laboratories standardize on hardware and operating systems, which simplifies the installation and support process. |
|
22 | 32 | |
23 | -### Broad Exposure for Your Software |
|
24 | -More than 300+ structural biology laboratories from 90 institutions in 19 countries participate in the Consortium including the labs of many HHMI investigators and a few Nobel Prize winners. Deployment of your application can be customized to include only non-profit labs or broadened to include industry labs as well. Please visit the Consortium website for the full list of participating groups that can benefit from rapid access to your software. Please note that most SBGrid Consortium laboratories standardize on hardware and operating systems, which simplifies the installation and support process. |
|
33 | +### Connect With Users |
|
25 | 34 | |
26 | -### Connect With Users |
|
27 | 35 | Announcing a new version of your software? We can use webex to broadcast your presentation to all laboratories participating in our consortium. We can also disseminate information about your application to our community in our monthly newsletter. Visiting Boston? Please let us know because we'd love to schedule a seminar for members of our local structural biology community. |
downloads/SBGrid_Installation_Manager-2.2.11.AppImage
... | ... | Binary files /dev/null and b/downloads/SBGrid_Installation_Manager-2.2.11.AppImage differ |
downloads/SBGrid_Installation_Manager-2.2.11.dmg
... | ... | Binary files /dev/null and b/downloads/SBGrid_Installation_Manager-2.2.11.dmg differ |
examples.md
... | ... | @@ -1,12 +1,12 @@ |
1 | 1 | ## Usage examples for SBGrid applications |
2 | 2 | |
3 | -The following pages provide usage info and examples for select applications in the SBGrid environment. For access to documentation, manuals, application websites, etc, please visit : [https://sbgrid.org/software](https://sbgrid.org/software/) |
|
3 | +The following pages provide usage info and examples for select applications in the SBGrid environment. For access to documentation, manuals, application websites, etc, please visit : [https://sbgrid.org/software](https://sbgrid.org/software/) |
|
4 | 4 | |
5 | - - [Arp/Warp registration](examples/arpwarp_registration) |
|
6 | - - [EMAN2 with Theano for Neural Network Particle Picking](examples/EMAN2_w_theano) |
|
7 | - - [HADDOCK](examples/haddock) |
|
8 | - - [Local Reconstruction in SCIPION](examples/localrec_w_scipion) |
|
9 | - - [Locscale](examples/locscale) |
|
10 | - - [PHENIX - phenix.rosetta_refine](examples/phenix.rosetta_refine) |
|
11 | - - [SCIPION - running tutorials without write privileges](examples/running_scipion_tutorials) |
|
12 | - - [DIALS - Version control in DIALS](examples/DIALS_version_control) |
|
... | ... | \ No newline at end of file |
0 | +- [Arp/Warp registration](examples/arpwarp_registration) |
|
1 | +- [EMAN2 with Theano for Neural Network Particle Picking](examples/EMAN2_w_theano) |
|
2 | +- [HADDOCK](examples/haddock) |
|
3 | +- [Local Reconstruction in SCIPION](examples/localrec_w_scipion) |
|
4 | +- [Locscale](examples/locscale) |
|
5 | +- [PHENIX - phenix.rosetta_refine](examples/phenix.rosetta_refine) |
|
6 | +- [SCIPION - running tutorials without write privileges](examples/running_scipion_tutorials) |
|
7 | +- [DIALS - Version control in DIALS](examples/DIALS_version_control) |
getting_started.md
... | ... | @@ -1,10 +1,12 @@ |
1 | 1 | ## Getting Started |
2 | 2 | |
3 | -- [Using the SBGrid software collection](#getting-started_using-the-sbgrid-software-collection) |
|
4 | -- [Making the shell configuration automatic](#getting-started_making-the-shell-configuration-automatic) |
|
5 | -- [Setting an alias](#getting-started_setting-an-alias) |
|
3 | +- [Getting Started](#getting-started) |
|
4 | + - [Using the SBGrid software collection](#using-the-sbgrid-software-collection) |
|
5 | + - [Making the shell configuration automatic](#making-the-shell-configuration-automatic) |
|
6 | + - [Setting an alias](#setting-an-alias) |
|
6 | 7 | |
7 | 8 | ### Using the SBGrid software collection |
9 | + |
|
8 | 10 | The SBGrid software collection can be found installed at **/programs**. |
9 | 11 | All software in the SBGrid collection is run from the the command line in a terminal. Do set up the shell environment the terminal to run the programs, you will need to initialize the SBGrid environment. |
10 | 12 | |
... | ... | @@ -33,7 +35,7 @@ For Bash, in **~/.bashrc**, add : |
33 | 35 | For tcsh, in **~/.tcshrc** or **~/.cshrc**, add : |
34 | 36 | |
35 | 37 | if ( -e /programs/sbgrid.cshrc ) then |
36 | - source /programs/sbgrid.cshrc |
|
38 | + source /programs/sbgrid.cshrc |
|
37 | 39 | endif |
38 | 40 | |
39 | 41 | ### Setting an alias |
gpu.md
... | ... | @@ -1,22 +1,32 @@ |
1 | 1 | ## GPU computing |
2 | 2 | |
3 | 3 | GPU-accelerated computing uses a graphics processing unit (GPU) to accelerate computations in computer programs. Several applications in the SBGrid programs tree are GPU-accelerated. Some examples are RELION, GCTF, MotionCor2, Gautomatch, IMOD, AmberTools, etc. Here's what you need to take advantage of a GPU: |
4 | -### Requirements for GPU (CUDA) applications |
|
5 | 4 | |
6 | -**NVIDIA Hardware** |
|
5 | +<!-- TOC --> |
|
6 | + |
|
7 | +- [GPU computing](#gpu-computing) |
|
8 | +- [Requirements for GPU (CUDA) applications](#requirements-for-gpu-cuda-applications) |
|
9 | + - [NVIDIA Hardware](#nvidia-hardware) |
|
10 | + - [Hardware Drivers](#hardware-drivers) |
|
11 | + |
|
12 | +<!-- /TOC --> |
|
13 | + |
|
14 | +## Requirements for GPU (CUDA) applications |
|
15 | + |
|
16 | +### NVIDIA Hardware |
|
7 | 17 | |
8 | 18 | To use GPU-accelerated applications, you will need an NVIDIA GPU. We don't currently support other co-processors (Xeon Phi, AMD). If you think we should, let us know at bugs@sbgrid.org . |
9 | 19 | |
10 | - Not all GPUs are created equal - some applications are restricted to GPUs with a certain 'Compute Capability (i.e. of 3.5 or greater)'. You can check your card's rating and find more information on GPU computing here : [https://developer.nvidia.com/cuda-gpus](https://developer.nvidia.com/cuda-gpus) |
|
20 | +Not all GPUs are created equal - some applications are restricted to GPUs with a certain 'Compute Capability (i.e. of 3.5 or greater)'. You can check your card's rating and find more information on GPU computing here : [https://developer.nvidia.com/cuda-gpus](https://developer.nvidia.com/cuda-gpus) |
|
11 | 21 | |
12 | -**Drivers** |
|
22 | +### Hardware Drivers |
|
13 | 23 | |
14 | 24 | You linux workstation must have the proper drivers for your GPU. You can find drivers for your card here : [https://developer.nvidia.com/cuda-zone](https://developer.nvidia.com/cuda-zone) |
15 | 25 | |
16 | 26 | We currently support applications that rely on versions of CUDA 7.5 to 10 and these libraries are included with the SBGrid distribution. CUDA libraries do not need to be installed locally - they will not be used by SBGrid software. However, it is important to have a recent driver version if possible. |
17 | 27 | |
18 | -For information about GPU hardware and CUDA / driver version compatibility, [see this table at nvidia.com](https://docs.nvidia.com/deploy/cuda-compatibility/index.html#binary-compatibility__table-toolkit-driver) |
|
28 | +For information about GPU hardware and CUDA / driver version compatibility, [see this table at nvidia.com](https://docs.nvidia.com/deploy/cuda-compatibility/index.html#binary-compatibility__table-toolkit-driver) |
|
19 | 29 | |
20 | -For more information on GPUs and RELION, check Erik Lindahl's blog at the Department of Biochemistry & Biophysics, Stockholm University, [http://www.cryoem.se/relion-gpu](http://www.cryoem.se/relion-gpu) |
|
30 | +For more information on GPUs and RELION, check Erik Lindahl's blog at the Department of Biochemistry & Biophysics, Stockholm University, [http://www.cryoem.se/relion-gpu](http://www.cryoem.se/relion-gpu) |
|
21 | 31 | |
22 | 32 | GPU questions? Want to use GPU support in an application and it's not working? Please email *bugs@sbgrid.org* |
help.md
... | ... | @@ -1,15 +1,17 @@ |
1 | 1 | ## Software Help |
2 | 2 | |
3 | -If you are having a problem with software included in the SBGrid suite or think you've discovered an application bug, please use the [SBGrid](http://sbgrid.org/bugs) web form to alert us to the problem. You can also email bugs@sbgrid.org with details on the problem, but the web form is the preferred method. |
|
3 | +If you are having a problem with software included in the SBGrid suite or think you've discovered an application bug, please use the [SBGrid](http://sbgrid.org/bugs) web form to alert us to the problem. You can also email bugs@sbgrid.org with details on the problem, but the web form is the preferred method. |
|
4 | 4 | |
5 | 5 | If the problem with the software started after an update, you can configure your SBGrid environment to [use an older version of the software](overrides). |
6 | 6 | |
7 | 7 | ### New Software and Software Updates |
8 | + |
|
8 | 9 | To request a new software package or an update to an existing package, please use the [Software](http://sbgrid.org/req) Update/Installation Request form]]. |
9 | 10 | |
10 | -We try to accommodate most requests for new software, but we do occasionally run into difficulties. Despite most of our software being free for academics, some developers insist that each lab download and install their own software. We are happy to provide developers with the list of SBGrid members that have access to their software, but that doesn't always satisfy their requirements. |
|
11 | +We try to accommodate most requests for new software, but we do occasionally run into difficulties. Despite most of our software being free for academics, some developers insist that each lab download and install their own software. We are happy to provide developers with the list of SBGrid members that have access to their software, but that doesn't always satisfy their requirements. |
|
11 | 12 | |
12 | 13 | Even when things go smoothly, license requests and working out licensing details with developers can take some time, so please don't wait until the last minute before requesting software you anticipate you may need for your project. |
13 | 14 | |
14 | 15 | ### Newsletter |
15 | -SBGrid sends a monthly newsletter with information concerning software updates, upcoming webinars, talks and other items of interest to our community. The archive of previous newsletters is available online at the [SBGrid Newsletter Archive](https://sbgrid.org/newsletters/). |
|
16 | + |
|
17 | +SBGrid sends a monthly newsletter with information concerning software updates, upcoming webinars, talks and other items of interest to our community. The archive of previous newsletters is available online at the [SBGrid Newsletter Archive](https://sbgrid.org/newsletters/). |
images/GUI-v2-1-activation.png
... | ... | Binary files /dev/null and b/images/GUI-v2-1-activation.png differ |
images/GUI-v2-1-priv.png
... | ... | Binary files /dev/null and b/images/GUI-v2-1-priv.png differ |
images/GUI-v2-2-synthetic.png
... | ... | Binary files /dev/null and b/images/GUI-v2-2-synthetic.png differ |
images/GUI-v2-3-home.png
... | ... | Binary files /dev/null and b/images/GUI-v2-3-home.png differ |
images/GUI-v2-4-installed.png
... | ... | Binary files /dev/null and b/images/GUI-v2-4-installed.png differ |
images/GUI-v2-4.5-infopane.png
... | ... | Binary files /dev/null and b/images/GUI-v2-4.5-infopane.png differ |
images/GUI-v2-5-programs.png
... | ... | Binary files /dev/null and b/images/GUI-v2-5-programs.png differ |
images/GUI-v2-6-addedtask.png
... | ... | Binary files /dev/null and b/images/GUI-v2-6-addedtask.png differ |
images/GUI-v2-7-tasklist.png
... | ... | Binary files /dev/null and b/images/GUI-v2-7-tasklist.png differ |
images/GUI-v2-8-approvetasks.png
... | ... | Binary files /dev/null and b/images/GUI-v2-8-approvetasks.png differ |
images/GUI-v2-9-reinstall.png
... | ... | Binary files /dev/null and b/images/GUI-v2-9-reinstall.png differ |
images/GUI-v2-9-runningtasks1.png
... | ... | Binary files /dev/null and b/images/GUI-v2-9-runningtasks1.png differ |
installation_admin.md
... | ... | @@ -1,7 +1,24 @@ |
1 | -##Managing Your Software Installation |
|
1 | +## Managing Your SBGrid Site Installation |
|
2 | 2 | |
3 | -### *sbgrid-admin* Utility |
|
4 | -The *sbgrid-admin* utility used to install the complete software collection. A download link is provided in the initial site set up email, and the script is included in the installation itself at */programs/share/sbgrid/bin/sbgrid-admin*. It includes built-in help: |
|
3 | +<!-- TOC --> |
|
4 | + |
|
5 | +- [Managing Your SBGrid Site Installation](#managing-your-sbgrid-site-installation) |
|
6 | + - [The sbgrid-admin Utility](#the-sbgrid-admin-utility) |
|
7 | + - [Usage](#usage) |
|
8 | + - [Configuration Options](#configuration-options) |
|
9 | + - [Rsync Transaction Logging](#rsync-transaction-logging) |
|
10 | + |
|
11 | +<!-- /TOC --> |
|
12 | + |
|
13 | +### The sbgrid-admin Utility |
|
14 | + |
|
15 | +The sbgrid-admin utility used to install the complete software collection in what we refer to as a "Site installation". This is ideal for large labs, shared and departmental installations that use a shared network file storage for their programs. The installation is updated automatically on a monthly basis. [This installation is large and can take some time to install.](size_graph). |
|
16 | + |
|
17 | +A download link is provided in the initial site set up email, and the script is included in the installation itself at _/programs/share/sbgrid/bin/sbgrid-admin_. |
|
18 | + |
|
19 | +### Usage |
|
20 | + |
|
21 | +sbgrid-admin includes built-in help: |
|
5 | 22 | |
6 | 23 | ``` |
7 | 24 | $ sbgrid-admin -h |
... | ... | @@ -19,33 +36,34 @@ Usage: sbgrid-admin [-chirstu] |
19 | 36 | -u Force manual update of an existing installation. |
20 | 37 | ``` |
21 | 38 | |
22 | -The most commonly used option is *sbgrid-admin -u* to force a manual update. This will synchronize your local installation with the SBGrid master installation hosted at Harvard Medical School. |
|
39 | +The most commonly used option is _sbgrid-admin -u_ to force a manual update. This will synchronize your local installation with the SBGrid master installation hosted at Harvard Medical School. |
|
40 | + |
|
41 | +The SBGrid software configuration files use both static and dynamically generated files. The main shell initialization files, **/programs/sbgrid.cshrc** and **/programs/sbgrid.shrc** are static files, but the operating-system specific configurations are dynamically generated and customized for the packages available at your site. _sbgrid-admin -r_ will regenerate the branch-specific configuration files should you accidentally delete or alter them. |
|
23 | 42 | |
24 | -The SBGrid software configuration files use both static and dynamically generated files. The main shell initialization files, **/programs/sbgrid.cshrc** and **/programs/sbgrid.shrc** are static files, but the operating-system specific configurations are dynamically generated and customized for the packages available at your site. *sbgrid-admin -r* will regenerate the branch-specific configuration files should you accidentally delete or alter them. |
|
43 | +### Configuration Options |
|
25 | 44 | |
26 | - Configuration Options |
|
27 | -The *sbgrid-admin* script has some additional configuration options to accommodate the installation requirements at different sites. |
|
45 | +The _sbgrid-admin_ script has some additional configuration options to accommodate the installation requirements at different sites. |
|
28 | 46 | |
29 | -The ~sbgrid/.sbgridrc configuration file for the *sbgrid-admin* script must contain a sitename and site key. All other configurations are optional. |
|
47 | +The ~sbgrid/.sbgridrc configuration file for the _sbgrid-admin_ script must contain a sitename and site key. All other configurations are optional. |
|
30 | 48 | |
31 | -Options take the form of *OPTION_NAME="setting"*. |
|
49 | +Options take the form of _OPTION_NAME="setting"_. |
|
32 | 50 | |
33 | -| **Option** |** Example** | **Description** | |
|
34 | -|:------------- |:-------------:| :---------------| |
|
35 | -| SB_SITENAME | sbgrid-bene | The site name for your installation provided by SBGrid | |
|
36 | -| SB_SITEKEY | xyxyxyxyxyxyxy | The installation key for your site provided by SBGrid | |
|
37 | -| INSTALL_TARGET| /nfs/programs | The installation directory for the software | |
|
38 | -| RSYNC_ARGS | "--port 8080"| Advanced arguments to rsync. Can be used to workaround blocked rsync ports. | |
|
39 | -| HTTP_PROXY | host.name:port | Proxy hostname and port for use by rsync and curl | |
|
40 | -| POST_UPDATE_SCRIPT | /absolute/path/to/script|Optional script to be run after a successful software update | |
|
41 | -| CRON_SCHEDULE | 5 1 * * * | Set a custom cron schedule | |
|
51 | +| **Option** | ** Example** | **Description** | |
|
52 | +| :----------------- | :----------------------: | :-------------------------------------------------------------------------- | |
|
53 | +| SB_SITENAME | sbgrid-bene | The site name for your installation provided by SBGrid | |
|
54 | +| SB_SITEKEY | xyxyxyxyxyxyxy | The installation key for your site provided by SBGrid | |
|
55 | +| INSTALL_TARGET | /nfs/programs | The installation directory for the software | |
|
56 | +| RSYNC_ARGS | "--port 8080" | Advanced arguments to rsync. Can be used to workaround blocked rsync ports. | |
|
57 | +| HTTP_PROXY | host.name:port | Proxy hostname and port for use by rsync and curl | |
|
58 | +| POST_UPDATE_SCRIPT | /absolute/path/to/script | Optional script to be run after a successful software update | |
|
59 | +| CRON_SCHEDULE | 5 1 \* \* \* | Set a custom cron schedule | |
|
42 | 60 | |
61 | +### Rsync Transaction Logging |
|
43 | 62 | |
44 | - Rsync Transaction Logging |
|
45 | 63 | If you want a date-stamped log of all rsync downloads, deletions and updates, you can add a line like this to the ~sbgrid/.sbgridrc file: |
46 | 64 | |
47 | 65 | ``` |
48 | 66 | RSYNC_ARGS="--log-file=$HOME/logs/sbgrid-admin-`date +%Y%m%d`.log" |
49 | 67 | ``` |
50 | 68 | |
51 | -This will create a date-stamped log file any time an actual change to the software tree happens. In general this should not be necessary, but for troubleshooting purposes it can be useful. |
|
69 | +This will create a date-stamped log file any time an actual change to the software tree happens. In general this should not be necessary, but for troubleshooting purposes it can be useful. |
installation_overview.md
... | ... | @@ -1,53 +1,69 @@ |
1 | 1 | ## Installing the SBGrid software collection |
2 | -[Installing the software](#installing-the-software) |
|
3 | - - [Complete site installation](#installing-the-software_site-installation) |
|
4 | - - [Graphic installation for MacOS](#installing-the-software_graphical-installation-for-macos) |
|
5 | - - [Command Line installation manager](#installing-the-software_command-line-installation-manager-for-linux-and-macos) |
|
6 | 2 | |
7 | -[Supported Operating Systems](#supported-operating-systems) |
|
8 | - - [Linux](#supported-operating-systems_linux) |
|
9 | - - [OS X Intel](#supported-operating-systems_os-x-intel) |
|
3 | +### Installing the software |
|
10 | 4 | |
11 | -## Installing the software |
|
12 | 5 | The SBGrid Software Suite contains 440+ Scientific software applications for [Linux and OS X](operatingsystems). |
13 | 6 | |
14 | -The software can be installed using one of 3 methods: |
|
7 | +The software can be installed using one of 3 methods: |
|
8 | +- The `sbgrid-admin` script is used for [Site installation](installation_admin) |
|
9 | +- `sbgrid-cli` which is the [SBGrid package manager](sbgrid-cli) |
|
10 | +- [SBGrid installation manager graphical interface](client_install). |
|
11 | +--- |
|
12 | +<!-- TOC --> |
|
13 | + |
|
14 | +- [Installing the SBGrid software collection](#installing-the-sbgrid-software-collection) |
|
15 | + - [Installing the software](#installing-the-software) |
|
16 | +- [- SBGrid installation manager graphical interface.](#--sbgrid-installation-manager-graphical-interface) |
|
17 | + - [Site installation](#site-installation) |
|
18 | + - [Graphical installation for MacOS](#graphical-installation-for-macos) |
|
19 | + - [Command line installation manager for Linux and MacOS](#command-line-installation-manager-for-linux-and-macos) |
|
20 | +- [Supported Operating Systems](#supported-operating-systems) |
|
21 | + - [Linux](#linux) |
|
22 | + - [OS X Intel](#os-x-intel) |
|
23 | + |
|
24 | +<!-- /TOC --> |
|
15 | 25 | |
16 | 26 | ### Site installation |
27 | + |
|
17 | 28 | [A script-based installation that includes the complete software collection for Linux and/or MacOS.](installation_admin) |
18 | 29 | |
19 | 30 | This is ideal for large labs, shared and departmental installations that use a shared network file storage for their programs. The installation is updated automatically on a monthly basis. [This installation is large and can take some time to install.](size_graph) |
20 | 31 | |
21 | 32 | ### Graphical installation for MacOS |
33 | + |
|
22 | 34 | [A Graphical stand-alone installation manager for MacOS](client_install) |
23 | 35 | |
24 | 36 | The MacOS GUI installation manager allows users to select the applications they need when they need them through a MacOS-native graphical application. Applications are updated on a rolling basis and are available to the user at their convenience. Updates are reported when available, but are managed by the user. |
25 | 37 | |
26 | 38 | ### Command line installation manager for Linux and MacOS |
39 | + |
|
27 | 40 | [Command line installation using the SBGrid package managager program for Linux and MacOS ](client_CLI_install) |
28 | 41 | |
29 | 42 | The SBGrid CLI tool allows users to choose the titles they wish to install using a command-line driven package manager. Applications can be installed and updated as convenient. Updates are released on a rolling basis and can be installed by the user as necessary. This program can be made automatic or used in manual mode. |
30 | 43 | |
31 | -Member labs may use any/all of the installation types above for as many Computers as they require. |
|
44 | +Member labs may use any/all of the installation types above for as many Computers as they require. |
|
32 | 45 | |
33 | 46 | ## Supported Operating Systems |
34 | -The SBGrid Software Suite can run on Linux and macOS/OS X machines. |
|
47 | + |
|
48 | +The SBGrid Software Suite can run on Linux and macOS/OS X machines. |
|
35 | 49 | |
36 | 50 | ### Linux |
37 | -We build and test software under 64-bit CentOS 7. The majority of our Linux users are using the Red Hat / CentOS / Scientific Linux / Fedora distributions. We also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on these distributions, but it is known to work. We will work to resolve problems reported by users of these Linux distributions. |
|
51 | + |
|
52 | +We build and test software under 64-bit CentOS 7. The majority of our Linux users are using the Red Hat / CentOS / Scientific Linux / Fedora distributions. We also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on these distributions, but it is known to work. We will work to resolve problems reported by users of these Linux distributions. |
|
38 | 53 | |
39 | 54 | We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 7 and 8). Only 64-bit versions of linux are supported (though 32-bit software is included in the collection). As of January 2015, we are no longer updating the 32-bit software branch, though we will work to resolve reported problems. We also have a library of IRIX and PowerPC software. If those titles are needed, make a request at bugs@sbgrid.org. |
40 | 55 | |
41 | 56 | Currently Supported: |
42 | 57 | |
43 | -* Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux. |
|
44 | -* We are no longer building software for RHEL 5.x or 6.x, but compatible applications will remain in the software tree. We will respond to support requests for these and we will resolve problems where possible. |
|
58 | +- Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux. |
|
59 | +- We are no longer building software for RHEL 5.x or 6.x, but compatible applications will remain in the software tree. We will respond to support requests for these and we will resolve problems where possible. |
|
60 | + |
|
61 | +### OS X Intel |
|
45 | 62 | |
46 | -### OS X Intel |
|
47 | 63 | We build and test the programs under the most five most recent OS X releases. |
48 | 64 | |
49 | 65 | Currently Supported: |
50 | 66 | |
51 | -* OS X Intel 10.13 - 10.15 |
|
52 | -* As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications. |
|
53 | -* "Apple Silicon" macs can run most of the software in the collection on macOS 11 "Big Sur. Few native applications are currently available, but most software works in our early testing. |
|
... | ... | \ No newline at end of file |
0 | +- OS X Intel 10.13 - 10.15 |
|
1 | +- As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications. |
|
2 | +- "Apple Silicon" macs can run most of the software in the collection on macOS 11 "Big Sur. Few native applications are currently available, but most software works in our early testing. |
laptopinstall.md
... | ... | @@ -4,8 +4,8 @@ If you would like to install SBGrid tools on a machine that is frequently discon |
4 | 4 | |
5 | 5 | We have a GUI-based installation client for MacOS that allows software to be selected, installed, and updated on demand from SBGrid servers. There is also a command-line client for MacOS and Linux that will allow installation and upgrade of individual titles from the command line. |
6 | 6 | |
7 | - - [Information on installation of our MacOS GUI.](client_install) |
|
7 | +- [Information on installation of our MacOS GUI.](client_install) |
|
8 | 8 | |
9 | - - [Information on installation of our command-line tools for MacOS and Linux](client_CLI_install). |
|
9 | +- [Information on installation of our command-line tools for MacOS and Linux](client_CLI_install). |
|
10 | 10 | |
11 | -Our sbgrid-laptop installation shell-script is no longer supported. |
|
11 | +Our sbgrid-laptop installation shell-script is no longer supported. |
mailinglist.md
... | ... | @@ -1,5 +1,5 @@ |
1 | 1 | ## Mailing List for Site Administrators |
2 | 2 | |
3 | -We have a small mailing list for technical users and site administrators. |
|
3 | +We have a small mailing list for technical users and site administrators. |
|
4 | 4 | |
5 | 5 | Email accounts@sbgrid.org and we'll add you to the list. |
managing_install.md
... | ... | @@ -1,17 +1,19 @@ |
1 | 1 | ## Site Configuration |
2 | - - [Configuration](#configuration) |
|
3 | - - [Pre-Installation](#pre-installation) |
|
4 | - - [Approximate size per Branch](#pre-installation_approximate-size-per-branch) |
|
5 | - - [Installation](#installation) |
|
6 | - - [Post-Installation Steps](#post-installation-steps) |
|
7 | - - [SGI IRIX Software Branch](#sgi-irix-software-branch) |
|
2 | + |
|
3 | +- [Site Configuration](#site-configuration) |
|
4 | +- [Configuration](#configuration) |
|
5 | +- [Pre-Installation](#pre-installation) |
|
6 | + - [Approximate size per Branch](#approximate-size-per-branch) |
|
7 | +- [Installation](#installation) |
|
8 | +- [Post-Installation Steps](#post-installation-steps) |
|
9 | +- [SGI IRIX Software Branch](#sgi-irix-software-branch) |
|
8 | 10 | |
9 | 11 | ## Configuration |
10 | 12 | |
11 | 13 | The SBGrid Software Suite is designed to be installed on a single computer at your site, which will then share that installation with all the workstations on your network via NFS. |
12 | 14 | We refer to this computer as the site "master" server. |
13 | 15 | |
14 | -The master server will require at least 500 GB of free disk space on a case-sensitive file system and must run some variety of UNIX. The installation script will download the software branches you select, and then install a cron job that will run regularly to check for updates. |
|
16 | +The master server will require at least 500 GB of free disk space on a case-sensitive file system and must run some variety of UNIX. The installation script will download the software branches you select, and then install a cron job that will run regularly to check for updates. |
|
15 | 17 | |
16 | 18 | Software installation and update are initiated from your local server at your site and downloaded from our servers. http is used to query our servers to check for update, and rsync is used to download the updates. Outbound HTTP, and RSYNC is necessary. |
17 | 19 | |
... | ... | @@ -20,19 +22,19 @@ Software installation and update are initiated from your local server at your si |
20 | 22 | ## Pre-Installation |
21 | 23 | |
22 | 24 | | Installation Requirements | | |
23 | -| ------------------------- | ----------------------------------------------------| |
|
25 | +| ------------------------- | --------------------------------------------------- | |
|
24 | 26 | | Hard Drive Space | ~1 Tb recommended for full installation | |
25 | 27 | | Operating System | Linux, OS X and other UNIX | |
26 | 28 | | Privileges | Root account (Linux) or Administrator account (Mac) | |
27 | 29 | | network | Outbound http, rsync (ports 80 and 873, 8080) | |
28 | 30 | |
29 | - |
|
30 | 31 | ### Approximate size per Branch |
32 | + |
|
31 | 33 | | Branch | size | |
32 | 34 | | ------------ | ------ | |
33 | -| i386-mac | 300 Gb | |
|
34 | -| x86_64-linux | 450 Gb | |
|
35 | -| shared files | 15 Gb | |
|
35 | +| i386-mac | 300 Gb | |
|
36 | +| x86_64-linux | 450 Gb | |
|
37 | +| shared files | 15 Gb | |
|
36 | 38 | |
37 | 39 | [Size breakdown of titles in a typical installation](size_graph) |
38 | 40 | |
... | ... | @@ -46,24 +48,23 @@ Once the email has been received and your information has been entered into our |
46 | 48 | |
47 | 49 | ## Installation |
48 | 50 | |
49 | - A site installation is performed using the [sbgrid-admin](installation_admin) utility. |
|
51 | +A site installation is performed using the [sbgrid-admin](installation_admin) utility. |
|
50 | 52 | |
51 | - 1. Create an 'sbgrid' user on the machine that will host your software installation. This should be a normal, unprivileged user account. |
|
52 | - 2. Log in as this 'sbgrid' user. |
|
53 | - 3. Download the installation script from the URL provided in the account creation email. |
|
54 | - 4. Make it executable: `chmod +x sbgrid-admin` |
|
55 | - 5. Run the script: `./sbgrid-admin -i` |
|
56 | - 6. The script will walk you through configuring your installation, downloading the software and installing a cron job that will keep the software updated at your site. You will need the **site name** and **install key** provided in the account creation email. The installation may take anywhere from several hours to a day, depending on your network and the number of applications available to your site. |
|
53 | +1. Create an 'sbgrid' user on the machine that will host your software installation. This should be a normal, unprivileged user account. |
|
54 | +2. Log in as this 'sbgrid' user. |
|
55 | +3. Download the installation script from the URL provided in the account creation email. |
|
56 | +4. Make it executable: `chmod +x sbgrid-admin` |
|
57 | +5. Run the script: `./sbgrid-admin -i` |
|
58 | +6. The script will walk you through configuring your installation, downloading the software and installing a cron job that will keep the software updated at your site. You will need the **site name** and **install key** provided in the account creation email. The installation may take anywhere from several hours to a day, depending on your network and the number of applications available to your site. |
|
57 | 59 | |
58 | 60 | ## Post-Installation Steps |
59 | 61 | |
60 | - 1. Add a symlink in the root directory of each machine that wants to use the software. The installation script will print the suggested syntax for the command.`ln -s /path/to/sbgrid/installation /programs` |
|
61 | - 2. Any user that wishes to use the software needs to configure their shell to initialize the SBGrid shell environment. For bash and other sh-compliant shells, add the following line to your ~/.bash_profile or ~/.bashrc: `. /programs/sbgrid.shrc` For csh and tcsh, add the following line to your ~/.cshrc: `source /programs/sbgrid.cshrc` |
|
62 | - 3. For some linux distributions, the shipped version of tcsh does not support shell variables longer than 4096 characters. Since the current PATH in our default shell initialization is larger than that, you will need to update tcsh. RPMs for Red Hat 4/5 and CentOS 4/5 are provided at /programs/i386-linux/system/RPMS. |
|
63 | - |
|
62 | +1. Add a symlink in the root directory of each machine that wants to use the software. The installation script will print the suggested syntax for the command.`ln -s /path/to/sbgrid/installation /programs` |
|
63 | +2. Any user that wishes to use the software needs to configure their shell to initialize the SBGrid shell environment. For bash and other sh-compliant shells, add the following line to your ~/.bash_profile or ~/.bashrc: `. /programs/sbgrid.shrc` For csh and tcsh, add the following line to your ~/.cshrc: `source /programs/sbgrid.cshrc` |
|
64 | +3. For some linux distributions, the shipped version of tcsh does not support shell variables longer than 4096 characters. Since the current PATH in our default shell initialization is larger than that, you will need to update tcsh. RPMs for Red Hat 4/5 and CentOS 4/5 are provided at /programs/i386-linux/system/RPMS. |
|
64 | 65 | |
65 | -## SGI IRIX Software Branch |
|
66 | +## SGI IRIX Software Branch |
|
66 | 67 | |
67 | -Since the IRIX software branch is frozen and no longer receiving updates, it is not installed and updated in the same manner as the active software branches. In order to install the IRIX software branch, please run: `./sbgrid-admin -s` |
|
68 | +Since the IRIX software branch is frozen and no longer receiving updates, it is not installed and updated in the same manner as the active software branches. In order to install the IRIX software branch, please run: `./sbgrid-admin -s` |
|
68 | 69 | |
69 | -Note that the IRIX branch is only compatible with *tcsh*; there is no sh-compatible configuration for this branch. |
|
70 | +Note that the IRIX branch is only compatible with _tcsh_; there is no sh-compatible configuration for this branch. |
mirrors.md
... | ... | @@ -1,3 +1,3 @@ |
1 | 1 | # SBGrid Mirrors |
2 | 2 | |
3 | -For the benefit of the local SBGrid community, we recommend the following to access frequently-used open source software. If you would like for us to add a mirror, please [contact us](help@sbgrid.org). |
|
3 | +For the benefit of the local SBGrid community, we recommend the following to access frequently-used open source software. If you would like for us to add a mirror, please [contact us](help@sbgrid.org). |
modulefiles.md
... | ... | @@ -1,46 +1,44 @@ |
1 | -#SBGrid/BioGrids Module Files |
|
1 | +# SBGrid/BioGrids Module Files |
|
2 | 2 | |
3 | -- [Overview](#overview) |
|
4 | -- [Accessing Modules](#accessing-modules) |
|
5 | -- [Verify](#verify) |
|
6 | -- [Load](#load) |
|
7 | -- [Unload](#unload) |
|
8 | -- [Issues](#issues) |
|
9 | - |
|
10 | -<a name="overview"></a> |
|
11 | 3 | ## Overview |
12 | 4 | |
13 | -Modulefiles for loading and unloading the sbgrid or biogrids environment are available in /programs/share/modulefiles/x86_64-linux and /programs/share/modulefiles/i386-mac. The module files are designed to work with an existing module/lmod setup. Loading the sbgrid/biogrids module initializes the entire sbgrid/biogrids environment and is used instead of the "source" command. If you are using modules then you should remove the source lines, such as "source sbgrid.shrc", from your startup rc files. |
|
5 | +Modulefiles for loading and unloading the sbgrid or biogrids environment are available in /programs/share/modulefiles/x86_64-linux and /programs/share/modulefiles/i386-mac. The module files are designed to work with an existing module/lmod setup. Loading the sbgrid/biogrids module initializes the entire sbgrid/biogrids environment and is used instead of the "source" command. If you are using modules then you should remove the source lines, such as "source sbgrid.shrc", from your startup rc files. |
|
6 | +<!-- TOC --> |
|
7 | + |
|
8 | +- [SBGrid/BioGrids Module Files](#sbgridbiogrids-module-files) |
|
9 | + - [Overview](#overview) |
|
10 | + - [Accessing Modules](#accessing-modules) |
|
11 | + - [Verify](#verify) |
|
12 | + - [Load](#load) |
|
13 | + - [Unload](#unload) |
|
14 | + - [Reporting Issues](#reporting-issues) |
|
14 | 15 | |
15 | -<a name="access"></a> |
|
16 | +<!-- /TOC --> |
|
16 | 17 | ## Accessing Modules |
17 | 18 | |
18 | -To access the files you need to update your **MODULEPATH** environment variable. |
|
19 | +To access the files you need to update your **MODULEPATH** environment variable. |
|
19 | 20 | |
20 | 21 | in bash |
21 | - |
|
22 | + |
|
22 | 23 | export MODULEPATH=/programs/share/modulefiles/x86_64-linux:"$MODULEPATH" |
23 | - |
|
24 | + |
|
24 | 25 | in tcsh |
25 | 26 | |
26 | 27 | setenv MODULEPATH /programs/share/modulefiles/x86_64-linux:"$MODULEPATH" |
27 | 28 | |
28 | 29 | The above command may be added to your shell startup files or your site Administrator may update the system wide path. |
29 | - |
|
30 | -<a name="verify"></a> |
|
30 | + |
|
31 | 31 | ## Verify |
32 | 32 | |
33 | -***module avail*** will show you what modules are available for loading. If your MODULEPATH is correct you should see the sbgrid/rc and/or the biogrids/rc module. |
|
33 | +**_module avail_** will show you what modules are available for loading. If your MODULEPATH is correct you should see the sbgrid/rc and/or the biogrids/rc module. |
|
34 | 34 | |
35 | 35 | $ module avail sbgrid |
36 | 36 | ---------------------- /programs/share/modulefiles/i386-mac -------------------------- |
37 | 37 | sbgrid/rc |
38 | 38 | |
39 | - |
|
40 | -<a name="load"></a> |
|
41 | 39 | ## Load |
42 | 40 | |
43 | -Loading the sbgrid/biogrids module initializes the entire environment and not individual applications. The module determines if you are using bash or tcsh and loads the shell appropriate environment using the same command for both tcsh and bash. |
|
41 | +Loading the sbgrid/biogrids module initializes the entire environment and not individual applications. The module determines if you are using bash or tcsh and loads the shell appropriate environment using the same command for both tcsh and bash. |
|
44 | 42 | |
45 | 43 | $ module load sbgrid |
46 | 44 | Loading SBGrid |
... | ... | @@ -51,21 +49,13 @@ Loading the sbgrid/biogrids module initializes the entire environment and not in |
51 | 49 | ... "remainder of startup message" |
52 | 50 | $ |
53 | 51 | |
54 | - |
|
55 | -<a name="unload"></a> |
|
56 | 52 | ## Unload |
57 | 53 | |
58 | -You can remove the sbgrid/biogrids environment with the ***module unload*** command. This removes any grid specific environment settings. If after loading sbgrid you load additonal modules, these modules will not be removed. To see what modules you have loaded you can use ***module list***. |
|
54 | +You can remove the sbgrid/biogrids environment with the **_module unload_** command. This removes any grid specific environment settings. If after loading sbgrid you load additonal modules, these modules will not be removed. To see what modules you have loaded you can use **_module list_**. |
|
59 | 55 | |
60 | 56 | $ module unload sbgrid |
61 | 57 | UnLoading SBGrid |
62 | 58 | |
63 | -<a name="issues"></a> |
|
64 | -## Issues |
|
59 | +## Reporting Issues |
|
65 | 60 | |
66 | 61 | Please report any issues to bugs@sbgrid.org |
67 | - |
|
68 | - |
|
69 | - |
|
70 | - |
|
71 | - |
monolithic.md
... | ... | @@ -1,11 +1,10 @@ |
1 | 1 | # SBGrid software environment |
2 | + |
|
2 | 3 | ## Overview |
3 | 4 | |
4 | 5 | The SBGrid 'Monolithic' software environment provides access to all installed packages using standard shell PATH with minimal required dependencies. [Standard system libraries should be sufficient to run all applications.](workstation_setup) The environment includes added features for users to manage their software version selection. |
5 | 6 | |
6 | - |
|
7 | -You can switch between the legacy SBGrid environment and the new [capsule](capsules) environment with the *sbcap* command. *sbcap on* will enable the capsule environment. |
|
8 | -You can always return to the legacy configuration with the *sbcap off* command. |
|
7 | +You can switch between the legacy SBGrid environment and the default [capsule](capsules) environment with the _sbcap_ command. _sbcap on_ will enable the capsule environment. You can always return to the legacy configuration with the _sbcap off_ command. |
|
9 | 8 | |
10 | 9 | The sbcap setting is persistent across shells - You don't need to do this for every shell. |
11 | 10 |
operatingsystems.md
... | ... | @@ -2,28 +2,50 @@ |
2 | 2 | |
3 | 3 | The SBGrid Software Suite can run on Linux and macOS/OS X. |
4 | 4 | |
5 | +<!-- TOC --> |
|
6 | + |
|
7 | +- [Supported Operating Systems](#supported-operating-systems) |
|
8 | + - [Linux](#linux) |
|
9 | + - [OS X Intel](#os-x-intel) |
|
10 | + - [OS X Arm, "Apple Silicon"](#os-x-arm-apple-silicon) |
|
11 | + - [Windows Intel](#windows-intel) |
|
12 | + - [OS X PowerPC](#os-x-powerpc) |
|
13 | + - [IRIX](#irix) |
|
14 | + |
|
15 | +<!-- /TOC --> |
|
5 | 16 | ### Linux |
6 | -We build and test software under 64-bit CentOS 7 and 8. The majority of our Linux users are using Red Hat or CentOS distributions, but we also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on distributions other than CentOS, but the software is known to work, and we will work to resolve problems reported by users of these Linux distributions. |
|
7 | 17 | |
8 | -We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 7 and 8). Only 64-bit versions of linux are supported. As of January 2015, we are no longer updating the 32-bit software branch. |
|
18 | +We build and test software under 64-bit CentOS 7 and 8. The majority of our Linux users are using Red Hat or CentOS distributions, but labs also use Ubuntu, Debian and OpenSuSE with SBGrid. We don't explicitly test the software on distributions other than CentOS, but the software is known to work. We will work to resolve problems reported by users of these Linux distributions where possible on a best-effort basis. |
|
9 | 19 | |
10 | -Currently Supported: |
|
20 | +We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 7 and 8). |
|
11 | 21 | |
12 | -* Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux. |
|
13 | -* We are no longer building software for RHEL 5.x or 6.x. |
|
22 | +- Red Hat Enterprise Linux 7.x and 8.x and the community supported versions: CentOS and Scientific Linux. |
|
23 | +- We are no longer building software for RHEL/CentOS 5.x or 6.x. |
|
14 | 24 | |
15 | -## OS X Intel |
|
16 | -We build and test the programs under the most five most recent OS X releases. |
|
25 | +### OS X Intel |
|
26 | + |
|
27 | +We build and test the programs under the most four most recent OS X releases. |
|
28 | +MacOS 10.14 was the last release to support 32-bit binaries. If your work requires 32-bit software, this is the last OS release that will allow that software to run. |
|
17 | 29 | |
18 | 30 | Currently Supported: |
19 | 31 | |
20 | -* OS X Intel 10.13 - 10.15 |
|
21 | -* As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications available. |
|
32 | +- OS X Intel 10.13 - 11 |
|
33 | +- As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications available. Also note that there are [known issues with macOS 11](big-sur). |
|
34 | + |
|
35 | +### OS X Arm, "Apple Silicon" |
|
36 | + |
|
37 | +There are few native applications for Apple CPUs in the software collection, but most applications work through Apple's Rosetta2 compatility environment. Notable exceptions are applications compiled with Intel compilers (Rosetta, RELION). |
|
38 | + |
|
39 | +### Windows Intel |
|
40 | + |
|
41 | +Windows provides Linux compatibility environment called "Windows Subsystem for Linux" (WSL), based on Ubuntu. WSL is still under active development. We suspect it is possible to get most SBGrid applications working with WSL, but we have no experience with Windows can can't provide support. But if you have success here, let us know. |
|
42 | + |
|
43 | +### OS X PowerPC |
|
44 | + |
|
45 | +The OS X PowerPC branch is currently frozen and is obsolete. |
|
46 | +The applications are archived and available on request. |
|
22 | 47 | |
23 | -## OS X PowerPC |
|
24 | -The OS X PowerPC branch is currently frozen. |
|
25 | -The applications are available on request. |
|
48 | +### IRIX |
|
26 | 49 | |
27 | -## IRIX |
|
28 | -The IRIX programs branch is currently frozen. |
|
29 | -The applications are available on request. |
|
50 | +The IRIX programs branch is currently frozen and is obsolete. |
|
51 | +The applications are archived and available on request. |
overrides.md
... | ... | @@ -1,64 +1,69 @@ |
1 | 1 | # Overriding Software Versions |
2 | 2 | |
3 | -Most of the software titles installed in the SBGrid software collection have several versions available. We try to provide at least three versions of each software package, although very old or very new applications may have fewer versions. |
|
4 | - |
|
5 | -## Display Available Versions |
|
6 | - |
|
7 | -To list the available versions of a software title, you can use the *sbgrid-info* utility. Running *sbgrid-info -l* will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this: |
|
3 | +Most of the software titles installed in the SBGrid software collection have several versions available. We try to provide at least three versions of each software package, although very old or very new applications may have more or fewer versions respectively. |
|
4 | +<!-- TOC --> |
|
8 | 5 | |
6 | +- [Overriding Software Versions](#overriding-software-versions) |
|
7 | + - [Display Available Versions](#display-available-versions) |
|
8 | + - [Overriding Default Versions](#overriding-default-versions) |
|
9 | + - [Disabling a Software Package](#disabling-a-software-package) |
|
9 | 10 | |
10 | - $ sbgrid-info -l ccp4 |
|
11 | - Version information for: /programs/x86_64-linux/ccp4 |
|
11 | +<!-- /TOC --> |
|
12 | +## Display Available Versions |
|
12 | 13 | |
13 | - Default version: 7.0 |
|
14 | - In-use version: 6.5 |
|
15 | - Other available versions: 6.4.0 6.3.0 |
|
16 | - Overrides use this shell variable: CCP4_X |
|
14 | +To list the available versions of a software title, you can use the _sbgrid-info_ utility. Running _sbgrid-info -l_ will list the versions for your current platform. From a Linux machine, a search for PyMOL versions looks like this: |
|
17 | 15 | |
16 | + $ sbgrid-info -l pymol |
|
17 | + Version information for: /programs/x86_64-linux/pymol |
|
18 | 18 | |
19 | -Running *sbgrid-info -L* will print the available versions for both of the current platforms (macOS and x86_64 Linux). |
|
19 | + Default version: 2.4.1_198 |
|
20 | + In-use version: 2.4.1_198 |
|
20 | 21 | |
22 | + Installed versions: 2.4.1_198 2.2.3 1.8.6.0 1.7.6.6 |
|
23 | + Other available versions: 2.2.3 1.8.6.0 1.7.6.6 |
|
24 | + Overrides use this shell variable: PYMOL_X |
|
21 | 25 | |
22 | - $ sbgrid-info -L gnuplot |
|
23 | - Version information for: /programs/x86_64-linux/gnuplot |
|
26 | +Running _sbgrid-info -L_ will print the available versions for both of the current platforms (macOS and x86_64 Linux). |
|
24 | 27 | |
25 | - Default version: 4.6.4 |
|
26 | - In-use version: 4.6.4 |
|
27 | - Other available versions: 4.6.0 4.4.3 4.2.6 |
|
28 | - Overrides use this shell variable: GNUPLOT_X |
|
28 | + $ sbgrid-info -L gnuplot |
|
29 | + Version information for: /programs/x86_64-linux/gnuplot |
|
29 | 30 | |
30 | - Version information for: /programs/i386-mac/gnuplot |
|
31 | + Default version: 4.6.4 |
|
32 | + In-use version: 4.6.4 |
|
33 | + Other available versions: 4.6.0 4.4.3 4.2.6 |
|
34 | + Overrides use this shell variable: GNUPLOT_X |
|
31 | 35 | |
32 | - Default version: 4.6.4 |
|
33 | - Other available versions: 4.4.3 4.2.6 4.6.0 |
|
34 | - Overrides use this shell variable: GNUPLOT_M |
|
36 | + Version information for: /programs/i386-mac/gnuplot |
|
35 | 37 | |
38 | + Default version: 4.6.4 |
|
39 | + Other available versions: 4.4.3 4.2.6 4.6.0 |
|
40 | + Overrides use this shell variable: GNUPLOT_M |
|
36 | 41 | |
37 | 42 | ## Overriding Default Versions |
38 | 43 | |
39 | -To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version. |
|
44 | +To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version. |
|
40 | 45 | |
41 | -The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this: |
|
46 | +The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this: |
|
42 | 47 | |
43 | -`APPLICATION_X=1.2` |
|
48 | +`<APPLICATION>_X=1.2` |
|
44 | 49 | |
45 | -APPLICATION_X is the name of the application followed by an underscore and the shorthand initial for the architecture. All SBGrid application variables are capitalized. The last field on the line is the software version number you want to use. The initials for each software branch are: |
|
50 | +where `<APPLICATION>_X` is the name of the application followed by an underscore and the shorthand initial for the architecture. All SBGrid application variables are capitalized. The last field on the line is the software version number you want to use. The initials for each software branch are: |
|
46 | 51 | |
47 | 52 | | Software Directory | Shorthand Initial | |
48 | 53 | | ------------------ | ----------------- | |
49 | -| x86_64-linux | _X | |
|
50 | -| i386-mac | _M | |
|
51 | - |
|
52 | -To quickly open the overrides file in your default $EDITOR, you can run *sbgrid-overrides -e*. |
|
54 | +| x86_64-linux | \_X | |
|
55 | +| i386-mac | \_M | |
|
53 | 56 | |
54 | -When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well. |
|
57 | +To quickly open the overrides file in your default $EDITOR, you can run _sbgrid-overrides -e_. |
|
55 | 58 | |
56 | -The example output below shows CCP4 on linux being changed from the default version: |
|
59 | +When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well. |
|
57 | 60 | |
58 | - Configuration options in effect for this shell: |
|
59 | - Variable Setting Configuration |
|
60 | - CCP4_M 6.3.0 personal |
|
61 | +The example output below shows PyMOL on linux being changed from the default version on macOS: |
|
61 | 62 | |
63 | + Configuration options in effect for this shell: |
|
64 | + Variable Setting Configuration |
|
65 | + PYMOL_M 2.2.3 personal |
|
62 | 66 | |
63 | 67 | ## Disabling a Software Package |
68 | + |
|
64 | 69 | To disable a specific software package, set its version to "disable" in your ~/.sbgrid.conf file. |
recommended.md
... | ... | @@ -1,7 +1,17 @@ |
1 | 1 | # Recommended Hardware |
2 | 2 | |
3 | +<!-- TOC --> |
|
4 | + |
|
5 | +- [Recommended Hardware](#recommended-hardware) |
|
6 | + - [Linux Workstations](#linux-workstations) |
|
7 | + - [Apple Workstations](#apple-workstations) |
|
8 | + |
|
9 | +<!-- /TOC --> |
|
10 | + |
|
3 | 11 | ## Linux Workstations |
12 | + |
|
4 | 13 | SBGrid's preferred hardware vendor is [ThinkMate](http://thinkmate.com) and we have some [recommended configurations](http://www.thinkmate.com/sbgrid) for structural biology computing. Please feel free to contact us at help@sbgrid.org regarding upcoming hardware purchases if you have questions - we'd be happy to advise. |
5 | 14 | |
6 | 15 | ## Apple Workstations |
7 | -Any Apple machine can be a capable computer for structural biology. The basic Apple educational discount is available through their online web store, and your institution may have negotiated an even better deal with their Apple representative. SBGrid has several labs that run exclusively on Macs and OS X. |
|
16 | + |
|
17 | +Any Apple machine can be a capable computer for structural biology. The basic Apple educational discount is available through their online web store, and your institution may have negotiated an arrangement with their Apple representative. SBGrid has several labs that run exclusively on Macs and OS X, though these are not advised for CryoEM data processing. |
sbgrid-cli.md
... | ... | @@ -1,43 +1,60 @@ |
1 | -## SBGrid command line installation manager, sbgrid-cli |
|
1 | +## SBGrid Installation Manager CLI : Installation and Usage |
|
2 | 2 | |
3 | 3 | `sbgrid-cli` is a command line installation manager for the SBGrid software collection. |
4 | +This page covers the usage of the installation manager graphical user interface (CLI). For more information on the latest graphical interface (GUI), [see here](sbgrid-gui). |
|
4 | 5 | |
5 | -SBGrid can be installed on computers running Linux or macOS operating systems. |
|
6 | -[CentOS/RHEL 7 or 8 is recommended for linux, or MacOSX v10.13 - macOS 10.15 for Macs.](operatingsystems). |
|
7 | -CentOS 6 has reached "End-of-Life" and is no longer supported. macOS 10.15 "Catalina" and macOS 11.0 "Big Sur" can be used, but an `/etc/syntetic.conf` file is required to create the `/programs` path. See [here for more info :](catalina) |
|
8 | - |
|
9 | -The SBGrid installation manager requires an account. |
|
6 | +The SBGrid installation manager requires an account. |
|
10 | 7 | Set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/) |
11 | 8 | |
9 | +The SBGrid installation manager is available in graphical and command-line flavors for macOS and Linux. The command-line and graphical versions are interchange and can be used for the same installation. You can find these on the [Download page here](client_downloads). |
|
10 | + |
|
11 | +<!-- TOC --> |
|
12 | + |
|
13 | +- [SBGrid Installation Manager CLI : Installation and Usage](#sbgrid-installation-manager-cli--installation-and-usage) |
|
14 | + - [Requirements and recommendations](#requirements-and-recommendations) |
|
15 | + - [Installation](#installation) |
|
16 | +- [General Usage](#general-usage) |
|
17 | + - [Activation](#activation) |
|
18 | + - [Restoring from a saved config : reactivate](#restoring-from-a-saved-config--reactivate) |
|
19 | + - [Listing available titles, status](#listing-available-titles-status) |
|
20 | + - [Getting Information about titles](#getting-information-about-titles) |
|
21 | + - [Installing and removing](#installing-and-removing) |
|
22 | + - [Updating titles](#updating-titles) |
|
23 | + - [Remove obsolete titles](#remove-obsolete-titles) |
|
24 | + - [Additional subcommands](#additional-subcommands) |
|
25 | + - [Troubleshooting and diagnostics](#troubleshooting-and-diagnostics) |
|
26 | + - [Installing software for multiple platforms](#installing-software-for-multiple-platforms) |
|
27 | + - [Logging](#logging) |
|
28 | + - [Software Version Management in the SBGrid environment](#software-version-management-in-the-sbgrid-environment) |
|
29 | + - [Running SBGrid software](#running-sbgrid-software) |
|
30 | + - [Known Issues](#known-issues) |
|
31 | + - [Deprecated releases](#deprecated-releases) |
|
32 | + |
|
33 | +<!-- /TOC --> |
|
34 | + |
|
12 | 35 | ### Requirements and recommendations |
13 | - `sbgrid-cli` is single binary executable and should work on most modern Linux distributions. |
|
14 | 36 | |
15 | - The SBGrid installation manager will install the software collection to `/opt/sbgrid` by default (though this can be changed). A symlink from `/programs` to the installation directory is required and this step does require admin priveleges. **Admin privileges are not required to run the applications**. This is only for the initial installation, specifically the creation of /opt/sbgrid (if desired) and for `/programs` (required). |
|
16 | - |
|
17 | - The `sbgrid-cli` install manager uses 'sudo' for priveleged installation tasks. As such, it should be used from an account with sudo privileges if this functionality is desired. Alternatively, software installation can be competed without sudo and the `/programs` link can be added manually later. The software will not be functional without this path. |
|
18 | - |
|
19 | - While not strictly required, we recommend a dedicated 'sbgrid' user account for software management, particularly on multiuser systems. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and lost inadvertantly during software updates. The `sbgrid-cli` program will add and remove software. **If data files are accidentally saved into the software collection, they are likely to be lost.** |
|
37 | +`sbgrid-cli` is single binary executable and should work on most modern Linux distributions. |
|
20 | 38 | |
21 | -### Latest version : v2.2.9 |
|
22 | - |
|
23 | -[LINUX : sbgrid-cli_2.2.9_linux.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.9_linux.tar.gz) |
|
39 | +The SBGrid installation manager will install the software collection to `/opt/sbgrid` by default (though this can be changed). A symlink from `/programs` to the installation directory is required and this step does require admin priveleges. **Admin privileges are not required to run the applications**. This is only for the initial installation, specifically the creation of /opt/sbgrid (if desired) and for `/programs` (required). |
|
24 | 40 | |
25 | -[macOS : sbgrid-cli_2.2.9_macos.tar.gz](https://sbgrid.org/wiki/downloads/sbgrid-cli_2.2.9_macos.tar.gz) |
|
41 | +The `sbgrid-cli` install manager uses 'sudo' for priveleged installation tasks. As such, it should be used from an account with sudo privileges if this functionality is desired. Alternatively, software installation can be completed without sudo and the `/programs` link can be added manually later. The software will not be functional without this path. |
|
26 | 42 | |
43 | +While not strictly required, we recommend a dedicated 'sbgrid' user account for software management, particularly on multiuser systems. This ensures the software can't be modified by user accounts and that data won't be mistakenly saved into the software stack and lost inadvertantly during software updates. The `sbgrid-cli` program will add and remove software. **If user data files are accidentally saved into the software collection, they are likely to be lost.** |
|
27 | 44 | |
28 | 45 | ### Installation |
29 | 46 | |
30 | 47 | The `sbgrid-cli` program is a single executable and does not have any dependencies or requirements. |
31 | -Untar the archive on the command line with : |
|
48 | +Untar the archive on the command line with : |
|
32 | 49 | |
33 | 50 | ``` |
34 | 51 | tar -zxf <archive_file.tar.gz> |
35 | 52 | ``` |
36 | 53 | |
37 | -where the "archive file" is the name of the tar.gz file downloaded from the links above. |
|
38 | - |
|
54 | +where the "archive file" is the name of the tar.gz file downloaded from the links above. |
|
55 | + |
|
39 | 56 | **MAC USERS PLEASE NOTE** |
40 | -If you encounter a pop-up warning about an "unidentified developer", you need to strip apple's quarantine extended attribute from the `sbgrid-cli` executable. This is easy to do. |
|
57 | +If you encounter a pop-up warning about an "unidentified developer", you need to strip apple's quarantine extended attribute from the `sbgrid-cli` executable. This is easy to do. |
|
41 | 58 | |
42 | 59 | First, cancel the dialog and then run this in your terminal: |
43 | 60 | |
... | ... | @@ -47,54 +64,56 @@ xattr -d com.apple.quarantine sbgrid-cli |
47 | 64 | |
48 | 65 | You should then be able to run the application normally without warnings. |
49 | 66 | |
50 | ------------- |
|
67 | +--- |
|
68 | + |
|
51 | 69 | ## General Usage |
52 | -![](images/sbgrid-cli_usage_2.1.3.png) |
|
53 | 70 | |
54 | -The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example : |
|
71 | +![](images/sbgrid-cli_usage_2.1.3.png) |
|
55 | 72 | |
73 | +The SBGrid command line installation manager takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example : |
|
56 | 74 | |
57 | 75 | ``` |
58 | 76 | $ sbgrid-cli install --help |
59 | 77 | ``` |
60 | 78 | |
61 | -will produce the help info for the `install` subcommand. |
|
79 | +will produce the help info for the `install` subcommand. |
|
62 | 80 | |
63 | 81 | ### Activation |
82 | + |
|
64 | 83 | To install the software, you must activate your installation with valid credentials provided by SBGrid. This process is only required for the initial installation of the software and is not required to add/remove/upgrade titles. |
65 | 84 | |
66 | 85 | Activate with the `activate` subcommand |
67 | 86 | |
68 | 87 | ``` |
69 | - $ sbgrid-cli activate --help |
|
88 | + $ sbgrid-cli activate --help |
|
70 | 89 | |
71 | - SBGrid Installer 2.2.9 f593932a17 — |
|
90 | + SBGrid Installer 2.2.9 f593932a17 — |
|
72 | 91 | _______ _____ _ __ |
73 | 92 | / __/ _ )/ ___/___(_)__/ / |
74 | 93 | _\ \/ _ / (_ / __/ / _ / |
75 | 94 | /___/____/\___/_/ /_/\_,_/ |
76 | 95 | C o n s o r t i u m |
77 | - |
|
96 | + |
|
78 | 97 | |
79 | 98 | USAGE — activate |
80 | - |
|
99 | + |
|
81 | 100 | ▸ sbgrid-cli activate [site] [user] [key] [OPTIONS...] |
82 | 101 | |
83 | 102 | |
84 | 103 | ARGUMENTS |
85 | 104 | |
86 | - [site] The installation site provided in your activation |
|
87 | - credentials |
|
88 | - [user] The username provided in your activation credentials |
|
89 | - [key] The activation key provided in your activation |
|
90 | - credentials |
|
105 | + [site] The installation site provided in your activation |
|
106 | + credentials |
|
107 | + [user] The username provided in your activation credentials |
|
108 | + [key] The activation key provided in your activation |
|
109 | + credentials |
|
91 | 110 | |
92 | 111 | OPTIONS |
93 | 112 | |
94 | - -k, --credential-key <key> Activate with a single credential key |
|
95 | - --darwin Specify macOS as a platform |
|
96 | - --no-link No symlink creation, no sudo prompt. |
|
97 | - --linux Specify Linux as a platform |
|
113 | + -k, --credential-key <key> Activate with a single credential key |
|
114 | + --darwin Specify macOS as a platform |
|
115 | + --no-link No symlink creation, no sudo prompt. |
|
116 | + --linux Specify Linux as a platform |
|
98 | 117 | --skip-folder-checking Skips checking if a folder with programs already exists |
99 | 118 | -t, --target <target> Specify a custom installation target |
100 | 119 | |
... | ... | @@ -108,23 +127,23 @@ skips creatation of a symlink at `/programs`. Useful for installs without sudo |
108 | 127 | |
109 | 128 | **--skip-folder-checking** |
110 | 129 | |
111 | -skips the check for software that is already installed. Will overwrite existing installations. |
|
130 | +skips the check for software that is already installed. Will overwrite existing installations. |
|
112 | 131 | |
113 | 132 | **--target <target>** |
114 | 133 | |
115 | 134 | Set the install directory to a different path than `/opt/sbgrid` |
116 | 135 | |
117 | -Trouble activating? See Troubleshooting options further down this page. |
|
136 | +Trouble activating? See Troubleshooting options further down this page. |
|
118 | 137 | |
119 | 138 | ### Restoring from a saved config : reactivate |
120 | 139 | |
121 | -**reactivate** subcommand can restore from a saved config file. This config includes all titles and versions from a saved installation. Useful for moving installations or reproducing installations. |
|
140 | +**reactivate** subcommand can restore from a saved config file. This config includes all titles and versions from a saved installation. Useful for moving installations or reproducing installations. |
|
122 | 141 | |
123 | 142 | ``` |
124 | 143 | $ sbgrid-cli reactivate <configPath> [OPTIONS...] |
125 | 144 | ``` |
126 | 145 | |
127 | -### Listing available titles, status |
|
146 | +### Listing available titles, status |
|
128 | 147 | |
129 | 148 | The `sbgrid-cli list` command will show all available titles. They are normally colored by their installation status. |
130 | 149 | Available options : |
... | ... | @@ -132,37 +151,37 @@ Available options : |
132 | 151 | **list** |
133 | 152 | |
134 | 153 | ``` |
135 | --a, --all-versions List all available versions for a title |
|
136 | --c, --collections List the available software collections |
|
137 | --d, --default-versions List only the default version for a title |
|
138 | ---long-format Use the long format to display the title list |
|
139 | ---one-column Format the output into a single column |
|
154 | +-a, --all-versions List all available versions for a title |
|
155 | +-c, --collections List the available software collections |
|
156 | +-d, --default-versions List only the default version for a title |
|
157 | +--long-format Use the long format to display the title list |
|
158 | +--one-column Format the output into a single column |
|
140 | 159 | ``` |
141 | 160 | |
142 | 161 | The `list` subcommand has several options |
143 | 162 | |
144 | 163 | ``` |
145 | 164 | USAGE — list |
146 | - |
|
165 | + |
|
147 | 166 | ▸ sbgrid-cli list [title...] [OPTIONS...] |
148 | 167 | |
149 | 168 | |
150 | 169 | ARGUMENTS |
151 | 170 | |
152 | - [title...] The names of the software titles to list |
|
171 | + [title...] The names of the software titles to list |
|
153 | 172 | |
154 | 173 | OPTIONS |
155 | 174 | |
156 | - -a, --all-versions List all available versions for a title |
|
157 | - -c, --collections List the available software collections |
|
158 | - --darwin Specify macOS as a platform |
|
159 | - -d, --default-versions List only the default version for a title |
|
160 | - --linux Specify Linux as a platform |
|
161 | - --long-format Use the long format to display the title list |
|
162 | - --one-column Format the output into a single column |
|
175 | + -a, --all-versions List all available versions for a title |
|
176 | + -c, --collections List the available software collections |
|
177 | + --darwin Specify macOS as a platform |
|
178 | + -d, --default-versions List only the default version for a title |
|
179 | + --linux Specify Linux as a platform |
|
180 | + --long-format Use the long format to display the title list |
|
181 | + --one-column Format the output into a single column |
|
163 | 182 | ``` |
164 | 183 | |
165 | -Note `--collections` can be used to see subsets of software as listed at [https://sbgrid.org/software/](https://sbgrid.org/software/). |
|
184 | +Note `--collections` can be used to see subsets of software as listed at [https://sbgrid.org/software/](https://sbgrid.org/software/). |
|
166 | 185 | |
167 | 186 | **updates** |
168 | 187 | |
... | ... | @@ -179,12 +198,12 @@ The following installed packages have updates available (x86_64-linux): |
179 | 198 | - r@3.6.2 (patch for installed version) |
180 | 199 | ``` |
181 | 200 | |
182 | -Updates are either new default versions (new default), or updates to an existing version (patch for installed version). The patch versions are usually bug or configuration fixes. |
|
201 | +Updates are either new default versions (new default), or updates to an existing version (patch for installed version). The patch versions are usually bug or configuration fixes. |
|
183 | 202 | |
184 | 203 | **obsolete** |
185 | 204 | |
186 | -Shows obsolete versions that will be removed. |
|
187 | -Obsolete versions are previously installed versions no longer included in the SBGrid installation. |
|
205 | +Shows obsolete versions that will be removed. |
|
206 | +Obsolete versions are previously installed versions no longer included in the SBGrid installation. |
|
188 | 207 | |
189 | 208 | ``` |
190 | 209 | $ sbgrid-cli obsolete [OPTIONS...] |
... | ... | @@ -194,16 +213,16 @@ Obsolete versions are previously installed versions no longer included in the SB |
194 | 213 | |
195 | 214 | **info** |
196 | 215 | |
197 | -The *info* subcommand shows information about each title, including a description and links to documentation can be show with the `sbgrid-cli info <title>` command. See example below. |
|
216 | +The _info_ subcommand shows information about each title, including a description and links to documentation can be show with the `sbgrid-cli info <title>` command. See example below. |
|
198 | 217 | |
199 | 218 | ``` |
200 | 219 | $ sbgrid-cli info <title...> [OPTIONS...] |
201 | 220 | ``` |
202 | 221 | |
203 | -For example, info for *RELION* : |
|
222 | +For example, info for _RELION_ : |
|
204 | 223 | |
205 | 224 | ``` |
206 | - $ sbgrid-cli info relion |
|
225 | + $ sbgrid-cli info relion |
|
207 | 226 | ------------------------------------------------------------------------------------ |
208 | 227 | Package information for relion (x86_64-linux): |
209 | 228 | |
... | ... | @@ -241,11 +260,11 @@ Description: |
241 | 260 | class averages in cryo-electron microscopy. |
242 | 261 | |
243 | 262 | Technical notes: |
244 | -## SBGrid Usage Info RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux. For general information on running GPU accelerated applications from SBGrid, please see here : https://sbgrid.org/wiki/gpuCUDA builds of RELION re designated by a '_cu' suffix in the version of the application. For example, 3.1.0_cu9.2 is linked against CUDA v9.2 libraries. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware.RELION builds without CUDA support are compiled with Intel 2019.5 with accelation options and Intel math libraries. ### RELION and MPI versionsRELION uses the 'mpirun' executable to manage MPI "ranks" for parallel processing. SBGrid includes several OpenMPI versions which are matched to specific RELION versions. When called from the SBGrid capsule environment, the relion GUI is configured to use the correct version of OpenMPI to manage parallel processing. When calling RELION binaries from the command line, the `mpirun.relion` executable can be used. `mpirun.relion` is configured to used the correct version of OpenMPI for each version of RELION. The 3.1.* versions for RELION use the default configuration of OpenMPI (3.1.6 on Linux, 2.1.3 on macOS) and do not require the version to be defined. Older releases use OpenMPI 2.1.2 which should be specified in $HOME/.sbgrid.conf. To set the OpenMPI version, add : OPENMPI_X=2.1.2"to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun. As noted above, you can also use the `mpirun.relion` executable in place of `mpirun` to use the MPI that matches the currently configured version of RELION. In this case, no other configuration is needed.Version 3.1.0_cu8.0 is compiled to support legacy CPUs (pre-Haswell). OpenMPI 3.1.6_compat is also needed for this version.Versions 3.1.0_cu8.0_slurm20 3.1-beta_cu8.0_slurm20 and 3.0.8_cu8.0_slurm20 support Slurm v20 PMI library. ## Recent Changes2.2.9111 : Add 3.1.1 RELION versions20200703 : Add 3.1.0 release version20200629 : reconfigure RELION gui to automatically use correct 'mpirun' in capsules.20200610 : rebuild of 3.1-beta releases with OpenMPI 3.1.6 from commit 5997001. |
|
263 | + SBGrid Usage Info RELION versions > 2.0 are GPU-accelerated using Nvidia CUDA on Linux. For general information on running GPU accelerated applications from SBGrid, please see here : https://sbgrid.org/wiki/gpuCUDA builds of RELION re designated by a '_cu' suffix in the version of the application. For example, 3.1.0_cu9.2 is linked against CUDA v9.2 libraries. All builds are single precision on the GPU and can be run on 'consumer-grade' GPU hardware.RELION builds without CUDA support are compiled with Intel 2019.5 with accelation options and Intel math libraries. RELION and MPI versionsRELION uses the 'mpirun' executable to manage MPI "ranks" for parallel processing. SBGrid includes several OpenMPI versions which are matched to specific RELION versions. When called from the SBGrid capsule environment, the relion GUI is configured to use the correct version of OpenMPI to manage parallel processing. When calling RELION binaries from the command line, the `mpirun.relion` executable can be used. `mpirun.relion` is configured to used the correct version of OpenMPI for each version of RELION. The 3.1.* versions for RELION use the default configuration of OpenMPI (3.1.6 on Linux, 2.1.3 on macOS) and do not require the version to be defined. Older releases use OpenMPI 2.1.2 which should be specified in $HOME/.sbgrid.conf. To set the OpenMPI version, add : OPENMPI_X=2.1.2"to $HOME/.sbgrid.conf and open a new terminal to use the correct mpirun. As noted above, you can also use the `mpirun.relion` executable in place of `mpirun` to use the MPI that matches the currently configured version of RELION. In this case, no other configuration is needed.Version 3.1.0_cu8.0 is compiled to support legacy CPUs (pre-Haswell). OpenMPI 3.1.6_compat is also needed for this version.Versions 3.1.0_cu8.0_slurm20 3.1-beta_cu8.0_slurm20 and 3.0.8_cu8.0_slurm20 support Slurm v20 PMI library. Recent Changes2.2.9111 : Add 3.1.1 RELION versions20200703 : Add 3.1.0 release version20200629 : reconfigure RELION gui to automatically use correct 'mpirun' in capsules.20200610 : rebuild of 3.1-beta releases with OpenMPI 3.1.6 from commit 5997001. |
|
245 | 264 | |
246 | -## Known Issues20200610 : Empty values in GUI during autopicking can be interpreted as Text instead of Float values. ## Deprecated versionsThe following verions are deprecated and will be removed in a future SBGrid update.20200706: 3.0.8_cu10.1 3.0.8_cu9.2 3.0.8_avx2 3.1-beta_cu9.2 3.1-beta_cu10.1 |
|
265 | +Known Issues20200610 : Empty values in GUI during autopicking can be interpreted as Text instead of Float values. Deprecated versionsThe following verions are deprecated and will be removed in a future SBGrid update.20200706: 3.0.8_cu10.1 3.0.8_cu9.2 3.0.8_avx2 3.1-beta_cu9.2 3.1-beta_cu10.1 |
|
247 | 266 | |
248 | -## (c) Copyright 2008, Structural Biology Grid (www.sbgrid.org)## Last Update to this document# Jason Key 0a6b896 2020-11-15 18:39:38 -0500 |
|
267 | +(c) Copyright 2008, Structural Biology Grid (www.sbgrid.org) Last Update to this document# Jason Key 0a6b896 2020-11-15 18:39:38 -0500 |
|
249 | 268 | |
250 | 269 | Links: |
251 | 270 | Website: http://www2.mrc-lmb.cam.ac.uk/relion/index.php/Main_Page |
... | ... | @@ -253,11 +272,11 @@ Links: |
253 | 272 | Forumhelp: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A0=CCPEM |
254 | 273 | ``` |
255 | 274 | |
256 | -The `info` subcommand includes all version info, dependencies ( which are automatically installed), technical notes and relevant links. |
|
275 | +The `info` subcommand includes all version info, dependencies ( which are automatically installed), technical notes and relevant links. |
|
257 | 276 | |
258 | 277 | ### Installing and removing |
259 | 278 | |
260 | -Install and remove titles with the `sbgrid-cli install <title>` and `sbgrid-cli remove <title>` command. Each of these commands can take multiple titles with versions at one time. |
|
279 | +Install and remove titles with the `sbgrid-cli install <title>` and `sbgrid-cli remove <title>` command. Each of these commands can take multiple titles with versions at one time. |
|
261 | 280 | |
262 | 281 | **install** |
263 | 282 | |
... | ... | @@ -266,26 +285,26 @@ Install and remove titles with the `sbgrid-cli install <title>` and `sbgrid-cli |
266 | 285 | |
267 | 286 | ARGUMENTS |
268 | 287 | |
269 | - [title...] The name(s) of the software title(s) to install. To |
|
288 | + [title...] The name(s) of the software title(s) to install. To |
|
270 | 289 | specify a non-default version, append @ and the version |
271 | - number to the name of the title (e.g. xyz@1.2.3). |
|
290 | + number to the name of the title (e.g. xyz@1.2.3). |
|
272 | 291 | |
273 | 292 | OPTIONS |
274 | 293 | |
275 | - --all-titles Installs all the available titles |
|
276 | - --all-versions This will install all the available versions for a |
|
277 | - specified title or collection |
|
278 | - -c, --collection <title> The title of a software collection to install |
|
279 | - --darwin Specify macOS as a platform |
|
280 | - --linux Specify Linux as a platform |
|
281 | - -j, --num-workers <num-workers> Run installation tasks in parallel |
|
282 | - number, default: 1 |
|
283 | - --reinstall Force the reinstallation of already installed packages |
|
294 | + --all-titles Installs all the available titles |
|
295 | + --all-versions This will install all the available versions for a |
|
296 | + specified title or collection |
|
297 | + -c, --collection <title> The title of a software collection to install |
|
298 | + --darwin Specify macOS as a platform |
|
299 | + --linux Specify Linux as a platform |
|
300 | + -j, --num-workers <num-workers> Run installation tasks in parallel |
|
301 | + number, default: 1 |
|
302 | + --reinstall Force the reinstallation of already installed packages |
|
284 | 303 | ``` |
285 | 304 | |
286 | 305 | **Installation Examples** |
287 | 306 | |
288 | -Install a single default version of an application, *adxv* : |
|
307 | +Install a single default version of an application, _adxv_ : |
|
289 | 308 | |
290 | 309 | ``` |
291 | 310 | $ sbgrid-cli install adxv |
... | ... | @@ -298,19 +317,19 @@ info: (2/2) Setting up your installation... |
298 | 317 | $ |
299 | 318 | ``` |
300 | 319 | |
301 | -Install a specific version of a *adxv* : |
|
320 | +Install a specific version of a _adxv_ : |
|
302 | 321 | |
303 | 322 | ``` |
304 | 323 | $ sbgrid-cli install adxv@1.9.11 |
305 | 324 | ``` |
306 | 325 | |
307 | -Install all versions of *adxv* : |
|
326 | +Install all versions of _adxv_ : |
|
308 | 327 | |
309 | 328 | ``` |
310 | 329 | $ sbgrid-cli install adxv --all-versions |
311 | 330 | ``` |
312 | 331 | |
313 | -Install the 'Electron Microscopy' collection of titles (see above *list* command to list *collections*): |
|
332 | +Install the 'Electron Microscopy' collection of titles (see above _list_ command to list _collections_): |
|
314 | 333 | |
315 | 334 | ``` |
316 | 335 | $ sbgrid-cli install -c 'Electron Microscopy' |
... | ... | @@ -332,7 +351,7 @@ Note the `--reinstall` flag can be added to all commands to reinstall titles tha |
332 | 351 | |
333 | 352 | **remove** |
334 | 353 | |
335 | -Same options as install subcommand above. |
|
354 | +Same options as install subcommand above. |
|
336 | 355 | |
337 | 356 | ``` |
338 | 357 | $ sbgrid-cli remove [title...] [OPTIONS...] |
... | ... | @@ -350,7 +369,7 @@ $ sbgrid-cli update relion |
350 | 369 | |
351 | 370 | ### Remove obsolete titles |
352 | 371 | |
353 | -Use the clean subcommand to list or remove obsolete versions or titles |
|
372 | +Use the clean subcommand to list or remove obsolete versions or titles |
|
354 | 373 | |
355 | 374 | **clean** |
356 | 375 | |
... | ... | @@ -360,33 +379,32 @@ $ sbgrid-cli clean [OPTIONS...] |
360 | 379 | |
361 | 380 | ### Additional subcommands |
362 | 381 | |
363 | -`sbgrid-cli` provides additional subcommands for automated software colletion maintenance and troubleshooting. |
|
382 | +`sbgrid-cli` provides additional subcommands for automated software colletion maintenance and troubleshooting. |
|
364 | 383 | |
365 | -**admin** |
|
384 | +**admin** |
|
366 | 385 | |
367 | -Run periodic installation, update and removal. Installs all new titles, updates where appropriate and removes obsolete versions |
|
386 | +Run periodic installation, update and removal. Installs all new titles, updates where appropriate and removes obsolete versions |
|
368 | 387 | |
369 | 388 | ``` |
370 | 389 | $ sbgrid-cli admin |
371 | 390 | ``` |
372 | 391 | |
373 | -For example running |
|
392 | +For example running |
|
374 | 393 | |
375 | 394 | ``` |
376 | -$ sbgrid-cli admin |
|
395 | +$ sbgrid-cli admin |
|
377 | 396 | ``` |
378 | 397 | |
379 | -will install all default, update all installed titles and remove all obsolete versions while |
|
398 | +will install all default, update all installed titles and remove all obsolete versions while |
|
380 | 399 | |
381 | 400 | ``` |
382 | 401 | $ sbgrid-cli admin --all-versions |
383 | 402 | ``` |
384 | 403 | |
385 | -will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions. |
|
404 | +will install all versions of all titles, add any new titles, update any pending updates, and remove obsolete versions. |
|
386 | 405 | This |
387 | 406 | |
388 | - |
|
389 | -**rebuild** |
|
407 | +**rebuild** |
|
390 | 408 | |
391 | 409 | `rebuild` rebuilds the installation environment configuration files. Usually this step is automatic but can be run manually for troubleshooting. |
392 | 410 | |
... | ... | @@ -394,23 +412,22 @@ This |
394 | 412 | $ sbgrid-cli rebuild |
395 | 413 | ``` |
396 | 414 | |
397 | -**crontab** |
|
415 | +**crontab** |
|
398 | 416 | |
399 | -Writes a basic script for crontab for *admin* functionality |
|
417 | +Writes a basic script for crontab for _admin_ functionality |
|
400 | 418 | |
401 | 419 | **save** |
402 | 420 | |
403 | -The *save* subcommand saves the current configuration so it can be restored at a later stage or replicated on another machine or in the cloud. |
|
404 | - |
|
421 | +The _save_ subcommand saves the current configuration so it can be restored at a later stage or replicated on another machine or in the cloud. |
|
405 | 422 | |
406 | 423 | ### Troubleshooting and diagnostics |
407 | 424 | |
408 | -**check-connection** |
|
425 | +**check-connection** |
|
409 | 426 | |
410 | 427 | Provides network diagnostics for connectivity to SBGrid at Harvard Medical School. |
411 | 428 | |
412 | 429 | ``` |
413 | - $ sbgrid-cli check-connection |
|
430 | + $ sbgrid-cli check-connection |
|
414 | 431 | info: (1/1) Checking connection... |
415 | 432 | info: Checking services... |
416 | 433 | info: Checking sync2.sbgrid.org (port: 8080) ... |
... | ... | @@ -421,22 +438,24 @@ info: Checking sbgrid.org (HTTP) ... |
421 | 438 | info: Connectivity test succeeded, all remote services are reachable |
422 | 439 | ``` |
423 | 440 | |
424 | -**diag** |
|
425 | -Run troubleshooting and diagnostic tests for the software collection. |
|
441 | +**diag** |
|
442 | +Run troubleshooting and diagnostic tests for the software collection. |
|
426 | 443 | |
427 | -**verify** |
|
428 | -Lists missing software versions and .rc files. |
|
444 | +**verify** |
|
445 | +Lists missing software versions and .rc files. |
|
429 | 446 | |
430 | 447 | ### Installing software for multiple platforms |
431 | -On linux, add the --darwin command to install / remove for macOS . |
|
432 | -Conversely, use the --linux command to install / remove for Linux while on macOS. |
|
433 | -These flags can be added to many of the subcommands to limit to Linux or macOS. |
|
448 | + |
|
449 | +On linux, add the --darwin command to install / remove for macOS . |
|
450 | +Conversely, use the --linux command to install / remove for Linux while on macOS. |
|
451 | +These flags can be added to many of the subcommands to limit to Linux or macOS. |
|
434 | 452 | Useful for servers that share a software stack over NFS. |
435 | 453 | |
436 | 454 | ``` |
437 | 455 | $ sbgrid-cli list --darwin |
438 | 456 | ``` |
439 | -This will list all software available for macOS. |
|
457 | + |
|
458 | +This will list all software available for macOS. |
|
440 | 459 | The platform flag ( `--linux` or `--darwin`) is implied for the platform used to install the software, i.e. on linux, `--linux` is redundant. |
441 | 460 | |
442 | 461 | ### Logging |
... | ... | @@ -444,19 +463,21 @@ The platform flag ( `--linux` or `--darwin`) is implied for the platform used to |
444 | 463 | `sbgrid-cli` writes log files to `$HOME/.sbgrid/logs` |
445 | 464 | |
446 | 465 | ### Software Version Management in the SBGrid environment |
466 | + |
|
447 | 467 | If you have a single version of an application installed, explicit version selection in your environment is not needed. |
448 | 468 | |
449 | -In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*. |
|
469 | +In the case of multiple installed versions, the _SBGrid Default_ version will be the version available at the terminal when it is installed, unless configured otherwise in _~/.sbgrid.conf_. |
|
450 | 470 | |
451 | -In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment. |
|
471 | +In the case of multiple non-default versions installed, the _latest release_ will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your _~/.sbgrid.conf_ file. This is the same as in the standard SBGrid environment. |
|
452 | 472 | |
453 | 473 | **Version priority in the shell** |
454 | - 1. *~/.sbgrid.conf* |
|
455 | - 2. Installed single version |
|
456 | - 3. Installed Default version |
|
457 | - 4. Latest installed release |
|
458 | 474 | |
459 | -There is more info on how to manage versions here --> [SBGrid version overrides](versions) |
|
475 | +1. _~/.sbgrid.conf_ |
|
476 | +2. Installed single version |
|
477 | +3. Installed Default version |
|
478 | +4. Latest installed release |
|
479 | + |
|
480 | +There is more info on how to manage versions here --> [SBGrid version overrides](versions) |
|
460 | 481 | |
461 | 482 | ### Running SBGrid software |
462 | 483 | |
... | ... | @@ -468,12 +489,11 @@ or in tcsh |
468 | 489 | |
469 | 490 | $ source /programs/sbgrid.cshrc |
470 | 491 | |
471 | -For more info on system configuration for SBGrid software, please check here ---> [Workstation setup](workstation_setup). |
|
492 | +For more info on system configuration for SBGrid software, please check here ---> [Workstation setup](workstation_setup). |
|
472 | 493 | |
473 | 494 | ### Known Issues |
474 | 495 | |
475 | - **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
476 | - |
|
496 | +**rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
477 | 497 | |
478 | 498 | ### Deprecated releases |
479 | 499 |
sbgrid-gui.md
... | ... | @@ -0,0 +1 @@ |
1 | +client_install.md |
|
... | ... | \ No newline at end of file |
schrodinger_remote.md
... | ... | @@ -12,14 +12,13 @@ The schrodinger.hosts file should be located (or created) in your home directory |
12 | 12 | |
13 | 13 | An example schrodinger.hosts file: |
14 | 14 | |
15 | - |
|
16 | 15 | name: localhost |
17 | 16 | tmpdir: /tmp/ |
18 | 17 | |
19 | 18 | # remote system |
20 | - name: sbgrid-zorin |
|
21 | - user: my_remote_username |
|
22 | - host: zorin.sbgrid.org |
|
19 | + name: <my_schrodinger_host> |
|
20 | + user: <my_remote_username> |
|
21 | + host: <my_remote_hostname> |
|
23 | 22 | tmpdir: /tmp |
24 | 23 | processors: 32 |
25 | 24 |
sharp.md
... | ... | @@ -1,7 +1,5 @@ |
1 | 1 | ## SBGrid Sharp server |
2 | 2 | |
3 | -Due to decreased user demand and security considerations, SBGrid no longer maintains a user-accessible server for Global Phasing's application Sharp/AutoSharp. |
|
4 | -We now include Sharp in the SBGrid programs collection and it can be accessed through the CCP4 interface. A license from Global Phasing is required and must be locally installed. |
|
3 | +Due to decreased user demand and security considerations, SBGrid no longer maintains a user-accessible server for Global Phasing's application Sharp/AutoSharp. We now include Sharp in the SBGrid programs collection and it can be accessed through the CCP4 interface. A license from Global Phasing is required and must be locally installed. |
|
5 | 4 | |
6 | -For more information see [here](https://sbgrid.org/software/titles/sharpautosharp) |
|
7 | -Documentation for using Sharp can be found [here](http://www.globalphasing.com/sharp/manual/) |
|
5 | +For more information see [here](https://sbgrid.org/software/titles/sharpautosharp). Documentation for using Sharp can be found [here](http://www.globalphasing.com/sharp/manual/) |
size_graph.md
... | ... | @@ -9,6 +9,7 @@ |
9 | 9 | ``` |
10 | 10 | |
11 | 11 | ### x86_64-linux |
12 | + |
|
12 | 13 | **TITLES LARGER THAN 1GB :** |
13 | 14 | |
14 | 15 | ``` |
... | ... | @@ -98,10 +99,11 @@ |
98 | 99 | 1.0G cns/ [+ ] |
99 | 100 | 1.0G modeller/ [+ ] |
100 | 101 | 1.0G julia/ [+ ] |
101 | - 1.0G cryoid/ [+ ] |
|
102 | + 1.0G cryoid/ [+ ] |
|
102 | 103 | ``` |
103 | 104 | |
104 | 105 | ### i386-mac |
106 | + |
|
105 | 107 | **TITLES LARGER THAN 1GB :** |
106 | 108 | |
107 | 109 | ``` |
... | ... | @@ -161,6 +163,7 @@ |
161 | 163 | ``` |
162 | 164 | |
163 | 165 | ### share |
166 | + |
|
164 | 167 | **TITLES LARGER THAN 1GB :** |
165 | 168 | |
166 | 169 | ``` |
... | ... | @@ -168,4 +171,4 @@ |
168 | 171 | 9.4G morda/ [++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ] |
169 | 172 | 5.6G texlive/ [+++++++++++++++++++++++++++++++++ ] |
170 | 173 | 5.1G balbes/ [++++++++++++++++++++++++++++++ ] |
171 | -``` |
|
... | ... | \ No newline at end of file |
0 | +``` |
stereo.md
... | ... | @@ -1,10 +1,5 @@ |
1 | 1 | ## General |
2 | 2 | |
3 | -### 3D Stereo on RHEL/CentOS 6 systems |
|
4 | - |
|
5 | -Nvidia 3d stereo on RHEL 6 is reasonably straight-forward. |
|
6 | -Take a look [here](xorg_conf) for an example xorg.conf file. This configuration if for a Quadro 4000 card and a 1920x1080 display. Your settings may vary depending on your hardware. |
|
7 | - |
|
8 | 3 | ### 3D Stereo on RHEL/CentOS 7 systems with Gnome 3 |
9 | 4 | |
10 | 5 | Nvidia 3D stereo typically requires disabling the Composite extension in X.org. Unfortunately, this extension is required to run Gnome 3 and the gdm login mangager supplied as the default desktop in CentOS and many other linux distributions. |
... | ... | @@ -16,69 +11,46 @@ The MATE Desktop Environment is the continuation of GNOME 2 which is the default |
16 | 11 | |
17 | 12 | To change to MATE on CentOS7 systems, first, install the Extra Packages for Enterprise Linux (EPEL) repo: |
18 | 13 | |
19 | - |
|
20 | - yum install epel-release |
|
21 | - |
|
14 | + yum install epel-release |
|
22 | 15 | |
23 | 16 | Then install the nvidia drivers from epel |
24 | 17 | |
25 | - |
|
26 | - yum install kmod-nvidia |
|
27 | - |
|
18 | + yum install kmod-nvidia |
|
28 | 19 | |
29 | 20 | You may find you need these packages as well |
30 | 21 | |
31 | - |
|
32 | - yum install mesa-libGLU-9.0.0-4.el7.x86_64 libXScrnSaver-1.2.2-6.1.el7.x86_64 |
|
33 | - |
|
22 | + yum install mesa-libGLU-9.0.0-4.el7.x86_64 libXScrnSaver-1.2.2-6.1.el7.x86_64 |
|
34 | 23 | |
35 | 24 | Next, install lightdm which doesn't require the composite extension. |
36 | 25 | |
37 | - |
|
38 | - yum install lightdm |
|
39 | - |
|
26 | + yum install lightdm |
|
40 | 27 | |
41 | 28 | From there we do a couple of groupinstalls |
42 | 29 | You may have these rpms installed already, but just for good measure |
43 | 30 | |
44 | - |
|
45 | - yum group install "X Window System" |
|
46 | - |
|
31 | + yum group install "X Window System" |
|
47 | 32 | |
48 | 33 | then |
49 | 34 | |
50 | - |
|
51 | - yum groupinstall "MATE Desktop" |
|
52 | - |
|
35 | + yum groupinstall "MATE Desktop" |
|
53 | 36 | |
54 | 37 | Toggle from gdm to lightdm in systemd using systemctl. |
55 | 38 | To see what you are using as a 'display manager', check this link |
56 | 39 | |
57 | - |
|
58 | - ls -l /etc/systemd/system/display-manager.service |
|
59 | - |
|
40 | + ls -l /etc/systemd/system/display-manager.service |
|
60 | 41 | |
61 | 42 | This is likely pointing to gdm and should be changed to point to lightdm. |
62 | 43 | You can change that with systemctl. |
63 | 44 | |
64 | - |
|
65 | - systemctl disable gdm |
|
66 | - systemctl enable lightdm |
|
67 | - |
|
45 | + systemctl disable gdm |
|
46 | + systemctl enable lightdm |
|
68 | 47 | |
69 | 48 | And then this will reload you changes, similar to changing runlevels with sysinitV |
70 | 49 | |
50 | + systemctl isolate graphical.target |
|
71 | 51 | |
72 | - systemctl isolate graphical.target |
|
73 | - |
|
74 | - |
|
75 | -Make sure to select MATE from the drop menu as your graphical before you login. |
|
76 | - |
|
77 | -## Mac OS X |
|
78 | - |
|
79 | -* X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/) to run X11-based applications. |
|
52 | +Make sure to select MATE from the drop menu as your graphical before you login. |
|
80 | 53 | |
81 | -## Laptops |
|
54 | +## Mac OS X |
|
82 | 55 | |
83 | -* You can create a local installation to take along with you. |
|
84 | -http://www.sbgrid.org/wiki/laptopinstall |
|
56 | +- We are not aware of Stereo viewing options for macOS computers at this time. |
versions.md
... | ... | @@ -4,47 +4,43 @@ Most of the software titles installed in the SBGrid software collection have sev |
4 | 4 | |
5 | 5 | ## Display Available Versions |
6 | 6 | |
7 | -To list the available versions of a software title, you can use the *sbgrid* utility. Running *sbgrid -l* will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this: |
|
7 | +To list the available versions of a software title, you can use the _sbgrid_ utility. Running _sbgrid -l_ will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this: |
|
8 | 8 | |
9 | + $ sbgrid-info -l ccp4 |
|
10 | + Version information for: /programs/x86_64-linux/ccp4 |
|
9 | 11 | |
10 | - $ sbgrid-info -l ccp4 |
|
11 | - Version information for: /programs/x86_64-linux/ccp4 |
|
12 | + Default version: 7.0 |
|
13 | + In-use version: 6.5 |
|
14 | + Other available versions: 6.4.0 6.3.0 |
|
15 | + Overrides use this shell variable: CCP4_X |
|
12 | 16 | |
13 | - Default version: 7.0 |
|
14 | - In-use version: 6.5 |
|
15 | - Other available versions: 6.4.0 6.3.0 |
|
16 | - Overrides use this shell variable: CCP4_X |
|
17 | +Running _sbgrid-info -L_ will print the available versions for the three current platforms (OS X PowerPC and Intel, Linux). |
|
17 | 18 | |
19 | + $ sbgrid-info -L gnuplot |
|
20 | + Version information for: /programs/x86_64-linux/gnuplot |
|
18 | 21 | |
19 | -Running *sbgrid-info -L* will print the available versions for the three current platforms (OS X PowerPC and Intel, Linux). |
|
22 | + Default version: 4.6.4 |
|
23 | + In-use version: 4.6.4 |
|
24 | + Other available versions: 4.6.0 4.4.3 4.2.6 |
|
25 | + Overrides use this shell variable: GNUPLOT_X |
|
20 | 26 | |
27 | + Version information for: /programs/i386-linux/gnuplot |
|
21 | 28 | |
22 | - $ sbgrid-info -L gnuplot |
|
23 | - Version information for: /programs/x86_64-linux/gnuplot |
|
29 | + Default version: 4.6.0 |
|
30 | + Other available versions: 4.4.3 4.2.6 |
|
31 | + Overrides use this shell variable: GNUPLOT_L |
|
24 | 32 | |
25 | - Default version: 4.6.4 |
|
26 | - In-use version: 4.6.4 |
|
27 | - Other available versions: 4.6.0 4.4.3 4.2.6 |
|
28 | - Overrides use this shell variable: GNUPLOT_X |
|
29 | - |
|
30 | - Version information for: /programs/i386-linux/gnuplot |
|
31 | - |
|
32 | - Default version: 4.6.0 |
|
33 | - Other available versions: 4.4.3 4.2.6 |
|
34 | - Overrides use this shell variable: GNUPLOT_L |
|
35 | - |
|
36 | - Version information for: /programs/i386-mac/gnuplot |
|
37 | - |
|
38 | - Default version: 4.6.4 |
|
39 | - Other available versions: 4.4.3 4.2.6 4.6.0 |
|
40 | - Overrides use this shell variable: GNUPLOT_M |
|
33 | + Version information for: /programs/i386-mac/gnuplot |
|
41 | 34 | |
35 | + Default version: 4.6.4 |
|
36 | + Other available versions: 4.4.3 4.2.6 4.6.0 |
|
37 | + Overrides use this shell variable: GNUPLOT_M |
|
42 | 38 | |
43 | 39 | ## Overriding Default Versions |
44 | 40 | |
45 | -To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version. |
|
41 | +To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version. |
|
46 | 42 | |
47 | -The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this: |
|
43 | +The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this: |
|
48 | 44 | |
49 | 45 | `APPLICATION_X=1.2` |
50 | 46 | |
... | ... | @@ -52,18 +48,19 @@ APPLICATION_X is the name of the application followed by an underscore and the s |
52 | 48 | |
53 | 49 | | Software Directory | Shorthand Initial | |
54 | 50 | | ------------------ | ----------------- | |
55 | -| x86_64-linux | _X | |
|
56 | -| i386-mac | _M | |
|
51 | +| x86_64-linux | \_X | |
|
52 | +| i386-mac | \_M | |
|
57 | 53 | |
58 | -To quickly open the overrides file in your default $EDITOR, you can run *sbgrid-overrides -e*. |
|
54 | +To quickly open the overrides file in your default $EDITOR, you can run _sbgrid-overrides -e_. |
|
59 | 55 | |
60 | -When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well. |
|
56 | +When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well. |
|
61 | 57 | |
62 | 58 | The example output below shows CCP4 on linux being changed from the default version: |
63 | 59 | |
64 | - Configuration options in effect for this shell: |
|
65 | - Variable Setting Configuration |
|
66 | - CCP4_M 6.3.0 personal |
|
60 | + Configuration options in effect for this shell: |
|
61 | + Variable Setting Configuration |
|
62 | + CCP4_M 6.3.0 personal |
|
67 | 63 | |
68 | 64 | ## Disabling a Software Package |
65 | + |
|
69 | 66 | To disable a specific software package, set its version to "disable" in your ~/.sbgrid.conf file. |
workstation_setup.md
... | ... | @@ -1,32 +1,30 @@ |
1 | 1 | ## General |
2 | 2 | |
3 | -* You should use a network installation for workstations and servers if at all possible. NFS, SMB and AFP all work for sharing a single installation among multiple machines. The decreased admin overhead, bandwidth and disk savings of sharing a single installation is a significant benefit. |
|
3 | +- You should use a network installation for workstations and servers if at all possible. NFS, SMB and AFP all work for sharing a single installation among multiple machines. The decreased admin overhead, bandwidth and disk savings of sharing a single installation is a significant benefit. |
|
4 | 4 | |
5 | 5 | ## Linux |
6 | -Information on configuring 3D stereo can be found [here](stereo) |
|
7 | 6 | |
8 | -* All Linux machines need installations of a recent version (6.17+) of csh/tcsh. Red Hat Enterprise Linux 6 and other recent distributions usually have an up to date version. |
|
7 | +Information on configuring 3D stereo can be found [here](stereo) |
|
9 | 8 | |
10 | -* SELinux must be disabled. |
|
9 | +- All Linux machines need installations of a recent version (6.17+) of csh/tcsh. Red Hat Enterprise Linux 6 and other recent distributions usually have an up to date version. |
|
11 | 10 | |
12 | -* 64-bit machines need a number of 32-bit compatibility packages due to a number of legacy packages that are only available as 32-bit applications. Additional fonts for Tcl/Tk, Motif and Xview applications are also encouraged. |
|
11 | +- 64-bit machines need a number of 32-bit compatibility packages due to a number of legacy packages that are only available as 32-bit applications. Additional fonts for Tcl/Tk, Motif and Xview applications are also encouraged. |
|
13 | 12 | |
14 | 13 | Packages for RHEL 7, and 8 and compatible machines: |
15 | 14 | |
16 | - yum install glibc.i686 gnome-terminal libgcc.i686 libX11.i686 libXaw.i686 libXext.i686 \ |
|
17 | - ncurses.i686 redhat-lsb.i686 xorg-x11-fonts-75dpi xorg-x11-fonts-100dpi xorg-x11-fonts-ISO8859-1-75dpi \ |
|
18 | - xorg-x11-fonts-ISO8859-1-100dpi xorg-x11-fonts-misc libXScrnSaver freetype.i686 \ |
|
19 | - fontconfig.i686 zlib.i686 libstdc++.i686 glx-utils |
|
20 | - |
|
21 | -In addition to the above, on RHEL8, CentOS8 and similar distributions, you will need |
|
15 | + yum install glibc.i686 gnome-terminal libgcc.i686 libX11.i686 libXaw.i686 libXext.i686 \ |
|
16 | + ncurses.i686 redhat-lsb.i686 xorg-x11-fonts-75dpi xorg-x11-fonts-100dpi xorg-x11-fonts-ISO8859-1-75dpi \ |
|
17 | + xorg-x11-fonts-ISO8859-1-100dpi xorg-x11-fonts-misc libXScrnSaver freetype.i686 \ |
|
18 | + fontconfig.i686 zlib.i686 libstdc++.i686 glx-utils |
|
22 | 19 | |
23 | - yum install libnsl |
|
20 | +In addition to the above, on RHEL8, CentOS8 and similar distributions, you will need |
|
24 | 21 | |
25 | -* gnome-terminal is required for [hkl2map](https://www.sbgrid.org/software/titles/hkl2map). |
|
26 | -* The same 32-bit requirement applies for 64-bit Debian and Ubuntu machines. This is supported via the [Multiarch](https://wiki.debian.org/Multiarch/HOWTO) system. You'll need at least the following packages to run most of the software. Please email us if you discover we have left some out. |
|
27 | -`apt-get install libc6-i386 lsb tcsh gawk libjpeg62 curl libx11-6:i386 libxext6:i386` |
|
22 | + yum install libnsl |
|
28 | 23 | |
29 | -## Mac OS X |
|
24 | +- gnome-terminal is required for [hkl2map](https://www.sbgrid.org/software/titles/hkl2map). |
|
25 | +- The same 32-bit requirement applies for 64-bit Debian and Ubuntu machines. This is supported via the [Multiarch](https://wiki.debian.org/Multiarch/HOWTO) system. You'll need at least the following packages to run most of the software. Please email us if you discover we have left some out. |
|
26 | + `apt-get install libc6-i386 lsb tcsh gawk libjpeg62 curl libx11-6:i386 libxext6:i386` |
|
30 | 27 | |
31 | -* * X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/) to run X11-based applications. |
|
28 | +## Mac OS X |
|
32 | 29 | |
30 | +- - X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the [MacOSForge site](https://www.xquartz.org/) to run X11-based applications. |
wsmr-worked.md
... | ... | @@ -1,35 +1,40 @@ |
1 | 1 | # Data Processing after WS-MR |
2 | 2 | |
3 | 3 | ## 1 Verify Results for Search Models |
4 | -The first follow-up step for a search model resulting from WSMR is to repeat MR locally. |
|
4 | + |
|
5 | +The first follow-up step for a search model resulting from WSMR is to repeat MR locally. |
|
5 | 6 | |
6 | 7 | To download one of the search models; first click the "Load Top 100 Hits" button, click one of the yellow circles in the resulting plot, and then use the download link for the model. |
7 | 8 | |
8 | -* * * |
|
9 | +--- |
|
10 | + |
|
9 | 11 | ![](images/data-processing-after-ws-mr-1.jpg) |
10 | -* * * |
|
12 | + |
|
13 | +--- |
|
14 | + |
|
11 | 15 | ![](images/data-processing-after-ws-mr-2.png) |
12 | -* * * |
|
16 | + |
|
17 | +--- |
|
13 | 18 | |
14 | 19 | A typical input deck (`MR01.in` for this example) for `phaser` would look something like this (with the paths to your input `MTZ` and `PDB` files adjusted appropriately): |
15 | 20 | |
16 | - ROOT MR01 |
|
17 | - MODE MR_AUTO |
|
18 | - HKLIn reflections.mtz |
|
19 | - LABIn F=FP SIGF=SIGFP |
|
20 | - ENSEmble SearchModel PDB model.pdb IDENtity 0.3 |
|
21 | - COMPosition PERCENTAGE 0.50 |
|
22 | - RESOlution HIGH 3.1 |
|
23 | - SEARch ENSEmble SearchModel NUM 1 |
|
24 | - SGALternative SELECT ALL |
|
21 | + ROOT MR01 |
|
22 | + MODE MR_AUTO |
|
23 | + HKLIn reflections.mtz |
|
24 | + LABIn F=FP SIGF=SIGFP |
|
25 | + ENSEmble SearchModel PDB model.pdb IDENtity 0.3 |
|
26 | + COMPosition PERCENTAGE 0.50 |
|
27 | + RESOlution HIGH 3.1 |
|
28 | + SEARch ENSEmble SearchModel NUM 1 |
|
29 | + SGALternative SELECT ALL |
|
25 | 30 | |
26 | -This can be run with versions of `phaser` distributed with `CCP4` or `PHENIX` (with `phaser < MR01.in > MR01.out` or `phenix.phaser < MR01.in > MR01.out` respectively). The statistics (LLG and Z-scores) from local runs may differ due to differences in `phaser` versions. |
|
31 | +This can be run with versions of `phaser` distributed with `CCP4` or `PHENIX` (with `phaser < MR01.in > MR01.out` or `phenix.phaser < MR01.in > MR01.out` respectively). The statistics (LLG and Z-scores) from local runs may differ due to differences in `phaser` versions. |
|
27 | 32 | |
28 | 33 | The `SGALternative` card is only necessary if you're checking alternative space-groups. |
29 | 34 | |
30 | 35 | ## 2 Expand Search |
31 | 36 | |
32 | -WSMR searches for a single copy of the search model - however there may be multiple copies of the model in the ASU. If so, the next step is the increase the `NUM` value for the `SEARch` card. When in doubt, it's better to set this too hight rather than too low - `phaser` will stop when unable to locate additional copies. |
|
37 | +WSMR searches for a single copy of the search model - however there may be multiple copies of the model in the ASU. If so, the next step is the increase the `NUM` value for the `SEARch` card. When in doubt, it's better to set this too hight rather than too low - `phaser` will stop when unable to locate additional copies. |
|
33 | 38 | |
34 | 39 | ## 3 Autobuild |
35 | 40 | |
... | ... | @@ -41,7 +46,6 @@ Using the `PHENIX` autobuilder: |
41 | 46 | |
42 | 47 | The input model (`MR_Results.pdb`) for the autobuilder is the final result modeles from the initial or expanded MR search. |
43 | 48 | |
44 | -The input `MTZ` file should be the original amplitudes (or intensities) used for searching, *not* the results from `phaser`. If phaser was run with the `SGALternative` card, make sure the spacegroup of this `MTZ` matches that of the search solutions. |
|
49 | +The input `MTZ` file should be the original amplitudes (or intensities) used for searching, _not_ the results from `phaser`. If phaser was run with the `SGALternative` card, make sure the spacegroup of this `MTZ` matches that of the search solutions. |
|
45 | 50 | |
46 | 51 | The `nproc=4` option should only be used if there are four (or more) available cores - when using the `rebuild_in_place` option, `phenix.autobuild` can't take advantage of more than 4 processors. |
47 | - |