3cfe1c3366b06d15f5709dbd7468ef36f59a9894
client_install.md
... | ... | @@ -72,10 +72,7 @@ Now we have */Volumes/sbgrid_client_install/sbgrid*. Create a symlink from **/op |
72 | 72 | |
73 | 73 | The symlink at **/programs** still points to **/opt/sbgrid**, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive. |
74 | 74 | |
75 | -[SBGrid install client -- Usage info](client_usage) |
|
76 | - |
|
77 | - |
|
78 | -## SBGrid installation client - Usage |
|
75 | +## Usage |
|
79 | 76 | |
80 | 77 | **Instructions for installing the SBGrid software installation client can be found here** --> [Installation Instructions](client_install) |
81 | 78 |
usage/Home.md
... | ... | @@ -1 +1 @@ |
1 | -SBGrid-Wiki.md |
|
... | ... | \ No newline at end of file |
0 | +../Home.md |
|
... | ... | \ No newline at end of file |
usage/README.md
... | ... | @@ -1 +1 @@ |
1 | -SBGrid-Wiki.md |
|
... | ... | \ No newline at end of file |
0 | +../README.md |
|
... | ... | \ No newline at end of file |
usage/SBGrid-Wiki.md
... | ... | @@ -1,4 +0,0 @@ |
1 | -## Welcome to the SBGrid Consortium Wiki |
|
2 | -![SBGrid](images/terminal.png) |
|
3 | - |
|
4 | -This site provides information on how to install, use, and get help with your SBGrid software collection. We also include some information about SBGrid services. Please let us know if you have questions. |
usage/SBGrid-Wiki.md
... | ... | @@ -0,0 +1 @@ |
1 | +../SBGrid-Wiki.md |
|
... | ... | \ No newline at end of file |
usage/_Sidebar.md
... | ... | @@ -1,38 +0,0 @@ |
1 | -![SBGrid](images/sbgrid_small_logo.gif) **[SBGrid Wiki](Home)** |
|
2 | - |
|
3 | -Installing Software |
|
4 | -* [Installation: Overview](installation_overview) |
|
5 | -* [Supported Operating Systems](operatingsystems) |
|
6 | -* [Installation: 'Site' installation](installation_admin) |
|
7 | -* [Installation: MacOS GUI](client_install) |
|
8 | -* [Installation: Package Manager](client_CLI_install) |
|
9 | - |
|
10 | -Using the SBGrid Environment |
|
11 | -* [Getting Started with SBGrid](getting_started) |
|
12 | -* [Overriding Software Versions](versions) |
|
13 | -* [SBGrid environment: Capsules](capsules) |
|
14 | -* [SBGrid environment: Legacy](monolithic) |
|
15 | -* [SBGrid MacOS GUI : Usage](client_usage) |
|
16 | -* [SBGrid Package Manager : Usage](client_CLI_usage) |
|
17 | - |
|
18 | -Getting Help |
|
19 | -* [Software Help and Requests](help) |
|
20 | - |
|
21 | -Support for Site Administrators |
|
22 | -* [Preparing Workstations to run the Software](workstation_setup) |
|
23 | -* [Managing your Installation](managing_install) |
|
24 | -* [Administrator Software Version Overrides](admin_overrides) |
|
25 | -* [Admins Mailing List](mailinglist) |
|
26 | - |
|
27 | -Support for Developers |
|
28 | -* [Resources for Developers](developers) |
|
29 | -* [Build and Test Network](resources) |
|
30 | - |
|
31 | -Hardware Support Notes |
|
32 | -* [SBGrid Recommended Hardware](recommended) |
|
33 | -* [GPU computing](gpu) |
|
34 | -* [Setup Stereo 3D](stereo) |
|
35 | - |
|
36 | -Portals |
|
37 | -* [Data Processing After WSMR](wsmr-worked) |
|
38 | -* [SBGrid SHARP server](sharp) |
usage/_Sidebar.md
... | ... | @@ -0,0 +1 @@ |
1 | +../_Sidebar.md |
|
... | ... | \ No newline at end of file |
usage/admin_overrides.md
... | ... | @@ -1,38 +0,0 @@ |
1 | -## Site Administrator Overrides |
|
2 | - |
|
3 | -SBGrid installations allow site-level software control for Administrators |
|
4 | - |
|
5 | -### Software Blacklist |
|
6 | -Site administrators can prevent the shell initialization files from configuring software on a host by creating an empty file at |
|
7 | - |
|
8 | - **/programs/local/conf/disabled-hosts/<hostname>** |
|
9 | - |
|
10 | -where **<hostname>** is the output of the //hostname -s// command. This is useful for encouraging users not to run jobs on bastion hosts, file servers, etc. |
|
11 | - |
|
12 | -### Administrator Software Version Overrides |
|
13 | -Most of the software titles installed in the SBGrid Suite have several versions available. Typically, we try to provide at least three versions of each software package, although very old or very new applications may have fewer versions. |
|
14 | - |
|
15 | -There are two methods for site admins to configure version overrides using files placed in a **/programs/local/conf/** directory. |
|
16 | - |
|
17 | -- Site-wide Version Overrides |
|
18 | -A file named **site.conf** will be read when any SBGrid shell is initialized from the installation. |
|
19 | - |
|
20 | -- Per-host Version Overrides |
|
21 | -A file named **<hostname.conf>**, where **<hostname>** is the output of the //hostname -s// command, will be read after the site.conf on the host matching that hostname. |
|
22 | - |
|
23 | -### Precedence |
|
24 | -There are three files that will be examined for version overrides during shell initialization. In order from lowest to highest precedence: |
|
25 | - |
|
26 | - * /programs/local/conf/site.conf |
|
27 | - * /programs/local/conf/<hostname.conf> |
|
28 | - * $HOME/.sbgrid.conf |
|
29 | - |
|
30 | -The overrides are reported during shell initialization: |
|
31 | - |
|
32 | -``` |
|
33 | - Configuration options in effect for this shell: |
|
34 | - Variable Setting Configuration |
|
35 | - SPIDER_L 18.10 site |
|
36 | - CNS_L 1.21 machine |
|
37 | - CCP4_L 6.1.2 personal |
|
38 | -``` |
usage/admin_overrides.md
... | ... | @@ -0,0 +1 @@ |
1 | +../admin_overrides.md |
|
... | ... | \ No newline at end of file |
usage/client_CLI_install.md
... | ... | @@ -1,161 +0,0 @@ |
1 | -## SBGrid package mangager installation client |
|
2 | - |
|
3 | -The SBGrid software stack can be installed using our CLI (command line interface) installation client for [Linux (CentOS/RHEL 6 or 7 recommended) or Apple OSX computers running MacOSX v10.9 - 10.12.](operatingsystems) |
|
4 | - |
|
5 | -Three software installers are available. Binary releases are available for MacOS and CentOS7/Ubuntu operating systems. A python release is also provided which is compatible with Mac and most Linux (CentOS6 and higher) operating systems. |
|
6 | - |
|
7 | -The SBGrid installation client requires an individual account. To get started, first, set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/) |
|
8 | - |
|
9 | -### Pre-installation requirements |
|
10 | - |
|
11 | -**Admin access required on your computer.** |
|
12 | - The SBGrid installation client will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. While admin privileges are not required to run the application, you will need admin privileges to create /opt/sbgrid and /programs . |
|
13 | - |
|
14 | -**Existing SBGrid installations must be renamed or removed.** |
|
15 | - If you have previously installed SBGrid software on your computer at /programs or at /opt/sbgrid, these directories should be removed or renamed. The client will create these on first run. |
|
16 | - |
|
17 | -**Hard Drive Space** |
|
18 | - Depending on what you install, ensure you have enough free hard drive space on your machine. |
|
19 | - |
|
20 | -**For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.** |
|
21 | - Some packages are quite large and can be slow to download, especially over WiFi. |
|
22 | - |
|
23 | -**pip** |
|
24 | - pip is a package management system used to install and manage software packages written in Python. The software installation client is installable by pip. This may not be on you machine by default, instructions for adding it are included here. |
|
25 | - |
|
26 | -### Binary releases : MacOS and Linux Installation |
|
27 | - |
|
28 | -There is minimal installation needed for these binaries. They can be run from any location. Untar the archive, make the file executable if necessary, and run from your preferred location. |
|
29 | - |
|
30 | -[Mac : 1.0.555, 2017-06-21](downloads/sbgrid-1.0.555-Darwin.tgz) |
|
31 | - |
|
32 | -[Linux : 1.0.555, 2017-06-21](downloads/sbgrid-1.0.555-Linux.tgz) |
|
33 | - |
|
34 | -``` |
|
35 | -$ tar -zxf sbgrid-1.0.555-Darwin.tgz |
|
36 | - |
|
37 | -$ cd sbgrid-1.0.555-Darwin |
|
38 | - |
|
39 | -$ ./sbgrid |
|
40 | -usage: |
|
41 | -sbgrid <command> [<command_args>] |
|
42 | - |
|
43 | -Available commands are: |
|
44 | - activate activate new installation |
|
45 | - grids list available grids |
|
46 | - info print package metadata |
|
47 | - install install single package |
|
48 | - install-all install all packages from collection |
|
49 | - installed list installed packages |
|
50 | - list list available packages |
|
51 | - rebuild rebuild installation |
|
52 | - remove remove installed package |
|
53 | - resume resume interrupted installations |
|
54 | - update update package to latest release/version |
|
55 | - update-all update all packages to latest release/version |
|
56 | - updates list available updates for installed packages |
|
57 | - version print package version string |
|
58 | -sbgrid: error: too few arguments |
|
59 | -``` |
|
60 | - |
|
61 | -### Install python wheel using **pip** - Mac Installation |
|
62 | - |
|
63 | - On mac, pip is available from [macports](https://www.macports.org/), [homebrew](http://brew.sh/), and [fink](http://finkproject.org/). It also can be added using **easy_install**. easy_install will install pip into your system python. |
|
64 | - |
|
65 | - $ sudo easy_install pip |
|
66 | - |
|
67 | -### Install python wheel using **pip** - Linux Installation |
|
68 | - |
|
69 | - On CentOS6, you can install pip from the EPEL repository (yum -y install python-pip) or as [per these directions](https://pip.pypa.io/en/stable/installing/) |
|
70 | - |
|
71 | -## CLI client - Installation and activation |
|
72 | -**1. Download the latest SBGrid installation client from here.** |
|
73 | - |
|
74 | -[Latest build : 1.0.555, 2017-06-21](downloads/sbgrid-1.0.555-py2-none-any.whl) |
|
75 | - |
|
76 | -**2. Install / Upgrade with pip** |
|
77 | - |
|
78 | - $ sudo pip install SBGrid_Installer-1.0.461-py2-none-any.whl |
|
79 | - |
|
80 | - Which should produce output similar to : |
|
81 | - |
|
82 | -``` |
|
83 | -Unpacking ./SBGrid_Installer-1.0.448-py2-none-any.whl |
|
84 | -Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /nfs/programs-dev/i386-mac/python/2.7.5/lib/python2.7/site-packages (from SBGrid-Installer==1.0.488) |
|
85 | -Downloading/unpacking requests (from SBGrid-Installer==1.0b2.dev412) |
|
86 | - Downloading requests-2.11.1.tar.gz (485kB): 485kB downloaded |
|
87 | - Running setup.py egg_info for package requests |
|
88 | - |
|
89 | - warning: no files found matching 'test_requests.py' |
|
90 | -Installing collected packages: SBGrid-Installer, requests |
|
91 | - Running setup.py install for requests |
|
92 | - |
|
93 | - warning: no files found matching 'test_requests.py' |
|
94 | -Successfully installed SBGrid-Installer requests |
|
95 | -Cleaning up... |
|
96 | -``` |
|
97 | - |
|
98 | -The *sbgrid* command will produce this usage info : |
|
99 | - |
|
100 | - $ sbgrid |
|
101 | - |
|
102 | -``` |
|
103 | -usage: |
|
104 | -sbgrid <command> [<command_args>] |
|
105 | - |
|
106 | -Available commands are: |
|
107 | - activate Activate new installation |
|
108 | - list List available packages |
|
109 | - info Print package metadata |
|
110 | - install Install single package |
|
111 | - install-all Install all packages from collection |
|
112 | - installed List installed packages |
|
113 | - remove Remove installed package |
|
114 | - resume Resume interrupted installations |
|
115 | - upgrades List available upgrades for installed packages |
|
116 | - upgrade Upgrade package to latest version |
|
117 | - upgrade-all Upgrade all packages to latest version |
|
118 | - version Print package version string |
|
119 | -sbgrid: error: too few arguments |
|
120 | - |
|
121 | -``` |
|
122 | - |
|
123 | -**4. Activate the installation** |
|
124 | -Enter your site and key which you should have received these by email. |
|
125 | - |
|
126 | - $ sbgrid activate <site name> <user name> <activation key> |
|
127 | - |
|
128 | -You may be prompted for your sudo password to create /programs and /opt/sbgrid. |
|
129 | - |
|
130 | -**5. On successful activation, list software titles.** |
|
131 | - |
|
132 | - $ sbgrid list |
|
133 | - |
|
134 | - If activation continues to fail, you may have an old SBGrid installation at /programs or /opt/sbgrid. These should be removed. |
|
135 | - |
|
136 | -You may also be blocked from accessing SBGrid servers on port 873 and port 8080 by your institution's firewall. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080) |
|
137 | - |
|
138 | -For help, email *bugs@sbgrid.org.* |
|
139 | - |
|
140 | -### Installation on an external drive or USB key |
|
141 | -Currently the installer application installs the software tree in /opt/sbgrid and uses a symlink at /programs. This link is required for the software to work, but in principle the software can be located anywhere and linked to /opt/sbgrid. This functionality is not yet included in the SBGrid application, but can be set up manually with a symlink. |
|
142 | - |
|
143 | -An installation can be made on an external drive if you first do an install (into /opt/sbgrid), then move it and symlink to the new location. |
|
144 | - |
|
145 | -**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is */Volumes/sbgrid_client_install*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application. |
|
146 | - |
|
147 | -Next move */opt/sbgrid* to the USB key at */Volumes/sbgrid_client_install*. You will likely need sudo for this. |
|
148 | - |
|
149 | - $ sudo mv /opt/sbgrid /Volumes/sbgrid_client_install/. |
|
150 | - |
|
151 | -Now we have */Volumes/sbgrid_client_install/sbgrid*. Create a symlink from */opt/sbgrid* to */Volumes/sbgrid_client_install/sbgrid*. |
|
152 | - |
|
153 | - $ sudo ln -s /Volumes/sbgrid_client_install/sbgrid /opt/sbgrid |
|
154 | - |
|
155 | -The symlink at */programs* still points to */opt/sbgrid*, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive. |
|
156 | - |
|
157 | -### Some known issues |
|
158 | - |
|
159 | -* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. |
|
160 | - |
|
161 | -* **Activation Failed**. In some cases the Authorization dialog for admin privileges does not appear during activation. This causes the client activation to fail. This is usually due to a previously existing /programs directory or symlink from a prior installation. This must be removed for activation to be successful. Other users have reported successful activation after a restart. |
usage/client_CLI_install.md
... | ... | @@ -0,0 +1 @@ |
1 | +../client_CLI_install.md |
|
... | ... | \ No newline at end of file |
usage/client_CLI_usage.md
... | ... | @@ -1,253 +0,0 @@ |
1 | -## SBGrid installation client - Usage |
|
2 | - |
|
3 | -**Instructions for installation of the SBGrid software installation client can be found here** --> [Installation Instructions](client_CLI_install). |
|
4 | - |
|
5 | -All SBGrid software is run from the the terminal. |
|
6 | -For information on how to run software from the SBGrid collection and configure your shell, check the [getting started page.](getting_started). |
|
7 | - |
|
8 | -### General |
|
9 | -The SBGrid software installation client is a command line-based installer for the SBGrid software collection. The application allows for selected applications to be installed in the familiar SBGrid environment. |
|
10 | - |
|
11 | -The client displays software 'Collections' as a list. |
|
12 | - |
|
13 | - $ sbgrid list |
|
14 | - |
|
15 | -``` |
|
16 | -Crystallography |
|
17 | - 3dna |
|
18 | - adxv |
|
19 | - albula |
|
20 | - autoproc |
|
21 | - ... |
|
22 | - |
|
23 | -NMR |
|
24 | - aqua |
|
25 | - aria |
|
26 | - cara |
|
27 | - ccpnmr |
|
28 | - ccpnmr-chembuild |
|
29 | - ... |
|
30 | - |
|
31 | -Electron Microscopy |
|
32 | - 2dx |
|
33 | - ace2 |
|
34 | - auto3dem |
|
35 | - bfactor |
|
36 | - bsoft |
|
37 | - burnham-brandeis-helical-package |
|
38 | - chimera |
|
39 | - ... |
|
40 | - |
|
41 | -Structure Visualization & Analysis |
|
42 | - 3dna |
|
43 | - anaconda |
|
44 | - apbs |
|
45 | - aqua |
|
46 | - bobscript |
|
47 | - caver |
|
48 | - caver-analyst |
|
49 | - ccp4mg |
|
50 | - chimera |
|
51 | - ... |
|
52 | - |
|
53 | -Computational Chemistry |
|
54 | - ambertools |
|
55 | - apbs |
|
56 | - appion |
|
57 | - autodock |
|
58 | - autodock-vina |
|
59 | - avogadro |
|
60 | - concoord |
|
61 | - dock |
|
62 | - gromacs |
|
63 | - ... |
|
64 | - |
|
65 | -Other |
|
66 | - a2ps |
|
67 | - abyss |
|
68 | - aline |
|
69 | - amigos-ii |
|
70 | - amps |
|
71 | - assemble2 |
|
72 | - bamtools |
|
73 | - ... |
|
74 | -``` |
|
75 | - |
|
76 | -Information about each title, including a description and links to documentation can be show with the *sbgrid info <title>* command. |
|
77 | - |
|
78 | -### Example : Installing Albula |
|
79 | - |
|
80 | - $ sbgrid info albula |
|
81 | - |
|
82 | -``` |
|
83 | -Package: ALBULA |
|
84 | -Name slug: albula |
|
85 | - |
|
86 | -Available versions: |
|
87 | -* 3.2.0-2 (default) |
|
88 | -* 3.1.0-13 |
|
89 | -* 3.0.0-14 |
|
90 | -* 2.2.12 |
|
91 | - |
|
92 | -Collection(s): Crystallography |
|
93 | - |
|
94 | -Description: |
|
95 | - consists of the standalone program ALBULA VIEWER, a fast and easy-to- |
|
96 | -use program that allows optimal visualization of PILATUS and EIGER data, |
|
97 | -and ALBULA API, a Python programming interface for displaying images and |
|
98 | -performing operations and calculations. The API enables you to easily |
|
99 | -integrate the viewer functionality into your beamline infrastructure or |
|
100 | -experimental setup. |
|
101 | - |
|
102 | -Links: |
|
103 | -* Website: https://www.dectris.com/Albula_Overview.html |
|
104 | -``` |
|
105 | - |
|
106 | -To install: |
|
107 | - |
|
108 | - $ sbgrid install albula |
|
109 | - |
|
110 | -``` |
|
111 | -Installing: albula |
|
112 | -Updating installation configuration... |
|
113 | -Installation was successfull! |
|
114 | -``` |
|
115 | - |
|
116 | -To get started, load the SBGrid environment : |
|
117 | - |
|
118 | - $ source /programs/sbgrid.shrc |
|
119 | - |
|
120 | -``` |
|
121 | - Software Support by SBGrid (www.sbgrid.org) |
|
122 | -******************************************************************************** |
|
123 | - |
|
124 | -... |
|
125 | - |
|
126 | -SBGrid installation last updated: 2016-10-21 |
|
127 | -Please submit bug reports and help requests to: <bugs@sbgrid.org> or |
|
128 | - <http://sbgrid.org/bugs> |
|
129 | -******************************************************************************** |
|
130 | -``` |
|
131 | - |
|
132 | -### Example : Removing Albula |
|
133 | - |
|
134 | - $ sbgrid remove albula |
|
135 | - |
|
136 | -results in : |
|
137 | - |
|
138 | -``` |
|
139 | -Removing: albula |
|
140 | -Updating installation configuration... |
|
141 | -Package removed! |
|
142 | -``` |
|
143 | - |
|
144 | -### Version selection |
|
145 | - |
|
146 | -Default versions are installed by default for each application, though individual versions can be selected for each title. |
|
147 | - |
|
148 | -To do so, include the version after the title followed the version. To see what versions are available, use the *sbgrid info <title>* command. Let;s us the title epmr as an example here: |
|
149 | - |
|
150 | - $ sbgrid info epmr |
|
151 | - |
|
152 | -``` |
|
153 | -Package: EPMR |
|
154 | -Name slug: epmr |
|
155 | - |
|
156 | -Available versions: |
|
157 | -* 16.04 (default) |
|
158 | -* 16.01 |
|
159 | -* 15.12 |
|
160 | -* 15.04 |
|
161 | -* 13.07 |
|
162 | -* 11.02 |
|
163 | - |
|
164 | -Collection(s): Crystallography |
|
165 | - |
|
166 | -Description: |
|
167 | - a program that finds crystallographic molecular replacement solutions |
|
168 | -using an evolutionary search algorithm. The program directly optimizes |
|
169 | -three rotational and three positional parameters for the search model with |
|
170 | -respect to the correlation coefficient between Fo and Fc. |
|
171 | - |
|
172 | -Links: |
|
173 | -* Website: http://www.epmr.info/ |
|
174 | -* Manual: http://www.epmr.info/UsersGuide.html |
|
175 | -``` |
|
176 | - |
|
177 | -To install version 11.02, add the version string like so: |
|
178 | - |
|
179 | - $ sbgrid install epmr 11.02 |
|
180 | - |
|
181 | -which will produce : |
|
182 | - |
|
183 | -``` |
|
184 | -Installing: epmr (11.02) |
|
185 | -Updating installation configuration... |
|
186 | -Installation was successfull! |
|
187 | -key@key-mbp [20161021-21:05:56] ~/Downloads |
|
188 | -``` |
|
189 | - |
|
190 | -Check which versions are installed with the sbgrid info command again |
|
191 | - |
|
192 | - $ sbgrid info epmr |
|
193 | - |
|
194 | -``` |
|
195 | -epPackage: EPMR |
|
196 | -Name slug: epmr |
|
197 | - |
|
198 | -Available versions: |
|
199 | -* 16.04 (default) |
|
200 | -* 16.01 |
|
201 | -* 15.12 |
|
202 | -* 15.04 |
|
203 | -* 13.07 |
|
204 | -* 11.02 (installed) |
|
205 | - |
|
206 | -... |
|
207 | - |
|
208 | -``` |
|
209 | - |
|
210 | -Confirm with the *sbwhich* command |
|
211 | - |
|
212 | - |
|
213 | - $ sbwhich epmr |
|
214 | -``` |
|
215 | -/programs/i386-mac/epmr/11.02/epmr |
|
216 | -``` |
|
217 | - |
|
218 | -Reload the sbgrid shell to use the new version ( or set the environment variable EPMR_M=11.02 ). |
|
219 | - |
|
220 | -### Software Versions Management in the SBGrid environment |
|
221 | -If you have a single version of an application installed, explicit version selection in your environment is not needed. |
|
222 | - |
|
223 | -In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*. |
|
224 | - |
|
225 | -In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment. |
|
226 | - |
|
227 | -**Version priority in the shell** |
|
228 | - 1. *~/.sbgrid.conf* |
|
229 | - 2. Installed single version |
|
230 | - 3. Installed Default version |
|
231 | - 4. Latest installed release |
|
232 | - |
|
233 | -There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
234 | - |
|
235 | -### Running SBGrid software |
|
236 | - |
|
237 | -To use the software at the terminal in bash, open a new terminal and run |
|
238 | - |
|
239 | - $ source /programs/sbgrid.shrc |
|
240 | - |
|
241 | -or in tcsh |
|
242 | - |
|
243 | - $ source /programs/sbgrid.cshrc |
|
244 | - |
|
245 | -### Questions, Problems and Known Issues |
|
246 | -For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*. |
|
247 | -If relevant, please include a screenshot of the GUI if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report. |
|
248 | - |
|
249 | -**Known issues** |
|
250 | - |
|
251 | -* The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. |
|
252 | - |
|
253 | -* In some cases the prompt for admin credentials fails to appear on activation. Be sure there is no prior SBGrid install on your machine at /programs or /opt/sbgrid. |
usage/client_CLI_usage.md
... | ... | @@ -0,0 +1 @@ |
1 | +../client_CLI_usage.md |
|
... | ... | \ No newline at end of file |
usage/client_usage.md
... | ... | @@ -1,83 +0,0 @@ |
1 | -## SBGrid installation client - Usage |
|
2 | - |
|
3 | -**Instructions for installing the SBGrid software installation client can be found here** --> [Installation Instructions](client_install) |
|
4 | - |
|
5 | -### General |
|
6 | -The SBGrid software installation client is a GUI-based installer for the SBGrid software collection. The application allows for selected applications to be installed in the familiar SBGrid environment. |
|
7 | - |
|
8 | - ![installed](images/client_install.png) |
|
9 | - |
|
10 | -The client GUI is displays software 'Collections' on the right panel with folder icons under the 'Packages' heading. These Collections control the list of titles displayed in the center 'main' panel. |
|
11 | - |
|
12 | -The first of two of these 'Collections' are shortcut meta-collections of the local machine. The first is the currently installed titles. The second icon, Updates, shows updates available from SBGrid. 'Pending' is a collection of pending installs and removals. Below these shortcuts are packages are grouped by primary scientific uses. Installation status is also indicated in theses collections. |
|
13 | - |
|
14 | -Information about each title, including a description and links to documentation are shown in the upper right panel when that title is selected in the main pane. |
|
15 | - |
|
16 | -Once packages have been configured for installation and/or removal by selecting their checkbox, clicking the 'Apply Changes' button will perform update the titles, adding pending installations and removing pending deletions. |
|
17 | - |
|
18 | -### Example : Installing Albula |
|
19 | -Check the box to select Albula, then click the 'Apply Changes' button. |
|
20 | -Notice the text turns green for pending installations. Pending updates are Orange. |
|
21 | -![apply](images/client_apply2.png) |
|
22 | - |
|
23 | -### Example : Removing Albula |
|
24 | -Uncheck the box for Albula. Removals are shown in red text. |
|
25 | -![apply](images/client_remove1.png) |
|
26 | - |
|
27 | -Click apply changes. Albula will be removed. |
|
28 | -![apply](images/client_remove2.png) |
|
29 | - |
|
30 | -### Version selection |
|
31 | - |
|
32 | -Default versions are installed by default for each application, though individual versions can be selected for each title. To do so, show the version pane by selecting **"Show all package versions"** from the **"View"** menu. Then, in the bottom right, select a desired version with the check boxes. Multiple versions of a given title can be installed and are indicated in the main panel. |
|
33 | - |
|
34 | -Enable version panel |
|
35 | -![all](images/client_versions1.png) |
|
36 | - |
|
37 | -Check old/non-default versions |
|
38 | -![all](images/client_versions2.png) |
|
39 | - |
|
40 | - |
|
41 | -### Versions and the SBGrid environment |
|
42 | -If you have a single version of an application installed, explicitly version selection in your environment will not be needed. In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when installed, unless configured otherwise in *~/.sbgrid.conf*. |
|
43 | - |
|
44 | -If you have multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use either an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file as in the standard SBGrid environment. |
|
45 | - |
|
46 | -**Version priority in the shell** |
|
47 | - 1. *~/.sbgrid.conf* |
|
48 | - 2. Installed Default version |
|
49 | - 3. Latest installed release |
|
50 | - |
|
51 | -You can do open the configuration file by selecting the *"Edit Configuration File"* from the *"SBGrid Installer"* menu. |
|
52 | - |
|
53 | -![all](images/client_config1.png) |
|
54 | - |
|
55 | -This will open a text editor with a sample configuration file, or your *~/.sbgrid.conf* file if you have one already. |
|
56 | - |
|
57 | -![all](images/client_config2.png) |
|
58 | - |
|
59 | -There is more info on how to do that here --> [SBGrid version overrides](versions) |
|
60 | - |
|
61 | - |
|
62 | -### Running the software |
|
63 | - |
|
64 | -To run the software, you can click the "SBGrid Shell" button for an initialized bash shell. |
|
65 | - |
|
66 | -You may also run the software from another terminal on your machine. |
|
67 | -To use the software at the terminal in bash, open a new terminal and run |
|
68 | - |
|
69 | - source /programs/sbgrid.shrc |
|
70 | - |
|
71 | -or in tcsh |
|
72 | - |
|
73 | - source /programs/sbgrid.cshrc |
|
74 | - |
|
75 | -### Questions, Problems and Known Issues |
|
76 | -For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*. |
|
77 | -If relevant, please include a screenshot of the GUI if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report. |
|
78 | - |
|
79 | -**Known issues** |
|
80 | - |
|
81 | -* The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. |
|
82 | - |
|
83 | -* In some cases the prompt for admin credentials fails to appear on activation. Be sure there is no prior SBGrid install on your machine at /programs or /opt/sbgrid. |
usage/client_usage.md
... | ... | @@ -0,0 +1 @@ |
1 | +../client_usage.md |
|
... | ... | \ No newline at end of file |
usage/developers.md
... | ... | @@ -1,26 +0,0 @@ |
1 | -## SBGrid Developer Support Program |
|
2 | -In an effort to show our appreciation for their hard work and to encourage the continuing development and support of cutting edge structural biology software, SBGrid offers a Developer Support Program featuring a wide array of benefits for structural biology software developers. |
|
3 | - |
|
4 | -### Developer Network |
|
5 | -We can provide access to a dedicated development and test network for software developers. As a developer of an SBGrid supported application, you can request an account on this network and use our infrastructure to build and test your application on a wide range of operating systems. Visit the [developer network page](resources) for more details. |
|
6 | - |
|
7 | -### Support Letters |
|
8 | -When applying for grants or financial support please let us know! We can provide support letters on behalf of members of SBGrid Consortium. Letters would include details about our membership, number of computers that can access your software, operating systems used by our community, etc. Please use the [contact form](http://sbgrid.org/contact.php|contact) on the SBGrid website. |
|
9 | - |
|
10 | -### Software Beta Testing |
|
11 | -You are welcome to use SBGrid laboratories to beta-test your software. Just let us know when the new beta is available, and we will install it for all participating laboratories or a limited subset that you choose. |
|
12 | - |
|
13 | -### SBGrid Consortium Membership |
|
14 | -If your application is under active maintenance or development, your development group is entitled to free membership in the consortium. Letting us maintain your general structural biology software environment leaves you with more time to concentrate on your unique software contribution to the community. |
|
15 | - |
|
16 | -### Annual Software Awards |
|
17 | -Members of SBGrid Consortium vote in an annual poll to select their favorite structural biology application. Paul Emsley was the winner of the first poll. He won a Macbook Air laptop for his application Coot. |
|
18 | - |
|
19 | -### Stretch Your Resources |
|
20 | -First level software support is provided by the SBGrid non-profit center at Harvard Medical School. All members of the consortium communicate with the service center for assistance with software installation, upgrades, and basic troubleshooting. For many of the mundane problems involving installation, operating system portability and environmental set up, SBGrid members will never need to contact you for support. Your expertise with the software be best utilized answering questions and working on problems that directly involve the science behind your application. |
|
21 | - |
|
22 | -### Broad Exposure for Your Software |
|
23 | -More than 140 structural biology laboratories from 50 institutions in 11 countries participate in the Consortium including the labs of 25 HHMI investigators and 2 Nobel Prize winners. Deployment of your application can be customized to include only non-profit labs or broadened to include industry labs as well. Please visit the Consortium website for the full list of participating groups that can benefit from rapid access to your software. Please note that most SBGrid Consortium laboratories standardize on hardware and operating systems, which simplifies the installation and support process. |
|
24 | - |
|
25 | -### Connect With Users |
|
26 | -Announcing a new version of your software? We can use webex to broadcast your presentation to all laboratories participating in our consortium. We can also disseminate information about your application to our community in our monthly newsletter. Visiting Boston? Please let us know because we'd love to schedule a seminar for members of our local structural biology community. |
usage/developers.md
... | ... | @@ -0,0 +1 @@ |
1 | +../developers.md |
|
... | ... | \ No newline at end of file |
usage/getting_started.md
... | ... | @@ -1,47 +0,0 @@ |
1 | -## Getting Started |
|
2 | - |
|
3 | -### Using the SBGrid software collection |
|
4 | -The SBGrid software collection can be found installed at **/programs**. |
|
5 | -All software in the SBGrid collection is run from the the command line in a terminal. Do set up the shell environment the terminal to run the programs, you will need to initialize the SBGrid environment. |
|
6 | - |
|
7 | -Bash users should initialize the SBGrid environment using : |
|
8 | - |
|
9 | - source /programs/sbgrid.shrc |
|
10 | - |
|
11 | -Tcsh users should initialize the SBGrid environment with : |
|
12 | - |
|
13 | - source /programs/sbgrid.cshrc |
|
14 | - |
|
15 | -On initialization, you should see the SBGrid welcome message |
|
16 | - |
|
17 | -![SBGrid](images/terminal1.png) |
|
18 | - |
|
19 | -### Making the shell configuration automatic |
|
20 | - |
|
21 | -To setup your terminal to automatically load the SBGrid environment, add the following to your configuration file: |
|
22 | - |
|
23 | -For Bash, in **~/.bashrc**, add : |
|
24 | - |
|
25 | - if [ -f /programs/sbgrid.shrc ] ; then |
|
26 | - source /programs/sbgrid.shrc |
|
27 | - fi |
|
28 | - |
|
29 | -For tcsh, in **~/.tcshrc** or **~/.cshrc**, add : |
|
30 | - |
|
31 | - if ( -e /programs/sbgrid.cshrc ) then |
|
32 | - source /programs/sbgrid.cshrc |
|
33 | - endif |
|
34 | - |
|
35 | -### Setting an alias |
|
36 | - |
|
37 | -If you would prefer to load the SBGrid environment on demand and not have to type the command above, you can set an alias to a shorter command of your choosing. |
|
38 | - |
|
39 | -For example, for bash in ~/.bashrc : |
|
40 | - |
|
41 | - alias sbg='source /programs/sbgrid.shrc' |
|
42 | - |
|
43 | -For tcsh in ~/.tcshrc, this would be |
|
44 | - |
|
45 | - alias sbg 'source /programs/sbgrid.cshrc' |
|
46 | - |
|
47 | -Questions or problems? Please email **bugs@sbgrid.org** |
usage/getting_started.md
... | ... | @@ -0,0 +1 @@ |
1 | +../getting_started.md |
|
... | ... | \ No newline at end of file |
usage/help.md
... | ... | @@ -1,15 +0,0 @@ |
1 | -## Software Help |
|
2 | - |
|
3 | -If you are having a problem with software included in the SBGrid suite or think you've discovered an application bug, please use the [SBGrid](http://sbgrid.org/bugs) web form to alert us to the problem. You can also email bugs@sbgrid.org with details on the problem, but the web form is the preferred method. |
|
4 | - |
|
5 | -If the problem with the software started after an update, you can configure your SBGrid environment to [use an older version of the software](overrides). |
|
6 | - |
|
7 | -### New Software and Software Updates |
|
8 | -To request a new software package or an update to an existing package, please use the [Software](http://sbgrid.org/req) Update/Installation Request form]]. |
|
9 | - |
|
10 | -We try to accommodate most requests for new software, but we do occasionally run into difficulties. Despite most of our software being free for academics, some developers insist that each lab download and install their own software. We are happy to provide developers with the list of SBGrid members that have access to their software, but that doesn't always satisfy their requirements. |
|
11 | - |
|
12 | -Even when things go smoothly, license requests and working out licensing details with developers can take some time, so please don't wait until the last minute before requesting software you anticipate you may need for your project. |
|
13 | - |
|
14 | -### Newsletter |
|
15 | -SBGrid sends a monthly newsletter with information concerning software updates, upcoming webinars, talks and other items of interest to our community. The archive of previous newsletters is available online at the [SBGrid Newsletter Archive](https://sbgrid.org/newsletters/). |
usage/help.md
... | ... | @@ -0,0 +1 @@ |
1 | +../help.md |
|
... | ... | \ No newline at end of file |
usage/images/.DS_Store
... | ... | Binary files a/usage/images/.DS_Store and /dev/null differ |
usage/images/client_install.png
... | ... | Binary files a/usage/images/client_install.png and /dev/null differ |
usage/images/client_installed.png
... | ... | Binary files a/usage/images/client_installed.png and /dev/null differ |
usage/images/data-processing-after-ws-mr-1.jpg
... | ... | Binary files a/usage/images/data-processing-after-ws-mr-1.jpg and /dev/null differ |
usage/images/data-processing-after-ws-mr-2.png
... | ... | Binary files a/usage/images/data-processing-after-ws-mr-2.png and /dev/null differ |
usage/images/sbgrid-sync_software_list.png
... | ... | Binary files a/usage/images/sbgrid-sync_software_list.png and /dev/null differ |
usage/images/sbgrid_logo.png
... | ... | Binary files a/usage/images/sbgrid_logo.png and /dev/null differ |
usage/images/sbgrid_small_logo.gif
... | ... | Binary files a/usage/images/sbgrid_small_logo.gif and /dev/null differ |
usage/images/site_diagram.png
... | ... | Binary files a/usage/images/site_diagram.png and /dev/null differ |
usage/images/terminal.png
... | ... | Binary files a/usage/images/terminal.png and /dev/null differ |
usage/images/terminal1.png
... | ... | Binary files a/usage/images/terminal1.png and /dev/null differ |
usage/installation_admin.md
... | ... | @@ -1,51 +0,0 @@ |
1 | -##Managing Your Software Installation |
|
2 | - |
|
3 | -### *sbgrid-admin* Utility |
|
4 | -The *sbgrid-admin* utility used to install the complete software collection. A download link is provided in the initial site set up email, and the script is included in the installation itself at */programs/share/sbgrid/bin/sbgrid-admin*. It includes built-in help: |
|
5 | - |
|
6 | -``` |
|
7 | - $ sbgrid-admin -h |
|
8 | -sbgrid-admin: a tool for administering an SBGrid Software suite installation |
|
9 | - |
|
10 | -Usage: sbgrid-admin [-chirstu] |
|
11 | - |
|
12 | - -c Cron mode. Used for automated updates of the software suite. |
|
13 | - -h Help message. |
|
14 | - -i Install the software suite on this machine. |
|
15 | - -p Print a launchd plist for updating the software on OS X machines. |
|
16 | - -r Regenerate sh/csh shell configuration files. |
|
17 | - -s Install the software branch for SGI IRIX. |
|
18 | - -t Test the configuration file. |
|
19 | - -u Force manual update of an existing installation. |
|
20 | -``` |
|
21 | - |
|
22 | -The most commonly used option is *sbgrid-admin -u* to force a manual update. This will synchronize your local installation with the SBGrid master installation hosted at Harvard Medical School. |
|
23 | - |
|
24 | -The SBGrid software configuration files use both static and dynamically generated files. The main shell initialization files, **/programs/sbgrid.cshrc** and **/programs/sbgrid.shrc** are static files, but the operating-system specific configurations are dynamically generated and customized for the packages available at your site. *sbgrid-admin -r* will regenerate the branch-specific configuration files should you accidentally delete or alter them. |
|
25 | - |
|
26 | - Configuration Options |
|
27 | -The *sbgrid-admin* script has some additional configuration options to accommodate the installation requirements at different sites. |
|
28 | - |
|
29 | -The ~sbgrid/.sbgridrc configuration file for the *sbgrid-admin* script must contain a sitename and site key. All other configurations are optional. |
|
30 | - |
|
31 | -Options take the form of *OPTION_NAME="setting"*. |
|
32 | - |
|
33 | -| **Option** |** Example** | **Description** | |
|
34 | -|:------------- |:-------------:| :---------------| |
|
35 | -| SB_SITENAME | sbgrid-bene | The site name for your installation provided by SBGrid | |
|
36 | -| SB_SITEKEY | xyxyxyxyxyxyxy | The installation key for your site provided by SBGrid | |
|
37 | -| INSTALL_TARGET| /nfs/programs | The installation directory for the software | |
|
38 | -| RSYNC_ARGS | "--port 8080"| Advanced arguments to rsync. Can be used to workaround blocked rsync ports. | |
|
39 | -| HTTP_PROXY | host.name:port | Proxy hostname and port for use by rsync and curl | |
|
40 | -| POST_UPDATE_SCRIPT | /absolute/path/to/script|Optional script to be run after a successful software update | |
|
41 | -| CRON_SCHEDULE | 5 1 * * * | Set a custom cron schedule | |
|
42 | - |
|
43 | - |
|
44 | - Rsync Transaction Logging |
|
45 | -If you want a date-stamped log of all rsync downloads, deletions and updates, you can add a line like this to the ~sbgrid/.sbgridrc file: |
|
46 | - |
|
47 | -``` |
|
48 | -RSYNC_ARGS="--log-file=$HOME/logs/sbgrid-admin-`date +%Y%m%d`.log" |
|
49 | -``` |
|
50 | - |
|
51 | -This will create a date-stamped log file any time an actual change to the software tree happens. In general this should not be necessary, but for troubleshooting purposes it can be useful. |
usage/installation_admin.md
... | ... | @@ -0,0 +1 @@ |
1 | +../installation_admin.md |
|
... | ... | \ No newline at end of file |
usage/laptopinstall.md
... | ... | @@ -1,249 +0,0 @@ |
1 | -## SBGrid Software Installation : Laptops and Desktops without shared network storage |
|
2 | - |
|
3 | -If you would like to install SBGrid tools on a machine that is frequently disconnected from the network, like a laptop, or don't want to set up an NFS-shared software installation, it is possible to install the software to the hard disk on your local machine. |
|
4 | - |
|
5 | -We have a GUI-based installation client for MacOS that allows software to be selected, installed, and updated on demand from SBGrid servers. There is also a command-line client for MacOS and Linux that will allow installation and upgrade of individual titles from the command line. |
|
6 | - |
|
7 | - - [Information on installation of our MacOS GUI.](client_install) |
|
8 | - |
|
9 | - - [Information on installation of our command-line tools for MacOS and Linux](client_CLI_install). |
|
10 | - |
|
11 | -### Script-based installation tools |
|
12 | - |
|
13 | -While we recommend the software tools above, if you would like to install your software from a local source, there are script-based tools in the SBGrid programs tree that will create a copy of the software on your local hard disk. |
|
14 | - |
|
15 | -The 'sbgrid-laptop' script allows you to select individual applications from the software distribution for installation on your laptop. By default only the latest version of the selected applications will be installed. The 'localsync' script allows you to copy an entire operating system software branch to your local machine. This script can be used on laptops, but each branch is quite large in terms of disk space usage. Finally, the 'sbgrid-sync' script will allow you to install software from SBGrid servers. This script is deprecated in favor of the better CLI tools above and its use is discouraged. |
|
16 | - |
|
17 | - |
|
18 | - * *laptop-sync* |
|
19 | - - This script installs software from your own **local** installation. |
|
20 | - - This script requires an account on a local machine with access to the SBGrid softare collection. |
|
21 | - - Only latest versions will be installed. |
|
22 | - |
|
23 | - |
|
24 | - * *localsync* |
|
25 | - - This script installs software from your own **local** installation. |
|
26 | - - This script requires an account on a local machine with access to the SBGrid softare collection. |
|
27 | - - All versions of the software will be installed. |
|
28 | - |
|
29 | - |
|
30 | - * *sbgrid-sync (deprecated)* |
|
31 | - - This script installs software from SBGrid's servers. |
|
32 | - - an account on SBGrid's server is required. |
|
33 | - - THIS INSTALL METHOD WILL NO LONGER BE SUPPORTED IN A FUTURE RELEASE. |
|
34 | - |
|
35 | - |
|
36 | -### laptop-sync |
|
37 | -You can create a customized local installation of the software using the ''sbgrid-laptop'' script located at ''/programs/share/bin/sbgrid-laptop''. This script requires you to have an SSH login to a computer that has access to an SBGrid software installation and will let you specify which packages you want to install. |
|
38 | - |
|
39 | -``` |
|
40 | - sbgrid-laptop: a tool for creating a local installation of the |
|
41 | - SBGrid software on a laptop. |
|
42 | - |
|
43 | - Usage: sbgrid-laptop [-ituv] [-e list|config] |
|
44 | - |
|
45 | - -d Debug mode creates a log file for troubleshooting purposes. |
|
46 | - -e [list|config] |
|
47 | - Edit the software download list. |
|
48 | - -i Initial set up and installation of the SBGrid software. |
|
49 | - -s Re-run SSH key set up process. |
|
50 | - -t Test your current configuration. |
|
51 | - -u Update an existing installation using the current |
|
52 | - configuration. |
|
53 | - -v Verbose option for the file transfer. |
|
54 | -``` |
|
55 | - |
|
56 | - You need an SSH login to a machine with the SBGrid software installed |
|
57 | - to use this script. The script will create an SSH key and run an SSH |
|
58 | - agent process to handle authentication for the file transfers. |
|
59 | - |
|
60 | -Copy the script the machine you want to install the software on, and then run it in install mode: ''./sbgrid-laptop -i''. Follow the prompts on the screen to create your configuration file, your software installation list and to enable logins using an SSH key for authentication. |
|
61 | - |
|
62 | - |
|
63 | -### localsync Sync Script |
|
64 | -There is a script in the programs tree that can be used to copy the appropriate branch from a shared installation to your laptop or workstation. |
|
65 | - |
|
66 | -Copy /programs/share/bin/localsync from the machine that has the software to your home directory on the standalone machine: |
|
67 | - |
|
68 | - |
|
69 | - scp your.server.name:/programs/share/bin/localsync ~/ |
|
70 | - |
|
71 | - |
|
72 | -Then run the script like this: |
|
73 | - |
|
74 | - chmod 755 ~/localsync |
|
75 | - ~/localsync yourusername@your.server.name |
|
76 | - |
|
77 | - |
|
78 | -The script will prompt you for your sudo (admin) password in order to create the programs directory, and then it will prompt you for your login password to the server that hosts your programs installation. |
|
79 | - |
|
80 | -Here is an example run on my workstation: |
|
81 | - |
|
82 | -``` |
|
83 | - $ ./localsync bene@developer.sbgrid.org |
|
84 | - Running 'sudo mkdir /programs && sudo chown bene /programs' |
|
85 | - [sudo] password for bene: |
|
86 | - Copying the software from the i386-mac branch on your server to your local |
|
87 | - hard disk. Enter your ssh login password below for bene@developer.sbgrid.org: |
|
88 | - |
|
89 | - receiving file list ... |
|
90 | -``` |
|
91 | - |
|
92 | -This will copy the entire branch for your architecture to your local hard drive. For the OS X branch, this will use approximately 100 GB of disk space. |
|
93 | - |
|
94 | -You should use a network cable for the initial download, since the download is fairly large. Subsequent runs of the 'localsync' script are differential; they will only copy new or changed files, so they can be run over a wireless connection. The script can be run at any time to make your local installation match the installation on your local server. |
|
95 | - |
|
96 | -### Sharing a 'localsync' Software Installation without NFS |
|
97 | - |
|
98 | -While we recommend that sites export their software installation via NFS to their workstations, it is possible to use rsync to copy the master installation to each workstation. This method has the drawback that it requires manual intervention on the part of the local sysadmin, and updates will not be instantaneous or simultaneous for all machines. |
|
99 | - |
|
100 | -On each client machine, you'll need an 'sbgrid' user. That user will have a passphraseless ssh key that lets it log into the machine that hosts your primary installation. Each client machine will have a cron job for that sbgrid user that runs at 2 AM that will sync the programs from the master installation to the client machine. |
|
101 | - |
|
102 | -Here is a basic command run down. 'server1' holds the programs installation and 'client1' is what will be connecting to it. |
|
103 | - |
|
104 | - * Login as root/administrator on client1 |
|
105 | - * Create the 'sbgrid' user on client1 |
|
106 | - * Check the free space on /. |
|
107 | - * If there's enough free space, set up the programs directory: |
|
108 | - |
|
109 | - |
|
110 | - mkdir /programs |
|
111 | - chown -R sbgrid:sbgrid /programs |
|
112 | - |
|
113 | - * If there is not enough free space on the root volume, you'll need to find space on a local volume. |
|
114 | - |
|
115 | - * Login as 'sbgrid' on client1. |
|
116 | - * Create the passphraseless ssh key: |
|
117 | - |
|
118 | - |
|
119 | - ssh-keygen -d |
|
120 | - |
|
121 | - |
|
122 | -(hit enter to confirm default file location, no passphrase, etc) |
|
123 | - |
|
124 | - * Copy the ssh key to server1: |
|
125 | - |
|
126 | - |
|
127 | - cat ~/.ssh/id_dsa.pub | ssh server1 'cat - >> ~/.ssh/authorized_keys' |
|
128 | - |
|
129 | - * Copy the localsync script from server1 to client1. From client1: |
|
130 | - |
|
131 | - |
|
132 | - scp sbgrid@server1:/programs/share/bin/localsync . |
|
133 | - |
|
134 | - |
|
135 | -(May prompt to accept the host key. If you can't login without a password, the ssh key stuff above has failed, and you'll need to troubleshoot that.) |
|
136 | - |
|
137 | - chmod 755 localsync |
|
138 | - ./localsync sbgrid@server1 |
|
139 | - |
|
140 | -(This will take a while depending on the speed of the machines/network.) |
|
141 | - |
|
142 | - * Test the installation: |
|
143 | - |
|
144 | - |
|
145 | -tcsh |
|
146 | - |
|
147 | - source /programs/sbgrid.cshrc |
|
148 | - |
|
149 | -or |
|
150 | -bash |
|
151 | - |
|
152 | - source /programs/sbgrid.shrc |
|
153 | - |
|
154 | - |
|
155 | -(You should get a message like this: ) |
|
156 | -``` |
|
157 | - Welcome to SBGrid! |
|
158 | - |
|
159 | -******************************************************************************** |
|
160 | - Your use of the applications contained in the /programs directory constitutes |
|
161 | - acceptance of the terms of the SBGrid License Agreement included in the file |
|
162 | - /programs/share/LICENSE. The applications distributed by SBGrid are licensed |
|
163 | - exclusively to member laboratories of the SBGrid Consortium. |
|
164 | - |
|
165 | - To hush this license message, run 'touch ~/.agree2sbgrid'. |
|
166 | - |
|
167 | -******************************************************************************** |
|
168 | - Please submit bug reports and help requests to: `<bugs@sbgrid.org>` or |
|
169 | - `<http://sbgrid.org/bugs>` |
|
170 | - This installation last updated: 20110411 |
|
171 | - |
|
172 | -******************************************************************************** |
|
173 | - Total time to initialize: 1 second(s) |
|
174 | -``` |
|
175 | - |
|
176 | - * Add a cronjob for the updates. As the 'sbgrid' user on client1: |
|
177 | - |
|
178 | - |
|
179 | - echo "0 2 * * * ~/localsync sbgrid@server1" | crontab |
|
180 | - |
|
181 | - * Check the cronjob: |
|
182 | - |
|
183 | - |
|
184 | - crontab -l |
|
185 | - |
|
186 | -You're done! |
|
187 | - |
|
188 | - |
|
189 | -### sbgrid-sync (DEPRECATED) |
|
190 | - |
|
191 | -This script can be found in the programs installation at */programs/share/bin/sbgrid-sync*. |
|
192 | - |
|
193 | -``` |
|
194 | -sbgrid-sync: install or update the SBGrid Consortium software |
|
195 | - collection on your laptop or workstation. |
|
196 | - |
|
197 | -You will need a Consortium UNIX account to install and update your |
|
198 | -installation. If you don't have an account or don't remember your password, |
|
199 | -please email <accounts@sbgrid.org> for assistance. |
|
200 | - |
|
201 | -This script will create an SSH key and run an SSH agent process to handle |
|
202 | -authentication for the file transfers. Unless otherwise configured only the |
|
203 | -default version of the software titles will be installed. |
|
204 | - |
|
205 | -Usage: sbgrid-sync [-iesudt] |
|
206 | - |
|
207 | -Install/Configure Options: |
|
208 | - |
|
209 | - -i Initial set up and installation of the SBGrid software. |
|
210 | - -e Edit the software download list. |
|
211 | - |
|
212 | -Update Options: |
|
213 | - |
|
214 | - -u Update an existing installation using the current |
|
215 | - configuration. |
|
216 | - |
|
217 | -Troubleshooting Options: |
|
218 | - |
|
219 | - -d Debug mode creates a log file for troubleshooting purposes. |
|
220 | - -t Test your current configuration. |
|
221 | - |
|
222 | -``` |
|
223 | - |
|
224 | -Once an account has be created at SBGrid, the software can be installed with for a username (at SBGrid) and a path for the software installation. the -i flag. The user will be prompted with a list of software to add. |
|
225 | - |
|
226 | -![sync software list ](images/sbgrid-sync_software_list.png "sbgrid-sync software list") |
|
227 | - |
|
228 | -``` |
|
229 | -| We need to create a list of software you want included in the local |
|
230 | -| installation. We will start with a list of all the software titles. |
|
231 | -| Remove the leading hash mark (#) to _include_ a software title. |
|
232 | -``` |
|
233 | -Any titles NOT preceded with a '#' character will be installed. |
|
234 | -``` |
|
235 | -| Save and _QUIT_ the text editor after making your changes. If you are |
|
236 | -| using TextEdit on a Mac, you must completely quit (Apple-Q) the |
|
237 | -| application to continue. |
|
238 | -``` |
|
239 | -Once the editor has quit, software installation will start. |
|
240 | - |
|
241 | -``` |
|
242 | -| Creating an rsync include list to download files. |
|
243 | -| Running rsync to download the latest software. |
|
244 | -``` |
|
245 | -Once installation is completed, open a new terminal and |
|
246 | - |
|
247 | - source /programs/sbgrid.shrc |
|
248 | - |
|
249 | -to get started. |
usage/laptopinstall.md
... | ... | @@ -0,0 +1 @@ |
1 | +../laptopinstall.md |
|
... | ... | \ No newline at end of file |
usage/mailinglist.md
... | ... | @@ -1,5 +0,0 @@ |
1 | -## Mailing List for Site Administrators |
|
2 | - |
|
3 | -We have a small mailing list for technical users and site administrators. |
|
4 | - |
|
5 | -Visit the [SBGrid-tech mailing list](https///cmcd.hms.harvard.edu/sympa/info/sbgrid-tech) page to sign up. |
usage/mailinglist.md
... | ... | @@ -0,0 +1 @@ |
1 | +../mailinglist.md |
|
... | ... | \ No newline at end of file |
usage/managing_install.md
... | ... | @@ -1,61 +0,0 @@ |
1 | -# HOWTOs: SBGrid Installation Notes |
|
2 | - |
|
3 | -## Site Configuration |
|
4 | - |
|
5 | -The SBGrid Software Suite is designed to be installed on a single computer at your site, which will then share that installation with all the workstations on your network via NFS. |
|
6 | -We refer to this computer as the site "master" server. |
|
7 | - |
|
8 | -The master server will require at least 250 GB of free disk space on a case-sensitive file system and must run some variety of UNIX. The installation script will download the software branches you select, and then install a cron job that will run regularly to check for updates. |
|
9 | - |
|
10 | -Software installation and update are initiated from your local server at your site and downloaded from our servers. http is used to query our servers to check for update, and rsync is used to download the updates. Outbound HTTP, and RSYNC is necessary. |
|
11 | - |
|
12 | -![NFS-based installation](images/site_diagram.png "NFS-based installation") |
|
13 | - |
|
14 | -## Pre-Installation |
|
15 | - |
|
16 | -| Installation Requirements | | |
|
17 | -| ------------------------- | ----------------------------------------------------| |
|
18 | -| Hard Drive Space | ~400 GB required | |
|
19 | -| Operating System | Linux, OS X and other UNIX | |
|
20 | -| Privileges | Root account (Linux) or Administrator account (Mac) | |
|
21 | -| network | Outbound http, rsync (ports 80 and 873, 8080) | |
|
22 | - |
|
23 | - |
|
24 | -### Approximate size per Branch |
|
25 | -| Branch | size | |
|
26 | -| ------------ | ------ | |
|
27 | -| i386-mac | 175Gb | |
|
28 | -| x86_64-linux | 210Gb | |
|
29 | -| shared files | 18Gb | |
|
30 | - |
|
31 | -[Size breakdown of titles in a typical installation](size_graph) |
|
32 | - |
|
33 | -Email [accounts@sbgrid.org](accounts@sbgrid.org) to request the installation script for the software. Be sure to include the following information in your email: |
|
34 | - |
|
35 | - * Lab Name |
|
36 | - * Types of computers on site: Linux, OS X Intel, OS X PowerPC, IRIX |
|
37 | - * The names and email addresses of lab members that will use the software. One user may be designated to receive the majority of our correspondence if you would prefer not to hear from us too often. |
|
38 | - |
|
39 | -Once the email has been received and your information has been entered into our system, we will email you a script you will run that will begin the remote installation process. Instructions for running the script will be included in that email, and are reproduced below for reference. |
|
40 | - |
|
41 | -## Installation |
|
42 | - |
|
43 | - 1. Create an 'sbgrid' user on the machine that will host your software installation. This should be a normal, unprivileged user account. |
|
44 | - 2. Log in as this 'sbgrid' user. |
|
45 | - 3. Download the installation script from the URL provided in the account creation email. |
|
46 | - 4. Make it executable: `chmod +x sbgrid-admin` |
|
47 | - 5. Run the script: `./sbgrid-admin -i` |
|
48 | - 6. The script will walk you through configuring your installation, downloading the software and installing a cron job that will keep the software updated at your site. You will need the **site name** and **install key** provided in the account creation email. The installation may take anywhere from several hours to a day, depending on your network and the number of applications available to your site. |
|
49 | - |
|
50 | -## Post-Installation Steps |
|
51 | - |
|
52 | - 1. Add a symlink in the root directory of each machine that wants to use the software. The installation script will print the suggested syntax for the command.`ln -s /path/to/sbgrid/installation /programs` |
|
53 | - 2. Any user that wishes to use the software needs to configure their shell to initialize the SBGrid shell environment. For bash and other sh-compliant shells, add the following line to your ~/.bash_profile or ~/.bashrc: `. /programs/sbgrid.shrc` For csh and tcsh, add the following line to your ~/.cshrc: `source /programs/sbgrid.cshrc` |
|
54 | - 3. For some linux distributions, the shipped version of tcsh does not support shell variables longer than 4096 characters. Since the current PATH in our default shell initialization is larger than that, you will need to update tcsh. RPMs for Red Hat 4/5 and CentOS 4/5 are provided at /programs/i386-linux/system/RPMS. |
|
55 | - |
|
56 | - |
|
57 | -## SGI IRIX Software Branch |
|
58 | - |
|
59 | -Since the IRIX software branch is frozen and no longer receiving updates, it is not installed and updated in the same manner as the active software branches. In order to install the IRIX software branch, please run: `./sbgrid-admin -s` |
|
60 | - |
|
61 | -Note that the IRIX branch is only compatible with *tcsh*; there is no sh-compatible configuration for this branch. |
usage/managing_install.md
... | ... | @@ -0,0 +1 @@ |
1 | +../managing_install.md |
|
... | ... | \ No newline at end of file |
usage/mirrors.md
... | ... | @@ -1,3 +0,0 @@ |
1 | -# SBGrid Mirrors |
|
2 | - |
|
3 | -For the benefit of the local SBGrid community, we recommend the following to access frequently-used open source software. If you would like for us to add a mirror, please [contact us](help@sbgrid.org). |
usage/mirrors.md
... | ... | @@ -0,0 +1 @@ |
1 | +../mirrors.md |
|
... | ... | \ No newline at end of file |
usage/operatingsystems.md
... | ... | @@ -1,35 +0,0 @@ |
1 | -## Supported Operating Systems |
|
2 | - |
|
3 | -The SBGrid Software Suite can run on Linux, OS X and IRIX machines. |
|
4 | - |
|
5 | -### Linux |
|
6 | -We build and test software under 64-bit Red Hat 6. The majority of our Linux users are using the Red Hat/CentOS/Scientific Linux or Fedora distributions, but we also have labs using the software with Ubuntu, Debian and OpenSuSE. We don't explicitly test the software on these distributions, but it is known to work, and we will work to resolve problems reported by users of these Linux distributions. |
|
7 | - |
|
8 | -We officially support the two most recent releases of Red Hat/CentOS/Scientific Linux (currently 6 and 7) and the two most recent releases of Fedora Linux. At this time, only 64-bit versions of linux are fully supported. As of January 2015, we are no longer updating the 32-bit software branch, though we will work to resolve reported problems. |
|
9 | - |
|
10 | -Currently Supported: |
|
11 | - |
|
12 | -* Red Hat Enterprise Linux 6.x and 7.x and the community supported versions: CentOS and Scientific Linux. |
|
13 | -* We are no longer building software for RHEL 5.x, but compatible applications will remain in the software tree. We will respond to support requests for these and we will resolve problems where possible. |
|
14 | - |
|
15 | -## OS X Intel |
|
16 | -We build and test the programs under the most five most recent OS X releases. |
|
17 | - |
|
18 | -Currently Supported: |
|
19 | - |
|
20 | -* OS X Intel 10.9 - 10.12 |
|
21 | -* As above with earlier versions of linux, there are many software applications that are fully functional on earlier versions of MacOSX in the SBGrid tree. We work to maintain an environment compatible with these OS versions, though they may not receive the latest applications available. |
|
22 | - |
|
23 | -## OS X PowerPC |
|
24 | -The OS X PowerPC branch is currently frozen. The applications are stable and work well on our PowerPC hardware, but they are not being updated. |
|
25 | - |
|
26 | -Currently Supported: |
|
27 | - |
|
28 | -* OS X PowerPC 10.4 - 10.5 |
|
29 | - |
|
30 | -## IRIX |
|
31 | -The IRIX programs branch is currently frozen. The applications are stable and work well on our SGI hardware, but they are not being updated. |
|
32 | - |
|
33 | -Currently Supported: |
|
34 | - |
|
35 | -* IRIX 6.5.26 + bugfix releases |
usage/operatingsystems.md
... | ... | @@ -0,0 +1 @@ |
1 | +../operatingsystems.md |
|
... | ... | \ No newline at end of file |
usage/overrides.md
... | ... | @@ -1,71 +0,0 @@ |
1 | -# Overriding Software Versions |
|
2 | - |
|
3 | -Most of the software titles installed in the SBGrid software collection have several versions available. We try to provide at least three versions of each software package, although very old or very new applications may have fewer versions. |
|
4 | - |
|
5 | -## Display Available Versions |
|
6 | - |
|
7 | -To list the available versions of a software title, you can use the *sbgrid-info* utility. Running *sbgrid-info -l* will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this: |
|
8 | - |
|
9 | - |
|
10 | - $ sbgrid-info -l ccp4 |
|
11 | - Version information for: /programs/x86_64-linux/ccp4 |
|
12 | - |
|
13 | - Default version: 7.0 |
|
14 | - In-use version: 6.5 |
|
15 | - Other available versions: 6.4.0 6.3.0 |
|
16 | - Overrides use this shell variable: CCP4_X |
|
17 | - |
|
18 | - |
|
19 | -Running *sbgrid-info -L* will print the available versions for the three current platforms (OS X PowerPC and Intel, Linux). |
|
20 | - |
|
21 | - |
|
22 | - $ sbgrid-info -L gnuplot |
|
23 | - Version information for: /programs/x86_64-linux/gnuplot |
|
24 | - |
|
25 | - Default version: 4.6.4 |
|
26 | - In-use version: 4.6.4 |
|
27 | - Other available versions: 4.6.0 4.4.3 4.2.6 |
|
28 | - Overrides use this shell variable: GNUPLOT_X |
|
29 | - |
|
30 | - Version information for: /programs/i386-linux/gnuplot |
|
31 | - |
|
32 | - Default version: 4.6.0 |
|
33 | - Other available versions: 4.4.3 4.2.6 |
|
34 | - Overrides use this shell variable: GNUPLOT_L |
|
35 | - |
|
36 | - Version information for: /programs/i386-mac/gnuplot |
|
37 | - |
|
38 | - Default version: 4.6.4 |
|
39 | - Other available versions: 4.4.3 4.2.6 4.6.0 |
|
40 | - Overrides use this shell variable: GNUPLOT_M |
|
41 | - |
|
42 | - |
|
43 | -## Overriding Default Versions |
|
44 | - |
|
45 | -To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version. |
|
46 | - |
|
47 | -The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this: |
|
48 | - |
|
49 | -`APPLICATION_X=1.2` |
|
50 | - |
|
51 | -APPLICATION_X is the name of the application followed by an underscore and the shorthand initial for the architecture. The last field on the line is the software version number you want to use. The initials for each software branch are: |
|
52 | - |
|
53 | -| Software Directory | Shorthand Initial | |
|
54 | -| ------------------ | ----------------- | |
|
55 | -| i386-linux | _L | |
|
56 | -| x86_64-linux | _X | |
|
57 | -| i386-mac | _M | |
|
58 | - |
|
59 | -To quickly open the overrides file in your default $EDITOR, you can run *sbgrid-overrides -e*. |
|
60 | - |
|
61 | -When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well. |
|
62 | - |
|
63 | -The example output below shows CCP4 on linux being changed from the default version: |
|
64 | - |
|
65 | - Configuration options in effect for this shell: |
|
66 | - Variable Setting Configuration |
|
67 | - CCP4_M 6.3.0 personal |
|
68 | - |
|
69 | - |
|
70 | -## Disabling a Software Package |
|
71 | -To disable a specific software package, set its version to "disable" in your ~/.sbgrid.conf file. |
usage/overrides.md
... | ... | @@ -0,0 +1 @@ |
1 | +../overrides.md |
|
... | ... | \ No newline at end of file |
usage/recommended.md
... | ... | @@ -1,7 +0,0 @@ |
1 | -# Recommended Hardware |
|
2 | - |
|
3 | -## Linux Workstations |
|
4 | -SBGrid's preferred hardware vendor is [ThinkMate](http://thinkmate.com) and we have some [recommended configurations](http://www.thinkmate.com/sbgrid) for structural biology computing. Please feel free to contact us at help@sbgrid.org regarding upcoming hardware purchases if you have questions - we'd be happy to advise. |
|
5 | - |
|
6 | -## Apple Workstations |
|
7 | -Any Apple machine can be a capable computer for structural biology. The basic Apple educational discount is available through their online web store, and your institution may have negotiated an even better deal with their Apple representative. SBGrid has several labs that run exclusively on Macs and OS X. |
usage/recommended.md
... | ... | @@ -0,0 +1 @@ |
1 | +../recommended.md |
|
... | ... | \ No newline at end of file |
usage/resources.md
... | ... | @@ -1,85 +0,0 @@ |
1 | -# Development Network |
|
2 | - |
|
3 | -The basic account is a UNIX shell account accessible via SSH. This network account will let you access designated machines in the developer network. Along with the shell account you also get up to 10 GB of data storage, access to high performance compilers, basic development tools like version control systems (svn, git, etc) and shell text editors. |
|
4 | - |
|
5 | -Once you have an account, you can access the developer network by connecting via SSH to: |
|
6 | - |
|
7 | - *developer.sbgrid.org* |
|
8 | - |
|
9 | - developer runs Scientific Linux 6 x86_64 |
|
10 | - |
|
11 | -This machine (internally named sbgrid-dev-architect) is the only external facing host on the network, and it hosts your home directory and acts as the SSH bastion host for the network. From this machine you can SSH to any of the build and test hosts via their hostname in the table below in order to compile software, run tests, etc. |
|
12 | - |
|
13 | -The following are the always-on operating system/hardware combinations. They are generally kept at the latest point release: |
|
14 | - |
|
15 | -| Hostname | Operating System | Architecture | Notes | |
|
16 | -| ------------------ | --------------- | ----------- | ----------------------------------------- | |
|
17 | -| sbgrid-c5b | CentOS 5 | x86 | base SBGrid 32-bit Linux build VM | |
|
18 | -| sbgrid-c5b-64 | CentOS 5 | x86_64 | base SBGrid 64-bit Linux build VM | |
|
19 | -| sbgrid-c5t-64 | CentOS 5 | x86_64 | minimal install for portability testing | |
|
20 | -| sbgrid-c6b | CentOS 6 | x86 | base SBGrid 32-bit Linux build VM | |
|
21 | -| sbgrid-c6b-64 | CentOS 6 | x86_64 | base SBGrid 64-bit Linux build VM | |
|
22 | -| sbgrid-c6t-64 | CentOS 6 | x86_64 | minimal install for portability testing | |
|
23 | -| sbgrid-dev-vm-07 | Debian 5 | x86 | | |
|
24 | -| sbgrid-dev-vm-08 | Debian 5 | x86_64 | | |
|
25 | -| sbgrid-dev-vm-16 | Debian 6 | x86 | | |
|
26 | -| sbgrid-dev-vm-17 | Debian 6 | x86_64 | | |
|
27 | -| sbgrid-dev-vm-03 | Ubuntu 10.10 | x86 | | |
|
28 | -| sbgrid-dev-vm-04 | Ubuntu 10.10 | x86_64 | | |
|
29 | -| sbgrid-dev-vm-14 | OpenSuSE 11.3 | x86 | | |
|
30 | -| sbgrid-dev-vm-15 | OpenSuSE 11.3 | x86_64 | | |
|
31 | -| sbgrid-m106 | OS X 10.6 | x86/x86_64 | Base SBGrid OS X Intel build machine | |
|
32 | -| sbgrid-m107 | OS X 10.7 | x86/x86_64 | | |
|
33 | -| sbgrid-m108 | OS X 10.8 | x86/x86_64 | | |
|
34 | -| sbgrid-m109 | OS X 10.9 | x86/x86_64 | | |
|
35 | -| sbgrid-m1010 | OS X 10.10 | x86/x86_64 | | |
|
36 | -| sbgrid-dev-flange | OS X 10.5 | PowerPC | | |
|
37 | - |
|
38 | - |
|
39 | -We have the Intel, Portland and Absoft (PPC) compilers: |
|
40 | - |
|
41 | -* Intel 12.0, 11.1, 10.1 (ifc, ifort) - any linux host, OS X Intel hosts |
|
42 | -* Portland 14.4, 12.6, 10.9, 10.2, 9.0-1 (pgcc, pgf77/90/95) - sbgrid-dev-architect, sbgrid-dev-moose |
|
43 | - |
|
44 | -There is a configuration file for sh-compatible shells that will enable the compilers and their environmental settings: |
|
45 | - |
|
46 | - $ . /build/conf/buildenv.sh |
|
47 | - |
|
48 | -Then you can use the 'build' function to control your compiler settings: |
|
49 | - |
|
50 | - $ build help |
|
51 | - build: a shell function for controlling compilers |
|
52 | - |
|
53 | - Usage: build (help3264list) |
|
54 | - |
|
55 | - help This help message |
|
56 | - 32 Configure 32-bit compilers |
|
57 | - 64 Configure 64-bit compilers |
|
58 | - list List available compilers |
|
59 | - |
|
60 | -Additionally, there are other operating systems available as virtual machines that can be enabled (OpenSuSE, Ubuntu, Fedora, etc), and some additional hardware that can be made available (Sun SPARC, IRIX MIPS, etc) on request. |
|
61 | - |
|
62 | -Graphical access to the machines may be available through Apple Remote Desktop, VNC or the NoMachine desktop sharing client. Other tools could be made available if necessary as well. The whole thing's a bit of an experiment, really, so email us at `<bugs@sbgrid.org>`, and we'll see what we can work out. |
|
63 | - |
|
64 | -# Request an Account |
|
65 | - |
|
66 | -Thanks for your interest in participating in the SBGrid Developer Network. |
|
67 | - |
|
68 | -In order to be eligible for an account, you must have software in the SBGrid software suite or be planning to make your software available through SBGrid. This requirement limits accounts to developers of scientific software used in structural biology and related disciplines. |
|
69 | - |
|
70 | -That's the only requirement for new accounts. In return for access to these resources, you must agree to not abuse the resources for: |
|
71 | - |
|
72 | -* sending spam |
|
73 | -* cracking our computers or other peoples' computers |
|
74 | -* other activity which is illegal in the USA or your country |
|
75 | - |
|
76 | -And you agree to take reasonable precautions to maintain the security of your password and account by not sharing this information with other people. |
|
77 | -On our end, we will: |
|
78 | - |
|
79 | -* take reasonable precautions to maintain the security of the network, accounts and data |
|
80 | -* make occasional backups of account data (but don't count on it!) |
|
81 | -* attempt to maintain a high availability of the developer resources |
|
82 | - |
|
83 | -We reserve the right to close accounts at any time for any reason. |
|
84 | - |
|
85 | -Still interested? Great! We want to work with you, so please email `<bugs@sbgrid.org>` with your account request, and we'll get back to you as soon as possible. |
usage/resources.md
... | ... | @@ -0,0 +1 @@ |
1 | +../resources.md |
|
... | ... | \ No newline at end of file |
usage/sharp.md
... | ... | @@ -1,8 +0,0 @@ |
1 | -## SBGrid Sharp server |
|
2 | - |
|
3 | -SBGrid maintains a server for Global Phasing's application [Sharp/AutoSharp](https://sharp.sbgrid.org:8080) for use by consortium members. |
|
4 | -To use the sharp server, email accounts@sbgrid.org for account credentials. |
|
5 | - |
|
6 | -Documentation for using Sharp can be found [here](http://www.globalphasing.com/sharp/manual/) |
|
7 | - |
|
8 | - |
usage/sharp.md
... | ... | @@ -0,0 +1 @@ |
1 | +../sharp.md |
|
... | ... | \ No newline at end of file |
usage/stereo.md
... | ... | @@ -1,83 +0,0 @@ |
1 | -## General |
|
2 | - |
|
3 | -### 3D Stereo on RHEL/CentOS 6 systems |
|
4 | - |
|
5 | -Nvidia 3d stereo on RHEL 6 is reasonably straight-forward. |
|
6 | -Take a look [here](xorg_conf) for an example xorg.conf file. This configuration if for a Quadro 4000 card and a 1920x1080 display. Your settings may vary depending on your hardware. |
|
7 | - |
|
8 | -### 3D Stereo on RHEL/CentOS 7 systems with Gnome 3 |
|
9 | - |
|
10 | -Nvidia 3D stereo typically requires disabling the Composite extension in X.org. Unfortunately, this extension is required to run Gnome 3 and the gdm login mangager supplied as the default desktop in CentOS and many other linux distributions. |
|
11 | - |
|
12 | -As of version 337.19 of the nvidia driver, some Quadro configurations can operate with the composite extension enabled, but stereo functionality depends on a stereo-aware composite manager. The Composite manager in CentOS7 Gnome3 is not stereo aware and 3D stereo does not work by default. |
|
13 | - |
|
14 | -In order to use 3D stereo on Gnome3 systems, you can switch from Gnome3/gdm to MATE/lightdm. |
|
15 | -The MATE Desktop Environment is the continuation of GNOME 2 which is the default desktop in CentOS 5 and 6. |
|
16 | - |
|
17 | -To change to MATE on CentOS7 systems, first, install the Extra Packages for Enterprise Linux (EPEL) repo: |
|
18 | - |
|
19 | - |
|
20 | - yum install epel-release |
|
21 | - |
|
22 | - |
|
23 | -Then install the nvidia drivers from epel |
|
24 | - |
|
25 | - |
|
26 | - yum install kmod-nvidia |
|
27 | - |
|
28 | - |
|
29 | -You may find you need these packages as well |
|
30 | - |
|
31 | - |
|
32 | - yum install mesa-libGLU-9.0.0-4.el7.x86_64 libXScrnSaver-1.2.2-6.1.el7.x86_64 |
|
33 | - |
|
34 | - |
|
35 | -Next, install lightdm which doesn't require the composite extension. |
|
36 | - |
|
37 | - |
|
38 | - yum install lightdm |
|
39 | - |
|
40 | - |
|
41 | -From there we do a couple of groupinstalls |
|
42 | -You may have these rpms installed already, but just for good measure |
|
43 | - |
|
44 | - |
|
45 | - yum group install "X Window System" |
|
46 | - |
|
47 | - |
|
48 | -then |
|
49 | - |
|
50 | - |
|
51 | - yum groupinstall "MATE Desktop" |
|
52 | - |
|
53 | - |
|
54 | -Toggle from gdm to lightdm in systemd using systemctl. |
|
55 | -To see what you are using as a 'display manager', check this link |
|
56 | - |
|
57 | - |
|
58 | - ls -l /etc/systemd/system/display-manager.service |
|
59 | - |
|
60 | - |
|
61 | -This is likely pointing to gdm and should be changed to point to lightdm. |
|
62 | -You can change that with systemctl. |
|
63 | - |
|
64 | - |
|
65 | - systemctl disable gdm |
|
66 | - systemctl enable lightdm |
|
67 | - |
|
68 | - |
|
69 | -And then this will reload you changes, similar to changing runlevels with sysinitV |
|
70 | - |
|
71 | - |
|
72 | - systemctl isolate graphical.target |
|
73 | - |
|
74 | - |
|
75 | -Make sure to select MATE from the drop menu as your graphical before you login. |
|
76 | -## Mac OS X |
|
77 | - |
|
78 | -* Prior to OS X 10.8, the stock X11 has better compatibility than the Xquartz development version available from MacOSForge. With the OS X 10.8 release, X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the MacOSForge site to run X11-based applications. |
|
79 | - |
|
80 | -## Laptops |
|
81 | - |
|
82 | -* You can create a local installation to take along with you. |
|
83 | -http://www.sbgrid.org/wiki/laptopinstall |
usage/stereo.md
... | ... | @@ -0,0 +1 @@ |
1 | +../stereo.md |
|
... | ... | \ No newline at end of file |
usage/versions.md
... | ... | @@ -1,71 +0,0 @@ |
1 | -# Overriding Software Versions |
|
2 | - |
|
3 | -Most of the software titles installed in the SBGrid software collection have several versions available. We try to provide at least three versions of each software package, although very old or very new applications may have fewer versions. |
|
4 | - |
|
5 | -## Display Available Versions |
|
6 | - |
|
7 | -To list the available versions of a software title, you can use the *sbgrid* utility. Running *sbgrid -l* will list the versions for your current platform. From a Linux machine, a search for CCP4 versions looks like this: |
|
8 | - |
|
9 | - |
|
10 | - $ sbgrid-info -l ccp4 |
|
11 | - Version information for: /programs/x86_64-linux/ccp4 |
|
12 | - |
|
13 | - Default version: 7.0 |
|
14 | - In-use version: 6.5 |
|
15 | - Other available versions: 6.4.0 6.3.0 |
|
16 | - Overrides use this shell variable: CCP4_X |
|
17 | - |
|
18 | - |
|
19 | -Running *sbgrid-info -L* will print the available versions for the three current platforms (OS X PowerPC and Intel, Linux). |
|
20 | - |
|
21 | - |
|
22 | - $ sbgrid-info -L gnuplot |
|
23 | - Version information for: /programs/x86_64-linux/gnuplot |
|
24 | - |
|
25 | - Default version: 4.6.4 |
|
26 | - In-use version: 4.6.4 |
|
27 | - Other available versions: 4.6.0 4.4.3 4.2.6 |
|
28 | - Overrides use this shell variable: GNUPLOT_X |
|
29 | - |
|
30 | - Version information for: /programs/i386-linux/gnuplot |
|
31 | - |
|
32 | - Default version: 4.6.0 |
|
33 | - Other available versions: 4.4.3 4.2.6 |
|
34 | - Overrides use this shell variable: GNUPLOT_L |
|
35 | - |
|
36 | - Version information for: /programs/i386-mac/gnuplot |
|
37 | - |
|
38 | - Default version: 4.6.4 |
|
39 | - Other available versions: 4.4.3 4.2.6 4.6.0 |
|
40 | - Overrides use this shell variable: GNUPLOT_M |
|
41 | - |
|
42 | - |
|
43 | -## Overriding Default Versions |
|
44 | - |
|
45 | -To override the default version of a software title, you need to create an override file. The shell configuration scripts will read this file and override the default version. |
|
46 | - |
|
47 | -The override file is named .sbgrid.conf and should be placed in your $HOME directory. The syntax for overrides is a simple key=value pair. E.g. it should look like this: |
|
48 | - |
|
49 | -`APPLICATION_X=1.2` |
|
50 | - |
|
51 | -APPLICATION_X is the name of the application followed by an underscore and the shorthand initial for the architecture. The last field on the line is the software version number you want to use. The initials for each software branch are: |
|
52 | - |
|
53 | -| Software Directory | Shorthand Initial | |
|
54 | -| ------------------ | ----------------- | |
|
55 | -| i386-linux | _L | |
|
56 | -| x86_64-linux | _X | |
|
57 | -| i386-mac | _M | |
|
58 | - |
|
59 | -To quickly open the overrides file in your default $EDITOR, you can run *sbgrid-overrides -e*. |
|
60 | - |
|
61 | -When you open a new shell, you will see a message about the overridden version. Note that a site administrator can create sitewide or machine-specific overrides as well. |
|
62 | - |
|
63 | -The example output below shows CCP4 on linux being changed from the default version: |
|
64 | - |
|
65 | - Configuration options in effect for this shell: |
|
66 | - Variable Setting Configuration |
|
67 | - CCP4_M 6.3.0 personal |
|
68 | - |
|
69 | - |
|
70 | -## Disabling a Software Package |
|
71 | -To disable a specific software package, set its version to "disable" in your ~/.sbgrid.conf file. |
usage/versions.md
... | ... | @@ -0,0 +1 @@ |
1 | +../versions.md |
|
... | ... | \ No newline at end of file |
usage/workstation_setup.md
... | ... | @@ -1,35 +0,0 @@ |
1 | -## General |
|
2 | - |
|
3 | -* You should use a network installation for workstations and servers if at all possible. NFS, SMB and AFP all work for sharing a single installation among multiple machines. The decreased admin overhead, bandwidth and disk savings of sharing a single installation is a significant benefit. |
|
4 | - |
|
5 | -## Linux |
|
6 | -Information on configuring 3D stereo can be found [here](stereo) |
|
7 | - |
|
8 | -* All Linux machines need installations of a recent version (6.17+) of csh/tcsh. Red Hat Enterprise Linux 6 and other recent distributions usually have an up to date version. There are RPMs for Red Hat/CentOS/Scientific Linux 5.x in the software tree in the architecture specific directories: |
|
9 | - |
|
10 | - /programs/i386-linux/system/RPMs |
|
11 | - /programs/x86_64-linux/system/RPMs |
|
12 | - |
|
13 | -* SELinux must be disabled. |
|
14 | - |
|
15 | -* 64-bit machines need a number of 32-bit compatibility packages installed **even when using the 64-bit software branch**. This is due to a number of binary-only and legacy packages that are only available as 32-bit applications. Additional fonts for Tcl/Tk, Motif and Xview applications are also encouraged. |
|
16 | - |
|
17 | -Packages for RHEL 6, and 7 and compatible machines: |
|
18 | - |
|
19 | - yum install glibc.i686 libgcc.i686 libX11.i686 libXaw.i686 libXext.i686 ncurses.i686 \ |
|
20 | - redhat-lsb.i686 xorg-x11-fonts-75dpi xorg-x11-fonts-100dpi xorg-x11-fonts-ISO8859-1-75dpi \ |
|
21 | - xorg-x11-fonts-ISO8859-1-100dpi xorg-x11-fonts-misc libXScrnSaver |
|
22 | - |
|
23 | - |
|
24 | -* The same 32-bit requirement applies for 64-bit Debian and Ubuntu machines. This is supported via the [Multiarch](https///wiki.debian.org/Multiarch/HOWTO) system. You'll need at least the following packages to run most of the software. Please email us if you discover we have left some out. |
|
25 | -`apt-get install libc6-i386 lsb tcsh gawk libjpeg62 curl libx11-6:i386 libxext6:i386` |
|
26 | - |
|
27 | -## Mac OS X |
|
28 | -Information on configuring 3D stereo can be found [here](stereo) |
|
29 | - |
|
30 | -* Prior to OS X 10.8, the stock X11 has better compatibility than the Xquartz development version available from MacOSForge. With the OS X 10.8 release, X11 is no longer included by Apple, and you'll need to install the latest Xquartz version offered on the MacOSForge site to run X11-based applications. |
|
31 | - |
|
32 | -## Laptops |
|
33 | - |
|
34 | -* You can create a local installation to take along with you. |
|
35 | -http://www.sbgrid.org/wiki/laptopinstall |
usage/workstation_setup.md
... | ... | @@ -0,0 +1 @@ |
1 | +../workstation_setup.md |
|
... | ... | \ No newline at end of file |
usage/wsmr-worked.md
... | ... | @@ -1,47 +0,0 @@ |
1 | -# Data Processing after WS-MR |
|
2 | - |
|
3 | -## 1 Verify Results for Search Models |
|
4 | -The first follow-up step for a search model resulting from WSMR is to repeat MR locally. |
|
5 | - |
|
6 | -To download one of the search models; first click the "Load Top 100 Hits" button, click one of the yellow circles in the resulting plot, and then use the download link for the model. |
|
7 | - |
|
8 | -* * * |
|
9 | -![](images/data-processing-after-ws-mr-1.jpg) |
|
10 | -* * * |
|
11 | -![](images/data-processing-after-ws-mr-2.png) |
|
12 | -* * * |
|
13 | - |
|
14 | -A typical input deck (`MR01.in` for this example) for `phaser` would look something like this (with the paths to your input `MTZ` and `PDB` files adjusted appropriately): |
|
15 | - |
|
16 | - ROOT MR01 |
|
17 | - MODE MR_AUTO |
|
18 | - HKLIn reflections.mtz |
|
19 | - LABIn F=FP SIGF=SIGFP |
|
20 | - ENSEmble SearchModel PDB model.pdb IDENtity 0.3 |
|
21 | - COMPosition PERCENTAGE 0.50 |
|
22 | - RESOlution HIGH 3.1 |
|
23 | - SEARch ENSEmble SearchModel NUM 1 |
|
24 | - SGALternative SELECT ALL |
|
25 | - |
|
26 | -This can be run with versions of `phaser` distributed with `CCP4` or `PHENIX` (with `phaser < MR01.in > MR01.out` or `phenix.phaser < MR01.in > MR01.out` respectively). The statistics (LLG and Z-scores) from local runs may differ due to differences in `phaser` versions. |
|
27 | - |
|
28 | -The `SGALternative` card is only necessary if you're checking alternative space-groups. |
|
29 | - |
|
30 | -## 2 Expand Search |
|
31 | - |
|
32 | -WSMR searches for a single copy of the search model - however there may be multiple copies of the model in the ASU. If so, the next step is the increase the `NUM` value for the `SEARch` card. When in doubt, it's better to set this too hight rather than too low - `phaser` will stop when unable to locate additional copies. |
|
33 | - |
|
34 | -## 3 Autobuild |
|
35 | - |
|
36 | -Once MR has been exhausted (no more copies of the search model can be placed), one possible next step is to use an autobuilder for an initial attempt to correct the sequence of the model. |
|
37 | - |
|
38 | -Using the `PHENIX` autobuilder: |
|
39 | - |
|
40 | -`phenix.autobuild reflections.mtz MR_Results.pdb project.fasta nproc=4 > AutoBuild01.out` |
|
41 | - |
|
42 | -The input model (`MR_Results.pdb`) for the autobuilder is the final result modeles from the initial or expanded MR search. |
|
43 | - |
|
44 | -The input `MTZ` file should be the original amplitudes (or intensities) used for searching, *not* the results from `phaser`. If phaser was run with the `SGALternative` card, make sure the spacegroup of this `MTZ` matches that of the search solutions. |
|
45 | - |
|
46 | -The `nproc=4` option should only be used if there are four (or more) available cores - when using the `rebuild_in_place` option, `phenix.autobuild` can't take advantage of more than 4 processors. |
|
47 | - |
usage/wsmr-worked.md
... | ... | @@ -0,0 +1 @@ |
1 | +../wsmr-worked.md |
|
... | ... | \ No newline at end of file |
usage/xorg_conf.md
... | ... | @@ -1,77 +0,0 @@ |
1 | -## Example xorg.conf for Nvidia 3D |
|
2 | - |
|
3 | -### This configuration is for an ASUS VG278HE display and a Nvidia Quadro 4000 |
|
4 | - |
|
5 | -``` |
|
6 | -# SBGrid |
|
7 | -# nvidia version 319.32 |
|
8 | - |
|
9 | -Section "ServerLayout" |
|
10 | - Identifier "Layout0" |
|
11 | - Screen 0 "Screen0" 0 0 |
|
12 | - InputDevice "Keyboard0" "CoreKeyboard" |
|
13 | - InputDevice "Mouse0" "CorePointer" |
|
14 | - Option "Xinerama" "0" |
|
15 | -EndSection |
|
16 | - |
|
17 | -Section "Files" |
|
18 | - ModulePath "/usr/lib64/xorg/modules/extensions/nvidia" |
|
19 | - ModulePath "/usr/lib64/xorg/modules" |
|
20 | - FontPath "/usr/share/fonts/default/Type1" |
|
21 | -EndSection |
|
22 | - |
|
23 | -Section "InputDevice" |
|
24 | - |
|
25 | - # generated from default |
|
26 | - Identifier "Mouse0" |
|
27 | - Driver "mouse" |
|
28 | - Option "Protocol" "auto" |
|
29 | - Option "Device" "/dev/psaux" |
|
30 | - Option "Emulate3Buttons" "no" |
|
31 | - Option "ZAxisMapping" "4 5" |
|
32 | -EndSection |
|
33 | - |
|
34 | -Section "InputDevice" |
|
35 | - |
|
36 | - # generated from data in "/etc/sysconfig/keyboard" |
|
37 | - Identifier "Keyboard0" |
|
38 | - Driver "kbd" |
|
39 | - Option "XkbLayout" "us" |
|
40 | - Option "XkbModel" "pc105" |
|
41 | -EndSection |
|
42 | - |
|
43 | -Section "Monitor" |
|
44 | - Identifier "Monitor0" |
|
45 | - VendorName "Unknown" |
|
46 | - ModelName "Ancor Communications Inc ASUS VG278HE" |
|
47 | - HorizSync 24.0 - 162.0 |
|
48 | - VertRefresh 50.0 - 148.0 |
|
49 | - Option "DPMS" |
|
50 | -EndSection |
|
51 | - |
|
52 | -Section "Device" |
|
53 | - Identifier "Device0" |
|
54 | - Driver "nvidia" |
|
55 | - VendorName "NVIDIA Corporation" |
|
56 | - BoardName "Quadro 4000" |
|
57 | -EndSection |
|
58 | - |
|
59 | -Section "Screen" |
|
60 | - Identifier "Screen0" |
|
61 | - Device "Device0" |
|
62 | - Monitor "Monitor0" |
|
63 | - DefaultDepth 24 |
|
64 | - Option "AllowDFPStereo" "1" |
|
65 | - Option "UBB" "1" |
|
66 | - Option "Stereo" "10" |
|
67 | - Option "metamodes" "DFP-0: nvidia-auto-select +1920+0, DFP-2: nvidia-auto-select +0+0" |
|
68 | - SubSection "Display" |
|
69 | - Depth 24 |
|
70 | - EndSubSection |
|
71 | -EndSection |
|
72 | - |
|
73 | -Section "Extensions" |
|
74 | - Option "Composite" "Disable" |
|
75 | -EndSection |
|
76 | - |
|
77 | -``` |
usage/xorg_conf.md
... | ... | @@ -0,0 +1 @@ |
1 | +../xorg_conf.md |
|
... | ... | \ No newline at end of file |