_Sidebar.md
... ...
@@ -1,19 +1,17 @@
1 1
![SBGrid](images/sbgrid_small_logo.gif) **[SBGrid Wiki](Home)**
2 2
3 3
Installing Software
4
-* [Installation: Overview](installation_overview)
4
+* [Overview](installation_overview)
5 5
* [Supported Operating Systems](operatingsystems)
6
-* [Installation: 'Site' installation](managing_install)
7
-* [Installation: GUI](client_install)
8
-* [Installation: Package Manager](client_CLI_install)
6
+* [Full Site installation](managing_install)
7
+* [Graphical installation client](client_install)
8
+* [Command line installation client](client_CLI_install)
9 9
10 10
Using the SBGrid Environment
11 11
* [Getting Started with SBGrid](getting_started)
12
-* [Overriding Software Versions](versions)
13
-* [SBGrid environment: Capsules](capsules)
14
-* [SBGrid environment: Legacy](monolithic)
15
-* [SBGrid MacOS GUI : Usage](client_usage)
16
-* [SBGrid Package Manager : Usage](client_CLI_usage)
12
+* [Managing Software Versions](versions)
13
+* [SBGrid Capsules Environment](capsules)
14
+* [SBGrid Legacy Environment](monolithic)
17 15
18 16
Getting Help
19 17
* [Software Help and Requests](help)
client_CLI_install.md
... ...
@@ -1,13 +1,25 @@
1
-## SBGrid package mangager installation client
1
+## SBGrid command line installation client
2 2
3
-The SBGrid software stack can be installed using our CLI (command line interface) installation client for [Linux (CentOS/RHEL 6 or 7 recommended) or Apple OSX computers running MacOSX v10.9 - 10.12.](operatingsystems)
3
+### Contents
4
+ - [Installation](#Installation)
5
+ - [Pre-installation requirements](#Pre-installation requirements)
6
+ - [Binary releases : MacOS and Linux Installation](#Binary-releases)
7
+ - [Pip installation](#Installation-using-pip)
8
+ - [Installation on an external drive or USB key](#Installation-on-an-external-drive-or-USB-key)
9
+ - [General Usage](#General-Usage)
10
+ - [Activation](#Activation)
11
+ - [Installing and Removing Titles](#Installing-and-removing-packages)
12
+ - [Updating packages](#Updating-packages)
13
+ - [Known Issues](#Known-Issues)
4 14
5
-Three software installers are available. Binary releases are available for MacOS and CentOS7/Ubuntu operating systems. A python release is also provided which is compatible with Mac and most Linux (CentOS6 and higher) operating systems.
15
+## Installation
16
+The SBGrid software stack can be installed using our command line client for [Linux (CentOS/RHEL 6 or 7 recommended) or Apple OSX computers running MacOSX v10.9 - 10.12.](operatingsystems)
17
+
18
+Three software installers are available. Binary releases are available for MacOS and CentOS7 operating systems. A python release is also provided which is compatible with Mac and most Linux (CentOS6 and higher) operating systems.
6 19
7 20
The SBGrid installation client requires an individual account. To get started, first, set up an account by registering here : [SBGrid registration](https://sbgrid.org/registration/register/)
8 21
9 22
### Pre-installation requirements
10
-
11 23
**Admin access required on your computer.**
12 24
The SBGrid installation client will install the software tree to /opt/sbgrid and create a symlink from this directory to /programs. While admin privileges are not required to run the application, you will need admin privileges to create /opt/sbgrid and /programs .
13 25
... ...
@@ -20,12 +32,11 @@ The SBGrid installation client requires an individual account. To get started, f
20 32
**For large packages (Phenix, Rosetta, CCP4), a wired connection is recommended.**
21 33
Some packages are quite large and can be slow to download, especially over WiFi.
22 34
23
-**pip (for python whl install only)**
35
+**pip (for python whl install only, CentOS6 systems)**
24 36
pip is a package management system used to install and manage software packages written in Python. The software installation client is installable by pip. This may not be on you machine by default, instructions for adding it are included here.
25 37
26
-### Binary releases : MacOS and Linux Installation
27
-
28
-There is minimal installation needed for these binaries. They can be run from any location. Untar the archive, make the file executable if necessary, and run from your preferred location.
38
+### Binary releases
39
+Binary releases of the install client are recommended - there is minimal installation needed for these binaries and they can be run from any location with no dependencies. Untar the archive, make the file executable if necessary, and run from your preferred location.
29 40
30 41
[Mac : 1.0.660, 2017-06-21](downloads/sbgrid-1.0.660-Darwin.tgz)
31 42
... ...
@@ -41,46 +52,54 @@ usage:
41 52
sbgrid <command> [<command_args>]
42 53
43 54
Available commands are:
44
- activate activate new installation
45
- grids list available grids
46
- info print package metadata
47
- install install single package
48
- install-all install all packages from collection
49
- installed list installed packages
50
- list list available packages
51
- rebuild rebuild installation
52
- remove remove installed package
53
- resume resume interrupted installations
54
- update update package to latest release/version
55
- update-all update all packages to latest release/version
56
- updates list available updates for installed packages
57
- version print package version string
55
+
56
+Query packages:
57
+ collections list available collections
58
+ grids list available grids
59
+ info get detailed information on a particular package
60
+ installed list all installed packages
61
+ list list available packages
62
+ search list and search installed packages
63
+ updates list available updates
64
+
65
+Manage packages:
66
+ install install packages
67
+ install-all
68
+ rebuild rebuild installation of all installed packages
69
+ remove / uninstall remove installed packages
70
+ resume resume interrupted installations
71
+ update update installed package
72
+ update-all
73
+
74
+Environment:
75
+ shell Load sbgrid environment
76
+
77
+Installation management
78
+ activate activate new installation
79
+ admin cron mode
80
+ autoclean removes unused packages
81
+ reactivate reactivate installation using existing config and package database/list
82
+ save save current configuration
83
+
84
+Additional arguments:
85
+ -h, --help show usage information and exit current platform
86
+ -l, --info-versions list available and default versions for <program> on current platform
87
+ -L, --info-all-versions list available and default versions for <program> on all platforms
88
+ --debug enable verbose logging
58 89
sbgrid: error: too few arguments
59 90
```
60 91
61
-### Install python wheel using **pip** - Mac Installation
62
-
63
- On mac, pip is available from [macports](https://www.macports.org/), [homebrew](http://brew.sh/), and [fink](http://finkproject.org/). It also can be added using **easy_install**. easy_install will install pip into your system python.
64
-
65
- $ sudo easy_install pip
66
-
67
-### Install python wheel using **pip** - Linux Installation
68
-
92
+### Installation using pip
69 93
On CentOS6, you can install pip from the EPEL repository (yum -y install python-pip) or as [per these directions](https://pip.pypa.io/en/stable/installing/)
70 94
71
-## CLI client - Installation and activation
72
-**1. Download the latest SBGrid installation client from here.**
73
-
74 95
[Latest build : 1.0.660, 2017-06-21](downloads/sbgrid-1.0.660-py2-none-any.whl)
75 96
76
-**2. Install / Upgrade with pip**
77
-
78
- $ sudo pip install SBGrid_Installer-1.0.461-py2-none-any.whl
97
+ $ sudo pip install SBGrid_Installer-1.0.660-py2-none-any.whl
79 98
80
- Which should produce output similar to :
99
+Which should produce output similar to :
81 100
82 101
```
83
-Unpacking ./SBGrid_Installer-1.0.448-py2-none-any.whl
102
+Unpacking ./SBGrid_Installer-1.0.660-py2-none-any.whl
84 103
Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /nfs/programs-dev/i386-mac/python/2.7.5/lib/python2.7/site-packages (from SBGrid-Installer==1.0.488)
85 104
Downloading/unpacking requests (from SBGrid-Installer==1.0b2.dev412)
86 105
Downloading requests-2.11.1.tar.gz (485kB): 485kB downloaded
... ...
@@ -95,67 +114,336 @@ Successfully installed SBGrid-Installer requests
95 114
Cleaning up...
96 115
```
97 116
98
-The *sbgrid* command will produce this usage info :
117
+### Installation on an external drive or USB key
118
+Currently the installer application installs the software tree in /opt/sbgrid and uses a symlink at /programs. This link is required for the software to work, but in principle the software can be located anywhere and linked to /opt/sbgrid. This functionality is not yet included in the SBGrid application, but can be set up manually with a symlink.
119
+
120
+An installation can be made on an external drive if you first do an install (into /opt/sbgrid), then move it and symlink to the new location.
99 121
100
- $ sbgrid
122
+**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is */Volumes/sbgrid_client_install*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application.
123
+
124
+Next move */opt/sbgrid* to the USB key at */Volumes/sbgrid_client_install*. You will likely need sudo for this.
125
+
126
+ $ sudo mv /opt/sbgrid /Volumes/sbgrid_client_install/.
127
+
128
+Now we have */Volumes/sbgrid_client_install/sbgrid*. Create a symlink from */opt/sbgrid* to */Volumes/sbgrid_client_install/sbgrid*.
129
+
130
+ $ sudo ln -s /Volumes/sbgrid_client_install/sbgrid /opt/sbgrid
131
+
132
+The symlink at */programs* still points to */opt/sbgrid*, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive.
133
+
134
+## General Usage
135
+The SBGrid command line installation client takes subcommands and arguments to those commands to perform various tasks. These can be found in the usage info shown above. Each subcommand can also take a -h or --help argument to show more detailed usage info. For example, the 'install' subcommand can take several arguments :
101 136
102 137
```
103
-usage:
104
-sbgrid <command> [<command_args>]
138
+$ ./sbgrid install --help
139
+usage: sbgrid install [-h] [--all-versions] title [title ...]
105 140
106
-Available commands are:
107
- activate Activate new installation
108
- list List available packages
109
- info Print package metadata
110
- install Install single package
111
- install-all Install all packages from collection
112
- installed List installed packages
113
- remove Remove installed package
114
- resume Resume interrupted installations
115
- upgrades List available upgrades for installed packages
116
- upgrade Upgrade package to latest version
117
- upgrade-all Upgrade all packages to latest version
118
- version Print package version string
119
-sbgrid: error: too few arguments
141
+Install package.
142
+
143
+positional arguments:
144
+title package name or package_name@version
120 145
146
+optional arguments:
147
+-h, --help show this help message and exit
148
+--all-versions install all versions for a package
121 149
```
122 150
123
-**4. Activate the installation**
124
-Enter your site and key which you should have received these by email.
151
+### Activation
152
+To install the software, you must have valid credentials provided by SBGrid.
125 153
126
- $ sbgrid activate <site name> <user name> <activation key>
154
+Activate with the 'activate' subcommand
155
+```
156
+usage: sbgrid activate [-h] [--multibranch] site user key
127 157
128
-You may be prompted for your sudo password to create /programs and /opt/sbgrid.
158
+Activate new installation.
129 159
130
-**5. On successful activation, list software titles.**
160
+positional arguments:
161
+ site site name
162
+ user user name
163
+ key activation key
131 164
132
- $ sbgrid list
165
+optional arguments:
166
+ -h, --help show this help message and exit
167
+ --multibranch enable installation for all architectures
133 168
134
- If activation continues to fail, you may have an old SBGrid installation at /programs or /opt/sbgrid. These should be removed.
169
+```
135 170
136
-You may also be blocked from accessing SBGrid servers on port 873 and port 8080 by your institution's firewall. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
171
+The *--multibranch* option allows for installation of Linux or Mac software on server that should host both platforms, usually for access of NFS. This must be set at activation. Once set, Linux and Mac titles will be installed.
137 172
138
-For help, email *bugs@sbgrid.org.*
173
+### Listing available titles
139 174
140
-### Installation on an external drive or USB key
141
-Currently the installer application installs the software tree in /opt/sbgrid and uses a symlink at /programs. This link is required for the software to work, but in principle the software can be located anywhere and linked to /opt/sbgrid. This functionality is not yet included in the SBGrid application, but can be set up manually with a symlink.
175
+The *sbgrid list* command will show all available titles colored by their installation status. Installed titles are green, those with available updates are blue, and titles to be removed are red. Software is listed by 'Collection'.
142 176
143
-An installation can be made on an external drive if you first do an install (into /opt/sbgrid), then move it and symlink to the new location.
177
+```
178
+$ ./sbgrid list
179
+-- Crystallography -------------------------------------------------------------------------------------------------------------------------
180
+3dna eden pdb_redo solveresolve
181
+adxv eiger2cbf pdb-validation-suite somore
182
+albula elves
183
+...
184
+-- NMR -------------------------------------------------------------------------------------------------------------------------------------
185
+aqua gamma nmrview remediator
186
+aria haddock pales shiftx2
187
+...
188
+
189
+-- Electron Microscopy ---------------------------------------------------------------------------------------------------------------------
190
+2dx particle
191
+ace2 pft3dr
192
+auto3dem phoelix
193
+bfactor powerfit
194
+bsoft priismive
195
+burnham-brandeis-helical-package python-macromolecular-library
196
+chimera refmac
197
+crop relion
198
+...
144 199
145
-**Example:** 128Gb USB 'key' drives are available on Amazon for 30$ or less and are a nice way to supplement the SSDs that come in Mac laptops. To install on an external drive like this, mount it on your computer. For this example, the mount is */Volumes/sbgrid_client_install*. Then, using the SBGrid installer, do an initial installation on the hard drive. To make life easy, just do one application. Then close the installer application.
200
+```
146 201
147
-Next move */opt/sbgrid* to the USB key at */Volumes/sbgrid_client_install*. You will likely need sudo for this.
202
+### Getting Information about titles
148 203
149
- $ sudo mv /opt/sbgrid /Volumes/sbgrid_client_install/.
204
+Information about each title, including a description and links to documentation can be show with the *sbgrid info <title>* command.
150 205
151
-Now we have */Volumes/sbgrid_client_install/sbgrid*. Create a symlink from */opt/sbgrid* to */Volumes/sbgrid_client_install/sbgrid*.
206
+### Installing and removing
152 207
153
- $ sudo ln -s /Volumes/sbgrid_client_install/sbgrid /opt/sbgrid
208
+Install and remove titles with the *sbgrid install <title>* and *sbgrid remove <title>* command. Each of these commands can take multiple titles with versions at one time.
154 209
155
-The symlink at */programs* still points to */opt/sbgrid*, and that is a link that points to the external location. Open the installer and add the desired applications. These will now install to the external drive.
210
+```
211
+ $ ./sbgrid info epmr
212
+Package: EPMR
156 213
157
-### Some known issues
214
+Available versions:
215
+ * 16.01 (installed)
216
+ * 16.04 (installed)
217
+ * 16.07.1 (installed, default)
158 218
159
-* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available.
219
+Grids(s): SBGrid
220
+Collection(s): Crystallography
160 221
161
-* **Activation Failed**. In some cases the Authorization dialog for admin privileges does not appear during activation. This causes the client activation to fail. This is usually due to a previously existing /programs directory or symlink from a prior installation. This must be removed for activation to be successful. Other users have reported successful activation after a restart.
222
+Description:
223
+ a program that finds crystallographic molecular replacement solutions
224
+using an evolutionary search algorithm. The program directly optimizes
225
+three rotational and three positional parameters for the search model with
226
+respect to the correlation coefficient between Fo and Fc.
227
+
228
+Links:
229
+ Website: http://www.epmr.info/
230
+ Manual: http://www.epmr.info/UsersGuide.html
231
+
232
+```
233
+```
234
+ $ ./sbgrid info adxv
235
+Package: adxv
236
+
237
+Available versions:
238
+ * 1.9.10
239
+ * 1.9.11
240
+ * 1.9.12 (installed, default)
241
+ * 1.9.7
242
+
243
+Grids(s): SBGrid
244
+Collection(s): Crystallography
245
+
246
+Description:
247
+ displays protein crystallography X-ray diffraction data. The data may
248
+be displayed as a 2-D image, 3-D wire mesh or as integer pixel values. Data
249
+files may be saved in tiff or postscript format.
250
+
251
+Technical notes:
252
+ Adxv will display data from most current detectors: ADSC ccd Mar
253
+ccd APS 3x3 ccd Mar image plate (old and new format) Raxis II & IV Fuji
254
+image plate Crystallographic Binary Format (CBF) XDS .pck files Raw
255
+binary 8, 16 & 32 bit integer data
256
+
257
+Links:
258
+ Website: http://www.scripps.edu/tainer/arvai/adxv.html
259
+ Manual: http://www.scripps.edu/tainer/arvai/adxv/AdxvUserManual.pdf
260
+```
261
+```
262
+ $ ./sbgrid install adxv epmr epmr@16.01
263
+adxv@1.9.12 installed
264
+epmr@16.07.1 installated
265
+epmr@16.01 installed
266
+Updating installation configuration...
267
+
268
+```
269
+When a version string is not specified, the default version is installed or removed.
270
+
271
+### Updating titles
272
+
273
+Show titles with a pending update with the *sbgrid updates* command. Updates can be applied with the *sbgrid update <title>* or *sbgrid update-all* commands.
274
+
275
+### Example : Installing Albula
276
+
277
+ $ sbgrid info albula
278
+
279
+```
280
+Package: ALBULA
281
+Name : albula
282
+
283
+Available versions:
284
+* 3.2.0-2 (default)
285
+* 3.1.0-13
286
+* 3.0.0-14
287
+* 2.2.12
288
+
289
+Collection(s): Crystallography
290
+
291
+Description:
292
+ consists of the standalone program ALBULA VIEWER, a fast and easy-to-
293
+use program that allows optimal visualization of PILATUS and EIGER data,
294
+and ALBULA API, a Python programming interface for displaying images and
295
+performing operations and calculations. The API enables you to easily
296
+integrate the viewer functionality into your beamline infrastructure or
297
+experimental setup.
298
+
299
+Links:
300
+* Website: https://www.dectris.com/Albula_Overview.html
301
+```
302
+
303
+To install:
304
+
305
+ $ sbgrid install albula
306
+
307
+```
308
+Installing: albula
309
+Updating installation configuration...
310
+Installation was successfull!
311
+```
312
+
313
+To get started, load the SBGrid environment :
314
+
315
+ $ source /programs/sbgrid.shrc
316
+
317
+```
318
+ Software Support by SBGrid (www.sbgrid.org)
319
+********************************************************************************
320
+
321
+...
322
+
323
+SBGrid installation last updated: 2016-10-21
324
+Please submit bug reports and help requests to: <bugs@sbgrid.org> or
325
+ <http://sbgrid.org/bugs>
326
+********************************************************************************
327
+```
328
+
329
+### Example : Removing Albula
330
+
331
+ $ sbgrid remove albula
332
+
333
+results in :
334
+
335
+```
336
+Removing: albula
337
+Updating installation configuration...
338
+Package removed!
339
+```
340
+
341
+### Version selection
342
+
343
+Default versions are installed by default for each application, though individual versions can be selected for each title.
344
+
345
+To do so, include the version after the title followed the version. To see what versions are available, use the *sbgrid info <title>* command. Let;s us the title epmr as an example here:
346
+
347
+ $ sbgrid info epmr
348
+
349
+```
350
+Package: EPMR
351
+Name : epmr
352
+
353
+Available versions:
354
+* 16.04 (default)
355
+* 16.01
356
+* 15.12
357
+* 15.04
358
+* 13.07
359
+* 11.02
360
+
361
+Collection(s): Crystallography
362
+
363
+Description:
364
+ a program that finds crystallographic molecular replacement solutions
365
+using an evolutionary search algorithm. The program directly optimizes
366
+three rotational and three positional parameters for the search model with
367
+respect to the correlation coefficient between Fo and Fc.
368
+
369
+Links:
370
+* Website: http://www.epmr.info/
371
+* Manual: http://www.epmr.info/UsersGuide.html
372
+```
373
+
374
+To install version 11.02, add the version string like so:
375
+
376
+ $ sbgrid install epmr@11.02
377
+
378
+which will produce :
379
+
380
+```
381
+Installing: epmr (11.02)
382
+Updating installation configuration...
383
+Installation was successfull!
384
+```
385
+
386
+Check which versions are installed with the sbgrid info command again
387
+
388
+ $ sbgrid info epmr
389
+
390
+```
391
+epPackage: EPMR
392
+Name slug: epmr
393
+
394
+Available versions:
395
+* 16.04 (default)
396
+* 16.01
397
+* 15.12
398
+* 15.04
399
+* 13.07
400
+* 11.02 (installed)
401
+
402
+...
403
+
404
+```
405
+
406
+Confirm with the *sbwhich* command
407
+
408
+ $ sbwhich epmr
409
+```
410
+/programs/i386-mac/epmr/11.02/epmr
411
+```
412
+
413
+Reload the sbgrid shell to use the new version ( or set the environment variable EPMR_M=11.02 ).
414
+
415
+### Software Versions Management in the SBGrid environment
416
+If you have a single version of an application installed, explicit version selection in your environment is not needed.
417
+
418
+In the case of multiple installed versions, the *SBGrid Default* version will be the version available at the terminal when it is installed, unless configured otherwise in *~/.sbgrid.conf*.
419
+
420
+In the case of multiple non-default versions installed, the *latest release* will be version available in your shell. If you would like to have more than one version of a title installed, and prefer to use an older release or the non-default version when a default version is installed, you must set this explicitly in your *~/.sbgrid.conf* file. This is the same as in the standard SBGrid environment.
421
+
422
+**Version priority in the shell**
423
+ 1. *~/.sbgrid.conf*
424
+ 2. Installed single version
425
+ 3. Installed Default version
426
+ 4. Latest installed release
427
+
428
+There is more info on how to do that here --> [SBGrid version overrides](versions)
429
+
430
+### Running SBGrid software
431
+
432
+To use the software at the terminal in bash, open a new terminal and run
433
+
434
+ $ source /programs/sbgrid.shrc
435
+
436
+or in tcsh
437
+
438
+ $ source /programs/sbgrid.cshrc
439
+
440
+### Questions, Problems and Known Issues
441
+For questions or problems, the Help menu will direct to the SBGrid help page. Or just email *bugs@sbgrid.org*.
442
+
443
+If relevant, please include a screenshot of the terminal if possible (command + shift + 4) and please include the ~/Library/Application Support/SBGrid/sbgrid.log file with your report.
444
+
445
+### Known issues
446
+
447
+* **rsync required on 873 or 8080**. The application will fail if outbound port 873 and port 8080 are blocked by your institution or are otherwise not available. You can check if you can access [port 873 here](http://portquiz.net:873) and [port 8080 here](http://portquiz.net:8080)
448
+
449
+For help, email *bugs@sbgrid.org.*
client_CLI_usage.md
... ...
@@ -2,7 +2,7 @@
2 2
3 3
**Instructions for installation of the SBGrid software installation client can be found here** --> [Installation Instructions](client_CLI_install).
4 4
5
-All SBGrid software is run from the the terminal.
5
+SBGrid software is run from the the terminal.
6 6
For information on how to run software from the SBGrid collection and configure your shell, check the [getting started page.](getting_started).
7 7
8 8
### General
... ...
@@ -151,7 +151,7 @@ To do so, include the version after the title followed the version. To see what
151 151
152 152
```
153 153
Package: EPMR
154
-Name slug: epmr
154
+Name : epmr
155 155
156 156
Available versions:
157 157
* 16.04 (default)
... ...
@@ -176,7 +176,7 @@ Links:
176 176
177 177
To install version 11.02, add the version string like so:
178 178
179
- $ sbgrid install epmr 11.02
179
+ $ sbgrid install epmr@11.02
180 180
181 181
which will produce :
182 182