Overview

SBGrid provides comprehensive system administration support for computers that are used for data collection and analysis with Lattice Light Sheet Microscopy (LLSM) in the Kirchhausen lab. All servers are on the HMS network and are are physically located in a BCH managed network closet on the 3rd floor of CLSB. SBGrid also creates accounts on the Confocal data server on the BCH network.

For access to the file servers is available to lab members upon approval. Please email the SBGrid at help@sbgrid.org and CC your Lab Admin.

Lab workstations (OS X,Windows) are managed by lab members. Please contact your Lab Admin for help.

Get Help

For general questions and server connection issues email SBGrid at help@sbgrid.org and include your name, your lab and workstation name.

New lab members should contact help@sbgrid.org to complete their initial setup.

CPU Cluster

  • Lab members can submit CPU jobs from any Linux workstation in the lab. Current job submissions can be provisioned to the tk-cpu job queue.

DGX systems

  • dgx-a100-01 and dgx-a100-02 Are on an isolated network direct connection can be 'jumped' like ssh -J username@head.gpucluster.crystal.harvard.edu username@dgx-a100-01
  • OnDemand desktops can be launched from https://ood.gpucluster.crystal.harvard.edu/pun/sys/dashboard (must be on VPN or local network)
  • you username is required to launch a desktop, just select a queue.
  • For longer term desktops use month long queue, a dedicated queue for this resource in planned.

Linux Systems

All Lab linux systems are located across lab space in WAB. The Older HPC systems are in Dreamspace computing room in WAB 133. The Visual learning Systems are located in the new Visual learning center in WAB room 144. All Linux system access is managed by the SBGrid ARC team.

  • Lab workstation names
  • tkhpc32.med.harvard.edu
  • tkhpc32b.med.harvard.edu
  • tkhpc32c.med.harvard.edu
  • tkhpc48.med.harvard.edu
  • tkhpc36a.med.harvard.edu
  • tkhpc36b.med.harvard.edu
  • tkhpc36c.med.harvard.edu
  • tkl1.med.harvard.edu
  • tkl2.med.harvard.edu
  • tkl3.med.harvard.edu

  • DGX Systems
  • tk-dgx-1.med.harvard.edu
  • dgx-a100-01 Note: connect like ssh -J username@head.gpucluster.crystal.harvard.edu username@dgx-a100-01
  • dgx-a100-02 Note: connect like ssh -J username@head.gpucluster.crystal.harvard.edu username@dgx-a100-01

  • See additional tips section in Password-less ssh authentication

Linux Systems mount points

  • LLSM project folders - /nfs/data1expansion
  • LLSM project folders - /nfs/tkdata2
  • User home folders - /nfs/tkhome
  • SBGrid Project use - /nfs/sbgrid
  • Cluster SSD scratch Server - /scratch or /nfs/scratch
  • Cluster NVME scratch storage - /scratch2 or /nfs/scratch2
  • DGX Cluster scratch storage - /scratch1 or /nfs/scratch1
  • New Microscope data - /llsm

Connecting To Linux

After setting up your account with SBGrid you can log into any of the local Linux systems in your lab. No matter which system you use you will keep the same home folder.

Connecting To Your Labs Linux Systems Remotely

You can connect to your labs workstations by using the ssh program to connect through our bastions hosts. Please review our instructions the following, as you will need to request external SSH access:

Also see:

Submitting Job to Cluster

sbatch scripts and interactive srun command are available on all lab Linux workstations.

Data Storage

Processed data copied to the datasync2 directory and flagged to be archived are synced to HMS orchestra storage. On the main storage server, directories located at /data1/home/tk/public/datasync2 must be flagged with a 'transfer.txt' file in order for the data to sync with Orchestra transfer node. Users must manually create the file. While transferring, a 'transferring.txt' file is created inside the directory. Once the transfer is done, a 'transfered.txt' file is created inside the same directory to indicate that it finished.

Networking and General IT Support

For networking and general IT support for lab system connected to the BCH network contact the Children’s help desk at (617) 919-4357 or at help.desk@childrens.harvard.edu. HMS IT has access to the networking closets at the Warren Alpert Building.

For compute workstations contact help@sbgrid.org.