faq-moving-data.md
... ...
@@ -0,0 +1,45 @@
1
+# Moving data
2
+Basic guidelines and resources
3
+
4
+ ________________________________________
5
+/ If you are unsure about any of these \
6
+| instructions email help@sbgrid.org for |
7
+\ assistence. /
8
+ ----------------------------------------
9
+ \ ,__,
10
+ \ (oo)____
11
+ (__) )\
12
+ ||--|| *
13
+
14
+
15
+[[_TOC_]]
16
+
17
+
18
+## Internally
19
+
20
+### Overview
21
+Generally, systems located in the EM Facility and server rooms are interconencted at 10GBe. Desktop systems are connected at 1GBe. Due to many factors, it is unlilkely you will hit 10Gbe speeds, but your transfer will happen much faster on systems connected at 10Gbe.
22
+
23
+### rsync or mv?
24
+It is safest to use rsync when moving between filesystems.
25
+
26
+If moving between folders on the same filesystem it is safe to us the 'mv' command
27
+
28
+## Externally
29
+transfer.sbgrid.org is a robust system that is set up fer being a high speed transfer node. It can be used as an ssh and rsyncd destination. It can be reached internally by connection withjust the name 'transfer. ie ssh oconnor@transfer
30
+
31
+### Overview
32
+should already have [external-ssh](faq-remore-access)
33
+
34
+### rsync through ssh
35
+rsync my source to my destination
36
+
37
+### rsyncd for paswordless deposit location
38
+This is ideal where we may ask outside people to initiate the data transfer. Typically this
39
+is for for directly transfering large data sets to your GPU storage from data collected from
40
+umass, janelia or somewhere else via rsycnd.
41
+
42
+An example commant would look like -
43
+rsync -av mydatafolder rsync://rsyncuser@transfer.sbgrid.org/umass-deposit-mylabname
44
+
45
+contact help@sbgrid.org to set up a destination for directly