0ee94057e64e9390a5951548787380624297c0d1
faq-moving-data.md
... | ... | @@ -1,16 +1,9 @@ |
1 | 1 | # Moving data |
2 | 2 | Basic guidelines and resources |
3 | 3 | |
4 | - ________________________________________ |
|
5 | -/ If you are unsure about any of these \ |
|
6 | -| instructions email help@sbgrid.org for | |
|
7 | -\ assistence. / |
|
8 | - ---------------------------------------- |
|
9 | - \ ,__, |
|
10 | - \ (oo)____ |
|
11 | - (__) )\ |
|
12 | - ||--|| * |
|
13 | - |
|
4 | +If you are unsure about any of these |
|
5 | +instructions email help@sbgrid.org for |
|
6 | +assistance. |
|
14 | 7 | |
15 | 8 | [[_TOC_]] |
16 | 9 | |
... | ... | @@ -18,15 +11,15 @@ Basic guidelines and resources |
18 | 11 | ## Internally |
19 | 12 | |
20 | 13 | ### Overview |
21 | -Generally, systems located in the EM Facility and server rooms are interconencted at 10GBe. Desktop systems are connected at 1GBe. Due to many factors, it is unlilkely you will hit 10Gbe speeds, but your transfer will happen much faster on systems connected at 10Gbe. |
|
14 | +Generally, systems located in the EM Facility and server rooms are interconnected at 10GBe. Desktop systems are connected at 1GBe. Due to many factors, it is unlikely you will hit 10Gbe speeds, but your transfer will happen much faster on systems connected at 10Gbe. |
|
22 | 15 | |
23 | 16 | ### rsync or mv? |
24 | 17 | It is safest to use rsync when moving between filesystems. |
25 | 18 | |
26 | -If moving between folders on the same filesystem it is safe to us the 'mv' command |
|
19 | +If moving between folders on the same filesystem it is safe to use the 'mv' command |
|
27 | 20 | |
28 | 21 | ## Externally |
29 | -transfer.sbgrid.org is a robust system that is set up fer being a high speed transfer node. It can be used as an ssh and rsyncd destination. It can be reached internally by connection withjust the name 'transfer. ie ssh oconnor@transfer |
|
22 | +transfer.sbgrid.org is a robust system that is set up for being a high speed transfer node. It can be used as an ssh and rsyncd destination. It can be reached internally by connection with just the name 'transfer. ie ssh oconnor@transfer |
|
30 | 23 | |
31 | 24 | ### Overview |
32 | 25 | should already have [external-ssh](faq-remore-access) |
... | ... | @@ -36,10 +29,10 @@ rsync my source to my destination |
36 | 29 | |
37 | 30 | ### rsyncd for paswordless deposit location |
38 | 31 | This is ideal where we may ask outside people to initiate the data transfer. Typically this |
39 | -is for for directly transfering large data sets to your GPU storage from data collected from |
|
32 | +is for for directly transferring large data sets to your GPU storage from data collected from |
|
40 | 33 | umass, janelia or somewhere else via rsycnd. |
41 | 34 | |
42 | -An example commant would look like - |
|
35 | +An example command would look like - |
|
43 | 36 | rsync -av mydatafolder rsync://rsyncuser@transfer.sbgrid.org/umass-deposit-mylabname |
44 | 37 | |
45 | 38 | contact help@sbgrid.org to set up a destination for directly |