Changes between Version 12 and Version 13 of Procedures/NewDataArrival/Network


Ignore:
Timestamp:
Dec 8, 2014 3:23:40 PM (4 years ago)
Author:
dap
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Procedures/NewDataArrival/Network

    v12 v13  
    7272}}}
    7373
     74When running rsync, you might also want to consider putting it inside a while loop in case of any failures. This is especially useful when there is a high volume of data. Doing this will mean rsync will automatically restart after a given period if it fails. An example is as follows:
     75{{{
     76## Note: don't use too low a number in sleep, as this will repeat the command too often and won't make thelma very happy
     77while(true) ; do rsync -avz --progress arsfdan@thelma.nerc-arsf.ac.uk:/PATH/YOU/FOUND/EARLIER/PROJECTNAME . ; date ; sleep 1800 ; done
     78}}}
     79
    7480
    7581If something goes wrong after an hour or two, don't delete what you've already downloaded.  Instead, repeat the rsync command and it'll pick up where it left off.