Changes between Version 12 and Version 13 of Procedures/NewDataArrival/Network

Timestamp:

Dec 8, 2014, 3:23:40 PM (9 years ago)

Author:

dap

Comment:

--

Procedures/NewDataArrival/Network

@@ -72 +72 @@
 }}}
 
+When running rsync, you might also want to consider putting it inside a while loop in case of any failures. This is especially useful when there is a high volume of data. Doing this will mean rsync will automatically restart after a given period if it fails. An example is as follows:
+{{{
+## Note: don't use too low a number in sleep, as this will repeat the command too often and won't make thelma very happy
+while(true) ; do rsync -avz --progress arsfdan@thelma.nerc-arsf.ac.uk:/PATH/YOU/FOUND/EARLIER/PROJECTNAME . ; date ; sleep 1800 ; done
+}}}
+
 
 If something goes wrong after an hour or two, don't delete what you've already downloaded.  Instead, repeat the rsync command and it'll pick up where it left off.