Changes between Version 75 and Version 76 of Procedures/NEODCDelivery

Apr 24, 2012 12:39:26 PM (7 years ago)



  • Procedures/NEODCDelivery

    v75 v76  
    3333find -user `whoami` -exec chmod a+rX {} \;
    36  1. Create the tarballs for NEODC to download:[[BR]][[BR]]
    37    ''If AIMMS or GRIMM data is present then you will first need to separate these and put into separate tarballs. [[BR]]
    38     Use: tar czf <TARBALL NAME> <DIRECTORY TO TARBALL> [[BR]]
    39     Tarball name should be in format: GB09_05-2009_278b_Leighton_moss-AIMMS.tar.gz [[BR]]
    40     Create a md5sum file for the AIMMS/GRIMM data also [[BR]]
    41     Use: md5sum <TARBALL NAME> > <TARBALL NAME>-MD5SUM.txt''
    42    {{{
    43    su - arsf
    44    ~/arsf_data/archived/ <path to project in repository> <optional additional projects>
    45    (e.g. ~arsf/arsf_data/2011/flight_data/spain_portugal/EU11_03-2011_142_Jimena/)
    46    # To run the archiving locally rather than via the grid engine, use:
    47    ~arsf/usr/bin/ <path to project>
    48    }}}
    49    When complete, this will have dumped the data into `~arsf/arsf_data/archived/neodc_transfer_area/staging/`.  Check it looks OK then move it up one level so NEODC can rsync it. Logs will be in ~arsf/arsf_data/archived/archiver_logs/.
    50  [[BR]][[BR]]
    5135 1. Notify NEODC they can download the data (Current contact is: and record the date in the ticket.
    52  1. When NEODC confirm they have backed up the data:
    53   1. Remove tarball from the transfer area
     36 1. When NEODC confirm they have backed up the data:
    5437  1. Move the repository project to archive disk at: ~arsf/arsf_data/archived/<original path from ~arsf/arsf_data/>  [[BR]]
    5538     e.g. `mv ~arsf/arsf_data/2008/flight_data/uk/CEH08_01/ ~arsf/arsf_data/archived/2008/flight_data/uk/CEH08_01` [[BR]]
    5740  1. Create a symlink to the project in it's original location. Point the symlink through ~arsf/arsf_data/archived rather than directly to specific disk. [[BR]] e.g. `ln -s ~arsf/arsf_data/archived/2008/flight_data/uk/CEH08_01 ~arsf/arsf_data/2008/flight_data/uk/CEH08_01`
    5841  1. Note in ticket that it has been backed up by NEODC and moved to archive disk.
    59  1. Final steps - maybe wait a month:
     42 1. Final steps - maybe wait a couple of months:
    6043   1. If workspace version present, delete from being_archived.
    6144   1. Close the ticket