Changes between Version 40 and Version 41 of Procedures/NEODCDelivery


Ignore:
Timestamp:
May 14, 2010 10:46:05 AM (9 years ago)
Author:
knpa
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Procedures/NEODCDelivery

    v40 v41  
    1818}}}
    1919   1. Delete the contents of the lev1/ subdirectory, where these are duplicates of the delivery directory.
    20  1. Scan the filesystem for any 'bad' things and fix them:
    21    1. delete any unnecessary files - backups of DEMs that weren't used, temp files created by gedit (~ at end of filename), hidden files etc
    22    1. Remove executable bit on all files (except the point cloud filter and the run[aceh] scripts) -> `find -type f -not -wholename '*pt_cloud_filter*' -and -not -regex '.*/run[aceh]/.*sh' -and -perm /a=x -exec chmod a-x {} \;`
    23    1. Find all files/dirs with unusual characters (space, brackets, etc) - use `find -regex '.*[^-0-9a-zA-Z/._].*' | ~arsf/usr/bin/fix_naughty_chars.py` to give suggested commands, but check first
    24    1. Give everyone read permissions (and execute if it has user execute) for the current directory and below - `chmod -R a+rX .`
    25    1. Create a directory on /data/larsenb1/archived/arsf/<original path from ~arsf/arsf_data/> and move the data to it.
    26      1. e.g. `~arsf/2008/flight_data/uk/CEH08_01...` would be `/data/larsenb1/archived/arsf/2008/flight_data/uk/CEH08_01...`
    27    1. Create a symlink to the project in it's original repository location (e.g. under ~arsf/arsf_data/2008/flight_data/uk)
    28    1. Create a symlink in ~arsf/arsf_data/archived to the archived data at /data/larsenb1/archived/arsf/YYYYMMDD/
    29    1. copy and delete the DTG metadata from `~utils/logs/archiving_scratch/arsf...` to `~arsf/dtg_archive_metadata/YYYYMMDD/`
     20   1. Scan the filesystem for any 'bad' things and fix them:
     21    1. delete any unnecessary files - backups of DEMs that weren't used, temp files created by gedit (~ at end of filename), hidden files etc
     22    1. Remove executable bit on all files (except the point cloud filter and the run[aceh] scripts) -> `find -type f -not -wholename '*pt_cloud_filter*' -and -not -regex '.*/run[aceh]/.*sh' -and -perm /a=x -exec chmod a-x {} \;`
     23    1. Find all files/dirs with unusual characters (space, brackets, etc) - use `find -regex '.*[^-0-9a-zA-Z/._].*' | ~arsf/usr/bin/fix_naughty_chars.py` to give suggested commands, but check first
     24    1. Give everyone read permissions (and execute if it has user execute) for the current directory and below - `chmod -R a+rX .`
     25 1. Create a directory on /data/larsenb1/archived/arsf/<original path from ~arsf/arsf_data/> and move the data to it.  [[BR]]
     26    e.g. `~arsf/2008/flight_data/uk/CEH08_01...` would be `/data/larsenb1/archived/arsf/2008/flight_data/uk/CEH08_01...`
     27 1. Create a symlink to the project in it's original repository location (e.g. under ~arsf/arsf_data/2008/flight_data/uk)
     28 1. Create a symlink in ~arsf/arsf_data/archived to the archived data at /data/larsenb1/archived/arsf/YYYYMMDD/
    3029 1. Create an archive tarball for NEODC to download:
    3130{{{