Changes between Version 73 and Version 74 of Procedures/NEODCDelivery

Timestamp:

Mar 1, 2012, 4:16:05 PM (13 years ago)

Author:

knpa

Comment:

--

Procedures/NEODCDelivery

@@ -3 +3 @@
 This page documents the procedure to follow when sending data to NEODC.
 
-A project is ready to be archived when all sensors have been delivered. If it is 2010 or earlier then it will need to be fully r-synced from the workspace. Also, check the ticket and make sure there is nothing on there which suggests something still needs to be done with the dataset (ask the processor if need be).
-[[BR]]
+ 1. Choose a project. 
+  - A project is ready to be archived when all sensors have been delivered. 
+  - If it is 2010 or earlier then it will need to be fully r-synced from the workspace.
+  - Check the ticket and make sure there is nothing on there which suggests something still needs to be done with the dataset (ask the processor if need be).
  1. If there is a workspace version, move it into workspace/being_archived
- 1. Prepare the repository version for archiving:
-   1. Make sure everything is present and where it should be! (see [wiki:Processing/FilenameConventions] for the required layout and name formats) [[BR]]
-      Things to look out for: '''Delivery folders, applanix/rinex data, las files, DEMs''' [[BR]]
-      Use proj_tidy.sh to highlight any problems:
+ 1. Prepare the repository version for archiving: 
+   1. Run proj_tidy.sh to highlight any problems:
 {{{
 proj_tidy.sh -p <project directory> -c
 }}}
+     Check the output. Delete hidden/temporary/broken files. Fix incorrect file name formats and any other obvious errors. Everything in the delivery should be close to perfect, but don't worry too much about things in the main project.
+   1. Make sure that the main delivery data is present and the raw data is present. Run a quick eye over the rest of the file tree.
+   1. Remove unwanted large files. The project should have been cleaned up by the processor but often large files remain which are not needed. In particular, there are sometimes duplicates of data in processing/<sensor> which are included in delivery. Free up as much space as possible but deleting unwanted large files.
    1. Add a copy of the relevant trac ticket(s) ; run:
 {{{
@@ -20 +23 @@
 popd
 }}}
-   1. Scan the filesystem for any 'bad' things and fix them:
-    1. Delete any unnecessary files - backups of DEMs that weren't used, temp files created by gedit (~ at end of filename), hidden files, duplicates in lev1 dir etc
-    1. Find all files/dirs with unusual characters (space, brackets, etc), ignoring the admin/trac_ticket folder:
-{{{
-find -regex '.*[^-0-9a-zA-Z/._].*'  -o -path './admin/trac_ticket' -prune | ~arsf/usr/bin/fix_naughty_chars.py
-}}}
-       This will give suggested commands, but check first.
    1. Set permissions:
     1. Remove executable bit on all files (except the point cloud filter and the run[aceh] scripts): 
@@ -36 +32 @@
 chmod -R a+rX .
 }}}
+
  1. Create the tarballs for NEODC to download:[[BR]][[BR]]
    ''If AIMMS or GRIMM data is present then you will first need to separate these and put into separate tarballs. [[BR]]