Changes between Version 17 and Version 18 of Processing/proj_tidy

Timestamp:

Nov 26, 2014, 2:18:08 PM (10 years ago)

Author:

dap

Comment:

--

Processing/proj_tidy

@@ -45 +45 @@
 * SERIOUS BUG - although it's set up to check pre-2011 delivies (as outlined above), it currently can't do this if that flight has been converted to the layout. Since ALL flights have now been converted to the new layout, this needs fixing before we can archive older flights. (dap, ask someone what about the change in 2011, reprocessing, and conversion of structures). 
 * Currently it determines if raw data for a sensor exists by looking if there is e.g. hyperspectral/fenix/ dir. This should be changed so it actually looks for data files e.g. FENIX*.raw
-* Check if we have .hdr file and a .log file for every .raw file, and do something similar for other sensors. So basically check, if we do have a sensor as determined above, that all expected files are present (Owl included)
+  * This now works, except in cases where the raw images have been put in the wrong place.
+* Check if we have .hdr file and a .log file for every .raw file, and do something similar for other sensors. So basically check, if we do have a sensor as determined above, that all expected files are present.
+  * This has been implemented for all the hyperspectral and owl sensors. This check isn't necessary for other sensors as they only have one type of raw file (.scn for LiDAR, .raw for camera).
 * Check the database to get number of lines for a sensor, and check there are indeed this number
+  * This can't be done yet, as there are often test lines flown by ops, which are not always entered in to the database.
 * If can't find raw data, don't search for files pertaining to those sensors
   * In the {{{Check for missing directories}}} section, hyperspectral/owl is looked for. This should be thermal/owl. This ties in with the point listed below when the project layout is built. This is due to incorrect key list in the folder_structure module.
+  * Currently, {{{proj_tidy.missing_directories}}} calls {{{folder_structure.FolderStructure}}}'s constructor, which returns a full list of the directories that are expected to be in the project directory. This could be changed by either adding another function to proj_tidy.py that looks for regex instead or changing the FolderStructure constructor so that it can just return the relevant directories if necessary.
 * Check that the bandset in the hyperspectral header files is what we expect
 * Some updates are needed to the regex files so it recognises some newer files