Changes between Version 15 and Version 16 of Processing/proj_tidy


Ignore:
Timestamp:
Nov 24, 2014 4:20:48 PM (5 years ago)
Author:
dap
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Processing/proj_tidy

    v15 v16  
    4343
    4444== Improvements/fixes ==
    45 
    4645* SERIOUS BUG - although it's set up to check pre-2011 delivies (as outlined above), it currently can't do this if that flight has been converted to the layout. Since ALL flights have now been converted to the new layout, this needs fixing before we can archive older flights. (dap, ask someone what about the change in 2011, reprocessing, and conversion of structures).
    4746* Currently it determines if raw data for a sensor exists by looking if there is e.g. hyperspectral/fenix/ dir. This should be changed so it actually looks for data files e.g. FENIX*.raw
     
    4948* Check the database to get number of lines for a sensor, and check there are indeed this number
    5049* If can't find raw data, don't search for files pertaining to those sensors
     50  * In the {{{Check for missing directories}}} section, hyperspectral/owl is looked for. This should be thermal/owl. This ties in with the point listed below when the project layout is built.
    5151* Check that the bandset in the hyperspectral header files is what we expect
    5252* Some updates are needed to the regex files so it recognises some newer files
    53 * The use folder_structure to decide what dirs are missing is creating folders we don't need in flights, like eage and hawk dirs when there is no data for those. Should either remove these from folder_structure or (better) integrate this bit with the part that determines if sensors are present so it doesn't create these if they're not needed. It also currently puts owl in hyperspectral/owl when it should be in thermal/owl.
     53* The use folder_structure to decide what dirs are missing is creating folders we don't need in flights, like eagle and hawk dirs when there is no data for those. Should either remove these from folder_structure or (better) integrate this bit with the part that determines if sensors are present so it doesn't create these if they're not needed. It also currently puts owl in hyperspectral/owl when it should be in thermal/owl.
    5454* There are common errors that ops do that we should integrate into proj_tidy to make unpacking easier. For example, the RCD raws are often not put into the rcd/raw_images/ dir, so we could do this automatically.
    5555