Changes between Version 21 and Version 22 of Processing/proj_tidy


Ignore:
Timestamp:
Dec 2, 2014 9:29:17 AM (5 years ago)
Author:
dap
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Processing/proj_tidy

    v21 v22  
    5454* If can't find raw data, don't search for files pertaining to those sensors
    5555  * In the {{{Check for missing directories}}} section, hyperspectral/owl is looked for. This should be thermal/owl. This ties in with the point listed below when the project layout is built. This is due to incorrect key list in the folder_structure module.
    56   * Currently, {{{proj_tidy.missing_directories}}} calls {{{folder_structure.FolderStructure}}}'s constructor, which returns a full list of the directories that are expected to be in the project directory. This could be changed by either adding another function to proj_tidy.py that looks for regex instead or changing the FolderStructure constructor so that it can just return the relevant directories if necessary.
     56  * ~~Currently, {{{proj_tidy.missing_directories}}} calls {{{folder_structure.FolderStructure}}}'s constructor, which returns a full list of the directories that are expected to be in the project directory. This could be changed by either adding another function to proj_tidy.py that looks for regex instead or changing the FolderStructure constructor so that it can just return the relevant directories if necessary.~~
     57    * This was achieved by updating the missing_directories function. I changed it so that it now takes arguments that determine which missing directories it should look for. For example, it has the {{{check_hyper}}} argument, which {{{false}}} will be passed in to if there is no hyperspectral data. The Python function will check this argument and if it is false, will remove the path if it contains "/hyperspectral". The other arguments work in a similar way.
    5758* ~~Check that the bandset in the hyperspectral header files is what we expect~~
    5859  * This is done by checking if there are any .wls files in the hyperspectral sensor calibration directory (~arsf/calibration/<year>/<sensor>/) for that particular year. If it's there, it will count the number of lines in each file and add it to a Python list. It will then read in the header files and count the number of wavelengths in each one using the Python data_handler library. It will then check that the length of the header file is in the Python list of numbers of lines. If it's not, it will print a warning.