Changes between Version 21 and Version 22 of Processing/proj_tidy

Timestamp:

Dec 2, 2014, 9:29:17 AM (10 years ago)

Author:

dap

Comment:

--

Processing/proj_tidy

@@ -54 +54 @@
 * If can't find raw data, don't search for files pertaining to those sensors
   * In the {{{Check for missing directories}}} section, hyperspectral/owl is looked for. This should be thermal/owl. This ties in with the point listed below when the project layout is built. This is due to incorrect key list in the folder_structure module.
-  * Currently, {{{proj_tidy.missing_directories}}} calls {{{folder_structure.FolderStructure}}}'s constructor, which returns a full list of the directories that are expected to be in the project directory. This could be changed by either adding another function to proj_tidy.py that looks for regex instead or changing the FolderStructure constructor so that it can just return the relevant directories if necessary.
+  * ~~Currently, {{{proj_tidy.missing_directories}}} calls {{{folder_structure.FolderStructure}}}'s constructor, which returns a full list of the directories that are expected to be in the project directory. This could be changed by either adding another function to proj_tidy.py that looks for regex instead or changing the FolderStructure constructor so that it can just return the relevant directories if necessary.~~
+    * This was achieved by updating the missing_directories function. I changed it so that it now takes arguments that determine which missing directories it should look for. For example, it has the {{{check_hyper}}} argument, which {{{false}}} will be passed in to if there is no hyperspectral data. The Python function will check this argument and if it is false, will remove the path if it contains "/hyperspectral". The other arguments work in a similar way.
 * ~~Check that the bandset in the hyperspectral header files is what we expect~~
   * This is done by checking if there are any .wls files in the hyperspectral sensor calibration directory (~arsf/calibration/<year>/<sensor>/) for that particular year. If it's there, it will count the number of lines in each file and add it to a Python list. It will then read in the header files and count the number of wavelengths in each one using the Python data_handler library. It will then check that the length of the header file is in the Python list of numbers of lines. If it's not, it will print a warning.