Hyperspectral data delivery

Once the data has been processed, it needs to be put into a delivery directory. This is the final file structure in which it will be sent to the customer.

1. Create quicklook jpgs. This is the new improved scripted approach, if for any reason this fails do it manually by using ENVI, taking screenshots and cropping them using gimp.
   1. Use make_mosaic.sh script
      1. Open a terminal window in the lev3 directory under the project workspace
      2. Ensure the only geotiffs in the lev3 directory are ones you want to convert to jpgs - either delete unwanted ones or move them to a subdirectory
      3. Use the make_mosaic.sh script, which will generate jpgs for each individual line and also a mosaic of all lines. If vectors are given then a mosaic with vector overlay will also be generated.
      4. Usage make_mosaic.sh -d <tif-directory> -s <sensor-flag> -o <output-directory> [-v <vector-directory>] [-z <UTMZONE>]
      5. Example from within lev3 dir to create eagle images: make_mosaic.sh -d ./ -s e -o ../jpgs/ -v ~arsf/vectors/from_os/EX01_01/
   2. Otherwise (or if that fails) you may be able to use convert
      1. for filename in `ls`; do convert $filename `echo $filename | sed 's/.tif/.jpg/'`; done
      2. Use ENVI to create mosaics manually.
   3. Convert doesn't always produce images that are scaled sensibly. If so, use the old scripted method.
      1. Open a terminal window in the lev3 directory under the project workspace
      2. Ensure the only geotiffs in the lev3 directory are ones you want to convert to jpgs - either delete unwanted ones or move them to a subdirectory
      3. Run gtiff2jpg.py -d ./ -a - If this runs out of memory try again without the -a. You can also run on individual files instead of on a directory by using -s <filename> instead of -d ./
      4. Create mosaics separately using ENVI (or whatever other method).
2. Create the delivery directory: run make_delivery_folder.sh. Check it's created everything you expect correctly. If it fails, you can create the directory manually as follows:
   1. In the project directory in the workspace, create a directory called "delivery". Within this create a directory named after the date as YYYYMMDD, and within this create one named after the project code.
   2. Copy the contents of ~arsf/arsf_data/<year>/delivery/template into your new delivery directory
   3. Ensure the copy of the data quality report in the doc directory is the most recent version from ~arsf/doc/
   4. Copy the pdf logsheet into the logsheet directory
   5. Move the level 1 files from the directory they were processed into (<project_dir>/lev1/) into the lev1 directory in the delivery directory.
3. In the delivery directory create a directory called "misc". Copy files into it as follows:
   • For UK flights, copy in ~arsf/dems/geoid-spheroid/osgb02.cgrf
   • For non-UK flights, copy in ~arsf/dems/geoid-spheroid/sphsep15lx.grd UNLESS we supply a LIDAR DEM in which case they will not need this file.
4. Copy the mosaics and jpegs of flightlines created above into the screenshots directory
5. Ensure that the filenames of the level 1 files and flightline jpegs are correct - they should be [eh]JJJaff1b.*, where [eh] is e for eagle or h for hawk, JJJ is the julian day of the flight, a is a flight letter if appropriate (usually a, b or occasionally c), and ff is the flightline number. There should be one level 1 file (or set of files, if there are .bil and .bil.hdr files in addition to the HDF) per flightline. If any are missing for particular sensors (eg. because the sensor failed), this should be explained in the readme file.
6. New style read me is largely untested - expect some errors.
   1. Create a config file for the read me using the generate_readme_config.py script. Use a command such as generate_readme_config.py -d <delivery_directory> -r hyper
   2. Edit the config file and check all the items are filled in:
      1. If an instrument has no dark frames for all flight lines then enter instrument name in "dark_frames"
      2. Any remarks about the data should be entered as a sentence in the "data_quality_remarks" section.
      3. If vectors have been used then the accuracy should be entered in "vectors" (e.g. '5-10' if they're within 5m to 10m)
      4. line_numbering should contain a space separated list of line names linking the logsheet to the processed files.
      5. All "compulsory" items should contain data
   3. Create a TeX file. Use the script create_latex_hyperspectral_readme.py -f <config filename>
      1. This file can be reviewed and edited in any text editor if needed.
   4. Create a PDF file by running latex <tex_filename>
      1. Review the read me and check carefully to see if it looks OK with all relevant information present.
      2. Copy it to the delivery directory and remove any temporary files. Recommended to keep the TeX file until after delivery checking in case any edits are required.

---

If you have LIDAR data to make into a delivery, go to the LIDAR delivery page.

If not, or if you've done that already, the delivery is ready for checking.