Delivery Checking

Once a dataset has been prepared for burning and delivery, a second person should go over it and:

For Hyperspectral Data

1. Verify we have the correct PI (check against application, call Gloucester if unsure)
2. Check against the logsheet that all data that should be present is.
3. Check that all other folders and contents are present.
4. Check for typos, etc in the documentation.
5. Only the PDF read me file should be present (no .tex, .out, .aux, .log files)
6. Ensure the text files are Windows compatible (use the 'file' command on the .txt files: they should be ASCII with CRLF terminators) (run unix2dos ReadMe.txt)
7. Test out the readme level 3 processing command for one or more of the level 1 files (definitely one per sensor).
8. Check each of the screenshots
9. All level 1 files should be looked at visually using fastQC.
10. Run proj_tidy.sh on the project using delivery mode (-d flag) and look for any errors.
11. Check level 1 files have correct read/write permissions. chmod 644 lev1/*
12. If the delivery is ready to deliver, update the dataset on the ​Processing status page to "Ready to deliver".

For LIDAR Data

1. Verify we have the correct PI (check against application, call Gloucester if unsure)
2. Check against the logsheet that all data that should be present is.
3. Check that all other folders and contents are present
   • Only PDF versions of logsheet should be present.
4. Check for typos, etc in the documentation.
5. Only the PDF read me file should be present (no .tex, .out, .aux, .log files)
6. Ensure the text files are Windows compatible (use the 'file' command on the .txt files: they should be ASCII with CRLF terminators) (run unix2dos ReadMe.txt)
7. Check all the ASCII LIDAR files open/load, look OK and fit together horizontally and vertically. Either:
   • Use lag to view the data
   • Use a scripted approach with Grass. Either run import_ldr_txt_to_grass.sh from within Grass or run make_lidardem_or_intensity.sh?. You need to generate these yourself from the ascii files, you can't just look at already created DEM/Screenshots.
8. Run the script check_ascii_lidar.sh which will read in the ascii files and check all points have the correct number of records (9), report the min/max of the time/easting/northings and the number of points classified as noise.
9. Look at a couple of lines to check that obvious noise has been classified.
10. Check the DEM contents look OK
    • less <dem>
    • should have an azgcorr style header and plausible numbers as data
    • check DEM header resolution is the same as in the Read_Me.txt file
    • To view the DEM in envi, make a copy of it and run sed -i -e "1d" dem_copy.dem (this removes the azgcorr header)
11. Check the screenshots look OK
12. Run proj_tidy.sh on the project using delivery mode (-d flag) and look for any errors.
13. If the delivery is ready to deliver, update the dataset on the ​Processing status page to "Ready to deliver".

For Full Waveform Deliveries:

1. Check all the discrete LAS files open/load, look OK and fit together
2. Check some of the full waveform LAS files in TerraScan. Use the sol/trj file in the navigation directory to view some of the waveforms (see ​here for information on how to do this).
3. If fw_extractions folder is present: check the *_extractions.txt file - ensure all the listed folders/files are present. Check a couple of the ascii files to ensure they are readable. Check the *_extractions.jpg looks ok.

For Digital Photography Data

1. Verify we have the correct PI (check against application, call Gloucester if unsure)
2. Check against the readme that all data that should be present is.
3. Check that all other folders and contents are present.
4. Check for typos, etc in the documentation.
5. Only the PDF read me file should be present (no .tex, .out, .aux, .log files)
6. Ensure the text files are Windows compatible (use the 'file' command on the .txt files: they should be ASCII with CRLF terminators) (run unix2dos ReadMe.txt)
7. View all of the thumbnail images
   • Remove any that are very over/under exposed or not relevant to the project. This could include: very bright images, very dark images, images of the instrument bay door, images not overlapping with any of the Eagle/Hawk data
   • Also remove the corresponding tif images from the photographs directory.
   • Also remove the entry for the image from the eventfile csv.
     • Be careful not to truncate the values if using open office.
   • Recreate the KML file so that removed photos do not appear in it.
8. Check one (or more) of the photographs for tagging information: exiftool photographs/FILENAME
9. View one of the photographs to check it opens OK.
10. Check file sizes of photographs look reasonable (224M) and there are no _tmp photo files.
11. Open the kml file in googleearth and check it looks good and that thumbnails are displayed when the push pins are clicked.
    • If thumbnails are not visible open the kml file in a text editor. Check image source is the thumbnails directory and that image filenames are correct.
12. Check filenames correspond. If more than one project has been flown check that julian day has the letter after it (e.g. 298b). This will be in photograph, thumbnail and eventfile directories. Also check filenames in the eventfile have the julian day letter included.
13. Run proj_tidy.sh on the project using delivery mode (-d flag) and look for any errors.
14. If the delivery is ready to deliver, update the dataset on the ​Processing status page to "Ready to deliver".

---

After checking, the project should now be rsynced.