RG13/06, flight day 290/2014, Danum Valley

[dap]

Data location: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_290_Danum_Valley

Data arrived from network transfer on 16/12/2014.

Scientific objective: Investigating the impact of humans on tropical forests.

Priority: alpha 5

PI: David Coomes

Some corrupt webcam images were deleted:
141017_025820_000.jpg

Sensors:

• Fenix (requested)
• Leica FW LIDAR (?)
• Leica LIDAR (requested)
• RCD (requested)

Duplicate lines

Process only one for Fenix and RCD - check for which has least cloud cover, failing that choose closest to local noon

• 1220-1221
• 1159-1163 (also day 295)
• 1237-1243

May be three copies of 1239, logsheet says aborted.

[tec]

Started navigation processing

[tec]

RCD Processing
Finished converting tifs

[tec]

RCD Processing
Started RCD processing

[tec]

Navigation Processing
Line 001g has quality 3 nav at the time range 02:13:00.00 -> 02:13:10.50
Line 003c has quality 4 nav at the time range 02:19:16.00 -> 02:16:25.50
Other than that the nav has small patches of quality 2 nav, in general this nav data is pretty poor.

[tec]

RCD Processing
Error when running create_latex_camera_readme.py.

Shall look into this later.

[benj]

Added duplicate line details

[tec]

RCD Processing
Have a little bit of time so decided to finish this RCD.
Am reconverting raw's to tiffs as the tiff's got messed up somehow.

[dap]

Taking over RCD Processing

[dap]

RCD Processing

Removing images 150, 151, 156, 157, 166, 189 - 191, 206, 207, 242, 243, 262, 263, 286, 287, 296, 297 and 300 due to excessive cloud coverage.

[dap]

RCD Processing

Delivery created, now ready for delivery check (processing/delivery/RG13_06-290-camera-20150112/)

[lah]

started Fenix processing

• dem created fine
• header wavelengths replaced fine

[lah]

Fenix processing
Not processing inferior duplicates 6(1220), 9(1221), 14 & 17(1159), 15 & 18(1160), 16 & 19(1161), 10(1162), 13(1163), 20(1237), 21(1238), 22 & 27(1239), 28(1240), 29(1241), 30(1242), 31(1243).

1159, 1160 & 1161 best lines are from day 295.

[dac]

Navigation Processing

Reprocessed base station data

Latitude	4 43 30.55909
Longitude	117 36 19.18668
El Height	480.155 m

[dac]

Navigation Processing

Reprocessed navigation data using IPAS Pro.

[dap]

RCD Processing

RCD has been re-tagged with the new positional information created as a result of the reprocessing of the navigation and basestation data.

RG13_06-290-camera-20150112 is now ready for delivery check

[lah]

Lidar processing
Roll of -0.0062 and pitch of -0.0004 seems to work for all flightlines, though most lines only have trees to correct with.

[lah]

Fenix ready for delivery check. Everything in delivery processed with reprocessed nav.

[lah]

Lidar ready for delivery check.

[lah]

Fenix

• Have removed surplus Eagle & Hawk pages from logsheet
• Have changed Under/overflow from subsubsection to subsection in readme

[dac]

LiDAR delivery Check

Overall looks good, couple of minor points but ready to deliver once they have been resolved.

• DEM should be capitalised in Readme figure caption. Have corrected and fixed template
• Should note in readme if flat terrain wasn't available for calculating height offsets
• There was a large block of noise in line 17 not classified as noise. I have fixed this but will need copying to FW data / ASCII files.
• dem_compare gave a difference of 15 m between ASTER data. I suspect there are likely to be some errors associated with the ASTER DEM so this isn't a problem.
• The AGC value hasn't been exported the the LAS files (which could cause problems if the intensity data need to be normalised but not enough to justify reprocessing.)

[dac]

RCD delivery check

Starting delivery check

[dac]

RCD delivery check

Completed delivery check, generally OK. A couple of points:

• Suggest removing 'Some of the navigation data for this flight are of a low quality. This means that the orthorectification of the images may not be as accurate as we would normally be able to achieve.' The part about ortorectification is incorrect (as we don't othorectify just geotag) and also the quality of the reprocessed navigation data was OK.
• 207 has more than 50 % cloud cover
• 238 has more than 50 % cloud cover
• 247 has more than 50 % cloud cover
• Remove unneeded delivery folders.

[dap]

RCD

Rewrote data quality remarks in the read me and removed the part about bad navigation data. Also removed the previous deliveries.

RCD dataset now ready for delivery.

[lah]

Lidar Processing

• Have transferred classification in line 17 to fw & remade ascii (+made windows compatible).
• Have added extra text to readme.
• Have reprocessed the fw to get the AGC value anyway, and copied in classification.
• Have not recreated dem without line 17 noise.

[dac]

LiDAR Delivery Check

Updates look good. Ready to deliver.

[dac]

RCD and LiDAR Delivery

RCD and LiDAR data sent to PI via FTP 03/03/2015

[lah]

Fenix
Reprocessed with new bad pixel file, but bad pixels still remain. Will ask Mark what's going on.

[lah]

Fenix
Reprocessing again with bad pixels list from all flight lines.

[lah]

Fenix Ready for DC
Had to use original screenshot in readme as latex couldn't use thumbnail at any sensible resolution.

[dac]

Fenix Delivery Check

Starting delivery check.

[dac]

Fenix Delivery Check

Looks fine, couple of small points:

• Should note in the readme that not all lines acquired have been processed (due to duplicate coverage).
• The data quality report is for the 2014 calibration, I'm not sure if this needs to be updated as the 2015 calibration was used.
• Fixed thumbnail and remade readme.

Other than these ready to deliver.

[lah]

Fenix
Have added note to readme. Just need new data quality report now.

[lah]

Fenix ready for DC
Have recreated with newest calibration. GDAL env variable doesn't seem to have affected screenshots.

[dac]

Fenix DC

Rechecking Fenix delivery.

[dac]

Fenix DC

Looks good. check_apl_cmd is still running but outputs so far look OK and everything else is fine so suggest start zipping files.

Proj tidy printed error about wavelengths not matching 2014 cal (which isn't surprising as the 2015 cal was used).

Don't forget to remove old delivery.

[dac]

Fenix DC

Output from check_apl_cmd looks fine. Files zipped and ready to deliver.

[lah]

Fenix
Have changed Danum Valley to BALI SAFE to be consistent with the logsheet. (In readme and loghseet name)

[lah]

PI notified of delivery 05/05/2015 (Fenix, Lidar & RCD)

[dac]

Fenix Processing

Replaced wavelengths in header with those from updated calibration. Started reprocessing.

[stgo]

Fenix Processing

Have processed flightlines with new calibration

[gej]

Fenix Delivery Check

Data Quality report needs changing to 2015 along with the project_metadata.
fenix_viewvector_list.txt is missing according to proj_tidy.sh

Spectra looks okay to me, a few high bits compared to py6s, and also a few low bits but not too low.

Have removed fodis directory

[stgo]

Fenix

Updated data quality and project metadata

created fenix vectors, weird that the delivery creator skipped over this.

[lah]

Fenix DC - spectra check
Have checked all lines and no major problems. There is a spike at the end of the VNIR and a hump at the start of the SWIR, both of which are within the mask region. Comparing spectra to Py6S simulations, some fenix spectra are lower than predicted, but not by an alarming amount and never all from the same line. There is cloud in most flight lines that could account for the lower signal level.

The spectral shift is within 5 nm compared to previous data (2014 169). As this is a Malaysian flight, the wavelength shift may be slightly off the 2015 calibration wavelengths, most likely due to environmental conditions. This issue is currently under investigation.

[gej]

Fenix DC

Everything looks okay now. proj_tidy is complaining about the logsheet name (BALI_SAFE not Danum_Valley). But I don't think that's a problem since on the processing page it's down as SAFE area.

[stgo]

Fenix DC

The logsheet is named as it was in the original delivery. Is there anything else holding this back?

[gej]

Fenix DC

All good now, zipping mapped files then ready for delivery.

[gej]

Fenix DC

Mapped files zipped, ready for delivery

[gej]

Fenix Delivered to David Coomes via FTP on arsf1, November 18th 2015

[gej]

Started Archiving

[dac]

Archiving

Raw and archived data available from NEODC: ​http://browse.ceda.ac.uk/browse/neodc/arsf/raw_data/2014b/RG13_06-2014_290_Danum_Valley_raw

Marking as closed.