RG13/06, flight day 293/2014, SAFE Area

[dap]

Data location: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_293_Danum_Valley

Data arrived from network transfer on 17/12/2014.

Scientific objective: Investigating the impact of humans on tropical forests.

Priority: alpha 5

PI: David Coomes

Some corrupt webcam images were deleted:
141020_001111_000.jpg

The Leica data for this flight were split over two disks.

Full waveform data are present
No owl data present

Sensors:

• Fenix (requested)
• Leica FW LIDAR (delivered 27/04/2015)
• Leica LIDAR (requested, delivered 27/04/2015)
• RCD (requested, delivered 27/04/2015)

Duplicate lines

Process only one for Fenix and RCD - check for which has least cloud cover, failing that choose closest to local noon

• 1131-1138 (day 291)
• 1137-1158 (day 297, 1137-1138 3 times - also day 294)

[tec]

Navigation Processing

SAFE_9th_ Basestation Data
Latitude	4 43 30.56080
Longitude	117 36 19.18868
El Height	479.764m

[tec]

Navigation Processing
Nav finished, used ipas pro
CA 1.10
Ell Mask 14
Max Dual Freq Dist 80km
for both sets of nav

[tec]

MAKE SURE YOU USE THE CORRECT SOL FILE

[benj]

Added duplicate line details

[tec]

Navigation Processing
Started Nav processing again.

[tec]

Navigation Processing

SAFE_6th_ Basestation Data
Latitude	4 43 30.56092
Longitude	117 36 19.18717
El Height	480.214m

[tec]

Navigation Processing
Done using same parameters as above. Use 2014293_merged*.sol for processing.

[tec]

RCD Processing
Starting RCD Processing

[tec]

RCD Processing

Images removed

Part 1: None
Part 2: 1,85,108,110

Images left in with cloud

Part 1: 208,241-242,271-275
Part 2: 55,84,86,106-107,109

[tec]

UGH, all files starting 192222421 are part of this flight, all starting 200240081 are part of 294

[tec]

RCD Processing
Tagging Tiffs

[tec]

RCD Processing
Tiffs tagged, RCD now on hold (unless someone else continues) as have no time again.

[lah]

Lidar Processing

Roll and pitch seem consistent for all flight lines (using trees as no buildings).

Roll: -0.00623
Pitch: -0.0004

[dap]

Fenix Processing

Starting Fenix processing.

[tec]

RCD Processing
Awaiting DC

[lah]

Lidar
Making delivery. Recreating logsheet as existing one is labelled 292 and is missing notes and last 7 flight lines.

[lah]

Lidar
Found error with logsheet - changed disk mid flight, lidar/als/logs had to be concatenated.
Also latex seemed to have lost some packages. Reinstalled with <sudo yum -y install 'tex(multirow.sty)'> etc.

Final problem - converting dem does not complete.

[lah]

Lidar ready for DC
Kept logsheet as Danum_Valley but could also be BALI-SAFE?

[lah]

Replying to lah:

Lidar
Found error with logsheet - changed disk mid flight, lidar/als/logs had to be concatenated.
Also latex seemed to have lost some packages. Reinstalled with <sudo yum -y install 'tex(multirow.sty)'> etc.

Final problem - converting dem does not complete. -forgot projection!

[dac]

RCD Delivery Check
Started delivery check.

[dac]

RCD Delivery Check
No readme - will resume delivery check when generated.

[dac]

LiDAR DC

Starting LiDAR delivery check

[tec]

RCD Processing
Readme Config file is missing 7 line names aparently, shall look into this.

[tec]

RCD Processing
Has readme, DC please.

[dap]

Fenix Processing

Corrected SCT values so far:

SAFE Site letter	Flightline	Fenix SCT
D	1	1.10
	2	0.92
	3	1.11
	4	0.90
	5	0.94
	6	-0.11
	7	0.94
	8	0.94
	9	1.00
	10	0.96
	11	0.92
	12	0.99
	13	*
	14	0.93
	15	0.98
	16	0.99
	17	0.89
	18	1.04
	19	0.92
	20	1.04
	21	0.88
	22	1.10
	23	-0.13
	24	1.05
	25	0.90
	26	1.06
	27	0.93
	28	1.02
	29	0.94
C	30	0.65
	31	1.37
	32	0.67
	33	0.40
	34	0.67
	35	1.29
	36	0.72
	37	1.20
	38	0.77
	39	1.14
	40	0.79
	41	0.09
	42	0.94
	43	0.98
	44	0.96
	45	0.98
	46	0.95
	47	1.00
	48	0.94
	49	1.00
	50	0.95
	51	0.96
	52	-0.01
	53	1.02

* = Could not process this line

All corrections found.

[dap]

RCD Delivery Check

Starting delivery check.

[dac]

LiDAR DC

There are a number of lines in the discrete return data which are duplicates of each other (las and ascii), the full waveform data look OK though. The duplicate lines I found were:

• 11 and 12
• 13 and 14
• 15 and 16
• 17 and 18
• 19 and 20
• 23 and 24

Have stopped DC and will redo once the duplicate lines have been sorted out.

Other points

• Changed las1.0 folder to las1.2
• Readme looks fine but confirm if site is Danum Valley or BALI-SAFE
• Pitch / Roll looks good
• Classification looks fine

[dap]

RCD Delivery Check

No problems found, apart from "Danum Valley, Malaysia" used as the site area instead of "SAFE area, Malaysia" in the read me and exiftags. I'll change these and the data will be ready for delivery when I've addressed these problems.

[dap]

RCD Delivery Check

Changed exiftags in photographs using command

exiftool -LocationName="SAFE Area, Malaysia" *.tif

in photographs directory. Also changed site name on first page of read me.

RCD delivery now ready to go.

[dap]

Fenix Processing

I've just noticed that the apl config file doesn't have a section for flight line 13. This seems to be because of an error caused when generating the config file:

Navigation does not cover the header file: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_293_Danum_Valley/hyperspectral/fenix/FENIX293-14-13.hdr. nav=[81443.0011565, 97114.4930145], header=[86298, 43]

[lah]

Lidar
Have reclassified duplicated lines and added to delivery. Redoing dem, screenshots & readme.

[tec]

Delivery
Copied RCD to FTP, waiting on others before email

[lah]

Lidar
Found many more overwritten duplicates to reprocess :(

[lah]

Lidar ready for DC
Redone additional duplicated lines 22,26,33,35,37,39,43,45,47,49 & 51.
Fixed delivery - screenshots and readme show no more duplicates
Renamed logsheet and readme to SAFE Area, Malaysia to match RCD delivery

[dac]

LiDAR DC

Looks good, ready to deliver.

Some minor comments,

• Some files didn't have correct line endings (fixed).
• In the intensity screenshot, one of the lines is really bright, not a problem as the lidar intensity isn't calibrated (and AGC is saved in file).
• Difference between 46 and 47 is larger than rest (38 cm in log sheet, checked and this is accurate). Don't think this could be improved on without a lot of effort, in particular as same pitch and roll values worked well for the rest of the lines.
• There were a couple of crowns, I think all on the overlap between two lines, where a lot of crown points were classified as noise (see screenshot). Not enough crowns to worry about and sufficient non-noise points remain.

[dac]

LiDAR and RCD Delivery

LiDAR and RCD data sent to PI (David Coomes) via FTP 27/04/2015

[dap]

Fenix Processing

Processing with new calibration results is now complete and delivery has been created. Ready for delivery check.

[tec]

Delivery Check
Starting Fenix DC

[tec]

Delivery Check
Removed fodis dir

Add in the lines in the readme pdf and its ready.

[tec]

Delivery Check
Done, zipped and ready to go.

[tec]

Delivery
Rsyncing to FTP:arsf1 DONE

[lah]

PI notified of delivery 05/05/2015 (Fenix, Lidar & RCD)

[stgo]

Started reprocessing hyperspectral

[gej]

Created Delivery, Ready for DC

[lah]

Fenix DC

• spectra mostly look ok. There is a large spike at the beginning of the SWIR region for most spectra in all lines, but this is within the masked out region. There is also a ~5nm (1 band) offset in spectral features compared to previous data (2014 169).
• renamed screenshots.
• lines 30 & 31 scts look a bit off, but if it was good enough last delivery then it probably can't be made better.

Ready to deliver once new data quality report is ready

[dac]

Fenix

• Updated data quality report
• Copied to ftp (arsf1) - likely to have more projects ready today so will notify PI of all together.

[dac]

Fenix

Delivered to PI via FTP (arsf1) 21/10/2015

[dac]

Archiving

Checked and ready for upload.

[dac]

Archiving

Data uploaded to NEODC.