Opened 4 years ago

Closed 3 years ago

#549 closed flight processing (fixed)

RG13/06, flight day 293/2014, SAFE Area

Reported by: dap Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: Other processors:

Description (last modified by tec)

Data location: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_293_Danum_Valley

Data arrived from network transfer on 17/12/2014.

Scientific objective: Investigating the impact of humans on tropical forests.

Priority: alpha 5

PI: David Coomes

Some corrupt webcam images were deleted:
141020_001111_000.jpg

The Leica data for this flight were split over two disks.

Full waveform data are present
No owl data present

Sensors:

  • Fenix (requested)
  • Leica FW LIDAR (delivered 27/04/2015)
  • Leica LIDAR (requested, delivered 27/04/2015)
  • RCD (requested, delivered 27/04/2015)

Duplicate lines

Process only one for Fenix and RCD - check for which has least cloud cover, failing that choose closest to local noon

  • 1131-1138 (day 291)
  • 1137-1158 (day 297, 1137-1138 3 times - also day 294)

Attachments (1)

93_classification.png (11.2 KB) - added by dac 4 years ago.

Download all attachments as: .zip

Change History (54)

comment:1 Changed 4 years ago by dap

  • Description modified (diff)

comment:2 Changed 4 years ago by tec

Navigation Processing

SAFE_9th_ Basestation Data
Latitude4 43 30.56080
Longitude117 36 19.18868
El Height479.764m

comment:3 Changed 4 years ago by tec

Navigation Processing
Nav finished, used ipas pro
CA 1.10
Ell Mask 14
Max Dual Freq Dist 80km
for both sets of nav

comment:4 Changed 4 years ago by tec

MAKE SURE YOU USE THE CORRECT SOL FILE

comment:5 Changed 4 years ago by benj

  • Description modified (diff)

Added duplicate line details

comment:6 Changed 4 years ago by tec

Navigation Processing
Started Nav processing again.

comment:7 Changed 4 years ago by tec

Navigation Processing

SAFE_6th_ Basestation Data
Latitude4 43 30.56092
Longitude117 36 19.18717
El Height480.214m

comment:8 Changed 4 years ago by tec

Navigation Processing
Done using same parameters as above. Use 2014293_merged*.sol for processing.

comment:9 Changed 4 years ago by tec

RCD Processing
Starting RCD Processing

comment:10 Changed 4 years ago by tec

RCD Processing

Images removed

Part 1: None
Part 2: 1,85,108,110

Images left in with cloud

Part 1: 208,241-242,271-275
Part 2: 55,84,86,106-107,109

Last edited 4 years ago by tec (previous) (diff)

comment:11 Changed 4 years ago by tec

UGH, all files starting 192222421 are part of this flight, all starting 200240081 are part of 294 Being a noob

Last edited 4 years ago by tec (previous) (diff)

comment:12 Changed 4 years ago by tec

RCD Processing
Tagging Tiffs

comment:13 Changed 4 years ago by tec

RCD Processing
Tiffs tagged, RCD now on hold (unless someone else continues) as have no time again.

comment:14 Changed 4 years ago by lah

Lidar Processing

Roll and pitch seem consistent for all flight lines (using trees as no buildings).

Roll: -0.00623
Pitch: -0.0004

comment:15 Changed 4 years ago by dap

Fenix Processing

Starting Fenix processing.

comment:16 Changed 4 years ago by tec

RCD Processing
Awaiting DC

comment:17 Changed 4 years ago by lah

Lidar
Making delivery. Recreating logsheet as existing one is labelled 292 and is missing notes and last 7 flight lines.

comment:18 follow-up: Changed 4 years ago by lah

Lidar
Found error with logsheet - changed disk mid flight, lidar/als/logs had to be concatenated.
Also latex seemed to have lost some packages. Reinstalled with <sudo yum -y install 'tex(multirow.sty)'> etc.

Final problem - converting dem does not complete.

comment:19 Changed 4 years ago by lah

Lidar ready for DC
Kept logsheet as Danum_Valley but could also be BALI-SAFE?

comment:20 in reply to: ↑ 18 Changed 4 years ago by lah

Replying to lah:

Lidar
Found error with logsheet - changed disk mid flight, lidar/als/logs had to be concatenated.
Also latex seemed to have lost some packages. Reinstalled with <sudo yum -y install 'tex(multirow.sty)'> etc.

Final problem - converting dem does not complete. -forgot projection!

comment:21 Changed 4 years ago by dac

RCD Delivery Check
Started delivery check.

comment:22 Changed 4 years ago by dac

RCD Delivery Check
No readme - will resume delivery check when generated.

comment:23 Changed 4 years ago by dac

LiDAR DC

Starting LiDAR delivery check

comment:24 Changed 4 years ago by tec

RCD Processing
Readme Config file is missing 7 line names aparently, shall look into this.

comment:25 Changed 4 years ago by tec

RCD Processing
Has readme, DC please.

comment:26 Changed 4 years ago by dap

Fenix Processing

Corrected SCT values so far:

SAFE Site letterFlightlineFenix SCT
D11.10
20.92
31.11
40.90
50.94
6-0.11
70.94
80.94
91.00
100.96
110.92
120.99
13*
140.93
150.98
160.99
170.89
181.04
190.92
201.04
210.88
221.10
23-0.13
241.05
250.90
261.06
270.93
281.02
290.94
C300.65
311.37
320.67
330.40
340.67
351.29
360.72
371.20
380.77
391.14
400.79
410.09
420.94
430.98
440.96
450.98
460.95
471.00
480.94
491.00
500.95
510.96
52-0.01
531.02


* = Could not process this line

All corrections found.

Last edited 4 years ago by dap (previous) (diff)

comment:27 Changed 4 years ago by dap

RCD Delivery Check

Starting delivery check.

comment:28 Changed 4 years ago by dac

LiDAR DC

There are a number of lines in the discrete return data which are duplicates of each other (las and ascii), the full waveform data look OK though. The duplicate lines I found were:

  • 11 and 12
  • 13 and 14
  • 15 and 16
  • 17 and 18
  • 19 and 20
  • 23 and 24

Have stopped DC and will redo once the duplicate lines have been sorted out.

Other points

  • Changed las1.0 folder to las1.2
  • Readme looks fine but confirm if site is Danum Valley or BALI-SAFE
  • Pitch / Roll looks good
  • Classification looks fine

comment:29 Changed 4 years ago by dap

RCD Delivery Check

No problems found, apart from "Danum Valley, Malaysia" used as the site area instead of "SAFE area, Malaysia" in the read me and exiftags. I'll change these and the data will be ready for delivery when I've addressed these problems.

comment:30 Changed 4 years ago by dap

RCD Delivery Check

Changed exiftags in photographs using command

exiftool -LocationName="SAFE Area, Malaysia" *.tif

in photographs directory. Also changed site name on first page of read me.

RCD delivery now ready to go.

comment:31 Changed 4 years ago by dap

  • Summary changed from RG13/06, flight day 293/2014, Danum Valley to RG13/06, flight day 293/2014, SAFE Area

comment:32 Changed 4 years ago by dap

Fenix Processing

I've just noticed that the apl config file doesn't have a section for flight line 13. This seems to be because of an error caused when generating the config file:

Navigation does not cover the header file: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_293_Danum_Valley/hyperspectral/fenix/FENIX293-14-13.hdr. nav=[81443.0011565, 97114.4930145], header=[86298, 43]

comment:33 Changed 4 years ago by lah

Lidar
Have reclassified duplicated lines and added to delivery. Redoing dem, screenshots & readme.

comment:34 Changed 4 years ago by tec

Delivery
Copied RCD to FTP, waiting on others before email

Last edited 4 years ago by tec (previous) (diff)

comment:35 Changed 4 years ago by lah

Lidar
Found many more overwritten duplicates to reprocess :(

comment:36 Changed 4 years ago by lah

Lidar ready for DC
Redone additional duplicated lines 22,26,33,35,37,39,43,45,47,49 & 51.
Fixed delivery - screenshots and readme show no more duplicates
Renamed logsheet and readme to SAFE Area, Malaysia to match RCD delivery

Changed 4 years ago by dac

comment:37 Changed 4 years ago by dac

LiDAR DC

Looks good, ready to deliver.

Some minor comments,

  • Some files didn't have correct line endings (fixed).
  • In the intensity screenshot, one of the lines is really bright, not a problem as the lidar intensity isn't calibrated (and AGC is saved in file).
  • Difference between 46 and 47 is larger than rest (38 cm in log sheet, checked and this is accurate). Don't think this could be improved on without a lot of effort, in particular as same pitch and roll values worked well for the rest of the lines.
  • There were a couple of crowns, I think all on the overlap between two lines, where a lot of crown points were classified as noise (see screenshot). Not enough crowns to worry about and sufficient non-noise points remain.


comment:38 Changed 4 years ago by dac

LiDAR and RCD Delivery

LiDAR and RCD data sent to PI (David Coomes) via FTP 27/04/2015

Last edited 4 years ago by dac (previous) (diff)

comment:39 Changed 4 years ago by tec

  • Description modified (diff)

comment:40 Changed 4 years ago by dap

Fenix Processing

Processing with new calibration results is now complete and delivery has been created. Ready for delivery check.

comment:41 Changed 4 years ago by tec

Delivery Check
Starting Fenix DC

comment:42 Changed 4 years ago by tec

Delivery Check
Removed fodis dir

Add in the lines in the readme pdf and its ready.

comment:43 Changed 4 years ago by tec

Delivery Check
Done, zipped and ready to go.

comment:44 Changed 4 years ago by tec

Delivery
Rsyncing to FTP:arsf1 DONE

Last edited 4 years ago by tec (previous) (diff)

comment:45 Changed 4 years ago by lah

PI notified of delivery 05/05/2015 (Fenix, Lidar & RCD)

comment:46 Changed 4 years ago by stgo

Started reprocessing hyperspectral

comment:47 Changed 4 years ago by gej

Created Delivery, Ready for DC

comment:48 Changed 4 years ago by lah

Fenix DC

  • spectra mostly look ok. There is a large spike at the beginning of the SWIR region for most spectra in all lines, but this is within the masked out region. There is also a ~5nm (1 band) offset in spectral features compared to previous data (2014 169).
  • renamed screenshots.
  • lines 30 & 31 scts look a bit off, but if it was good enough last delivery then it probably can't be made better.

Ready to deliver once new data quality report is ready

comment:49 Changed 4 years ago by dac

Fenix

  • Updated data quality report
  • Copied to ftp (arsf1) - likely to have more projects ready today so will notify PI of all together.

comment:50 Changed 4 years ago by dac

Fenix

Delivered to PI via FTP (arsf1) 21/10/2015

comment:51 Changed 3 years ago by dac

Archiving

Checked and ready for upload.

comment:52 Changed 3 years ago by dac

Archiving

Data uploaded to NEODC.

comment:53 Changed 3 years ago by asm

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.