Opened 10 years ago
Closed 8 years ago
#549 closed flight processing (fixed)
RG13/06, flight day 293/2014, SAFE Area
Reported by: | dap | Owned by: | |
---|---|---|---|
Priority: | immediate | Milestone: | |
Component: | Processing: general | Keywords: | |
Cc: | Other processors: |
Description (last modified by tec)
Data location: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_293_Danum_Valley
Data arrived from network transfer on 17/12/2014.
Scientific objective: Investigating the impact of humans on tropical forests.
Priority: alpha 5
PI: David Coomes
Some corrupt webcam images were deleted:
141020_001111_000.jpg
The Leica data for this flight were split over two disks.
Full waveform data are present
No owl data present
Sensors:
- Fenix (requested)
- Leica FW LIDAR (delivered 27/04/2015)
- Leica LIDAR (requested, delivered 27/04/2015)
- RCD (requested, delivered 27/04/2015)
Duplicate lines
Process only one for Fenix and RCD - check for which has least cloud cover, failing that choose closest to local noon
- 1131-1138 (day 291)
- 1137-1158 (day 297, 1137-1138 3 times - also day 294)
Attachments (1)
Change History (54)
comment:1 Changed 10 years ago by dap
- Description modified (diff)
comment:2 Changed 10 years ago by tec
comment:3 Changed 10 years ago by tec
Navigation Processing
Nav finished, used ipas pro
CA 1.10
Ell Mask 14
Max Dual Freq Dist 80km
for both sets of nav
comment:4 Changed 10 years ago by tec
MAKE SURE YOU USE THE CORRECT SOL FILE
comment:6 Changed 10 years ago by tec
Navigation Processing
Started Nav processing again.
comment:7 Changed 10 years ago by tec
Navigation Processing
SAFE_6th_ Basestation Data | |
---|---|
Latitude | 4 43 30.56092 |
Longitude | 117 36 19.18717 |
El Height | 480.214m |
comment:8 Changed 10 years ago by tec
Navigation Processing
Done using same parameters as above. Use 2014293_merged*.sol for processing.
comment:9 Changed 10 years ago by tec
RCD Processing
Starting RCD Processing
comment:10 Changed 10 years ago by tec
RCD Processing
Images removed
Part 1: None
Part 2: 1,85,108,110
Images left in with cloud
Part 1: 208,241-242,271-275
Part 2: 55,84,86,106-107,109
comment:11 Changed 10 years ago by tec
UGH, all files starting 192222421 are part of this flight, all starting 200240081 are part of 294
comment:12 Changed 10 years ago by tec
RCD Processing
Tagging Tiffs
comment:13 Changed 10 years ago by tec
RCD Processing
Tiffs tagged, RCD now on hold (unless someone else continues) as have no time again.
comment:14 Changed 10 years ago by lah
Lidar Processing
Roll and pitch seem consistent for all flight lines (using trees as no buildings).
Roll: -0.00623
Pitch: -0.0004
comment:15 Changed 10 years ago by dap
Fenix Processing
Starting Fenix processing.
comment:16 Changed 10 years ago by tec
RCD Processing
Awaiting DC
comment:17 Changed 10 years ago by lah
Lidar
Making delivery. Recreating logsheet as existing one is labelled 292 and is missing notes and last 7 flight lines.
comment:18 follow-up: ↓ 20 Changed 10 years ago by lah
Lidar
Found error with logsheet - changed disk mid flight, lidar/als/logs had to be concatenated.
Also latex seemed to have lost some packages. Reinstalled with <sudo yum -y install 'tex(multirow.sty)'> etc.
Final problem - converting dem does not complete.
comment:19 Changed 9 years ago by lah
Lidar ready for DC
Kept logsheet as Danum_Valley but could also be BALI-SAFE?
comment:20 in reply to: ↑ 18 Changed 9 years ago by lah
Replying to lah:
Lidar
Found error with logsheet - changed disk mid flight, lidar/als/logs had to be concatenated.
Also latex seemed to have lost some packages. Reinstalled with <sudo yum -y install 'tex(multirow.sty)'> etc.
Final problem - converting dem does not complete. -forgot projection!
comment:21 Changed 9 years ago by dac
RCD Delivery Check
Started delivery check.
comment:22 Changed 9 years ago by dac
RCD Delivery Check
No readme - will resume delivery check when generated.
comment:23 Changed 9 years ago by dac
LiDAR DC
Starting LiDAR delivery check
comment:24 Changed 9 years ago by tec
RCD Processing
Readme Config file is missing 7 line names aparently, shall look into this.
comment:25 Changed 9 years ago by tec
RCD Processing
Has readme, DC please.
comment:26 Changed 9 years ago by dap
Fenix Processing
Corrected SCT values so far:
SAFE Site letter | Flightline | Fenix SCT |
D | 1 | 1.10 |
2 | 0.92 | |
3 | 1.11 | |
4 | 0.90 | |
5 | 0.94 | |
6 | -0.11 | |
7 | 0.94 | |
8 | 0.94 | |
9 | 1.00 | |
10 | 0.96 | |
11 | 0.92 | |
12 | 0.99 | |
13 | * | |
14 | 0.93 | |
15 | 0.98 | |
16 | 0.99 | |
17 | 0.89 | |
18 | 1.04 | |
19 | 0.92 | |
20 | 1.04 | |
21 | 0.88 | |
22 | 1.10 | |
23 | -0.13 | |
24 | 1.05 | |
25 | 0.90 | |
26 | 1.06 | |
27 | 0.93 | |
28 | 1.02 | |
29 | 0.94 | |
C | 30 | 0.65 |
31 | 1.37 | |
32 | 0.67 | |
33 | 0.40 | |
34 | 0.67 | |
35 | 1.29 | |
36 | 0.72 | |
37 | 1.20 | |
38 | 0.77 | |
39 | 1.14 | |
40 | 0.79 | |
41 | 0.09 | |
42 | 0.94 | |
43 | 0.98 | |
44 | 0.96 | |
45 | 0.98 | |
46 | 0.95 | |
47 | 1.00 | |
48 | 0.94 | |
49 | 1.00 | |
50 | 0.95 | |
51 | 0.96 | |
52 | -0.01 | |
53 | 1.02 |
* = Could not process this line
All corrections found.
comment:27 Changed 9 years ago by dap
RCD Delivery Check
Starting delivery check.
comment:28 Changed 9 years ago by dac
LiDAR DC
There are a number of lines in the discrete return data which are duplicates of each other (las and ascii), the full waveform data look OK though. The duplicate lines I found were:
- 11 and 12
- 13 and 14
- 15 and 16
- 17 and 18
- 19 and 20
- 23 and 24
Have stopped DC and will redo once the duplicate lines have been sorted out.
Other points
- Changed las1.0 folder to las1.2
- Readme looks fine but confirm if site is Danum Valley or BALI-SAFE
- Pitch / Roll looks good
- Classification looks fine
comment:29 Changed 9 years ago by dap
RCD Delivery Check
No problems found, apart from "Danum Valley, Malaysia" used as the site area instead of "SAFE area, Malaysia" in the read me and exiftags. I'll change these and the data will be ready for delivery when I've addressed these problems.
comment:30 Changed 9 years ago by dap
RCD Delivery Check
Changed exiftags in photographs using command
exiftool -LocationName="SAFE Area, Malaysia" *.tif
in photographs directory. Also changed site name on first page of read me.
RCD delivery now ready to go.
comment:31 Changed 9 years ago by dap
- Summary changed from RG13/06, flight day 293/2014, Danum Valley to RG13/06, flight day 293/2014, SAFE Area
comment:32 Changed 9 years ago by dap
Fenix Processing
I've just noticed that the apl config file doesn't have a section for flight line 13. This seems to be because of an error caused when generating the config file:
Navigation does not cover the header file: /users/rsg/arsf/arsf_data/2014/flight_data/malaysia/RG13_06-2014_293_Danum_Valley/hyperspectral/fenix/FENIX293-14-13.hdr. nav=[81443.0011565, 97114.4930145], header=[86298, 43]
comment:33 Changed 9 years ago by lah
Lidar
Have reclassified duplicated lines and added to delivery. Redoing dem, screenshots & readme.
comment:34 Changed 9 years ago by tec
Delivery
Copied RCD to FTP, waiting on others before email
comment:35 Changed 9 years ago by lah
Lidar
Found many more overwritten duplicates to reprocess :(
comment:36 Changed 9 years ago by lah
Lidar ready for DC
Redone additional duplicated lines 22,26,33,35,37,39,43,45,47,49 & 51.
Fixed delivery - screenshots and readme show no more duplicates
Renamed logsheet and readme to SAFE Area, Malaysia to match RCD delivery
Changed 9 years ago by dac
comment:37 Changed 9 years ago by dac
LiDAR DC
Looks good, ready to deliver.
Some minor comments,
- Some files didn't have correct line endings (fixed).
- In the intensity screenshot, one of the lines is really bright, not a problem as the lidar intensity isn't calibrated (and AGC is saved in file).
- Difference between 46 and 47 is larger than rest (38 cm in log sheet, checked and this is accurate). Don't think this could be improved on without a lot of effort, in particular as same pitch and roll values worked well for the rest of the lines.
- There were a couple of crowns, I think all on the overlap between two lines, where a lot of crown points were classified as noise (see screenshot). Not enough crowns to worry about and sufficient non-noise points remain.
comment:38 Changed 9 years ago by dac
LiDAR and RCD Delivery
LiDAR and RCD data sent to PI (David Coomes) via FTP 27/04/2015
comment:39 Changed 9 years ago by tec
- Description modified (diff)
comment:40 Changed 9 years ago by dap
Fenix Processing
Processing with new calibration results is now complete and delivery has been created. Ready for delivery check.
comment:41 Changed 9 years ago by tec
Delivery Check
Starting Fenix DC
comment:42 Changed 9 years ago by tec
Delivery Check
Removed fodis dir
Add in the lines in the readme pdf and its ready.
comment:43 Changed 9 years ago by tec
Delivery Check
Done, zipped and ready to go.
comment:44 Changed 9 years ago by tec
Delivery
Rsyncing to FTP:arsf1 DONE
comment:45 Changed 9 years ago by lah
PI notified of delivery 05/05/2015 (Fenix, Lidar & RCD)
comment:46 Changed 9 years ago by stgo
Started reprocessing hyperspectral
comment:47 Changed 9 years ago by gej
Created Delivery, Ready for DC
comment:48 Changed 9 years ago by lah
Fenix DC
- spectra mostly look ok. There is a large spike at the beginning of the SWIR region for most spectra in all lines, but this is within the masked out region. There is also a ~5nm (1 band) offset in spectral features compared to previous data (2014 169).
- renamed screenshots.
- lines 30 & 31 scts look a bit off, but if it was good enough last delivery then it probably can't be made better.
Ready to deliver once new data quality report is ready
comment:49 Changed 9 years ago by dac
Fenix
- Updated data quality report
- Copied to ftp (arsf1) - likely to have more projects ready today so will notify PI of all together.
comment:50 Changed 9 years ago by dac
Fenix
Delivered to PI via FTP (arsf1) 21/10/2015
comment:51 Changed 8 years ago by dac
Archiving
Checked and ready for upload.
comment:52 Changed 8 years ago by dac
Archiving
Data uploaded to NEODC.
comment:53 Changed 8 years ago by asm
- Resolution set to fixed
- Status changed from new to closed
Navigation Processing