#597 closed flight processing (fixed)
RANNIS15/28, flight day 242/2015, Hekla
Reported by: | asm | Owned by: | |
---|---|---|---|
Priority: | immediate | Milestone: | 2015 data processing completion |
Component: | Processing: general | Keywords: | |
Cc: | Other processors: |
Description (last modified by dac)
Data location: ~arsf/arsf_data/2015/flight_data/iceland/RANNIS15_28-2015_242_Hekla
Data arrived from ARSF via SATA disk 8 on 28/09/2015.
Priority: Unknown
PI: Gro Pedersen
CAFAM code: R028
Sensors:
- Fenix (requested)
- Owl (requested - currently unfunded)
- Leica LIDAR (requested)
- RCD (requested)
Change History (56)
comment:1 Changed 9 years ago by asm
- Milestone set to 2015 data processing completion
comment:2 Changed 9 years ago by asm
- Description modified (diff)
comment:3 Changed 9 years ago by dac
- Description modified (diff)
comment:4 Changed 9 years ago by asm
comment:5 Changed 9 years ago by asm
General Processing
Sent to PI ARSF data arrival notification for RANNIS15/28.
comment:6 Changed 9 years ago by asm
Navigation Processing
Started.
Needed to download base station information for this project. Used REYK
Basestation verification
Lat: 64 08 19.63090
Lon: -21 57 19.75497
Elipsoidal Height: 93.210 (metres)
Antenna Height: 0.057 (metres)
Could not find a suitable solution with Ipas TC, will try Ipas Pro.
comment:7 Changed 9 years ago by asm
Navigation Processing
Found a suitable solution using Ipas Pro. Also created sol file for camera processing.
comment:8 Changed 9 years ago by stgo
RCD processing
Starting camera processing.
comment:9 Changed 9 years ago by stgo
RCD processing
I've converted and tagged the images, creation of the delivery was fine but the readme is complaining that there are no rcd images in the generated KML file (?!) and that there has been a problem in the lidar sorting function. Looking in to this now.
comment:10 Changed 9 years ago by stgo
RCD delivery
ready for delivery check
comment:11 Changed 9 years ago by asm
RCD Delivery Check
Started.
-Google-earth is not loading any picture. Please double check cause could be a problem with the program installation.
-There are two additional thumbnails that are plots and do not correspond with any photograph and should not be included on the delivery (283, 284).
-Readme is missing pages at the end. It is missing pictures from 257 to 282 and general information about ARSF and copyright info.
-proj_tidy is complaning about every single file name but I can't see anything wrong, I suspect it is caused by a longer than usual project_code. Please re-check in any case.
-Some pictures are almost totally covered by clouds (217). If we are going to deliver those, a note about data quality will be beneficial on the readme file.
comment:12 Changed 9 years ago by dac
RCD
The path to the images in the KML were wrong, they were relative to the top level of the project rather than the delivery folder. Have fixed and checked under GoogleEarth.
Images completely covered by clouds should be removed.
comment:13 Changed 9 years ago by stgo
RCD
Fixed images and readme, new delivery created for checking
comment:14 Changed 9 years ago by asm
Fenix Hyperspectral Processing
Started. Found problem with Ipas Pro navigation, will try to re-create it.
comment:15 Changed 9 years ago by asm
RCD Delivery Check
All checks have been made. Everything seems correct. RCD is ready to delivery
comment:16 Changed 9 years ago by asm
Navigation Processing
Have re-done navigation with Ipas TC using PPP processing instead of GNSS differential. Have saved Ipas Pro output to a different directory in case of it is needed but will need to be tidied once archiving is needed.
comment:17 Changed 9 years ago by asm
Fenix Hyperspectral Processing
Found SCT values:
Flightline | FENIX |
1 | 0.94 |
2 | 1.06 |
3 | 0.91 |
4 | 0.95 |
5 | 1.04 |
6 | 0.98 |
7 | 0.97 |
Flightlines are fairly big on size, will split and create delivery.
comment:18 Changed 9 years ago by asm
Fenix Hyperspectral Processing
Have created the delivery and generated a readme file. Also realised that screenshots were mixed and did not match with its level3 and have renamed manually (also sct values were present on the name). Fenix is ready for Delivery Check.
comment:19 Changed 9 years ago by asm
Fenix Hyperspectral Processing
Solved some issues from delivery before DC also presented on 241a and noticed during DC.
-Removed fodis directoy
-Solved apl commands for bot config file and readme.
comment:20 Changed 9 years ago by dac
Delivery
Sent RCD to Gro Pederson (University of Iceland) on a hard drive (21/12/2015). Also placed on FTP server (arsf4) for early access.
comment:21 Changed 9 years ago by dac
PI prefers delivery by hard drive
comment:22 Changed 9 years ago by dac
Fenix
Have changed status back to processing as will need to be reprocessed once updated GPS basestaion data are available.
comment:23 Changed 9 years ago by dac
Marking as blocked - still waiting on GPS data from IMO.
comment:24 Changed 9 years ago by asm
Navigation processing
Navigation reprocessed with GPS data provided by Icelandic Met-office .
Basestation verification for FEDG:
Latitude 64 01 30.93098
Lon -19 41 22.05279
Ell Height 503.722
Ant Height 1.00 m, to L1-PC (TRM411249.00, MeasDist 0.929)
Which corresponds on decimal degrees to the values sent by Met-office: -19.68946006 64.02525821 503.73149445
Basestation verification for HESA:
Latitude 64 02 48.62714
Lon -19 33 38.08773
Ell Height 529.117
Ant Height 1.090 m, to L1-PC (TRM411249.00, MeasDist 1.019)
Also match data received: -19.56057992 64.04684073 529.08620580 HESA deltaz=0.244
Basestation verification for MJSK:
Latitude 63 55 58.59971
Lon -19 40 20.53000
Ell Height 770.562
Ant Height 1.050 m, to L1-PC (TRM411249.00, MeasDist 0.979)
Also match data received:-19.6723625459 63.9329479506 770.861162678
Best solution found using MJSK. Best solution found using MJSK. Copying files and will rename old basestation and ipas_honeywell to old_nav_basestation (Please clean after processing, before archiving).
comment:25 Changed 9 years ago by asm
Fenix
Creating a new hyperspectral delivery with the new navigation.
comment:26 Changed 9 years ago by asm
Fenix
Delivery and readme created. Awaiting delivery check. There is also an old delivery created with the old navigation that has not been checked and delivered. To be sorted out on the future.
comment:27 Changed 9 years ago by dac
Fenix Delivery Check
Starting delivery check.
comment:28 Changed 9 years ago by dac
Fenix Delivery Check
Generally looks good a couple of comments:
- Need to remove old delivery
- Lots of clouds and cloud shadow in data.
- check_apl_cmd doesn't run - commands not defined in config file.
- proj_tidy gave a lot of errors - I think due to length of project name.
- Py6S script didn't find many vegetation pixels - the ones it did looked good though.
- The readme lists f24207 as having 2 parts in the table with corresponding lines in the log sheet but there is only one part.
comment:29 Changed 9 years ago by asm
Fenix
All comments suggested during delivery check have been addressed.
comment:30 Changed 9 years ago by dac
Fenix
Marking as ready to delivery. Have started zipping mapped files.
comment:31 Changed 9 years ago by gej
Lidar Processing
Lack of features and high cloud cover so pitch and roll corrections difficult, found values of:
roll:-0.001
pitch:-0.0022
Classifying now.
comment:32 Changed 9 years ago by gej
Lidar Processing
Finished classification, creating delivery now.
comment:33 Changed 9 years ago by gej
Lidar Processing
Noticed that pitch and roll doesn't work well in some areas so am trying to find better values.
comment:34 Changed 9 years ago by gej
Lidar Processing
New pitch and roll values of
roll: -0.0010
pitch: -0.0020
Classifying now.
comment:35 Changed 9 years ago by gej
Lidar processing
Classified, creating delivery now
comment:36 Changed 9 years ago by gej
Lidar Processing
Delivery and Readme created
Ready for delivery check
comment:37 Changed 9 years ago by dac
LiDAR delivery check
Starting delivery check.
comment:38 Changed 9 years ago by dac
- Clouds are classified well:
- Output from demcompare (comparison with ASTER):
Difference statistics: Min: -465.749974609375 Max: 123.000025390625 Sum: -1689738.32831479 Mean: -9.07812332211263 Median: -8.1895 Absolute mean: 10.8730745807861 Std deviation: 19.8399810250404 Total cells: 6559705 Non-null cells: 186133
- Added some pagebreaks to fix pagination in readme
- Ready to deliver.
(previous comment was for 241b)
comment:39 Changed 9 years ago by asm
Delivery
Lidar and Fenix data dispatched via hard drive on 23/02/2016.
comment:40 Changed 9 years ago by asm
RCD processing
Taking over this project. Will create new eventfile and tag photos.
comment:41 Changed 9 years ago by asm
RCD processing
Creating new delivery
comment:42 Changed 9 years ago by asm
RCD processing
Delivery and readme created. Awaiting delivery check.
comment:43 Changed 9 years ago by lah
RCD DC
- Had to change read permissions for event file
- proj_tidy doesn't recognise any of the files as it's "RANNIS", apart from that everything is fine.
Ready to deliver.
comment:44 Changed 9 years ago by asm
Delivery
Camera reprocessed with new navigation dispatched via hard drive on 03/03/2016. No more re-processing pending.
comment:45 Changed 6 years ago by dac
Archiving
Data uploaded to CEDA at request of PI.
comment:46 Changed 6 years ago by dac
- Resolution set to fixed
- Status changed from new to closed
Archiving
Data available from CEDA. Closing ticket.
comment:47 Changed 6 years ago by wja
Owl Processing
- No darkframes
- Separate calibration files
Data has no been stitched and is currently processing to level1 using the following calibration file for each line:
Line | Cal File |
1 | T1042 |
2 | T1042 |
3 | T1116 |
4 | T1128 |
5 | 1139 |
6 | 1139 |
7 | T1149 |
comment:48 Changed 6 years ago by wja
Owl Processing
Processed to level1b.
Finding SCT values.
Line 6 is very short (1576 lines) and will not be processed further.
comment:49 Changed 6 years ago by wja
Owl Processing
SCT Values:
1 | 3.80 |
2 | 3.10 |
3 | 2.30 |
4 | 2.35 |
5 | 2.65 |
6 | N/A |
7 | 3.15 |
'sensorid' in level1 headers has been changed to match the hyperspectral sensors CSV in order for line information XMLs to be produced.
Prcoessing to level3.
comment:50 Changed 6 years ago by wja
Owl Prcoessing
Flightlines have been split where appropriate to be consistent with data in hyperspectral delivery.
Creating delivery.
comment:51 Changed 6 years ago by wja
Owl Delivery
Owl delivery created. Logsheet has been generated by adding appropriate Owl information to the original hyperspectral delivery logsheet.
Ready for delivery check.
comment:52 Changed 6 years ago by dac
Owl Delivery Check
- Should mention cloud cover and cloud shadows in readme as quite bad for this flight.
- Removed an *aux.xml file left in mapped directory
- The project name is listed in the logsheet as HEKLA RO28, R028 is just the identifier used by BAS it doesn't need to be in the project name. Has been used for previous deliveries so might as well keep for consistency though.
- check_apl_cmd ran through OK
- SCT values look good.
Zipping mapped files. Once note about cloud cover has been added to readme ready to deliver.
comment:53 Changed 6 years ago by wja
Owl Delivery
ReadMe updated.
Mapped files have been zipped.
Delivery placed on FTP slot 11.
Notification e-mail sent.
Delivery finalised.
comment:54 Changed 6 years ago by wja
Owl Archiving
Added to PostGIS.
Starting rsync to CEDA (15:18 31/05/2019).
comment:55 Changed 6 years ago by wja
Owl Archiving
rsync to CEDA complete (3/6/19).
E-mail sent to confirm it has been received.
comment:56 Changed 6 years ago by wja
Owl Archiving
CEDA has confirmed recepit of the reprocessed Owl data.
All data is now archived.
General Processing
-Logsheet generated.
-Engine times are approximate.