Magic, flight day 234/2021, Kiruna, Sweden

[wja]

Data location: /users/rsg/arsf/arsf_data/2021/flight_data/sweden/Magic-2021_234_Kiruna/
Data arrived from Kings College London via hardrive from Sweden on September 20th 2021.

Scientific objective: International project (includes NASA, CNRS, ESA, DLR, Eumetsat) to monitor and identify methane inventories in the arctic. JPL's HyTES instrument was utilised. A total of three aircraft were used to collect data, along with deployed balloons and ground measurments.

PI: Martin Wooster

[wja]

Unpacking

• run_unpacked_checks.py reports the following nav time issue:

Running checks for FENIX1K                                                                                            
Running check: arsf_check_library.checks.check_nav_timestamps                                                         
No date record ($GPZDA) found in nav file - will assume it is binary if cannot find a line starting with '$GPGGA' or '
$PRDID'.                                                                                                              
Error in /users/rsg/arsf/usr/lib/python/site-packages/arsf_unpacking/unpacking_utilities.py : write_message: Nav file 
does not have time stamps or failed to read the file using readAscii: /users/rsg/arsf/arsf_data/2021/flight_data/swede
n/SwathS-2021_234_Kiruna/hyperspectral/fenix/FENIX234-21-1/capture/FENIX234-21-1.nav  

Running check: arsf_check_library.checks.check_nav_last_frame                                                         
No date record ($GPZDA) found in nav file - will assume it is binary if cannot find a line starting with '$GPGGA' or '
$PRDID'.                                                                                                              
Error in /users/rsg/arsf/usr/lib/python/site-packages/arsf_unpacking/unpacking_utilities.py : write_message: Nav file 
does not have time stamps or failed to read the file using readAscii: /users/rsg/arsf/arsf_data/2021/flight_data/sweden/SwathS-2021_234_Kiruna/hyperspectral/fenix/FENIX234-21-1/capture/FENIX234-21-1.nav  

[wja]

Nav Processing

1 Wanring when importing nav data:

42434.000 : WARNING : Gap of 87.0 seconds in GNSS navigation data
42434.000 : WARNING : Gap of 87.0 seconds in GNSS observables data

Start end time of navigation data (GPS seconds of week):
GPS Week: 2172
Start: 42266 (22/08/2021 11:44:08)
End: 55431 (22/08/2021 15:23:33)

Warning occurs 168 seconds into the flight (2.8 mins) - likely before take off.

Downloaded basestation KIRU from epncb.eu:

lftp epncb.eu:/pub/
cd obs/2021/234
mirror --include-glob=KIRU* ./

Computed RTX coordaintes for KIRU:

• Horizontal sigma: 0.004 m
• Vertical sigma: 0.005 m

POSPac recommend to clip the ends of the nav data for processesing so it is closer to the basestation:

Current Start:	42248.000	Recommended Start:	43418.000
Current End:	55414.000	Recommended End:	54660.000

Data quality:

Horizontal RMSE < 1 cm apart from one spike at 3 cm.
Vertical RMSE < 2cm apart from one spike at 5 cm

[wja]

Hyperspectral Processing

Processed all flightlines with 3 bands (RGB) to check geoaccuracy.

Flightline 2 part 2 is very green. Unsure why this is exclusive to this section of the flightline.

[wja]

Hyperspectral Processing

3 band data is fine. The green nad red was just a result of contrast stretching done by Tuiview.

[dac]

Digital Camera

Started converting raw PhaseOne images to Tiff.

[wja]

Delivery created.

Ready for Delivery Check

[asm]

Delivery check

Started
-4 missing xml line information files. check_apl_cmd skipped those
-Very low signal, mostly only underflows even with bining 8 on the VNIR and large integration times. Near no data over 1500nm in the SWIR.
-Py6S shows shape matching in the VNIR but no where near in the SWIR.
-Please add note about data quality in readme

[wja]

• Added the missing XML files (mako wasn't installed on one of the gridnodes)
• Added underflow / noise note in the readme

[wja]

• Specifically mentioned SWIR bands being badly affected by underflows / noise in readme.

[asm]

Fenix DC

The xml for line 4 is fine now. The readme looks good. I have now zipped the files and those were zipped correctly. I will mark this dataset as ready to be delivered.

[wja]

Delivered

FTP slot 5, PI notified via e-mail.

[wja]

Archiving

Created JSONs, committed them to database.

Ready to sync to CEDA.

[wja]

Archiving

Queued transfer to CEDA to run when flight 233a (ticket #679) is complete.

[wja]

Transfer complete