Opened 3 years ago

Last modified 13 months ago

#684 new flight processing

Magic, flight day 236/2021, Kiruna, Sweden

Reported by: wja Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: Other processors:

Description (last modified by wja)

Data location: /users/rsg/arsf/arsf_data/2021/flight_data/sweden/Magic-2021_236_Kiruna/

Data arrived from Kings College London via hardrive from Sweden on September 20th 2021.

Scientific objective: International project (includes NASA, CNRS, ESA, DLR, Eumetsat) to monitor and identify methane inventories in the arctic. JPL's HyTES instrument was utilised. A total of three aircraft were used to collect data, along with deployed balloons and ground measurments.

PI: Martin Wooster

Change History (17)

comment:1 Changed 3 years ago by wja

Unpacking

This is a large flight, with 827G of raw Fenix1k data.

run_unpacked_checked.py reported issue with nav times.

comment:2 Changed 3 years ago by wja

  • Description modified (diff)

comment:3 Changed 3 years ago by wja

Navigation Processing

Processed using KIRU basestation accessed from epncb.eu

Computed RTX coordinates of KIRU:

Horizontal sigma: 0.004 m
Vertical sigma: 0.005 m

Horizontal RMSE < 2 cm apart from first minutes of the flight (< 4 cm). Vertical RMSE < 3 cm.

comment:4 Changed 3 years ago by wja

Darkframes recorded in their own separate files for this flight.

In the config, the following -darkfile argument will need to be added for aplcal for each line. E. g: cal_args_extra = -darkfile $PROJ_DIR/hyperspectral/fenix/FENIX*/*.raw

comment:5 Changed 3 years ago by wja

Hyperspectral Processing

Wavelengths in HDR files (including separate darkframe file headers) have been updated using replace_wavscale.py -w /users/rsg/arsf/calibration/2021/fenix1k/wlcal2b_vnir_1b_swir.txt FENIX*/capture/*hdr --final.

Lines 1 - 6 do not have separate darkframe files, these have been mapped with 3 bands.

comment:6 Changed 3 years ago by wja

Hyperspectral Processing

All lines processed with all bands. Paths to seperate darkframe files input for lines 7 - 30.

comment:7 Changed 3 years ago by wja

Ready for checking

Note this is a very large flight (30 lines, mapped data alone is 2.2T)

comment:8 Changed 2 years ago by mark1

Hyperspectral delivery check

  • Missing project_information XML
  • The mosaic image in the readme is from a different project and needs replacing

< will update further progress when finished checking L1 and L3 images >

comment:9 Changed 2 years ago by wja

Delivery

Added XML

comment:10 Changed 2 years ago by wja

Delivery
Corrected mosaic in ReadMe.

comment:11 Changed 2 years ago by mark1

Continuing Hyperspectral delivery check

Finished viewing all files. Offset between VNIR and SWIR quite large for line 27 part 01 - should be added to readme or quality report, as it results in dodgy Spectra - this has been seen in other Sweden files also.

comment:12 Changed 2 years ago by mark1

zipping mapped flight lines

comment:13 Changed 2 years ago by wja

Delivery

Finalised, put on FTP slot 5

comment:14 Changed 2 years ago by wja

Delivery Sent

PI notifified

comment:15 Changed 14 months ago by wja

Archiving

Created JSONs, committed them to database.

Ready to sync to CEDA.

comment:16 Changed 14 months ago by wja

Archiving

Starting transfer to CEDA

comment:17 Changed 13 months ago by wja

Archiving

Transfer complete

Note: See TracTickets for help on using tickets.