Opened 21 months ago

Last modified 8 months ago

#662 new flight processing

HyTES/19, flight day 180b/2019, Grosseto

Reported by: wja Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: Other processors:

Description

Data location: /users/rsg/arsf/arsf_data/2019/flight_data/italy/HyTES19-2019_169_Grosseto

Data arrived from Kings College London via hardisk on July 15 2019.

Scientific objective: Joint NASA and ESA campaign flying JPL’s HyTES thermal instrument over sites in Europe with a focus on crops and soil. Aim is to inform the future Land Surface Temperature Monitoring (LSTM) satellite mission. The NCEO Fenix instrument was flown alongside HyTES to provide visible – SWIR hyperspectral data.

PI: Martin Wooster

Sensors:

Fenix (requested, flown)

Change History (21)

comment:1 Changed 21 months ago by wja

Unpacking
Includes several sites including:

  • Redmere
  • The Fens
  • Milton Keynes
  • Duxford

comment:2 Changed 21 months ago by wja

Navigation Processing
OS Basestation RINEX data downloaded for station SNEO, NEWR & BUCI as noted on flight logsheet.

comment:3 Changed 21 months ago by wja

Navigation Processing
Have downloaded GPS nav data 'brdc180.19n' from CDDIS's FTP. https://cddis.nasa.gov/Data_and_Derived_Products/GNSS/broadcast_ephemeris_data.html

comment:4 Changed 20 months ago by asm

Nav Processing

Navigation processed via PPP. Accuracy looking good:
-Lat and lon sepparation under 0.05m and height separation under 0.08
-Position accuracy under 0.020
-Everything else looking good

comment:5 Changed 20 months ago by seg

Fenix Processing
Started processing

SCT Values identified

Flightline FENIX
1 1.00
2 2.00
3 2.00
4 2.00
5 1.00
6 1.00
7 2.00
8 1.00
Last edited 19 months ago by seg (previous) (diff)

comment:6 Changed 19 months ago by seg

Logsheet Creation

Log sheet created, however, flight-lines plot not generated so have included Flight KML.

comment:7 Changed 19 months ago by wja

Hyperspectral Processing
Started processing Fenix data to level three.
replace_wavscale.py has been run on the raw data - note that flightline 8 has differnt spectral binning with 448 bands.

comment:8 Changed 19 months ago by wja

Hyperspectral Delivery
Creating Fenix delivery

comment:9 Changed 18 months ago by wja

Hyperspectral Delivery
Just needs updated calibration and data quality reports.
Everything else is ready for checking.

comment:10 Changed 17 months ago by wja

Hyperspectral Delivery
Updated delivery.

Updated SCT values:

10.00
21.00
31.00
41.00
50.00
60.00
51.00
60.00

Ready for checking

comment:11 Changed 17 months ago by seg

Delivery Check

Starting Delivery Check

  • Missing line information for flightline 1
  • check_apl_cmd didn't run
  • Line 3 has undetected underflow bands 372-379
  • Line 4 has undetected underflow bands 370-387
  • Line 6 has undetected underflow bands 415-439
  • Line 7 has undetected underflow bands 415-439
  • Checked vegetation spectra against Py6S. Good match, a bit low in the SWIR with the exception of lines 1 and 2 that are completely underflowing and doesn't look to have usable data as analysis on tuiview with asm revealed
Last edited 17 months ago by seg (previous) (diff)

comment:12 Changed 17 months ago by seg

Delivery Check

DC finished*. First for seg, please have a second look

comment:13 Changed 17 months ago by asm

Delivery Check

Already started. Having a second look as it is first seg's DC.

comment:14 Changed 17 months ago by asm

Delivery Check

-check_apl_cmd running just fine, needed to use correct hyp_readme file.
-SCT look correct and with no offset
-re-created the flightline 1 xml file
-Looks like problems with the SWIR are caused by a too small integration time selected (minimum possible selected, over 200 times smaller than lines 6 and 7). This is likely caused by an human error, I will add that into the readme
-Every other check has been carried out, all correct.

I have updated the Readme to meet my comments and @seg. I will leave this project on hold for now to double check if it is worth deliver flightline 1 and 2 as they are or if we should drop the SWIR region. Once resolved and mapped files zipped, it should be ready to be delivered.

comment:15 Changed 17 months ago by asm

Fenix Delivery

After some discussing, we decided to mask out the SWIR bands for lines 1 and 2.
-Created new mask files
-Created new mapped files
-Moved new files to the delivery
-Updated the readme accordingly
-Added xml for line 5 as it was missing

Seg will have a second look as a DC and if everything is correct, should be ready to deliver soon.

comment:16 Changed 17 months ago by seg

Delivery Check

Everything looks good

comment:17 Changed 17 months ago by asm

Fenix Delivery

Mapped files have been successfully zipped. Marking this project as ready to be delivered.

comment:18 Changed 17 months ago by asm

Fenix Delivery

Project delivered, finalised and notification sent to PI on 22nd November 2019.

comment:19 Changed 10 months ago by wja

Atmospheric correction
Atmospheric correction has been applied to create level2 and mapped data.

Delivered to PI on June 22nd 2020

Needs archiving at CEDA

comment:20 Changed 9 months ago by wja

Archiving
JSONs created, added to internal database.
Waiting for account with CEDA to be renewed in order to rsync

comment:21 Changed 8 months ago by wja

Archiving
Rsync to CEDA complete. Have sent an e-mail to ask for their confirmation that the data has been received.

Note: See TracTickets for help on using tickets.