Opened 5 years ago

Last modified 4 years ago

#662 new flight processing

HyTES/19, flight day 180b/2019, Grosseto

Reported by: wja Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: Other processors:

Description

Data location: /users/rsg/arsf/arsf_data/2019/flight_data/italy/HyTES19-2019_169_Grosseto

Data arrived from Kings College London via hardisk on July 15 2019.

Scientific objective: Joint NASA and ESA campaign flying JPL’s HyTES thermal instrument over sites in Europe with a focus on crops and soil. Aim is to inform the future Land Surface Temperature Monitoring (LSTM) satellite mission. The NCEO Fenix instrument was flown alongside HyTES to provide visible – SWIR hyperspectral data.

PI: Martin Wooster

Sensors:

Fenix (requested, flown)

Change History (21)

comment:1 Changed 5 years ago by wja

Unpacking
Includes several sites including:

  • Redmere
  • The Fens
  • Milton Keynes
  • Duxford

comment:2 Changed 5 years ago by wja

Navigation Processing
OS Basestation RINEX data downloaded for station SNEO, NEWR & BUCI as noted on flight logsheet.

comment:3 Changed 5 years ago by wja

Navigation Processing
Have downloaded GPS nav data 'brdc180.19n' from CDDIS's FTP. https://cddis.nasa.gov/Data_and_Derived_Products/GNSS/broadcast_ephemeris_data.html

comment:4 Changed 5 years ago by asm

Nav Processing

Navigation processed via PPP. Accuracy looking good:
-Lat and lon sepparation under 0.05m and height separation under 0.08
-Position accuracy under 0.020
-Everything else looking good

comment:5 Changed 5 years ago by seg

Fenix Processing
Started processing

SCT Values identified

Flightline FENIX
1 1.00
2 2.00
3 2.00
4 2.00
5 1.00
6 1.00
7 2.00
8 1.00
Last edited 5 years ago by seg (previous) (diff)

comment:6 Changed 5 years ago by seg

Logsheet Creation

Log sheet created, however, flight-lines plot not generated so have included Flight KML.

comment:7 Changed 5 years ago by wja

Hyperspectral Processing
Started processing Fenix data to level three.
replace_wavscale.py has been run on the raw data - note that flightline 8 has differnt spectral binning with 448 bands.

comment:8 Changed 5 years ago by wja

Hyperspectral Delivery
Creating Fenix delivery

comment:9 Changed 5 years ago by wja

Hyperspectral Delivery
Just needs updated calibration and data quality reports.
Everything else is ready for checking.

comment:10 Changed 5 years ago by wja

Hyperspectral Delivery
Updated delivery.

Updated SCT values:

10.00
21.00
31.00
41.00
50.00
60.00
51.00
60.00

Ready for checking

comment:11 Changed 5 years ago by seg

Delivery Check

Starting Delivery Check

  • Missing line information for flightline 1
  • check_apl_cmd didn't run
  • Line 3 has undetected underflow bands 372-379
  • Line 4 has undetected underflow bands 370-387
  • Line 6 has undetected underflow bands 415-439
  • Line 7 has undetected underflow bands 415-439
  • Checked vegetation spectra against Py6S. Good match, a bit low in the SWIR with the exception of lines 1 and 2 that are completely underflowing and doesn't look to have usable data as analysis on tuiview with asm revealed
Last edited 5 years ago by seg (previous) (diff)

comment:12 Changed 5 years ago by seg

Delivery Check

DC finished*. First for seg, please have a second look

comment:13 Changed 5 years ago by asm

Delivery Check

Already started. Having a second look as it is first seg's DC.

comment:14 Changed 5 years ago by asm

Delivery Check

-check_apl_cmd running just fine, needed to use correct hyp_readme file.
-SCT look correct and with no offset
-re-created the flightline 1 xml file
-Looks like problems with the SWIR are caused by a too small integration time selected (minimum possible selected, over 200 times smaller than lines 6 and 7). This is likely caused by an human error, I will add that into the readme
-Every other check has been carried out, all correct.

I have updated the Readme to meet my comments and @seg. I will leave this project on hold for now to double check if it is worth deliver flightline 1 and 2 as they are or if we should drop the SWIR region. Once resolved and mapped files zipped, it should be ready to be delivered.

comment:15 Changed 5 years ago by asm

Fenix Delivery

After some discussing, we decided to mask out the SWIR bands for lines 1 and 2.
-Created new mask files
-Created new mapped files
-Moved new files to the delivery
-Updated the readme accordingly
-Added xml for line 5 as it was missing

Seg will have a second look as a DC and if everything is correct, should be ready to deliver soon.

comment:16 Changed 5 years ago by seg

Delivery Check

Everything looks good

comment:17 Changed 5 years ago by asm

Fenix Delivery

Mapped files have been successfully zipped. Marking this project as ready to be delivered.

comment:18 Changed 5 years ago by asm

Fenix Delivery

Project delivered, finalised and notification sent to PI on 22nd November 2019.

comment:19 Changed 4 years ago by wja

Atmospheric correction
Atmospheric correction has been applied to create level2 and mapped data.

Delivered to PI on June 22nd 2020

Needs archiving at CEDA

comment:20 Changed 4 years ago by wja

Archiving
JSONs created, added to internal database.
Waiting for account with CEDA to be renewed in order to rsync

comment:21 Changed 4 years ago by wja

Archiving
Rsync to CEDA complete. Have sent an e-mail to ask for their confirmation that the data has been received.

Note: See TracTickets for help on using tickets.