Opened 5 years ago
Last modified 4 years ago
#662 new flight processing
HyTES/19, flight day 180b/2019, Grosseto
Reported by: | wja | Owned by: | |
---|---|---|---|
Priority: | immediate | Milestone: | |
Component: | Processing: general | Keywords: | |
Cc: | Other processors: |
Description
Data location: /users/rsg/arsf/arsf_data/2019/flight_data/italy/HyTES19-2019_169_Grosseto
Data arrived from Kings College London via hardisk on July 15 2019.
Scientific objective: Joint NASA and ESA campaign flying JPL’s HyTES thermal instrument over sites in Europe with a focus on crops and soil. Aim is to inform the future Land Surface Temperature Monitoring (LSTM) satellite mission. The NCEO Fenix instrument was flown alongside HyTES to provide visible – SWIR hyperspectral data.
PI: Martin Wooster
Sensors:
Fenix (requested, flown)
Change History (21)
comment:1 Changed 5 years ago by wja
comment:2 Changed 5 years ago by wja
Navigation Processing
OS Basestation RINEX data downloaded for station SNEO, NEWR & BUCI as noted on flight logsheet.
comment:3 Changed 5 years ago by wja
Navigation Processing
Have downloaded GPS nav data 'brdc180.19n' from CDDIS's FTP. https://cddis.nasa.gov/Data_and_Derived_Products/GNSS/broadcast_ephemeris_data.html
comment:4 Changed 5 years ago by asm
Nav Processing
Navigation processed via PPP. Accuracy looking good:
-Lat and lon sepparation under 0.05m and height separation under 0.08
-Position accuracy under 0.020
-Everything else looking good
comment:5 Changed 5 years ago by seg
Fenix Processing
Started processing
SCT Values identified
Flightline | FENIX |
1 | 1.00 |
2 | 2.00 |
3 | 2.00 |
4 | 2.00 |
5 | 1.00 |
6 | 1.00 |
7 | 2.00 |
8 | 1.00 |
comment:6 Changed 5 years ago by seg
Logsheet Creation
Log sheet created, however, flight-lines plot not generated so have included Flight KML.
comment:7 Changed 5 years ago by wja
Hyperspectral Processing
Started processing Fenix data to level three.
replace_wavscale.py has been run on the raw data - note that flightline 8 has differnt spectral binning with 448 bands.
comment:8 Changed 5 years ago by wja
Hyperspectral Delivery
Creating Fenix delivery
comment:9 Changed 5 years ago by wja
Hyperspectral Delivery
Just needs updated calibration and data quality reports.
Everything else is ready for checking.
comment:10 Changed 5 years ago by wja
Hyperspectral Delivery
Updated delivery.
Updated SCT values:
1 | 0.00 |
2 | 1.00 |
3 | 1.00 |
4 | 1.00 |
5 | 0.00 |
6 | 0.00 |
5 | 1.00 |
6 | 0.00 |
Ready for checking
comment:11 Changed 5 years ago by seg
Delivery Check
Starting Delivery Check
- Missing line information for flightline 1
- check_apl_cmd didn't run
- Line 3 has undetected underflow bands 372-379
- Line 4 has undetected underflow bands 370-387
- Line 6 has undetected underflow bands 415-439
- Line 7 has undetected underflow bands 415-439
- Checked vegetation spectra against Py6S. Good match, a bit low in the SWIR with the exception of lines 1 and 2 that are completely underflowing and doesn't look to have usable data as analysis on tuiview with asm revealed
comment:12 Changed 5 years ago by seg
Delivery Check
DC finished*. First for seg, please have a second look
comment:13 Changed 5 years ago by asm
Delivery Check
Already started. Having a second look as it is first seg's DC.
comment:14 Changed 5 years ago by asm
Delivery Check
-check_apl_cmd running just fine, needed to use correct hyp_readme file.
-SCT look correct and with no offset
-re-created the flightline 1 xml file
-Looks like problems with the SWIR are caused by a too small integration time selected (minimum possible selected, over 200 times smaller than lines 6 and 7). This is likely caused by an human error, I will add that into the readme
-Every other check has been carried out, all correct.
I have updated the Readme to meet my comments and @seg. I will leave this project on hold for now to double check if it is worth deliver flightline 1 and 2 as they are or if we should drop the SWIR region. Once resolved and mapped files zipped, it should be ready to be delivered.
comment:15 Changed 5 years ago by asm
Fenix Delivery
After some discussing, we decided to mask out the SWIR bands for lines 1 and 2.
-Created new mask files
-Created new mapped files
-Moved new files to the delivery
-Updated the readme accordingly
-Added xml for line 5 as it was missing
Seg will have a second look as a DC and if everything is correct, should be ready to deliver soon.
comment:16 Changed 5 years ago by seg
Delivery Check
Everything looks good
comment:17 Changed 5 years ago by asm
Fenix Delivery
Mapped files have been successfully zipped. Marking this project as ready to be delivered.
comment:18 Changed 5 years ago by asm
Fenix Delivery
Project delivered, finalised and notification sent to PI on 22nd November 2019.
comment:19 Changed 4 years ago by wja
Atmospheric correction
Atmospheric correction has been applied to create level2 and mapped data.
Delivered to PI on June 22nd 2020
Needs archiving at CEDA
comment:20 Changed 4 years ago by wja
Archiving
JSONs created, added to internal database.
Waiting for account with CEDA to be renewed in order to rsync
comment:21 Changed 4 years ago by wja
Archiving
Rsync to CEDA complete. Have sent an e-mail to ask for their confirmation that the data has been received.
Unpacking
Includes several sites including: