Opened 21 months ago

Last modified 9 months ago

#657 new flight processing

HyTES/19, flight day 171c/2019, Grosseto

Reported by: wja Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: dac@… Other processors:


Data location: /users/rsg/arsf/arsf_data/2019/flight_data/italy/HyTES19-2019_169_Grosseto

Data arrived from Kings College London via hardisk on July 15 2019.

Scientific objective: Joint NASA and ESA campaign flying JPL’s HyTES thermal instrument over sites in Europe with a focus on crops and soil. Aim is to inform the future Land Surface Temperature Monitoring (LSTM) satellite mission. The NCEO Fenix instrument was flown alongside HyTES to provide visible – SWIR hyperspectral data.

PI: Martin Wooster


Fenix (requested, flown)

Change History (16)

comment:1 Changed 21 months ago by wja

Navigation Processing
Basestation data converted to RINEX. Of the three RINEX files (which contain multiple days of data), a file for this date has been created with the following command:

teqc -st 2019_06_20:06:27:48.840 -e 2019_06_20:15:09:15.860 +nav Default_9488_2006_062748.19n Default_9488_0509_114526.m00 > Default_9488_2006_062748.19o

comment:2 Changed 20 months ago by wja

  • Cc dac@… added

Navigation Processing
Unable to extract raw data. Will continue processing other flights and will return to investigate after.

Started Extraction
Raw file: E:\navigation_data_processing\171c\ipas20\raw\20190620_134141.dat.000
Extracting to: E:\navigation_data_processing\171c\extract\

Data extraction failed

comment:3 Changed 20 months ago by asm

Navigation Processing

I (Aser) have taken over this processing. The last raw ipas20 file was 0 in size so I just did the extraction without the file in the directory and the procedure was successful. Solution shows no missing data as plane comes back to starting point.

Navigation processed via PPP. Accuracy looking good:
-Lat and lon separation as well as height separation under 0.05m
-Position accuracy under 0.015

Navigation processing finished

comment:4 Changed 20 months ago by seg

Fenix Processing
Started processing.

SCT values identified

Flightline FENIX
1 1.00
2 0.75
3 0.3
4 0.26
Last edited 18 months ago by seg (previous) (diff)

comment:5 Changed 19 months ago by seg

Logsheet Creation

Log Sheets generated, flight line plot not generated so used flight KML instead.

comment:6 Changed 18 months ago by wja

Hyperspectral Delivery
Created delivery.
Still need 2019 data quality and calibration report.

comment:7 Changed 18 months ago by asm

Hyperspectral Delivery Check


comment:8 Changed 18 months ago by asm

Hyperspectral Delivery Check

-Removed fodis directory
-xml files are correct for project information but need to be updated for each line information under flightlines directory (still NERC-ARF)
-APL commands are not working
-Readme looks good. It seems that most of the lines have a very big number of underflows in the SWIR. Actually, with the exception of line 2, the other 3 lines are registering underflows for practically most of the range of the SWIR. There is no much we can do It would be nice to put that in the quality remarks.
-SCT look good in the screenshots.
-Vegetation spectra loks good compared with 6S (a bit low in the SWIR but shape matches)

Once those problems are addressed, I will double check but project seems ready every other way.

comment:9 Changed 18 months ago by seg

Fenix Processing

Had to change values for SCT after delivery check, even though navigation file seemed to work had to go to 2dp. Also FPS issues with lines 2 and 4 resolved. 2 changed from 60 to 59.78 and 4 from 59.988 to 60.

comment:10 Changed 18 months ago by asm

Hyperspectral Delivery Check


comment:11 Changed 18 months ago by asm

Hyperspectral Delivery Check

-Offsets and geo-correction look sensibly correct. There is a small offset at times and small improvements can be done (slightly not straight at very minor points) but given the fps issue, this solution looks good.
-Updated the hyperspectral data quality report with the new one
-Old and new xml files were under flightlines/line_information. Some of them were renamed, other with the SCTs on it. Left those that the SCT matched with this latest table.
-Updated the data quality remarks in the readme to point out that the FPS and SCT were found manually (not in the data quality report as using specim fix when nav synchronisation can be used)

Every other check has been made and everything looking good. I will zip the files and mark as ready to be delivered once done.

comment:12 Changed 18 months ago by asm

Hyperspectral Delivery Check

The mapped files have been zipped correctly, will mark now the dataset as ready to be delivered.

comment:13 Changed 18 months ago by asm

Hyperspectral Delivery

Data placed on FTP slot 15 and PI notified. Finalised delivery (08/11/19) and marking it as so.

comment:14 Changed 10 months ago by wja

Atmospheric correction
Atmospheric correction has been applied to create level2 and mapped data.

Delivered to PI on June 22nd 2020

Needs archiving at CEDA

comment:15 Changed 9 months ago by wja

JSONs created, added to internal database.
Waiting for account with CEDA to be renewed in order to rsync

comment:16 Changed 9 months ago by wja

Rsync to CEDA complete. Have sent an e-mail to ask for their confirmation that the data has been received.

Note: See TracTickets for help on using tickets.