HyTES/19, flight day 171c/2019, Grosseto

[wja]

Data location: /users/rsg/arsf/arsf_data/2019/flight_data/italy/HyTES19-2019_169_Grosseto

Data arrived from Kings College London via hardisk on July 15 2019.

Scientific objective: Joint NASA and ESA campaign flying JPL’s HyTES thermal instrument over sites in Europe with a focus on crops and soil. Aim is to inform the future Land Surface Temperature Monitoring (LSTM) satellite mission. The NCEO Fenix instrument was flown alongside HyTES to provide visible – SWIR hyperspectral data.

PI: Martin Wooster

Sensors:

Fenix (requested, flown)

[wja]

Navigation Processing
Basestation data converted to RINEX. Of the three RINEX files (which contain multiple days of data), a file for this date has been created with the following command:

teqc -st 2019_06_20:06:27:48.840 -e 2019_06_20:15:09:15.860 +nav Default_9488_2006_062748.19n Default_9488_0509_114526.m00 > Default_9488_2006_062748.19o

[wja]

Navigation Processing
Unable to extract raw data. Will continue processing other flights and will return to investigate after.
Log:

Started Extraction
Raw file: E:\navigation_data_processing\171c\ipas20\raw\20190620_134141.dat.000
Extracting to: E:\navigation_data_processing\171c\extract\

Data extraction failed

[asm]

Navigation Processing

I (Aser) have taken over this processing. The last raw ipas20 file was 0 in size so I just did the extraction without the file in the directory and the procedure was successful. Solution shows no missing data as plane comes back to starting point.

Navigation processed via PPP. Accuracy looking good:
-Lat and lon separation as well as height separation under 0.05m
-Position accuracy under 0.015

Navigation processing finished

[seg]

Fenix Processing
Started processing.

SCT values identified

Flightline	FENIX
1	1.00
2	0.75
3	0.3
4	0.26

[seg]

Logsheet Creation

Log Sheets generated, flight line plot not generated so used flight KML instead.

[wja]

Hyperspectral Delivery
Created delivery.
Still need 2019 data quality and calibration report.

[asm]

Hyperspectral Delivery Check

Started.

[asm]

Hyperspectral Delivery Check

-Removed fodis directory
-xml files are correct for project information but need to be updated for each line information under flightlines directory (still NERC-ARF)
-APL commands are not working
-Readme looks good. It seems that most of the lines have a very big number of underflows in the SWIR. Actually, with the exception of line 2, the other 3 lines are registering underflows for practically most of the range of the SWIR. There is no much we can do It would be nice to put that in the quality remarks.
-SCT look good in the screenshots.
-Vegetation spectra loks good compared with 6S (a bit low in the SWIR but shape matches)

Once those problems are addressed, I will double check but project seems ready every other way.

[seg]

Fenix Processing

Had to change values for SCT after delivery check, even though navigation file seemed to work had to go to 2dp. Also FPS issues with lines 2 and 4 resolved. 2 changed from 60 to 59.78 and 4 from 59.988 to 60.

[asm]

Hyperspectral Delivery Check

Re-started.

[asm]

Hyperspectral Delivery Check

-Offsets and geo-correction look sensibly correct. There is a small offset at times and small improvements can be done (slightly not straight at very minor points) but given the fps issue, this solution looks good.
-Updated the hyperspectral data quality report with the new one
-Old and new xml files were under flightlines/line_information. Some of them were renamed, other with the SCTs on it. Left those that the SCT matched with this latest table.
-Updated the data quality remarks in the readme to point out that the FPS and SCT were found manually (not in the data quality report as using specim fix when nav synchronisation can be used)

Every other check has been made and everything looking good. I will zip the files and mark as ready to be delivered once done.

[asm]

Hyperspectral Delivery Check

The mapped files have been zipped correctly, will mark now the dataset as ready to be delivered.

[asm]

Hyperspectral Delivery

Data placed on FTP slot 15 and PI notified. Finalised delivery (08/11/19) and marking it as so.

[wja]

Atmospheric correction
Atmospheric correction has been applied to create level2 and mapped data.

Delivered to PI on June 22nd 2020

Needs archiving at CEDA

[wja]

Archiving
JSONs created, added to internal database.
Waiting for account with CEDA to be renewed in order to rsync

[wja]

Archiving
Rsync to CEDA complete. Have sent an e-mail to ask for their confirmation that the data has been received.