Opened 9 months ago

Last modified 5 months ago

#676 new flight processing

SwathS, flight day 216a/2021, Rothamsted

Reported by: wja Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: Other processors:

Description

Data location: /users/rsg/arsf/arsf_data/2021/flight_data/uk/SwathS-2021_216a_Rothamsted

Data arrived from Kings College London via FTP on September 20th 2021

Scientific objective: Joint NASA and ESA campaign flying JPL’s HyTES thermal instrument over sites in Europe with a focus on crops and soil.

PI: Martin Wooster

Change History (16)

comment:1 Changed 9 months ago by wja

Unpacking

  • Flightline 16 is missing a header and calibration file (this is reported on the flight logsheet).
  • Unpacking checks return following issues regarding nav data:
    No date record ($GPZDA) found in nav file - will assume it is binary if cannot find a line starting with '$GPGGA' or $
    $PRDID'.                                                                                                              
    Error in unpacking_utilities.py : write_message: Nav file does not have time stamps or failed to read the file using readAscii: SwathS-2021_216a_Rothamsted/hyperspectral/fenix/FENIX216a-21-1/capture/FENIX216a-21-1.nav  
    
  • This is also no fps_set in the Fenix headers.

comment:2 Changed 8 months ago by dac

Phaseone

Raw images converted.

comment:3 Changed 8 months ago by wja

Navigation Processing

Have received OS basestation data from BIGF. Will need to acknowledge that they supplied these data in the documentation of the delivery.

Starting navigation processing

comment:4 Changed 8 months ago by wja

Navigation Processing

Navigation data processed in POSPac using the SmartBase method with the following basestations:

  • amer
  • brdc
  • buci
  • pete
  • pris
  • sneo
  • stee
  • well

QC report suggests RMSE is < 3cm.

comment:5 Changed 8 months ago by wja

Hyperspectral Processing

There is a flightline 216-21a_FL16_2021-08-04_10-28-19/ which is missing a hdr file and will not be processed. Although this is labeled FL16, the timestamp matches FL10 or FL11 on the logsheet.

comment:6 Changed 8 months ago by wja

Hyperspectral Processing

Fenix1k header wavelengths updated with replace_wavscale.py -w /users/rsg/arsf/calibration/2021/fenix1k/wlcal2b_vnir_1b_swir.txt hyperspectral/fenix/F*/capture/*hdr --final

comment:7 Changed 8 months ago by wja

Hyperspectral Processing

All flightlines mapped with 3 bands.

comment:8 Changed 8 months ago by wja

Hyperspectral Processing

FPS error present in lines 15 & 16. Both FPS values in header will need decreasing.

Line 16 also has an SCT error, it is ~+0.1 seconds at the start of the flightline.

comment:9 Changed 6 months ago by wja

Preliminary SCT Values:

LineSCT Error
10.06
20.00
30.00
40.00
50.00
60.02
70.00
80.00
90.00
100.00
110.02
120.04
130.06
14-0.04
150.10
160.16

These are to nearest 0.2 seconds at the location targets were deployed at Rothamsted. FPS issues still need identifying and correcting.

comment:10 Changed 5 months ago by wja

FPS issues evident in the final three flightlines (14, 15 & 16) - this is when the integration time was changed and could be related.

FPS values have been changed in raw data header file (origional headers have already been copied).
aplnav required the use of the -firstonly flag when processing with differnt FPS values.

LineSCT ErrorFPS (if changed)
10.06 -
20.00 -
30.00 -
40.00 -
50.00 -
60.02 -
70.00 -
80.00 -
90.00 -
100.00 -
110.02 -
120.04 -
130.06 -
14 -0.04 99.75
150.07 99
160.08 98

comment:11 Changed 5 months ago by wja

Awaiting Delivery Check

Created delivery

comment:12 Changed 5 months ago by asm

Delivery Check

Taking over this delivery check.

-Lines match nicely, well done with the FPS and SCT
-There are a lot of cloud shadow in the data, please make a note in the readme
-Also most of the bands are underflows. This has happened in the Fenix1K but here is probably worse because of clouds. Might be worth also adding that to the note in the readme.
-Py6S spectra matches, just very low for the bands under 600nm due to underflows.
-Removed symlink of sensor fenix vector files (that were present along with the fenix1K files)

All others checks have been done and everything looks good. I will start zipping the mapped files and the project should be done ready for delivery once the readme is updated.

comment:13 Changed 5 months ago by asm

Delivery Check

All files were zipped fine. Waiting for updated Readme file to mark project as ready to be delivered.

comment:14 Changed 5 months ago by wja

Updated ReadMe

Thanks for checking, I have made the updates to the ReadMe.

comment:15 Changed 5 months ago by asm

DC

Changes look good. Marked project as ready to be delivered.

comment:16 Changed 5 months ago by wja

Delivered

Placed on FTP slot 5, PI notified.

Note: See TracTickets for help on using tickets.