Opened 6 months ago

Last modified 5 months ago

#729 new flight processing

FIDEXII/23, flight day 224/2023, Canada

Reported by: asm Owned by:
Priority: immediate Milestone:
Component: Processing: general Keywords:
Cc: Other processors:

Description

Data location: /users/rsg/arsf/arsf_data/2023/flight_data/canada/FIDEXII-2023_224_Canada

Data arrived from NERC-ARF via hard drive September/October 2023
PI: Martin Wooster
Sensors:
Fenix1k
IBIS
OWL (priority)
PhaseOne

Change History (10)

comment:1 Changed 6 months ago by asm

General notes

All data has been unpacked. There was one ibis lines with no hdr that can't be processed and have been moved to another directory under "sif" to not cause problems.

Please note that OWL is the only priority data requested for this flight.

comment:2 Changed 6 months ago by asm

OWL

There were some problems with the grid to create the level1b data but the files are now mapped and I am creating a delivery.

comment:3 Changed 6 months ago by asm

IBIS

Flightline number 8 had an incorrect GPS stop point recorded so entered manually {51.136181, -87.058266} to be able to create a logsheet.

comment:4 Changed 5 months ago by asm

Owl

Delivery completed, ready for Delivery check.

comment:5 Changed 5 months ago by wja

Owl Delivery Check

Starting

comment:6 Changed 5 months ago by wja

Owl Processing

Heading boresight was incorrect in operational config. Have updated this and am remapping the flightlines.

Bash code to get the level1b files back to where they would be before the APL steps below:

# run from processing/owl/flightlines/level1b
for line in $(seq 1 25)
do
  printf -v lineid "%02d" $line
  ln -s /users/rsg/arsf/arsf_data/2023/flight_data/canada/FIDEXII-2023_224_Canada/processing/delivery/FIDEXII_23-224-owl-20240529/flightlines/level1b/o224${lineid}1b.bil* OWL224-23-${line}/
done
for line in $(seq 1 25)
do
  printf -v id "%02d" $line
  lineid=OWL224-23-${line}
  cd /users/rsg/arsf/arsf_data/2023/flight_data/canada/FIDEXII-2023_224_Canada/processing/owl/flightlines/level1b/${lineid}
  src=o224${id}1b.bil
  dst=OWL224-23-${line}_proc.bil
  rename.sh ${src} ${dst}
  rename.sh bil.hdr hdr
done
Last edited 5 months ago by wja (previous) (diff)

comment:7 Changed 5 months ago by wja

Owl Processing

Owl nav and mapped files have been reprocessed with correct boresight. Have also updated line info XMLs. Mapping looks much better.

Also remade logsheet with a clearer overview image.

Bands are very "flat" when looking with fastQC.

Test apl commands ran fine.

Zipping mapped files.

comment:8 Changed 5 months ago by wja

Owl Processing

Am not zipping mapped files yet. Line 4 needs remapping. Geocorrection looks good for all the other lines.

Once this is reprocessed and mapped files are zipped this can be delivered.

comment:9 Changed 5 months ago by wja

Owl Processing

Zipped mapped, marked ready to deliver.

One file got "stuck" whilst zipping, line 20. Am doing this locally and then will hardlink to the FTP.

comment:10 Changed 5 months ago by wja

Owl Delivered

Delivered via FTP slot 5 31/05/24.

Note: See TracTickets for help on using tickets.