Opened 9 years ago

Closed 8 years ago

Last modified 4 years ago

#600 closed flight processing (fixed)

EUFAR15/58, flight day 247a/2015, Holuhraun

Reported by: asm Owned by:
Priority: immediate Milestone: 2015 data processing completion
Component: Processing: general Keywords:
Cc: Other processors:

Description (last modified by dac)

Data location: ~arsf/arsf_data/2015/flight_data/iceland/EUFARIS15_58-2015_247a_Holuhraun

Project acronym: HOLUHRAUN_HAZ

Data arrived from ARSF via SATA disk 8 on 28/09/2015.

Priority: Unknown

PI: Hoskuldsso N. Armann

EUFAR code: E058

Sensors:

  • Fenix (requested)
  • Owl (requested)
  • Leica LIDAR (requested)
  • LIDAR Full-waveform (requested)
  • RCD (requested)

Change History (50)

comment:1 Changed 9 years ago by asm

  • Summary changed from UFAR15/58, flight day 247a/2015, Holuhraun to EUFAR15/58, flight day 247a/2015, Holuhraun

comment:2 Changed 9 years ago by dac

  • Description modified (diff)

comment:3 Changed 9 years ago by asm

General Processing

-Logsheet generated. Flightlines from 247b were present on the overview and has been removed.
-Engine times are approximate.

Last edited 9 years ago by asm (previous) (diff)

comment:4 Changed 9 years ago by asm

General Processing
Notification of ARSF data arrival has been sent to PI.

comment:5 Changed 9 years ago by asm

Navigation Processing

Started.

comment:6 Changed 9 years ago by asm

Navigation Processing

Basestation verification has been done using data downloaded for REYK via Ipas TC. Navigation has been also done. Finished.

comment:7 Changed 9 years ago by asm

General processing

Fenix flightline number 01 has been moved from main directory since it is not on logsheet and it is part of a different project.

comment:8 Changed 9 years ago by dac

RCD

Converted raw images to tifs. Will wait until basestation data is available before proceeding.

comment:9 Changed 9 years ago by dac

Fenix

The instrument was left on during transit to this site resulting in a really long line covering half of Iceland - this doesn't need to be processed and had already been moved to a separate folder.

comment:10 Changed 9 years ago by dac

Marking as blocked - still waiting on GPS data from IMO.

comment:11 Changed 9 years ago by asm

Navigation reprocessed with GPS data provided by Icelandic Met-office.

Basestation verification for THOC:
Latitude 64 56 01.37422
Lon -16 40 32.10833
Ell Height 750.030
Ant Height 0.086

Which corresponds on decimal degrees to the values sent by Met-office: (-16.67558569, 64.93371501) 749.99002177

Basestation verification for URHC:
Latitude 64 49 13.30388
Lon -17 08 49.76145
Ell Height 1079.660
Ant Height 0.086
Also match data recieved: (-17.14715560, 64.82036197), 1079.65299888

Best solution, only using URHC. Will copy files and have renamed old basestation and ipas_honeywell to old_nav_basestation (Please clean after processing, before archiving).

comment:12 Changed 9 years ago by gej

Fenix Processing

Have found SCT values of 1.00 for all lines
Due to a low fenix signal during acquisition the data is quite noisy on some bands.

Have mapped files and started creating delivery.

comment:13 Changed 9 years ago by gej

Fenix Processing

Delivery and readme created

Ready for Delivery check

comment:14 Changed 9 years ago by dac

Fenix Delivery Check

Starting delivery check.

comment:15 Changed 9 years ago by dac

Fenix Delivery Check

Apart from the low signal of the data, which is noted in readme look fine. A couple of minor things which have been fixed (see below). Zipping mapped files and marking as ready for delivery.

  • Updated readme text from "Due to a low fenix signal during acquisition there may be some noise in the data." to "The signal was low for this flight due to the low solar angle during acquisition and there is noticeable noise in some lines"
  • Needed to remove fodis directory.
  • Removed .aux.xml files from mapped directory.
  • There are a couple of data gaps in the ASTER DEM - nothing needed on this but thought it worth mentioning in the ticket.
  • Not sure why we include a link to NextMap data for the UK in the readme - not really appropriate for Iceland (template should be changed at some stage.)

comment:16 Changed 9 years ago by dac

Fenix Delivery

Delivered via FTP (arsf11) 11/02/2016

comment:17 Changed 9 years ago by lah

Lidar Processing

Found pitch and roll (forgot to save on ticket last week). Not many features to get offsets, but looks ok for all lines:

pitch: -0.00245
roll: -0.00101

Line 5 has a big cloud intersecting the data and has manually been classified.

No lidar full waveform with this data, so making a discrete delivery.

comment:18 Changed 9 years ago by lah

Lidar

Reprocessing with all returns. Boresight reg file fail :(

comment:19 Changed 9 years ago by lah

Lidar Processing

Reclassified new data. Many small clouds in lines 3 and 5 as well as the large cloud that I've tried to classify.

Creating new delivery.

comment:20 Changed 9 years ago by lah

Lidar ready for DC

comment:21 Changed 9 years ago by lah

Lidar DC
Checked for vertical offset compared to 244b and all looks fine. Dem differences might be real.

comment:22 Changed 9 years ago by asm

Lidar Delivery Check.

Started.
-Changed from las1.0 to las1.2
-I suggest to include on readme that full wave form is not included even because they requested and it was not recorded.
-Checked dem with lah, I think the difference is caused by changes on terrain (lava).

comment:23 Changed 9 years ago by asm

Lidar Delivery Check.

-Pitch and roll errors look fine.
-Last page on logsheet is not needed.
-Can't check demcompare, gej having a look.
All other details look fine apart from adding a note about full wave form on readme. Will check demcompare when possible and if everything is fine, mark it as ready to deliver.

comment:24 Changed 9 years ago by stgo

Lidar Delvery Check

Full demcompare output:

Difference statistics:
Min: -512.77782421875
Max: 377.333358398437
Sum: -2739544.92586114
Mean: -0.57744287864332
Median: -0.111084
Absolute mean: 2.1359187257574
Std deviation: 5.75530107453806
Total cells: 5121038
Non-null cells: 4744270

comment:25 Changed 9 years ago by asm

Lidar Delivery Check.

All checks done. Only needs to add a note on readme about full wave not included and will be ready to go.

comment:26 Changed 9 years ago by lah

Lidar

Added FW note to readme directly after delivery contents table.

comment:27 Changed 9 years ago by asm

Lidar

Checked note on readme: Please note that there are no LAS 1.3 files contained in the delivery as no full waveform lidar was recorded for this flight.

Ready to deliver.

comment:28 Changed 9 years ago by asm

Lidar

Classification is finally finished. Needed lot of work both running locally and manually due to clouds and low returns. Will create delivery.

Version 0, edited 9 years ago by asm (next)

comment:29 Changed 9 years ago by dac

LiDAR Delivery

Delivered via FTP (arsf11) 25/02/2016

comment:30 follow-up: Changed 9 years ago by dac

RCD

Created thumbnails from images. A lot of expected images are missing and the last few are just black. Nothing in logsheet about problems with RCD.

comment:31 in reply to: ↑ 30 Changed 9 years ago by lah

Replying to dac:

RCD

Created thumbnails from images. A lot of expected images are missing and the last few are just black. Nothing in logsheet about problems with RCD.

I believe the images you're missing are in 247b...

comment:32 Changed 9 years ago by dac

RCD Processing

Missing images were part of 247b but listed in events file. Removed these from event file before tagging images.

Created delivery and ready for delivery check.

comment:33 Changed 9 years ago by gej

RCD Delivery check
Images 194-208 look like the shutter may have been closed, and there is no tagging info for them. Should be removed from delivery. Just need to remove from photographs and thumbnails folders and then regenerate readme as they are mentioned as not able to be GPS tagged.

Everything else looks okay, so once them files have been removed will be ready to deliver.

comment:34 Changed 9 years ago by dac

RCD

Removed images 194 - 208 and updated Readme.

Marking as ready to delivery.

comment:35 Changed 9 years ago by dac

RCD

Copied to arsf11 on FTP server - will send notification with 244b LiDAR.

comment:36 Changed 9 years ago by dac

RCD Delivery

Sent notification with LiDAR data. Also copied to hard drive and passed on to Ingibjörg Jónsdóttir at ARSF workshop

comment:38 Changed 9 years ago by lah

Archiving

Owl raw data is wrongly renamed, so needs redoing.

comment:39 Changed 8 years ago by lah

Archiving

Raw data uploaded to NEODC 25/5/16

comment:40 Changed 8 years ago by asm

  • Resolution set to fixed
  • Status changed from new to closed

Archiving

Data now available from NEODC. Closing ticket.

comment:41 Changed 7 years ago by dac

*Owl Processing*

Changed header files:

  • Fixed GPS start time in header to be UTC/GMT rather than BST
  • Added GPS end time calculated using start time + (lines / framerate)

comment:42 Changed 7 years ago by dac

Owl Processing

Data calibrated and delivery containing unmapped data (level 1b) created for PI to evaluate data.

comment:43 Changed 7 years ago by dac

Owl Processing

Sample lines sent to PI via FTP (slot 14)

comment:44 Changed 4 years ago by wja

Owl Processing

Processing Owl data to level 3. SCT values appear to be around ~-300 seconds.

comment:45 Changed 4 years ago by wja

Owl Processing

Timings recorded in Owl data headers are incorrect, resulting in the considerably large SCT values.

The start and end times of Owl flightline 8 have been changed from 17:58:19 - 18:01:20 to 17:54:17 - 17:57:18 (to match the Fenix times).

Owl SCT Values

Flightline|SCT
1-372.0
2-372.3
3-315.8
4-363.0
5-327.4
6-288.0
7-357.0
852.5

Processing in slow mode with all bands and creating delivery

comment:46 Changed 4 years ago by wja

Delivery ready for checking
The OWL serial number in the RAW headers are out of date. I have had to change these from 920014 to 920013 (and have made copies of the originals).

Delivery created, ready for checking.

comment:47 Changed 4 years ago by dac

Delivery Check

  • Readme has table with lines in logsheet but no corresponding flight lines. If they are the same then easier to just remove this table.
  • Commands in readme use dem/EUFAR15_58-2015_247a-ASTER_larger.dem for DEM name but this isn't the same as what is supplied in delivery (modified config to get check_apl_cmd to run).
  • Remove Seb from contact list
  • Alignment between lines is good, also checked location against Google Satellite data in QGIS.

Once readme is fixed files can be zipped ready to be sent.

comment:48 Changed 4 years ago by wja

Delivery Check
Amendments have been made to the ReadMe.

comment:49 Changed 4 years ago by wja

Delivery on FTP
Delivery has been places on FTP slot 2 and finalised.

PI has not yet been notified.

comment:50 Changed 4 years ago by wja

Delivery Sent

PI has been notified of FTP location via e-mail.

Note: See TracTickets for help on using tickets.