Changes between Version 3 and Version 4 of Procedures/HyperspectralCalibrationCreation


Ignore:
Timestamp:
Sep 21, 2015 2:30:39 PM (4 years ago)
Author:
lah
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Procedures/HyperspectralCalibrationCreation

    v3 v4  
    11= Generating calibration files for Fenix =
    22
    3 Radiometric, wavelength and miscellaneous other calibration of the Fenix is undertaken at ARSF-Ops at least annually since 2014. This page describes how to use the calibration software written by ARSF-DAN to create the necessary calibration files from the raw calibration data.
     3Radiometric, wavelength and miscellaneous other calibration of the Fenix is undertaken at ARSF-Ops at least annually since 2014. This page describes how to use the calibration software written by ARSF-DAN to create the necessary calibration files from the raw calibration data. All progress should be recorded on a trac ticket (https://arsf-dan.nerc.ac.uk/trac/newticket) and added to the list below.
     4
     52015: https://arsf-dan.nerc.ac.uk/trac/ticket/594
    46
    57== Setup ==
    68
    7 Relevant scripts are held in the arsf-internal git repository under tools/libarsfcal.
     9Relevant scripts are held in the arsf git repository under tools/libarsfcal.
    810
    911Note that the various calibration scripts written in Python expect to import a package called "libarsfcal". This means that you must have the directory above the libarsfcal directory in your PYTHONPATH environment variable for the scripts to run. So eg.
     
    4951== Wavelength calibration ==
    5052
    51 This must be run first, since the radiometric calibration requires a wavelength calibration to tie the lamp data into. Note for Eagle you may need to re-run gen_bandsets.py (see "Other scripts", below) with different settings in order to obtain bandset files for different spectral binning settings.
     53This must be run first, since the radiometric calibration requires a wavelength calibration to tie the lamp data into. Note for Eagle and Fenix you may need to re-run gen_bandsets.py (see "Other scripts", below) with different settings in order to obtain bandset files for different spectral binning settings.
    5254
    5355'''Master script:''' cal_spectral.py
     
    8486The generated wavelength scale may be checked against the lamp lines to determine the error in each matching band and it's FWHM. The output of this test is recorded in the data analysis report. Any unrealistic FWHMs and any failing bands should be removed from the calibration and the wavelength scale regenerated.
    8587
    86  '''Master script:''' calc_peak_diffs.py
     88'''Master script:''' calc_peak_diffs.py
    8789
    8890Basic usage of this requires the following arguments:
     
    9193 * -l: Spectral lines file.
    9294
     95When you have created the final wavelength scale that passes the lamp line test, record the parameters on the ticket, especially the data set (day), sample_hdr_file and linefile from the config file and any optional parameters used with cal_spectral.py. Also record the final anchors and check that the VNIR and SWIR starting wavelengths are realistic. These may not match up with the anchors, depending on which sample header is used, as the previous calibration wavelengths are not currently set in the raw data files.
     96
    9397== Radiometric calibration ==
    9498
    9599This can either be run after the wavelength calibration in order to obtain a cal using an up-to-date wavelength calibration, or it can be run using an old wavelength calibration.
    96100
    97  '''Master script:''' cal_radiometric.py
     101'''Master script:''' cal_radiometric.py
    98102
    99103Basic usage of this requires only the name of the config file as an argument. You may also want to use the following arguments:
     
    119123
    120124There are scripts to generate analysis graphs and files under libarsfcal/analysis. These should be run on the calibration output, please add to them if you think of more tests.
     125
     126== Data quality report ==
     127
     128The data quality report must be updated for each calibration using the outputs produced by calc_peak_diffs.py and comparison.py.