Version 4 (modified by anee, 16 years ago) (diff)

--

Removing bad scans from ATM lines

  • Replace the azatm section of your script (for lines containing bad scan lines) with the two azatm commands below and run the script.
    • azatm -v -eds -1 -sNO -NOCAL -v -tc 0 -i atm/${ATM_PREFIX}${ATM_FILE_NO}.* -h ${LEV1_HDF} \
    • azatm -v -bbtt 5 3 0.02 1 -bbf 7 7 -sNO -h ${LEV1_HDF} -cal ${CALIBRATION_FILE} \
  • Convert each raw ATM hdf file containing bad scan lines into bil files with headers by running azexhdf -h <hdf_filename.hdf> -Be <bil_filename.bil> (note: you may wish to place the bil files into their own directory as if they are in the same dir as the hdf files, envi gets confused when opening the hdfs and displays garbage).
  • Once the bil files have been created, run atm_bad_scans.py -f <filename> -t <pixel_threshold> -m <multiple> -b <bands>.
    • -f file to scan
    • -t number of pixels which have to be bad for a line to be considered bad
    • -m if a pixel in the current line is -m times larger or smaller than a pixel in previous the line it is considered bad

This will read band 7 of all the bil files and returns all the bad scan lines it finds (and writes these into a txt file with the same name as the bil file for easy copy and paste into the scripts). Currently these are just lines which contain significant numbers of 0 values or complete lines of high values. Other, harder to detect bad scans may exist so it is worth keeping an eye out for these.

  • Copy the bad scan line numbers from the txt files into the corresponding scripts after the -eds option. The lines numbers entered into the scripts will be marked as bad in the hdfs after running the scripts. These will still be visible when viewing the hdfs but will not be present in the level 3 GeoTIFFs.
  • Rerun the processing and manually view the lev1/lev3, looking out for slipped scans (line starts late and is offset) or white streaks. Find the line number of these in ENVI using the cursor location (subtract 1 from the Y value as azatm counts from 0 and ENVI counts from 1) and add these line numbers to the -eds part of the azatm command, then rerun and repeat.