Version 35 (modified by benj, 14 years ago) (diff)


ARSF Scripts and Binaries

Please keep this page updated. Also please keep it sorted in a sensible order or we're never going to be able to find anything...


Script Language Use bash Runs classify_las on a set of LAS files using a specified classification algorithm bash Checks the ASCII LiDAR files in the delivery for erroneous data Python Creates a Readme for lidar deliveries bash Convert a directory of LAS files or a single LAS file into ascii format bash Merges sets of LAS files of the form *_000.LAS, *_001.LAS... etc. together bash Generates an azgcorr-format ASCII DEM from old Optech lidar point cloud files bash Create a LiDAR delivery folder bash Create a lidar dem or intensity image from ascii lidar files
LASsorter Python sorts Las files by time, x, y, z , ascending and descending Python Reads old Optech LiDAR files and outputs a numeric histogram for use in filtering
classify_las Binary (C) LiDAR classification
lag Binary (C) LiDAR file viewer
pt_cloud_filter Binary (C) Removes points of a specified classification from ascii lidar point cloud


Script Language Use bash Determines lat/lon for flight from Eagle/Hawk header files bash Determines BNG grid squares for flight from Eagle/Hawk header files bash Script to use IGM files to generate a GLT file and map level 1 data bash Creates a hyperspectral delivery folder bash Script to convert GeoTIFFs into JPGs and create a mosaic image (with vectors) Python Get the North/South/East/West extent of a number of hdr files in bng coords Python Test specified Eagle/Hawk framerates against actual framerates calculated from qpfTiming Python Create a LaTeX file for a PDF Readme for Hyperspectral deliveries Python Truncates BIL files so that the file size matches what the header file says it should Python Auto-renames (line numbers and removes sct section) level 1, level 3, screenshots for a delivery. Python Generates config files for hyperspectral data processing Python Generates a synthetic Eagle or Hawk dataset Python Generates a synthetic SBET file Python Extracts boresight values for given day from data file Python Extracts calibration file names for given day from data file Python Gets North/South/East/West extent of (part of) an SBET file in lat/lon
getposition Python Gets position information at from an SBET file for a specified time (or file limits) Python Finds sync records on one or more AISA nav files Python Outputs mean altitude, heading and speed from an SBET file for a number of Eagle or Hawk lines Python Checks which of a selection of Eagle/Hawk header files have compatible binning, framerate and integration time settings Python Merges a .cfg and a .sync (eagle/hawk line sct offsets) Python Runs az suite on specified Eagle/Hawk flightline for processing Python Cuts a chunk of an AISA nav file out into a smaller nav file Python Submits an ARSF project for processing through the grid engine
fastQC Binary (C) Program for viewing BIL files (raw data or level 1)
nav2txt Binary (C) Output contents of an AISA nav file to an ASCII text file


Script Language Use bash Creates a Photograph delivery folder bash Converts RCD TIF files to JPG thumbnails Python Creates a LaTeX file for generating a PDF read_me for delivery
image_events_file_fixer Python Corrects image event files, mainly by using a sol/sbet file to correct position accuracy
rename_photos_update_events_file Python generates new file names for tiffs and their entries in the image events file
tag_tiffs Python Adds tags to tiff files (using image event files) which define position, attitude and other metadata


Script Language Use bash Converts dems from grass format header to az header bash Converts dems from az format header to grass header bash Convert GML Vector files to Shapefiles bash Converts specified lat/lon into BNG co-ordinates (wrapper around appropriate proj command) bash Symlinks all files in a source directory into a target directory Python uses grass to produce tiff images of vectors
az_log_cleaner Python Removes normal output from az logs to leave only important messages Python Converts binary files from one data type to another (eg. Float32 -> Int16) Python Converts BNG numeric grid references to OS grid square co-ordinates Python Reads eagle or hawk header files and SBET file to generate a list of the DEM tiles that the SBET covers Python Converts .doc or .odt files to PDF format Python Finds linux-unfriendly characters in filenames
gpstime Python Converts GPS time-of-week to human-readable format and vice-versa Python Creates a config file for hyperspectral and camera read_me generators Python Lists contents of an HDF file to the terminal
hdf_to_bil Python converts hdf files to bil files Python Sets defined bad pixels in a BIL or BSQ file to be a mask value
ppv_to_envi_igm Python converts a ppv file (whatever those are) to an igm file and creates a envi header file for it Python Searches E/H headers and gets start/stop times for importing into Grafnav to show on trajectory Python Extracts date from Trimble GPS format file names
teqc Binary (third-party) Program for slicing/splicing/fiddling with RINEX or other GPS base station data (like raw data)

Libraries Python Functions to convert numbers to letters and back (A=1, B=2 etc) Python Reads AISA band (.prn) files Python Sorts config files into sensible order (can also be executed directly) Python Reads/writes BIL and BSQ files Python Converts GPS time-of-week to human-readable format and vice-versa Python Gets mean altitude, heading and speed from an SBET file for a number of Eagle or Hawk lines Python Functions to manipulate SBET files, also limited AISA nav file support


Script Language Use bash Create an ASCII Read-me for camera deliveries Python Part of old processing job submission system Python Create a Readme for Hyperspectral deliveries Python Part of old processing job submission system Python Convert GeoTIFFs to JPEGs Python Gets summary information about an SBET file - superseded by getposition

Note: See also Python resources/libraries on main RSG wiki at