ARSF Scripts and Binaries

Please keep this page updated. Also please keep it sorted in a sensible order or we're never going to be able to find anything...

LiDAR

Script	Language	Use
check_ascii_lidar.sh	bash	Checks the ASCII LiDAR files in the delivery for erroneous data
classify_las	Binary (C)	LiDAR classification
classify_las_files.sh	bash	Runs classify_las on a set of LAS files using a specified classification algorithm
create_lidar_readme.py	Python	Creates a Readme for lidar deliveries
lag	Binary (C)	LiDAR file viewer
las2txt.sh	bash	Convert a directory of LAS files or a single LAS file into ascii format
las_merge.sh	bash	Merges sets of LAS files of the form *_000.LAS, *_001.LAS... etc. together
LASsorter	Python	sorts Las files by time, x, y, z , ascending and descending
lidar2dem.sh	bash	Generates an azgcorr-format ASCII DEM from old Optech lidar point cloud files
lidar_histogram.py	Python	Reads old Optech LiDAR files and outputs a numeric histogram for use in filtering
make_lidar_delivery.sh	bash	Create a LiDAR delivery folder
make_lidardem_or_intensity.sh	bash	Create a lidar dem or intensity image from ascii lidar files
pt_cloud_filter	Binary (C)	Removes points of a specified classification from ascii lidar point cloud

Hyperspectral

Script	Language	Use
getlatlong.sh	bash	Determines lat/lon for flight from Eagle/Hawk header files
gettiles.sh	bash	Determines BNG grid squares for flight from Eagle/Hawk header files
igm2map.sh	bash	Script to use IGM files to generate a GLT file and map level 1 data
make_delivery_folder.sh	bash	Creates a hyperspectral delivery folder
make_mosaic.sh	bash	Script to convert GeoTIFFs into JPGs and create a mosaic image (with vectors)
bounding_box.py	Python	Get the North/South/East/West extent of a number of hdr files in bng coords
check_qpftiming.py	Python	Test specified Eagle/Hawk framerates against actual framerates calculated from qpfTiming
create_latex_hyperspectral_readme.py	Python	Create a LaTeX file for a PDF Readme for Hyperspectral deliveries
dimfixer.py	Python	Truncates BIL files so that the file size matches what the header file says it should
fastQC	Binary (C)	Program for viewing BIL files (raw data or level 1)
fixnamesl13.py	Python	Auto-renames (line numbers and removes sct section) level 1, level 3, screenshots for a delivery.
generate_runscripts.py	Python	Generates config files for hyperspectral data processing
gen_synth_raw.py	Python	Generates a synthetic Eagle or Hawk dataset
gen_synth_sbet.py	Python	Generates a synthetic SBET file
get_boresight_vals.py	Python	Extracts boresight values for given day from data file
get_calib_vals.py	Python	Extracts calibration file names for given day from data file
get_sbet_bounds.py	Python	Gets North/South/East/West extent of (part of) an SBET file in lat/lon
getposition	Python	Gets position information at from an SBET file for a specified time (or file limits)
getsync.py	Python	Finds sync records on one or more AISA nav files
logwriter.py	Python	Outputs mean altitude, heading and speed from an SBET file for a number of Eagle or Hawk lines
match_dark_frames.py	Python	Checks which of a selection of Eagle/Hawk header files have compatible binning, framerate and integration time settings
mergeCFSync.py	Python	Merges a .cfg and a .sync (eagle/hawk line sct offsets)
nav2txt	Binary (C)	Output contents of an AISA nav file to an ASCII text file
process_specim_line.py	Python	Runs az suite on specified Eagle/Hawk flightline for processing
slice_nav.py	Python	Cuts a chunk of an AISA nav file out into a smaller nav file
specim_gap_check.py	Python	Searches Eagle/Hawk raw files for dropped frames by looking at the band 1 frame counter
specim_qsub.py	Python	Submits an ARSF project for processing through the grid engine

Camera

Script	Language	Use
create_latex_camera_readme.py	Python	Creates a LaTeX file for generating a PDF read_me for delivery
image_events_file_fixer	Python	Corrects image event files, mainly by using a sol/sbet file to correct position accuracy
make_delivery_folder.sh	bash	Creates a Photograph delivery folder
photo2thumb.sh	bash	Converts RCD TIF files to JPG thumbnails
rename_photos_update_events_file	Python	generates new file names for tiffs and their entries in the image events file
tag_tiffs	Python	Adds tags to tiff files (using image event files) which define position, attitude and other metadata

General

Script	Language	Use
auto_grass_vector_tiff_conversion_driver.sh	Python	uses grass to produce tiff images of vectors
az_log_cleaner	Python	Removes normal output from az logs to leave only important messages
binary_converter.py	Python	Converts binary files from one data type to another (eg. Float32 -> Int16)
bnglookup.py	Python	Converts BNG numeric grid references to OS grid square co-ordinates
demgen.py	Python	Reads eagle or hawk header files and SBET file to generate a list of the DEM tiles that the SBET covers
demhdr_az2grass.sh	bash	Converts dems from az format header to grass header
demheaderconvert.sh	bash	Converts dems from grass format header to az header
doc2pdf.py	Python	Converts .doc or .odt files to PDF format
fix_naughty_chars.py	Python	Finds linux-unfriendly characters in filenames
generate_readme_config.py	Python	Creates a config file for hyperspectral and camera read_me generators
GML2Shape.sh	bash	Convert GML Vector files to Shapefiles
gpstime	Python	Converts GPS time-of-week to human-readable format and vice-versa
hdf_output.py	Python	Lists contents of an HDF file to the terminal
hdf_to_bil	Python	converts hdf files to bil files
ll2bng.sh	bash	Converts specified lat/lon into BNG co-ordinates (wrapper around appropriate proj command)
mask_bad_pixels.py	Python	Sets defined bad pixels in a BIL or BSQ file to be a mask value
ppv_to_envi_igm	Python	converts a ppv file (whatever those are) to an igm file and creates a envi header file for it
symlink_src_dir.sh	bash	Symlinks all files in a source directory into a target directory
teqc	Binary (third-party)	Program for slicing/splicing/fiddling with RINEX or other GPS base station data (like raw data)
times4grafnav.py	Python	Searches E/H headers and gets start/stop times for importing into Grafnav to show on trajectory
trmdatefinder.py	Python	Extracts date from Trimble GPS format file names

Libraries

alphaconv.py	Python	Functions to convert numbers to letters and back (A=1, B=2 etc)
band_reader.py	Python	Reads AISA band (.prn) files
configSorter.py	Python	Sorts config files into sensible order (can also be executed directly)
data_handler.py	Python	Reads/writes BIL and BSQ files
libgpstime.py	Python	Converts GPS time-of-week to human-readable format and vice-versa
liblogwriter.py	Python	Gets mean altitude, heading and speed from an SBET file for a number of Eagle or Hawk lines
sbet_handler.py	Python	Functions to manipulate SBET files, also limited AISA nav file support

Obsolete

Script	Language	Use
arsf_processing_monitor.py	Python	Part of old processing job submission system
gtiff2jpg.py	Python	Convert GeoTIFFs to JPEGs

Note: See also Python resources/libraries on main RSG wiki at ​http://rsg.pml.ac.uk/intranet/trac/wiki/Python