ARSF Scripts and Binaries
Please keep this page updated. Also please keep it sorted in a sensible order or we're never going to be able to find anything...
LiDAR
| Script | Language | Use
|
| alspp.exe | bash | Runs wine version of ALSPP
|
| arsf_winesetup.sh | bash | Configure wine environment for ARSF users
|
| attune | bash | Runs wine version of Attune (boresight calibration)
|
| check_ascii_lidar.sh | bash | Checks the ASCII LiDAR files in the delivery for erroneous data
|
| classify_las | Binary (C) | LiDAR classification
|
| classify_las_files.sh | bash | Runs classify_las on a set of LAS files using a specified classification algorithm
|
| create_lidar_readme.py | Python | Creates a Readme for lidar deliveries
|
| fugroviewer.exe | bash | Runs wine version of Fugroviewer
|
| lag | Binary (C++) | LiDAR file viewer
|
| las2txt.sh | bash | Convert a directory of LAS files or a single LAS file into ascii format
|
| las_merge.sh | bash | Merges sets of LAS files of the form *_000.LAS, *_001.LAS... etc. together
|
| LASsorter | Python | sorts Las files by time, x, y, z , ascending and descending
|
| leica_photo_processing | bash | Runs wine version of Leica's photo processor
|
| lidar2dem.sh | bash | Generates an azgcorr-format ASCII DEM from old Optech lidar point cloud files
|
| lidar_histogram.py | Python | Reads old Optech LiDAR files and outputs a numeric histogram for use in filtering
|
| make_lidar_delivery.sh | bash | Create a LiDAR delivery folder
|
| make_lidardem_or_intensity.sh | bash | Create a lidar dem or intensity image from ascii lidar files
|
| pt_cloud_filter | Binary (C) | Removes points of a specified classification from ascii lidar point cloud
|
Hyperspectral
| Script | Language | Use
|
| getlatlong.sh | bash | Determines lat/lon for flight from Eagle/Hawk header files
|
| gettiles.sh | bash | Determines BNG grid squares for flight from Eagle/Hawk header files
|
| igm2map.sh | bash | Script to use IGM files to generate a GLT file and map level 1 data
|
| make_delivery_folder.sh | bash | Creates a hyperspectral delivery folder
|
| make_mosaic.sh | bash | Script to convert GeoTIFFs into JPGs and create a mosaic image (with vectors)
|
| bounding_box.py | Python | Get the North/South/East/West extent of a number of hdr files in bng coords
|
| check_qpftiming.py | Python | Test specified Eagle/Hawk framerates against actual framerates calculated from qpfTiming
|
| create_latex_hyperspectral_readme.py | Python | Create a LaTeX file for a PDF Readme for Hyperspectral deliveries
|
| dimfixer.py | Python | Truncates BIL files so that the file size matches what the header file says it should
|
| fastQC | Binary (C) | Program for viewing BIL files (raw data or level 1)
|
| fixnamesl13.py | Python | Auto-renames (line numbers and removes sct section) level 1, level 3, screenshots for a delivery.
|
| generate_runscripts.py | Python | Generates config files for hyperspectral data processing
|
| gen_synth_raw.py | Python | Generates a synthetic Eagle or Hawk dataset
|
| gen_synth_sbet.py | Python | Generates a synthetic SBET file
|
| get_boresight_vals.py | Python | Extracts boresight values for given day from data file
|
| get_calib_vals.py | Python | Extracts calibration file names for given day from data file
|
| get_sbet_bounds.py | Python | Gets North/South/East/West extent of (part of) an SBET file in lat/lon
|
| getposition | Python | Gets position information at from an SBET file for a specified time (or file limits)
|
| getsync.py | Python | Finds sync records on one or more AISA nav files
|
| hdr_fps_check.py | Python | Checks if a Specim file has a mismatch between recorded and actual frame rate (Hawk problem)
|
| logwriter.py | Python | Outputs mean altitude, heading and speed from an SBET file for a number of Eagle or Hawk lines
|
| match_dark_frames.py | Python | Checks which of a selection of Eagle/Hawk header files have compatible binning, framerate and integration time settings
|
| mergeCFSync.py | Python | Merges a .cfg and a .sync (eagle/hawk line sct offsets)
|
| nav2txt | Binary (C) | Output contents of an AISA nav file to an ASCII text file
|
| ppv_to_envi_igm.py | Python | Converts azgcorr's ppv (per-pixel view vector) output to an ENVI IGM
|
| process_specim_line.py | Python | Runs az suite on specified Eagle/Hawk flightline for processing
|
| slice_nav.py | Python | Cuts a chunk of an AISA nav file out into a smaller nav file
|
| specim_gap_check.py | Python | Searches Eagle/Hawk raw files for dropped frames by looking at the band 1 frame counter
|
| specim_qsub.py | Python | Submits an ARSF project for processing through the grid engine
|
Camera
| Script | Language | Use
|
| create_latex_camera_readme.py | Python | Creates a LaTeX file for generating a PDF read_me for delivery
|
| image_events_file_fixer | Python | Corrects image event files, mainly by using a sol/sbet file to correct position accuracy
|
| make_delivery_folder.sh | bash | Creates a Photograph delivery folder
|
| photo2thumb.sh | bash | Converts RCD TIF files to JPG thumbnails
|
| rename_photos_update_events_file | Python | generates new file names for tiffs and their entries in the image events file
|
| tag_tiffs | Python | Adds tags to tiff files (using image event files) which define position, attitude and other metadata
|
General
| Script | Language | Use
|
| atcor | bash | Runs ATCOR-4
|
| auto_grass_vector_tiff_conversion_driver.sh | Python | uses grass to produce tiff images of vectors
|
| binary_converter.py | Python | Converts binary files from one data type to another (eg. Float32 -> Int16)
|
| bnglookup.py | Python | Converts BNG numeric grid references to OS grid square co-ordinates
|
| demgen.py | Python | Reads eagle or hawk header files and SBET file to generate a list of the DEM tiles that the SBET covers
|
| demhdr_az2grass.sh | bash | Converts dems from az format header to grass header
|
| demheaderconvert.sh | bash | Converts dems from grass format header to az header
|
| doc2pdf.py | Python | Converts .doc or .odt files to PDF format
|
| fastcopy_arsf_proj_dir.sh | bash | Script to make a workspace copy of a project directory (ie. avoid copying raw files, etc)
|
| fix_naughty_chars.py | Python | Finds linux-unfriendly characters in filenames
|
| generate_readme_config.py | Python | Creates a config file for hyperspectral and camera read_me generators
|
| GML2Shape.sh | bash | Convert GML Vector files to Shapefiles
|
| gpstime | Python | Converts GPS time-of-week to human-readable format and vice-versa
|
| hdf_output.py | Python | Lists contents of an HDF file to the terminal
|
| hdf_to_bil | Python | converts hdf files to bil files
|
| ll2bng.sh | bash | Converts specified lat/lon into BNG co-ordinates (wrapper around appropriate proj command)
|
| mask_bad_pixels.py | Python | Sets defined bad pixels in a BIL or BSQ file to be a mask value
|
| ppv_to_envi_igm | Python | converts a ppv file (whatever those are) to an igm file and creates a envi header file for it
|
| symlink_src_dir.sh | bash | Symlinks all files in a source directory into a target directory
|
| teqc | Binary (third-party) | Program for slicing/splicing/fiddling with RINEX or other GPS base station data (like raw data)
|
| times4grafnav.py | Python | Searches E/H headers and gets start/stop times for importing into Grafnav to show on trajectory
|
| trmdatefinder.py | Python | Extracts date from Trimble GPS format file names
|
Libraries
| Script | Language | Use
|
| alphaconv.py | Python | Functions to convert numbers to letters and back (A=1, B=2 etc)
|
| band_reader.py | Python | Reads AISA band (.prn) files
|
| configSorter.py | Python | Sorts config files into sensible order (can also be executed directly)
|
| data_handler.py | Python | Reads/writes BIL and BSQ files
|
| libgpstime.py | Python | Converts GPS time-of-week to human-readable format and vice-versa
|
| liblogwriter.py | Python | Gets mean altitude, heading and speed from an SBET file for a number of Eagle or Hawk lines
|
| sbet_handler.py | Python | Functions to manipulate SBET files, also limited AISA nav file support
|
Obsolete
| Script | Language | Use
|
| arsf_processing_monitor.py | Python | Part of old processing job submission system
|
| az_log_parser.py | Python | Parse output from az* programs to remove cruft - not kept up to date with newer versions and possibly too ambitious
|
| gtiff2jpg.py | Python | Convert GeoTIFFs to JPEGs
|
If it's obsolete and been replaced by something newer / better, delete the obsoleted one. If we don't have a replacement, it may be worth keeping around but remember the cost in confusion.
Unknown
| Script | Language | Use
|
| atm_bad_scans.py | Python |
|
| auto_grass_vector_tiff_conversion_control_script.grass | ASCII English text |
|
| casefixer.py | Python |
|
| combined_band_mask.py | symbolic link to `/users/rsg/arsf/code/mask_creation/combined_band_mask.py' |
|
| common_readme_functions.py | ASCII Java program text |
|
| configSorter | symbolic link to `/users/rsg/arsf/usr/lib/python/site-packages/configSorter.py' |
|
| create_latex_lidar_readme.py | Python |
|
| delivery_prep_2006.sh | bash |
|
| freelook | bash | Runs ENVI Freelook
|
| generate_mask.py | Python |
|
| generate_mask.sh | bash |
|
| get_first_return.sh | bash |
|
| hdf_to_bil.py | Python |
|
| igm2map.pro | ASCII English text |
|
| image_events_file_fixer.py | Python |
|
| import_ldr_txt_to_grass.sh | ASCII English text |
|
| kmlise_project.py | Python |
|
| kml_line_photosorter.py | Python |
|
| kqsub | bash |
|
| lagf12 | bash |
|
| las_hdr_pop.py | Python |
|
| las_sampler.py | Python |
|
| las_single_class.py | Python |
|
| LASsorter.py | Python |
|
| lidar_histogram.sh | bash |
|
| lidar_stats.py | Python |
|
| make_lidardem_or_intensity.grass | ASCII English text |
|
| make_mosaic.grass | ASCII English text |
|
| nextmapdem.sh | bash |
|
| overlay_combined_band_mask.py | symbolic link to `/users/rsg/arsf/code/mask_creation/overlay_combined_band_mask.py' |
|
| photo_renamer.py | Python |
|
| proj_tidy.sh | bash |
|
| read_arsf_logsheets.py | Python |
|
| remove_bands_from_header.py | Python |
|
| rename_photos_update_events_file.py | Python |
|
| seperate_band_mask.py | symbolic link to `/users/rsg/arsf/code/mask_creation/seperate_band_mask.py' |
|
| tag_tiffs.py | Python |
|
| tifftagger2_exiftool.py | Python |
|
| trim_lidar.sh | bash |
|
| unpack_file_check.py | Python |
|
| unpack_folder_structure.py | Python |
|
Note: See also Python resources/libraries on main RSG wiki at http://rsg.pml.ac.uk/intranet/trac/wiki/Python