Run script updates

[benj]

This ticket is for keeping track of desired changes/updates to the run scripts and/or run script generator. If you'd like an update please put it in this ticket so it doesn't get lost - update the list at the top and put a comment in.

Relevant files:

• generate_runscripts.py
• specim_qsub.py
• process_specim_line.py
• configSorter.py
• template_specim_config.cfg

Desired changes:

• Fix generate_runscripts.py to still generate an Eagle/Hawk config file with per-line information as far as possible even if not given a logsheet.
• Fix generate_runscripts.py so that it correctly takes into account the situation where the Eagle and Hawk file numbers are different.
• Rationalise the handling of the variables SORTIE and FLETTER - in some places they are confused and/or not as expected
• Improve configSorter.py so that it sorts entries into the same order that they're in the template file rather than alphabetically.
• Ensure level 1 HDF file is deleted even if the run fails. Otherwise if there are lots of failures the gridnode hard disks fill up.

[benj]

Fixed divide-by-zero error on sct increment of 0

[benj]

Updated run script generator to detect UK/non-UK flights from lat/lon in Eagle/Hawk header file rather than from project code.

[benj]

Altered script generator to automatically find a DEM if one is present and incorporate it into the config file.

[benj]

Changed specim_qsub.py to check for a single "sct=" key as well as just start and end times. Actually did this a while ago and didn't update the ticket because it took a while to get it tested.

[iopa]

Fixed configSorter.py to sort line sections alphanumerically (eagle before hawk and in correct order of line number).

[iopa]

Replying to benj:

This ticket is for keeping track of desired changes/updates to the run scripts and/or run script generator. If you'd like an update please put it in this ticket so it doesn't get lost - update the list at the top and put a comment in.

Relevant files:

• generate_runscripts.py
• specim_qsub.py
• process_specim_line.py
• template_specim_config.cfg

Desired changes:

• Fix generate_runscripts.py to still generate an Eagle/Hawk config file with per-line information as far as possible even if not given a logsheet.
• Fix generate_runscripts.py so that it correctly takes into account the situation where the Eagle and Hawk file numbers are different.
• Rationalise the handling of the variables SORTIE and FLETTER - in some places they are confused and/or not as expected
• Put level 1 HDF into /tmp/random_folder rather than just in /tmp - prevents blocking if a file with the same name owned by another user already exists.
• Ensure level 1 HDF file is deleted even if the run fails. Otherwise if there are lots of failures the gridnode hard disks fill up.

[iopa]

Apologies, that was not what I intended, I was trying to remove the configSorter fix off the description.

[mggr]

Done:

• Put level 1 HDF into /tmp/random_folder rather than just in /tmp - prevents blocking if a file with the same name owned by another user already exists.