Opened 9 years ago

Last modified 9 years ago

#335 new bug

Run script updates

Reported by: benj Owned by: benj
Priority: alpha 4 high Milestone: The Glorious Future
Component: PML utilities Keywords:
Cc: iopa Other processors:

Description (last modified by iopa)

This ticket is for keeping track of desired changes/updates to the run scripts and/or run script generator. If you'd like an update please put it in this ticket so it doesn't get lost - update the list at the top and put a comment in.

Relevant files:

  • generate_runscripts.py
  • specim_qsub.py
  • process_specim_line.py
  • configSorter.py
  • template_specim_config.cfg

Desired changes:

  • Fix generate_runscripts.py to still generate an Eagle/Hawk config file with per-line information as far as possible even if not given a logsheet.
  • Rationalise the handling of the variables SORTIE and FLETTER - in some places they are confused and/or not as expected
  • Ensure level 1 HDF file is deleted even if the run fails. Otherwise if there are lots of failures the gridnode hard disks fill up.

Change History (15)

comment:1 Changed 9 years ago by benj

  • Description modified (diff)

comment:2 Changed 9 years ago by benj

  • Description modified (diff)

comment:3 Changed 9 years ago by benj

  • Description modified (diff)

comment:4 Changed 9 years ago by benj

  • Description modified (diff)

Fixed divide-by-zero error on sct increment of 0

comment:5 Changed 9 years ago by benj

  • Description modified (diff)

Updated run script generator to detect UK/non-UK flights from lat/lon in Eagle/Hawk header file rather than from project code.

comment:6 Changed 9 years ago by benj

  • Description modified (diff)

comment:7 Changed 9 years ago by benj

  • Description modified (diff)

Altered script generator to automatically find a DEM if one is present and incorporate it into the config file.

comment:8 Changed 9 years ago by benj

  • Description modified (diff)

comment:9 Changed 9 years ago by benj

  • Cc iopa added

comment:10 Changed 9 years ago by benj

  • Description modified (diff)

Changed specim_qsub.py to check for a single "sct=" key as well as just start and end times. Actually did this a while ago and didn't update the ticket because it took a while to get it tested.

comment:11 Changed 9 years ago by iopa

Fixed configSorter.py to sort line sections alphanumerically (eagle before hawk and in correct order of line number).

comment:12 in reply to: ↑ description Changed 9 years ago by iopa

Replying to benj:

This ticket is for keeping track of desired changes/updates to the run scripts and/or run script generator. If you'd like an update please put it in this ticket so it doesn't get lost - update the list at the top and put a comment in.

Relevant files:

  • generate_runscripts.py
  • specim_qsub.py
  • process_specim_line.py
  • template_specim_config.cfg

Desired changes:

  • Fix generate_runscripts.py to still generate an Eagle/Hawk config file with per-line information as far as possible even if not given a logsheet.
  • Fix generate_runscripts.py so that it correctly takes into account the situation where the Eagle and Hawk file numbers are different.
  • Rationalise the handling of the variables SORTIE and FLETTER - in some places they are confused and/or not as expected
  • Put level 1 HDF into /tmp/random_folder rather than just in /tmp - prevents blocking if a file with the same name owned by another user already exists.
  • Ensure level 1 HDF file is deleted even if the run fails. Otherwise if there are lots of failures the gridnode hard disks fill up.

comment:13 Changed 9 years ago by iopa

Apologies, that was not what I intended, I was trying to remove the configSorter fix off the description.

comment:14 Changed 9 years ago by mggr

  • Description modified (diff)

Done:

  • Put level 1 HDF into /tmp/random_folder rather than just in /tmp - prevents blocking if a file with the same name owned by another user already exists.

comment:15 Changed 9 years ago by iopa

  • Description modified (diff)
Note: See TracTickets for help on using tickets.