Job execution and submission

Modules managing the execution and submission of jobs to computing clusters. This is mostly used for small productions during the validation or verification phase.

Interface to workload managers like gridengine or HTCondor.

exception job_execution.job_manager.JobExecutionError

Job execution error.

class job_execution.job_manager.JobManager(submit_engine=None, submit_options=None, test=False)

Interface to workload managers like gridengine or HTCondor.

Expects that jobs are described by shell scripts.

Parameters:

submit_enginestr

Job submission system. Default is local.

testbool

Testing mode without sub submission.

check_submission_system()

Check that the requested workload manager exist on the system.

Raises:

MissingWorkloadManagerError

if workflow manager is not found.

submit(run_script=None, run_out_file=None, log_file=None)

Submit a job described by a shell script.

Parameters:

run_script: str

Shell script describing the job to be submitted.

run_out_file: str or Path

Redirect output/error/job stream to this file (out,err,job suffix).

log_file: str or Path

The log file of the actual simulator (CORSIKA or sim_telarray). Provided in order to print the log excerpt in case of run time error.

property submit_engine

Get the submit command.