Job execution and submission

Modules managing the execution and submission of jobs to computing clusters. This is mostly used for small productions during the validation or verification phase.

Interface to workload managers like gridengine or HTCondor.

exception job_execution.job_manager.JobExecutionError

Exception for job execution error (usually CORSIKA or sim_telarray).

class job_execution.job_manager.JobManager(submit_command=None, test=False)

JobManager provides an interface to workload managers like gridengine or HTCondor.

Parameters:

submit_command: str

Job submission command.

test: bool

Testing mode without sub submission.

Raises:

MissingWorkloadManagerError

if requested workflow manager not found.

submit(run_script=None, run_out_file=None, log_file=None)

Submit a job described by a shell script.

Parameters:

run_script: str

Shell script describing the job to be submitted.

run_out_file: str or Path

Redirect output/error/job stream to this file (out,err,job suffix).

log_file: str or Path

The log file of the actual simulator (CORSIKA or sim_telarray). Provided in order to print the log excerpt in case of run time error.

test_submission_system()

Check that the requested workload manager exist on the system this script is executed.

Raises:

MissingWorkloadManagerError

if workflow manager is not found.

exception job_execution.job_manager.MissingWorkloadManagerError

Exception for missing work load manager.