Job execution and submission

Modules managing the execution and submission of jobs to computing clusters. This is mostly used for small productions during the validation or verification phase.

exception job_execution.job_manager.JobExecutionError

Exception for job execution error (usually CORSIKA or sim_telarray).

class job_execution.job_manager.JobManager(submit_command=None, test=False)

JobManager provides an interface to workload managers like gridengine or HTCondor.

Parameters:

submit_command: str

Job submission command.

test: bool

Testing mode without sub submission.

Raises:

MissingWorkloadManagerError

if requested workflow manager not found.

submit(run_script=None, run_out_file=None, log_file=None)

Submit a job described by a shell script.

Parameters:

run_script: str

Shell script describing the job to be submitted.

run_out_file: str or Path

Redirect output/error/job stream to this file (out,err,job suffix).

log_file: str or Path

The log file of the actual simulator (CORSIKA or sim_telarray). Provided in order to print the log excerpt in case of run time error.

test_submission_system()

Check that the requested workload manager exist on the system this script is executed.

Raises:

MissingWorkloadManagerError

if workflow manager is not found.

exception job_execution.job_manager.MissingWorkloadManagerError

Exception for missing work load manager.