simulate_prod_htcondor_generator

simulate_prod_htcondor_generator#

Generate a run script and submit file for HT Condor job submission of a simulation production.

This tool facilitates the submission of multiple simulations to the HT Condor batch system, enabling:

  • Execution of simulations using the “simtools-simulate-prod” application.

  • ‘number_of_runs’ jobs are submitted to the HT Condor batch system.

  • Utilization of an Apptainer image containing the SimPipe simulation software and tools.

  • Packaging of data and histogram files, and writing them to a specified directory.

This tool is intended for use in an HT Condor environment. Jobs run in a container universe using the Apptainer image specified in the command line (’–apptainer_image’). Output is written to the ‘output_path’ directory, with ‘simtools-output’ and ‘logs’ subdirectories.

Requirements for the ‘simtools-simulate-prod-htcondor-generator’ application:

  • Availability of an Apptainer image ‘simtools-prod’ (obtainable from the package registry on GitHub, e.g., via ‘apptainer pull –force docker://ghcr.io/gammasim/simtools-prod:latest’).

  • Environment parameters required to run CORSIKA and sim_telarray, as well as DB access credentials. These should be listed similarly to a ‘.env’ file and copied to ‘output_path/env.txt’. Ensure that the path to the simulation software is correctly set to ‘SIMTOOLS_SIMTEL_PATH=/workdir/sim_telarray’.

Command line arguments#

output_path (str, required)

Directory where the output and the simulation data files will be written.

apptainer_image (str, optional)

Apptainer image to use for the simulation (full path).

priority (int, optional)

Job priority (default: 1).

(all other command line arguments are identical to those of simulate_prod).