simtools-production-select-files#

Select production files from production metadata manifests.

Overview#

The application selects production files from the simulate_prod_job_metadata.yml manifests written for completed simulation jobs. Selection expressions address manifest fields using dotted paths, for example configuration.zenith_angle=20 deg.

The selected files are grouped by their simulation configuration. Use --require_complete_runs to reject groups with missing run numbers.

Input and output#

Role

Argument

Format

Description

Input

production_path

Directory

Directory containing job-* output directories.

Input

select

KEY=VALUE

Optional selection expression; may be repeated.

Output

output_file

YAML

Optional file containing the selected groups.

Command line arguments#

options#

–help

show this help message and exit

–production_path

Directory containing simulate_prod job output directories.

Required.

–file_type

Manifest file type to select.

Default: reduced_event_data.

–require_complete_runs

Fail when selected run numbers are not contiguous within each group.

application#

–select

Selection expression as dotted.path=value. Can be repeated.

–show_options

Print available values for a supported option and exit.

output#

–output_file

Output data file.

–output_file_format

file format of output data

Default: ecsv.

–skip_output_validation

skip output data validation against schema

Example#

simtools-production-select-files \
    --production_path /data/production \
    --select configuration.zenith_angle="20 deg" \
    --select configuration.primary=gamma \
    --file_type reduced_event_data \
    --output_file selected_files.yml