simtools-production-select-files#
Select production files from production metadata manifests.
Overview#
The application selects production files from the
simulate_prod_job_metadata.yml manifests written for completed simulation jobs. Selection
expressions address manifest fields using dotted paths, for example
configuration.zenith_angle=20 deg.
The selected files are grouped by their simulation configuration. Use
--require_complete_runs to reject groups with missing run numbers.
Input and output#
Role |
Argument |
Format |
Description |
|---|---|---|---|
Input |
|
Directory |
Directory containing |
Input |
|
|
Optional selection expression; may be repeated. |
Output |
|
YAML |
Optional file containing the selected groups. |
Command line arguments#
options#
- –help
show this help message and exit
- –production_path
Directory containing simulate_prod job output directories.
Required.
- –file_type
Manifest file type to select.
Default: reduced_event_data.
- –require_complete_runs
Fail when selected run numbers are not contiguous within each group.
application#
- –select
Selection expression as dotted.path=value. Can be repeated.
- –show_options
Print available values for a supported option and exit.
output#
- –output_file
Output data file.
- –output_file_format
file format of output data
Default: ecsv.
- –skip_output_validation
skip output data validation against schema
Example#
simtools-production-select-files \
--production_path /data/production \
--select configuration.zenith_angle="20 deg" \
--select configuration.primary=gamma \
--file_type reduced_event_data \
--output_file selected_files.yml