simtools-submit-data-from-external

Submit data file through the command line.

Input data and metadata is validated, and if necessary enriched and converted following a pre-described schema.

Command line arguments

input_meta (str, optional)

input meta data file (yml format)

input_file (str, required)

input data file (alias: input_data_file)

schema_file (str, optional)

Schema describing the input data

Example

Submit mirror measurements with associated metadata:

simtools-submit-data-from-external \\
    --input_meta ./tests/resources/MLTdata-preproduction.meta.yml \\
    --input_file ./tests/resources/MLTdata-preproduction.ecsv \\
    --schema_file src/simtools/schemas/input/MST_mirror_2f_measurements.schema.yml \\
    --output_file TEST-submit_data_from_external.ecsv

Expected final print-out message:

INFO::model_data_writer(l70)::write_data::Writing data to \\
    /simtools/simtools-output/d-2023-07-31/TEST-submit_data_from_external.ecsv

Command line arguments

options

–help

show this help message and exit

–input_meta

meta data file associated to input data

–input_file

Input data file

Required.

–schema_file

Schema file describing input data

–ignore_metadata

Ignore metadata

output

–output_file

Output data file.

–output_file_format

file format of output data

Default: ecsv.

–skip_output_validation

skip output data validation against schema

application

–show_options

Print available values for a supported option and exit.

Example

Prepare mirror measurements for submission

Validate an external MST mirror-measurement table and metadata against the input-data schema.

Application: simtools-submit-data-from-external

Integration test: submit_data_from_external_submit_table.yml

Command

simtools-submit-data-from-external --config tests/integration_tests/config/submit_data_from_external_submit_table.yml

Configuration

input_file: tests/resources/static/MLTdata-preproduction.ecsv
input_meta: tests/resources/static/MLTdata-preproduction.meta.yml
output_file: test.ecsv
output_path: simtools-output
schema_file: input/MST_mirror_2f_measurements.schema.yml