2023-10-14 SigSci-CREG forecasts #29
validate-submission.yaml
on: pull_request
validate-submission
3m 6s
Annotations
1 notice
validate-submission
✔ FluSight-forecast-hub: All hub config files are valid.
✔ 2023-10-14-SigSci-CREG.csv: File exists at path
'model-output/SigSci-CREG/2023-10-14-SigSci-CREG.csv'.
✔ 2023-10-14-SigSci-CREG.csv: File name "2023-10-14-SigSci-CREG.csv" is valid.
✔ 2023-10-14-SigSci-CREG.csv: File directory name matches `model_id` metadata
in file name.
✔ 2023-10-14-SigSci-CREG.csv: `round_id` is valid.
✔ 2023-10-14-SigSci-CREG.csv: File is accepted hub format.
✔ 2023-10-14-SigSci-CREG.csv: Metadata file exists at path
'model-metadata/SigSci-CREG.yml'.
✔ 2023-10-14-SigSci-CREG.csv: File could be read successfully.
✔ 2023-10-14-SigSci-CREG.csv: `round_id_col` name is valid.
✔ 2023-10-14-SigSci-CREG.csv: `round_id` column "reference_date" contains a
single, unique round ID value.
✔ 2023-10-14-SigSci-CREG.csv: All `round_id_col` "reference_date" values match
submission `round_id` from file name.
✔ 2023-10-14-SigSci-CREG.csv: Column names are consistent with expected round
task IDs and std column names.
✔ 2023-10-14-SigSci-CREG.csv: Column data types match hub schema.
✔ 2023-10-14-SigSci-CREG.csv: `tbl` contains valid values/value combinations.
✔ 2023-10-14-SigSci-CREG.csv: All combinations of task ID
column/`output_type`/`output_type_id` values are unique.
✔ 2023-10-14-SigSci-CREG.csv: Required task ID/output type/output type ID
combinations all present.
✔ 2023-10-14-SigSci-CREG.csv: Values in column `value` all valid with respect
to modeling task config.
✔ 2023-10-14-SigSci-CREG.csv: Values in `value` column are non-decreasing as
output_type_ids increase for all unique task ID value/output type
combinations of quantile or cdf output types.
✔ 2023-10-14-SigSci-CREG.csv: Values in `value` column do sum to 1 for all
unique task ID value combination of pmf output types.
✔ 2023-10-14-SigSci-CREG.csv: Time differences between t0 var `reference_date`
and t1 var `target_end_date` all match expected period of 7d 0H 0M 0S *
`horizon`.
✔ 2023-10-14-SigSci-CREG.csv: Target counts are less than location population
sizes.
✔ 2023-10-14-SigSci-CREG.csv: Submission time is within accepted submission
window for round.
✔ model-metadata-schema.json: File exists at path
'hub-config/model-metadata-schema.json'.
✔ SigSci-CREG.yml: File exists at path 'model-metadata/SigSci-CREG.yml'.
✔ SigSci-CREG.yml: Metadata file extension is "yml" or "yaml".
✔ SigSci-CREG.yml: Metadata file directory name matches "model-metadata".
✔ SigSci-CREG.yml: Metadata file contents are consistent with schema
specifications.
✔ SigSci-CREG.yml: Metadata file name matches the `model_id` specified within
the metadata file.
|