Skip to content
Hub Submission Validation (R)

2023-10-21 Stevens predictions and metadata #63

Sign in to view logs

2023-10-21 Stevens predictions and metadata

2023-10-21 Stevens predictions and metadata #63

Re-run triggered October 12, 2023 05:41
@AWebber1AWebber1
#56
StevensCS-Epidemic-Prediction:main
Status Failure
Total duration 2m 48s
Artifacts –

validate-submission.yaml

on: pull_request
validate-submission
2m 38s
validate-submission
Fit to window
Zoom out
Zoom in

Annotations

1 error and 2 notices
validate-submission
Process completed with exit code 1.
validate-submission
✔ FluSight-forecast-hub: All hub config files are valid. ✔ 2023-10-14-Stevens-GBR.csv: File exists at path 'model-output/Stevens-GBR/2023-10-14-Stevens-GBR.csv'. ✔ 2023-10-14-Stevens-GBR.csv: File name "2023-10-14-Stevens-GBR.csv" is valid. ✔ 2023-10-14-Stevens-GBR.csv: File directory name matches `model_id` metadata in file name. ✔ 2023-10-14-Stevens-GBR.csv: `round_id` is valid. ✔ 2023-10-14-Stevens-GBR.csv: File is accepted hub format. ✔ 2023-10-14-Stevens-GBR.csv: Metadata file exists at path 'model-metadata/Stevens-GBR.yml'. ✔ 2023-10-14-Stevens-GBR.csv: File could be read successfully. ✔ 2023-10-14-Stevens-GBR.csv: `round_id_col` name is valid. ✔ 2023-10-14-Stevens-GBR.csv: `round_id` column "reference_date" contains a single, unique round ID value. ✔ 2023-10-14-Stevens-GBR.csv: All `round_id_col` "reference_date" values match submission `round_id` from file name. ✔ 2023-10-14-Stevens-GBR.csv: Column names are consistent with expected round task IDs and std column names. ✔ 2023-10-14-Stevens-GBR.csv: Column data types match hub schema. ✔ 2023-10-14-Stevens-GBR.csv: `tbl` contains valid values/value combinations. ✔ 2023-10-14-Stevens-GBR.csv: All combinations of task ID column/`output_type`/`output_type_id` values are unique. ✔ 2023-10-14-Stevens-GBR.csv: Required task ID/output type/output type ID combinations all present. ✔ 2023-10-14-Stevens-GBR.csv: Values in column `value` all valid with respect to modeling task config. ! 2023-10-14-Stevens-GBR.csv: Values in `value` column are not non-decreasing as output_type_ids increase for all unique task ID value/output type combinations of quantile or cdf output types. See `error_tbl` attribute for details. ℹ 2023-10-14-Stevens-GBR.csv: No pmf output types to check for sum of 1. Check skipped. ✔ 2023-10-14-Stevens-GBR.csv: Time differences between t0 var `reference_date` and t1 var `target_end_date` all match expected period of 7d 0H 0M 0S * `horizon`. ✔ 2023-10-14-Stevens-GBR.csv: Target counts are less than location population sizes. ! 2023-10-14-Stevens-GBR.csv: Submission time must be within accepted submission window for round. Current time 2023-10-12 05:44:15.724977 is outside window 2023-10-08 EDT--2023-10-11 23:59:59 EDT. ✔ model-metadata-schema.json: File exists at path 'hub-config/model-metadata-schema.json'. ✔ Stevens-GBR.yml: File exists at path 'model-metadata/Stevens-GBR.yml'. ✔ Stevens-GBR.yml: Metadata file extension is "yml" or "yaml". ✔ Stevens-GBR.yml: Metadata file directory name matches "model-metadata". ✔ Stevens-GBR.yml: Metadata file contents are consistent with schema specifications. ✔ Stevens-GBR.yml: Metadata file name matches the `model_id` specified within the metadata file.
validate-submission
! 2023-10-14-Stevens-GBR.csv: Values in `value` column are not non-decreasing as output_type_ids increase for all unique task ID value/output type combinations of quantile or cdf output types. See `error_tbl` attribute for details. ! 2023-10-14-Stevens-GBR.csv: Submission time must be within accepted submission window for round. Current time 2023-10-12 05:44:15.724977 is outside window 2023-10-08 EDT--2023-10-11 23:59:59 EDT.