SGroup-RandomForest Fix on metafile and submission formatting #89
maa989validate-submission.yaml
on: pull_request
validate-submission
4m 12s
Annotations
1 error and 2 notices
|
validate-submission
Process completed with exit code 1.
|
|
validate-submission
✔ FluSight-forecast-hub: All hub config files are valid.
✔ 2023-10-14-SGroup-RandomForest.csv: File exists at path
'model-output/SGroup-RandomForest/2023-10-14-SGroup-RandomForest.csv'.
✔ 2023-10-14-SGroup-RandomForest.csv: File name
"2023-10-14-SGroup-RandomForest.csv" is valid.
✔ 2023-10-14-SGroup-RandomForest.csv: File directory name matches `model_id`
metadata in file name.
✔ 2023-10-14-SGroup-RandomForest.csv: `round_id` is valid.
✔ 2023-10-14-SGroup-RandomForest.csv: File is accepted hub format.
✔ 2023-10-14-SGroup-RandomForest.csv: Metadata file exists at path
'model-metadata/SGroup-RandomForest.yml'.
✔ 2023-10-14-SGroup-RandomForest.csv: File could be read successfully.
✔ 2023-10-14-SGroup-RandomForest.csv: `round_id_col` name is valid.
✔ 2023-10-14-SGroup-RandomForest.csv: `round_id` column "reference_date"
contains a single, unique round ID value.
✔ 2023-10-14-SGroup-RandomForest.csv: All `round_id_col` "reference_date"
values match submission `round_id` from file name.
✔ 2023-10-14-SGroup-RandomForest.csv: Column names are consistent with expected
round task IDs and std column names.
✔ 2023-10-14-SGroup-RandomForest.csv: Column data types match hub schema.
✔ 2023-10-14-SGroup-RandomForest.csv: `tbl` contains valid values/value
combinations.
✔ 2023-10-14-SGroup-RandomForest.csv: All combinations of task ID
column/`output_type`/`output_type_id` values are unique.
✔ 2023-10-14-SGroup-RandomForest.csv: Required task ID/output type/output type
ID combinations all present.
✔ 2023-10-14-SGroup-RandomForest.csv: Values in column `value` all valid with
respect to modeling task config.
✔ 2023-10-14-SGroup-RandomForest.csv: Values in `value` column are
non-decreasing as output_type_ids increase for all unique task ID
value/output type combinations of quantile or cdf output types.
! 2023-10-14-SGroup-RandomForest.csv: Values in `value` column do not sum to 1
for all unique task ID value combination of pmf output types. See
`error_tbl` attribute for details.
✔ 2023-10-14-SGroup-RandomForest.csv: Time differences between t0 var
`reference_date` and t1 var `target_end_date` all match expected period of 7d
0H 0M 0S * `horizon`.
✔ 2023-10-14-SGroup-RandomForest.csv: Target counts are less than location
population sizes.
! 2023-10-14-SGroup-RandomForest.csv: Submission time must be within accepted
submission window for round. Current time 2023-10-13 02:01:21.994352 is
outside window 2023-10-08 EDT--2023-10-11 23:59:59 EDT.
✔ tets: File exists at path 'model-output/SGroup-RandomForest/tets'.
✖ tets: File name "tets" must be valid. Could not correctly parse submission
metadata.
✖ tets: EXEC ERROR: Could not parse file name 'tets' for submission metadata.
Please consult documentation for file name requirements for correct metadata
parsing.
✔ model-metadata-schema.json: File exists at path
'hub-config/model-metadata-schema.json'.
✔ SGroup-RandomForest.yml: File exists at path
'model-metadata/SGroup-RandomForest.yml'.
✔ SGroup-RandomForest.yml: Metadata file extension is "yml" or "yaml".
✔ SGroup-RandomForest.yml: Metadata file directory name matches
"model-metadata".
✖ SGroup-RandomForest.yml: Metadata file contents must be consistent with
schema specifications. - /model_abbr must NOT have more than 16 characters .
- /model_abbr must match pattern "^[a-zA-Z0-9_+]+$" . - /license must be
equal to one of the allowed values .
|
|
validate-submission
! 2023-10-14-SGroup-RandomForest.csv: Values in `value` column do not sum to 1
for all unique task ID value combination of pmf output types. See
`error_tbl` attribute for details.
! 2023-10-14-SGroup-RandomForest.csv: Submission time must be within accepted
submission window for round. Current time 2023-10-13 02:01:21.994352 is
outside window 2023-10-08 EDT--2023-10-11 23:59:59 EDT.
✖ tets: File name "tets" must be valid. Could not correctly parse submission
metadata.
✖ tets: EXEC ERROR: Could not parse file name 'tets' for submission metadata.
Please consult documentation for file name requirements for correct metadata
parsing.
✖ SGroup-RandomForest.yml: Metadata file contents must be consistent with
schema specifications. - /model_abbr must NOT have more than 16 characters .
- /model_abbr must match pattern "^[a-zA-Z0-9_+]+$" . - /license must be
equal to one of the allowed values .
|