Skip to content
Performance Regression Test

Collection of minor improvements #27

Sign in to view logs

Collection of minor improvements

Collection of minor improvements #27

Triggered via pull request November 3, 2023 01:43
@tonyprtonypr
synchronize #257
tonypr:minor_improvements
Status Failure
Total duration 1m 42s
Artifacts –

perf-regression.yml

on: pull_request
build-python-and-test-performance
1m 29s
build-python-and-test-performance
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 1 warning
Benchmark (attempt #null): performance regression detected for test 'tests/integration_tests/test_speed.py::test_same_turn_alphabeta_speed'
Previous value was 1.713806737620061 and current value is 0.9490453185765001. It is 1.8058218127988326x worse, exceeding the failure threshold of 1.50.
build-python-and-test-performance
1 of 1 alerts exceeded the failure threshold `1.50` specified by fail-threshold input: # **Performance Alert** Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: a5ddf12b19df73bb2dceb8f8f42ebeb2889ae295 | Previous: 425ccdef04921d1756a1c9bb1f904fceb1f3c3d3 | Ratio | |-|-|-|-| | `tests/integration_tests/test_speed.py::test_same_turn_alphabeta_speed` | `0.9490453185765001` iter/sec (`stddev: 0.840171927015629`) | `1.713806737620061` iter/sec (`stddev: 0.8820659292016528`) | `1.81` | This comment was automatically generated by [workflow](https://github.com/bcollazo/catanatron/actions?query=workflow%3APerformance%20Regression%20Test).
build-python-and-test-performance
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/