Skip to content
Performance Regression Test

Collection of minor improvements #31

Sign in to view logs

Collection of minor improvements

Collection of minor improvements #31

Triggered via pull request November 3, 2023 02:02
@tonyprtonypr
synchronize #257
tonypr:minor_improvements
Status Failure
Total duration 1m 36s
Artifacts –

perf-regression.yml

on: pull_request
build-python-and-test-performance
1m 28s
build-python-and-test-performance
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 2 warnings
Benchmark (attempt #null): performance regression detected for test 'tests/integration_tests/test_speed.py::test_same_turn_alphabeta_speed'
Previous value was 1.0577737605843358 and current value is 0.47699098890699276. It is 2.2175969466596954x worse, exceeding the failure threshold of 1.50.
build-python-and-test-performance
1 of 2 alerts exceeded the failure threshold `1.50` specified by fail-threshold input: # **Performance Alert** Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 53e2f4eb02226cc5644e6f679d38d2afe8cc51d5 | Previous: 425ccdef04921d1756a1c9bb1f904fceb1f3c3d3 | Ratio | |-|-|-|-| | `tests/integration_tests/test_speed.py::test_alphabeta_speed` | `0.6964070484389694` iter/sec (`stddev: 1.4633188443901963`) | `0.9465673248247594` iter/sec (`stddev: 1.0074697465692781`) | `1.36` | | `tests/integration_tests/test_speed.py::test_same_turn_alphabeta_speed` | `0.47699098890699276` iter/sec (`stddev: 1.898997101616742`) | `1.0577737605843358` iter/sec (`stddev: 1.6334250473066654`) | `2.22` | This comment was automatically generated by [workflow](https://github.com/bcollazo/catanatron/actions?query=workflow%3APerformance%20Regression%20Test).
build-python-and-test-performance
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Benchmark (attempt #null): potential performance regression detected for test 'tests/integration_tests/test_speed.py::test_alphabeta_speed'
Previous value was 0.9465673248247594 and current value is 0.6964070484389694. It is 1.3592156009140581x worse, exceeding the warning threshold of 1.30.