Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] RegressionIT testTwoJobsWithSameRandomizeSeedUseSameTrainingSet failing #117805

Open
elasticsearchmachine opened this issue Dec 1, 2024 · 1 comment
Labels
:ml Machine learning needs:risk Requires assignment of a risk label (low, medium, blocker) Team:ML Meta label for the ML team >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest" --tests "org.elasticsearch.xpack.ml.integration.RegressionIT.testTwoJobsWithSameRandomizeSeedUseSameTrainingSet" -Dtests.seed=7A8082A28DA1954B -Dtests.locale=sq -Dtests.timezone=Europe/Monaco -Druntime.java=17

Applicable branches:
8.x

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Expected: <[nxqWgpMBWtLCxPKO8S44, mBqWgpMBWtLCxPKO8S44, zRqWgpMBWtLCxPKO8S44, 1hqWgpMBWtLCxPKO8S44, 9RqWgpMBWtLCxPKO8S44, pxqWgpMBWtLCxPKO8S44, qBqWgpMBWtLCxPKO8S44, 7hqWgpMBWtLCxPKO8S44, lxqWgpMBWtLCxPKO8S44, zxqWgpMBWtLCxPKO8S44, yxqWgpMBWtLCxPKO8S44, 5BqWgpMBWtLCxPKO8S44, xxqWgpMBWtLCxPKO8S44, 2BqWgpMBWtLCxPKO8S44, rxqWgpMBWtLCxPKO8S44, wRqWgpMBWtLCxPKO8S44, vxqWgpMBWtLCxPKO8S44, sxqWgpMBWtLCxPKO8S44, uxqWgpMBWtLCxPKO8S44, uRqWgpMBWtLCxPKO8S44, mRqWgpMBWtLCxPKO8S44, sRqWgpMBWtLCxPKO8S44, nRqWgpMBWtLCxPKO8S44, 2hqWgpMBWtLCxPKO8S44, oxqWgpMBWtLCxPKO8S44, nBqWgpMBWtLCxPKO8S44, 6RqWgpMBWtLCxPKO8S44, pBqWgpMBWtLCxPKO8S44, 6hqWgpMBWtLCxPKO8S44, -BqWgpMBWtLCxPKO8S44, 1BqWgpMBWtLCxPKO8S44, 6BqWgpMBWtLCxPKO8S44, wBqWgpMBWtLCxPKO8S44, 6xqWgpMBWtLCxPKO8S44, -RqWgpMBWtLCxPKO8S44, xBqWgpMBWtLCxPKO8S44, 7xqWgpMBWtLCxPKO8S44, uBqWgpMBWtLCxPKO8S44, zBqWgpMBWtLCxPKO8S44, vBqWgpMBWtLCxPKO8S44, 0RqWgpMBWtLCxPKO8S44, tBqWgpMBWtLCxPKO8S44, 1RqWgpMBWtLCxPKO8S44, rBqWgpMBWtLCxPKO8S44, 3xqWgpMBWtLCxPKO8S44, mhqWgpMBWtLCxPKO8S44, uhqWgpMBWtLCxPKO8S44, 4xqWgpMBWtLCxPKO8S44, rhqWgpMBWtLCxPKO8S44, 2xqWgpMBWtLCxPKO8S44]>
     but: was <[nxqWgpMBWtLCxPKO8S44, mBqWgpMBWtLCxPKO8S44, zRqWgpMBWtLCxPKO8S44, 1hqWgpMBWtLCxPKO8S44, 9RqWgpMBWtLCxPKO8S44, xRqWgpMBWtLCxPKO8S44, pxqWgpMBWtLCxPKO8S44, 7hqWgpMBWtLCxPKO8S44, lxqWgpMBWtLCxPKO8S44, zxqWgpMBWtLCxPKO8S44, yxqWgpMBWtLCxPKO8S44, 5BqWgpMBWtLCxPKO8S44, xxqWgpMBWtLCxPKO8S44, 2BqWgpMBWtLCxPKO8S44, tRqWgpMBWtLCxPKO8S44, rxqWgpMBWtLCxPKO8S44, wRqWgpMBWtLCxPKO8S44, vxqWgpMBWtLCxPKO8S44, sxqWgpMBWtLCxPKO8S44, uxqWgpMBWtLCxPKO8S44, uRqWgpMBWtLCxPKO8S44, mRqWgpMBWtLCxPKO8S44, sRqWgpMBWtLCxPKO8S44, rRqWgpMBWtLCxPKO8S44, nRqWgpMBWtLCxPKO8S44, 2hqWgpMBWtLCxPKO8S44, nBqWgpMBWtLCxPKO8S44, 6RqWgpMBWtLCxPKO8S44, pBqWgpMBWtLCxPKO8S44, mxqWgpMBWtLCxPKO8S44, -BqWgpMBWtLCxPKO8S44, 1BqWgpMBWtLCxPKO8S44, 6BqWgpMBWtLCxPKO8S44, wBqWgpMBWtLCxPKO8S44, 6xqWgpMBWtLCxPKO8S44, -RqWgpMBWtLCxPKO8S44, xBqWgpMBWtLCxPKO8S44, 7xqWgpMBWtLCxPKO8S44, uBqWgpMBWtLCxPKO8S44, zBqWgpMBWtLCxPKO8S44, 0RqWgpMBWtLCxPKO8S44, tBqWgpMBWtLCxPKO8S44, rBqWgpMBWtLCxPKO8S44, 3xqWgpMBWtLCxPKO8S44, 9xqWgpMBWtLCxPKO8S44, mhqWgpMBWtLCxPKO8S44, nhqWgpMBWtLCxPKO8S44, 4xqWgpMBWtLCxPKO8S44, rhqWgpMBWtLCxPKO8S44, 2xqWgpMBWtLCxPKO8S44]>

Issue Reasons:

  • [8.x] 2 failures in test testTwoJobsWithSameRandomizeSeedUseSameTrainingSet (1.1% fail rate in 185 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :ml Machine learning >test-failure Triaged test failures from CI Team:ML Meta label for the ML team needs:risk Requires assignment of a risk label (low, medium, blocker) labels Dec 1, 2024
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/ml-core (Team:ML)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml Machine learning needs:risk Requires assignment of a risk label (low, medium, blocker) Team:ML Meta label for the ML team >test-failure Triaged test failures from CI
Projects
None yet
Development

No branches or pull requests

1 participant