Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ci): Add integration test CI docker image with all the arrows #557

Merged
merged 9 commits into from
Jul 17, 2024

Conversation

paleolimbot
Copy link
Member

@paleolimbot paleolimbot commented Jul 15, 2024

This PR adds an integration test run for every commit by caching a recent docker image build (weekly) containing the built versions of integration tests from the Arrow monorepo and arrow-rs. This should result in a CI job with a reasonable run time that provides high-level testing and type coverage.

This is based on the arrow-rs version of the integration test job ( https://github.com/apache/arrow-rs/blob/6d4e2f2ceaf423031b0bc72f54c547dd77a0ddbb/.github/workflows/integration.yml ).

@paleolimbot paleolimbot changed the title chore(ci): Add integration test CI job with all the arrows chore(ci): Add integration test CI docker image with all the arrows Jul 15, 2024
@paleolimbot paleolimbot marked this pull request as ready for review July 16, 2024 12:31
Copy link
Member

@assignUser assignUser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, only nits from except the branch name :)

.github/workflows/docker-build.yaml Show resolved Hide resolved
.github/workflows/docker-build.yaml Show resolved Hide resolved
.github/workflows/integration.yaml Outdated Show resolved Hide resolved
.github/workflows/integration.yaml Show resolved Hide resolved
ci/docker/integration.dockerfile Outdated Show resolved Hide resolved
paleolimbot and others added 4 commits July 17, 2024 09:19
Co-authored-by: Jacob Wujciak-Jens <jacob@wujciak.de>
Co-authored-by: Jacob Wujciak-Jens <jacob@wujciak.de>
@paleolimbot paleolimbot merged commit bfa1bee into apache:main Jul 17, 2024
16 checks passed
@paleolimbot paleolimbot deleted the ci-integration-run-here branch July 17, 2024 13:43
@@ -94,15 +99,15 @@ jobs:
NANOARROW_PLATFORM: ${{ matrix.config.platform }}
DOCKER_DEFAULT_PLATFORM: "linux/${{ matrix.config.arch }}"
run: |
docker-compose push verify
docker-compose push ${{ matrix.config.service }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe docker compose?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah true, docker-compose is deprecated

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I need it because of the ARM runners here (the last time I checked, docker compose did not work there)

@paleolimbot paleolimbot added this to the nanoarrow 0.6.0 milestone Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants