Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move changes from experimental to develop #3265

Draft
wants to merge 49 commits into
base: develop
Choose a base branch
from

Merge pull request #3309 from cdunbar13/experimental

ad9e1bd
Select commit
Loading
Failed to load commit list.
Draft

Move changes from experimental to develop #3265

Merge pull request #3309 from cdunbar13/experimental
ad9e1bd
Select commit
Loading
Failed to load commit list.
Google Cloud Build / PR-validation (hpc-toolkit-dev) failed Nov 26, 2024 in 2m 37s

Summary

Build Information

Trigger PR-validation
Build ee947419-c489-473d-a339-37103cbfab77
Start 2024-11-26T10:49:24-08:00
Duration 1m53.681s
Status FAILURE

Steps

Step Status Duration
git-fetch-unshallow SUCCESS 3.693s
make-tests FAILURE 1m46.099s

Details

starting build "ee947419-c489-473d-a339-37103cbfab77"

FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: 	git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: 	git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/GoogleCloudPlatform/cluster-toolkit
 * branch            ad9e1bdad7a6d20e66d71f49b0badc19cd4cf4d2 -> FETCH_HEAD
HEAD is now at ad9e1bd Merge pull request #3309 from cdunbar13/experimental
SETUPBUILD
BUILD
Starting Step #0 - "git-fetch-unshallow"
Step #0 - "git-fetch-unshallow": Already have image (with digest): gcr.io/cloud-builders/git
Step #0 - "git-fetch-unshallow": From https://github.com/GoogleCloudPlatform/cluster-toolkit
Step #0 - "git-fetch-unshallow":  * [new branch]        chdu                -> origin/chdu
Step #0 - "git-fetch-unshallow":  * [new branch]        develop             -> origin/develop
Step #0 - "git-fetch-unshallow":  * [new branch]        experimental        -> origin/experimental
Step #0 - "git-fetch-unshallow":  * [new branch]        main                -> origin/main
Step #0 - "git-fetch-unshallow":  * [new branch]        revert-3232-develop -> origin/revert-3232-develop
Step #0 - "git-fetch-unshallow":  * [new branch]        revert-3260-experimental-kueue -> origin/revert-3260-experimental-kueue
Step #0 - "git-fetch-unshallow":  * [new branch]        sc23                -> origin/sc23
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.42.0             -> v1.42.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.1.0-alpha        -> v0.1.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.1.1-alpha        -> v0.1.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.2.0-alpha        -> v0.2.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.2.1-alpha        -> v0.2.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.2.2-alpha        -> v0.2.2-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.3.0-alpha        -> v0.3.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.3.1-alpha        -> v0.3.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.4.0-alpha        -> v0.4.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.5.0-alpha        -> v0.5.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.6.0-alpha        -> v0.6.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.7.0-alpha        -> v0.7.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.7.1-alpha        -> v0.7.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.7.2-alpha        -> v0.7.2-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.0.0              -> v1.0.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.1.0              -> v1.1.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.10.0             -> v1.10.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.10.1             -> v1.10.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.11.0             -> v1.11.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.12.0             -> v1.12.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.13.0             -> v1.13.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.14.0             -> v1.14.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.14.1             -> v1.14.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.15.0             -> v1.15.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.16.0             -> v1.16.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.17.0             -> v1.17.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.18.0             -> v1.18.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.18.1             -> v1.18.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.19.0             -> v1.19.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.19.1             -> v1.19.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.2.0              -> v1.2.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.2.1              -> v1.2.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.20.0             -> v1.20.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.21.0             -> v1.21.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.22.0             -> v1.22.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.22.1             -> v1.22.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.23.0             -> v1.23.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.24.0             -> v1.24.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.25.0             -> v1.25.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.26.0             -> v1.26.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.26.1             -> v1.26.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.27.0             -> v1.27.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.28.1             -> v1.28.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.29.0             -> v1.29.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.3.0              -> v1.3.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.30.0             -> v1.30.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.31.0             -> v1.31.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.31.1             -> v1.31.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.32.0             -> v1.32.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.32.1             -> v1.32.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.33.0             -> v1.33.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.0             -> v1.34.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.1             -> v1.34.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.2             -> v1.34.2
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.3             -> v1.34.3
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.35.0             -> v1.35.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.35.1             -> v1.35.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.36.0             -> v1.36.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.36.1             -> v1.36.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.37.0             -> v1.37.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.37.1             -> v1.37.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.37.2             -> v1.37.2
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.38.0             -> v1.38.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.39.0             -> v1.39.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.4.0              -> v1.4.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.4.1              -> v1.4.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.40.0             -> v1.40.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.40.1             -> v1.40.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.41.0             -> v1.41.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.5.0              -> v1.5.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.6.0              -> v1.6.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.7.0              -> v1.7.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.8.0              -> v1.8.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.9.0              -> v1.9.0
Finished Step #0 - "git-fetch-unshallow"
Starting Step #1 - "make-tests"
Step #1 - "make-tests": Pulling image: us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner
Step #1 - "make-tests": Using default tag: latest
Step #1 - "make-tests": latest: Pulling from hpc-toolkit-dev/hpc-toolkit-repo/test-runner
Step #1 - "make-tests": c2056d933cd6: Pulling fs layer
Step #1 - "make-tests": d3f895247ac5: Pulling fs layer
Step #1 - "make-tests": 05d199724b11: Pulling fs layer
Step #1 - "make-tests": 34766222467c: Pulling fs layer
Step #1 - "make-tests": c79bddf330f7: Pulling fs layer
Step #1 - "make-tests": 55b755dce003: Pulling fs layer
Step #1 - "make-tests": 4f4fb700ef54: Pulling fs layer
Step #1 - "make-tests": d2bfb0572aeb: Pulling fs layer
Step #1 - "make-tests": 1f745d6f29c7: Pulling fs layer
Step #1 - "make-tests": c79bddf330f7: Waiting
Step #1 - "make-tests": 55b755dce003: Waiting
Step #1 - "make-tests": 4f4fb700ef54: Waiting
Step #1 - "make-tests": d2bfb0572aeb: Waiting
Step #1 - "make-tests": 1f745d6f29c7: Waiting
Step #1 - "make-tests": 34766222467c: Waiting
Step #1 - "make-tests": d3f895247ac5: Download complete
Step #1 - "make-tests": 05d199724b11: Verifying Checksum
Step #1 - "make-tests": 05d199724b11: Download complete
Step #1 - "make-tests": c2056d933cd6: Verifying Checksum
Step #1 - "make-tests": c2056d933cd6: Download complete
Step #1 - "make-tests": 55b755dce003: Download complete
Step #1 - "make-tests": 4f4fb700ef54: Verifying Checksum
Step #1 - "make-tests": 4f4fb700ef54: Download complete
Step #1 - "make-tests": 34766222467c: Verifying Checksum
Step #1 - "make-tests": 34766222467c: Download complete
Step #1 - "make-tests": c79bddf330f7: Verifying Checksum
Step #1 - "make-tests": c79bddf330f7: Download complete
Step #1 - "make-tests": d2bfb0572aeb: Verifying Checksum
Step #1 - "make-tests": d2bfb0572aeb: Download complete
Step #1 - "make-tests": c2056d933cd6: Pull complete
Step #1 - "make-tests": d3f895247ac5: Pull complete
Step #1 - "make-tests": 05d199724b11: Pull complete
Step #1 - "make-tests": 34766222467c: Pull complete
Step #1 - "make-tests": 1f745d6f29c7: Verifying Checksum
Step #1 - "make-tests": 1f745d6f29c7: Download complete
Step #1 - "make-tests": c79bddf330f7: Pull complete
Step #1 - "make-tests": 55b755dce003: Pull complete
Step #1 - "make-tests": 4f4fb700ef54: Pull complete
Step #1 - "make-tests": d2bfb0572aeb: Pull complete
Step #1 - "make-tests": 1f745d6f29c7: Pull complete
Step #1 - "make-tests": Digest: sha256:df4f0d06a8052b4b79f3f908bb7edef72420415cdee8233794151eb27edc2d8e
Step #1 - "make-tests": Status: Downloaded newer image for us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner:latest
Step #1 - "make-tests": us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner:latest
Step #1 - "make-tests": **************** vetting go code **********************
Step #1 - "make-tests": **************** running gcluster unit tests **************
Step #1 - "make-tests": go vet ./cmd/... ./pkg/...
Step #1 - "make-tests": go: downloading gopkg.in/check.v1 v1.0.0-20201130134442-10cb98267c6c
Step #1 - "make-tests": go: downloading github.com/spf13/afero v1.11.0
Step #1 - "make-tests": go: downloading github.com/zclconf/go-cty-debug v0.0.0-20240509010212-0d6042c53940
Step #1 - "make-tests": go: downloading github.com/kr/pretty v0.3.1
Step #1 - "make-tests": go: downloading github.com/kr/text v0.2.0
Step #1 - "make-tests": go: downloading github.com/rogpeppe/go-internal v1.11.0
Step #1 - "make-tests": go test -cover ./cmd/... ./pkg/... 2>&1 |  perl tools/enforce_coverage.pl
Step #1 - "make-tests": ok  	hpc-toolkit/cmd	0.139s	coverage: 41.5% of statements
Step #1 - "make-tests": 	hpc-toolkit/pkg/logging		coverage: 0.0% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/config	0.120s	coverage: 86.9% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/deploymentio	0.012s	coverage: 88.2% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/inspect	0.408s	coverage: 86.0% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/modulereader	0.166s	coverage: 86.3% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/modulewriter	0.085s	coverage: 80.6% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/shell	0.542s	coverage: 25.3% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/sourcereader	1.005s	coverage: 88.8% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/validators	0.026s	coverage: 13.7% of statements
Step #1 - "make-tests": **************** building gcluster ************************
Step #1 - "make-tests": *********** running "Golden copy" tests ***********
Step #1 - "make-tests": tools/validate_configs/golden_copies/validate.sh
Step #1 - "make-tests": Testing igc_pkr
Step #1 - "make-tests": Testing igc_tf
Step #1 - "make-tests": Testing merge_flatten
Step #1 - "make-tests": Testing text_escape
Step #1 - "make-tests": Testing versioned_blueprint
Step #1 - "make-tests": *********** running basic integration tests ***********
Step #1 - "make-tests": tools/validate_configs/validate_configs.sh
Step #1 - "make-tests": Running tests in 8 processes
Step #1 - "make-tests": testing examples/gke-a3-megagpu.yaml in /tmp/tmp.2OZPyBO9cV
Step #1 - "make-tests": testing examples/ml-slurm-v5-legacy.yaml in /tmp/tmp.sI2Q6ulWxa
Step #1 - "make-tests": testing examples/gke-storage-parallelstore.yaml in /tmp/tmp.G4kV3F9lHD
Step #1 - "make-tests": testing examples/image-builder.yaml in /tmp/tmp.KTNwLlWKbD
Step #1 - "make-tests": testing examples/hpc-slurm-v5-legacy.yaml in /tmp/tmp.1hx9CtQWrR
Step #1 - "make-tests": testing examples/pfs-parallelstore.yaml in /tmp/tmp.qZ787TIQPq
Step #1 - "make-tests": testing examples/ml-gke.yaml in /tmp/tmp.33uKy2qgXl
Step #1 - "make-tests": testing examples/ml-slurm.yaml in /tmp/tmp.KfXMEPCu8D
Step #1 - "make-tests": 
Step #1 - "make-tests": Error: Failed to query available provider packages
Step #1 - "make-tests": 
Step #1 - "make-tests": Could not retrieve the list of available versions for provider
Step #1 - "make-tests": hashicorp/google-private: provider registry registry.terraform.io does not
Step #1 - "make-tests": have a provider named registry.terraform.io/hashicorp/google-private
Step #1 - "make-tests": 
Step #1 - "make-tests": All modules should specify their required_providers so that external
Step #1 - "make-tests": consumers will get the correct providers when using a module. To see which
Step #1 - "make-tests": modules are currently depending on hashicorp/google-private, run the
Step #1 - "make-tests": following command:
Step #1 - "make-tests":     terraform providers
Step #1 - "make-tests": *** ERROR: terraform init failed for examples/image-builder.yaml, logs in /tmp/tmp.KTNwLlWKbD/image-builder-ktnwllwkbd/cluster
Step #1 - "make-tests": 
Step #1 - "make-tests": Error: Failed to query available provider packages
Step #1 - "make-tests": 
Step #1 - "make-tests": Could not retrieve the list of available versions for provider
Step #1 - "make-tests": hashicorp/google-private: provider registry registry.terraform.io does not
Step #1 - "make-tests": have a provider named registry.terraform.io/hashicorp/google-private
Step #1 - "make-tests": 
Step #1 - "make-tests": All modules should specify their required_providers so that external
Step #1 - "make-tests": consumers will get the correct providers when using a module. To see which
Step #1 - "make-tests": modules are currently depending on hashicorp/google-private, run the
Step #1 - "make-tests": following command:
Step #1 - "make-tests":     terraform providers
Step #1 - "make-tests": *** ERROR: terraform init failed for examples/ml-slurm.yaml, logs in /tmp/tmp.KfXMEPCu8D/ml-slurm-kfxmepcu8d/cluster
Step #1 - "make-tests": 
Step #1 - "make-tests": Error: Failed to query available provider packages
Step #1 - "make-tests": 
Step #1 - "make-tests": Could not retrieve the list of available versions for provider
Step #1 - "make-tests": hashicorp/google-private: provider registry registry.terraform.io does not
Step #1 - "make-tests": have a provider named registry.terraform.io/hashicorp/google-private
Step #1 - "make-tests": 
Step #1 - "make-tests": All modules should specify their required_providers so that external
Step #1 - "make-tests": consumers will get the correct providers when using a module. To see which
Step #1 - "make-tests": modules are currently depending on hashicorp/google-private, run the
Step #1 - "make-tests": following command:
Step #1 - "make-tests":     terraform providers
Step #1 - "make-tests": *** ERROR: terraform init failed for examples/pfs-parallelstore.yaml, logs in /tmp/tmp.qZ787TIQPq/pfs-parallelstore-qz787tiqpq/primary
Step #1 - "make-tests": *** ERROR: a test failed. Exiting with status 1.
Step #1 - "make-tests": make: *** [Makefile:160: validate_configs] Error 1
Finished Step #1 - "make-tests"
ERROR
ERROR: build step 1 "us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner" failed: step exited with non-zero status: 2

Build Log: https://console.cloud.google.com/cloud-build/builds/ee947419-c489-473d-a339-37103cbfab77?project=508417052821