Skip to content

Nightly fast dispatch tests #6071

Nightly fast dispatch tests

Nightly fast dispatch tests #6071

Triggered via schedule November 26, 2024 18:00
Status Failure
Total duration 1h 32m 39s
Artifacts 35
build-artifact  /  ...  /  build-docker-image
44s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Matrix: fd-nightly / nightly-wh-unstable-models
Fit to window
Zoom out
Zoom in

Annotations

13 errors, 2 warnings, and 216 notices
fd-nightly / [Unstable] Nightly N150 mamba 3
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N150 mamba 2
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N150 mamba 4
Process completed with exit code 1.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N300 mamba 3
Process completed with exit code 1.
fd-nightly / Nightly N300 mistral7b
Process completed with exit code 1.
fd-nightly / Nightly N300 mistral7b_eth
Process completed with exit code 1.
fd-nightly / Nightly N300 yolov4
Process completed with exit code 1.
fd-nightly / Nightly N300 llama3.2-1B
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N300 mamba 4
Process completed with exit code 1.
fd-nightly / Nightly N300 qwen
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N300 mamba 2
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N300 mamba 6
The self-hosted runner: tt-metal-ci-vm-41 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
fd-nightly / [Unstable] Nightly N150 mamba 4
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 81 %
disk-usage-after-startup
Disk usage is 81 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 52 %
disk-usage-after-startup
Disk usage is 52 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 82 %
disk-usage-after-startup
Disk usage is 82 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 81 %
disk-usage-after-startup
Disk usage is 81 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 75 %
disk-usage-after-startup
Disk usage is 75 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 54 %
disk-usage-after-startup
Disk usage is 54 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 63 %
disk-usage-after-startup
Disk usage is 63 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 91 %
disk-usage-after-startup
Disk usage is 91 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 63 %
disk-usage-after-startup
Disk usage is 63 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 53 %
disk-usage-after-startup
Disk usage is 53 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 89 %
disk-usage-after-startup
Disk usage is 89 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 85 %
disk-usage-after-startup
Disk usage is 85 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 85 %
disk-usage-after-startup
Disk usage is 85 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 69 %
disk-usage-after-startup
Disk usage is 69 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 52 %
disk-usage-after-startup
Disk usage is 52 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 76 %
disk-usage-after-startup
Disk usage is 76 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 47 %
disk-usage-after-startup
Disk usage is 47 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 65 %
disk-usage-after-startup
Disk usage is 65 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 89 %
disk-usage-after-startup
Disk usage is 89 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 73 %
disk-usage-after-startup
Disk usage is 73 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 76 %
disk-usage-after-startup
Disk usage is 76 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 82 %
disk-usage-after-startup
Disk usage is 82 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 91 %
disk-usage-after-startup
Disk usage is 91 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 86 %
disk-usage-after-startup
Disk usage is 86 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 65 %
disk-usage-after-startup
Disk usage is 65 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 91 %
disk-usage-after-startup
Disk usage is 91 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 93 %
disk-usage-after-startup
Disk usage is 93 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 87 %
disk-usage-after-startup
Disk usage is 87 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull
299 MB
TTMetal_build_wormhole_b0
300 MB
test_reports_05bdfd4f-b79a-4b6a-b41c-f7c42ebd9cee
1.3 KB
test_reports_157b3191-2222-4a59-9f0f-da8023d995c5
1.32 KB
test_reports_230f4e53-2eed-4c14-ab7c-adac396e18f8
481 Bytes
test_reports_2575c725-5bd1-48bb-9add-5a5dd3e631ea
478 Bytes
test_reports_291c4473-89f1-4672-8834-ae4ff2f9a0fd
4.63 KB
test_reports_338e46c4-033a-4352-b6a5-5c70f85a3c1b
1.36 KB
test_reports_3447baa1-5da6-46c9-a080-aac1017f9cbe
607 Bytes
test_reports_354b460a-7605-4aa9-952e-6aef57d97167
6.89 KB
test_reports_362dfc66-e8aa-4f79-8aff-eaaae1871674
4.61 KB
test_reports_3a6001a5-053c-4eea-b152-e6cc9a89359d
912 Bytes
test_reports_3db02476-a810-43fa-b0d3-8bb463b04ceb
1.01 KB
test_reports_431536a7-2745-4d01-bd40-83195a2d775c
573 Bytes
test_reports_4a407318-df4e-4c9c-91d4-a24d1a0af20b
5.87 KB
test_reports_4b9d36e4-66b9-4484-9706-782b56d909ce
709 Bytes
test_reports_6cfbf2d7-3871-4edc-b398-9798676b00ff
477 Bytes
test_reports_6d39ad6e-92ac-42e3-bb01-037a03f5dcba
912 Bytes
test_reports_7505bbc2-2499-48e6-a77c-5fac9e27ac7e
6.32 KB
test_reports_7ef93cc8-1fc2-4c31-9110-6a7e8a5be3f3
822 Bytes
test_reports_98b436c0-5860-4630-9e03-11ff089accdd
5.88 KB
test_reports_acf69d41-8e26-46dc-82c8-338a0a13450b
815 Bytes
test_reports_ae388016-f10b-4494-ae17-831736fb3a2b
837 Bytes
test_reports_b8cc67ad-2cf0-4191-83f5-631ecc3494b5
547 Bytes
test_reports_ca4745b3-53df-42b5-9ca9-2dc51969faa2
712 Bytes
test_reports_cd2930d0-815b-420d-9557-8810b6e3ae6e
655 Bytes
test_reports_d0dbd142-ce0e-4e2f-bef5-3df02dc20ccb
1.13 KB
test_reports_d26da4e2-2ea0-4ec6-80e4-9aef7ee0398f
732 Bytes
test_reports_d3308fd7-3460-4fcd-a0be-ad719b942288
430 Bytes
test_reports_d3e938d0-2ed1-42ee-bcd5-70042f63ec58
621 Bytes
test_reports_d75fa403-f6bf-4170-9450-92fcde66b61b
629 Bytes
test_reports_e5eef47d-f734-433d-8f83-d2d6f7d0d2fd
649 Bytes
test_reports_e7162db2-1fc3-417b-b208-73b96e52da94
631 Bytes
test_reports_f390e769-62f8-4534-bec0-24f6736e4d0d
663 Bytes
test_reports_fbe54ff2-02ec-4513-9ea8-4fa91e465353
624 Bytes