server: Add "tokens per second" information in the backend (#10548) #38

Sign in to view logs

Triggered via push December 2, 2024 22:01

Xarbirus

master

Status Success

Total duration 45m 5s

Artifacts 20

build.yml

on: push

Matrix: windows-2019-cmake-cuda

Matrix: windows-latest-cmake-hip-release

Matrix: windows-latest-cmake

macOS-latest-cmake-arm64

macOS-latest-cmake-x64

ubuntu-focal-make

ubuntu-latest-cmake

macOS-latest-make

macOS-latest-cmake

ubuntu-focal-make-curl

ubuntu-latest-cmake-rpc

ubuntu-22-cmake-vulkan

ubuntu-22-cmake-hip

ubuntu-22-cmake-musa

ubuntu-22-cmake-sycl

ubuntu-22-cmake-sycl-fp16

macOS-latest-cmake-ios

macOS-latest-cmake-tvos

ubuntu-latest-cmake-cuda

windows-latest-cmake-sycl

windows-latest-cmake-hip

ios-xcode-build

Matrix: macOS-latest-swift

Matrix: ubuntu-latest-cmake-sanitizer

Matrix: windows-msys2

Annotations

1 error and 11 warnings

windows-latest-cmake (avx512-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...

Process completed with exit code 1.

ubuntu-latest-cmake

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-rpc

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

android-build

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-sanitizer (ADDRESS, Debug)

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-sanitizer (ADDRESS, Release)

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-sanitizer (UNDEFINED, Debug)

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-sanitizer (UNDEFINED, Release)

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-sanitizer (THREAD, Release)

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-sanitizer (THREAD, Debug)

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest-cmake-cuda

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Artifacts

Produced during runtime

Name	Size
cudart-llama-bin-win-cu11.7-x64.zip	303 MB
cudart-llama-bin-win-cu12.4-x64.zip	372 MB
llama-bin-macos-arm64.zip	51.9 MB
llama-bin-macos-x64.zip	53.5 MB
llama-bin-ubuntu-x64.zip	58.7 MB
llama-bin-win-avx-x64.zip	8.51 MB
llama-bin-win-avx2-x64.zip	8.52 MB
llama-bin-win-avx512-x64.zip	8.53 MB
llama-bin-win-cu11.7-x64.zip	145 MB
llama-bin-win-cu12.4-x64.zip	145 MB
llama-bin-win-hip-x64-gfx1030.zip	228 MB
llama-bin-win-hip-x64-gfx1100.zip	230 MB
llama-bin-win-hip-x64-gfx1101.zip	230 MB
llama-bin-win-kompute-x64.zip	8.81 MB
llama-bin-win-llvm-arm64.zip	10.1 MB
llama-bin-win-msvc-arm64.zip	12.8 MB
llama-bin-win-noavx-x64.zip	8.49 MB
llama-bin-win-openblas-x64.zip	19.5 MB
llama-bin-win-sycl-x64.zip	89.2 MB
llama-bin-win-vulkan-x64.zip	9.27 MB