Skip to content

server: Add "tokens per second" information in the backend (#10548) #38

server: Add "tokens per second" information in the backend (#10548)

server: Add "tokens per second" information in the backend (#10548) #38

windows-latest-cmake (noavx-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_A...

succeeded Dec 2, 2024 in 5m 2s