ConnorsApps / ollama-benchmarks Public

Notifications You must be signed in to change notification settings
Fork 0
Star 2

Test speed difference between GPU vs CPU only Ollama prompts

2 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
runs		runs
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
client.go		client.go
go.mod		go.mod
go.sum		go.sum
k8s-job.yaml		k8s-job.yaml
main.go		main.go
runs.go		runs.go
utils.go		utils.go

Repository files navigation

ollama-benchmarks

This repository is dedicated to testing prompts against different Ollama models.

Key Features:

Results of the tests are uploaded to a Minio bucket
The tests are executed within Kubernetes jobs
The program is written in Golang

About

Test speed difference between GPU vs CPU only Ollama prompts

Report repository

Releases

No releases published

Packages

No packages published

Languages