Popular repositories Loading

1. farel-bench farel-bench Public

   Testing LLM reasoning abilities with family relationship quizzes.

   Python 43 1

2. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   LLM inference in C/C++

   C++ 11

3. tlcl tlcl Public

   Simple Tool Caller for llama.cpp

   Python 9

4. distributed-llama distributed-llama Public

   Forked from b4rtaz/distributed-llama

   Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

   C++ 5

5. export-nemo-to-safetensors export-nemo-to-safetensors Public

   Forked from FailSpy/export-nemo-to-safetensors

   Simple script to export NeMo formatted models into safetensors.

   Python 2

6. llama-cpp-python llama-cpp-python Public

   Forked from abetlen/llama-cpp-python

   Python bindings for llama.cpp

   Python