ThereminQ-llama : baking a Quantum layer caek

This repo is alpha and dedicated to extending GGUF llama LLMs with QC data on Agent steriods

• new features will pop up in other ThereminQ repos
• this repo currently serves to test functionality

Functionality added to the ThereminQ stack so far

• agency to ThereminQ-tensors

---

Qrackmin + llama.cpp + open-interpreter + `` integrated container image stack

docker run --gpus all -v /path-to-/models:/text-generation-webui/models  -p 5000:5000 -p 5173:5173 -p 5601:5601 -p 6080:6080 -p 7860:7860 -p 8501:8501 -p 8081:8081 -d twobombs/thereminq-llama[:tag] 

• latest includes QC/AI dependancies and downloads a LLama3 model
• cli LLama.cpp compiled versions for direct CLI interaction such as model conversion
• chatui for web based LLM interfaces & huggingface URL tunnel
• agent for OpenInterpreterUI/CLI with Ollama3 integration
• big-agency Autogen Studio integrated with Ollama UI

---

---

Work in progress

---

Optional

• Download a ton of hugging face bin files through fetch-bins.sh

---

Credits for Qrack, LLaMa.cpp and Open Interpreter go to

Dan Strano https://github.com/unitaryfund/qrack

Georgi Gerganov https://github.com/ggerganov/llama.cpp

Open Interpreter project https://www.openinterpreter.com/

AutoGen Studio https://autogen-studio.com/

... and their respective contributers

---

poem generated by ChatGPT 3