🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

Prompt & Conversation Management Middleware for Conversational AI APIs such as OpenAI ChatGPT, Facebook Hugging Face, Anthropic Claude, Google Gemini, Ollama and Jlama. Lean, restful, scalable, and cloud-native. Developed in Java, powered by Quarkus, provided with Docker, and orchestrated with Kubernetes or Openshift.

An Automated AI-Powered Prompt Optimization Framework

🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

Open Source LLM proxy that transparently captures and logs all interactions with LLM API

Building blocks for rapid development of GenAI applications

Managed Prompt Engineering

An open-source prompt engineering framework.

An easy-to-use structured prompt builder for LLMs in TypeScript.

The prompt engineering, prompt management, and prompt evaluation tool for Python

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

These guides are designed to help teams and individuals leverage AI tools like GitHub Copilot, OpenAI, and Claude to build software projects efficiently and effectively

A lightweight, intuitive templating language designed for interactive use in LLM chat sessions.

The prompt engineering, prompt management, and prompt evaluation tool for Go.

A Chrome extension that enhances ChatGPT by providing quick access and management of prompts, streamlining interactions for improved efficiency and a better user experience. Perfect for optimizing your ChatGPT workflow.

The prompt engineering, prompt management, and prompt evaluation tool for Java.

The prompt engineering, prompt management, and prompt evaluation tool for Ruby.