The Eval Index / Observability / #220

langfuse/oss-llmops-stack

by langfuse · Observability · updated 1y ago

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.

26
momentum
140
stars
7
forks
#220
rank
ai-gatewaygatewayllmllm-evaluationllm-gatewayllm-observabilityllmopsmonitoringopen-sourceopenai-proxyprompt-managementself-hosted
View on GitHub →