← Back to changelog

February 14, 2025

Open Source LLMOps Stack

Marc Klingen

Together with LiteLLM, we launch the OSS LLMOps Stack which is a popular, well-integrated and battle-tested LLMOps stack that can easily be self-hosted and extended.

New Features

• Introduced the complete OSS LLMOps Stack that integrates the robust LiteLLM unified API for seamless access to over 100+ LLMs.
• Enhanced observability and evaluation through Langfuse, providing detailed monitoring and prompt management capabilities.

Improvements

• Streamlined integration between LiteLLM and Langfuse to ensure scalable, flexible, and reliable LLM operations.
• Optimized failover mechanisms and improved logging to elevate the user experience and system robustness.

👉 Check out the website of the stack to learn more: oss-llmops-stack.com