Langfuse Integrations Overview
Integrate your application with Langfuse to explore production traces and metrics.
Objective:
- Capture traces of your application
- Add scores to these traces to measure/evaluate quality of outputs
Main Integrations
| Integration | Supports | Description |
|---|---|---|
| SDK | Python, JS/TS | Manual instrumentation using the SDKs for full flexibility. |
| OpenAI | Python, JS/TS | Automated instrumentation using drop-in replacement of OpenAI SDK. |
| Langchain | Python, JS/TS | Automated instrumentation by passing callback handler to Langchain application or using OpenTelemetry. |
| Haystack | Python | Automated instrumentation via Haystack content tracing system. |
| LiteLLM | Python, JS/TS (proxy only) | Use any LLM as a drop in replacement for GPT. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs). |
| Vercel AI SDK | JS/TS | TypeScript toolkit designed to help developers build AI-powered applications with React, Next.js, Vue, Svelte, Node.js. |
| API | Directly call the public API. OpenAPI spec available. |
Packages integrated with Langfuse
| Name | Type | Description |
|---|---|---|
| LlamaIndex | Library | Available via third-party OTEL-based instrumentation package (openinference-instrumentation-llama-index) |
| Instructor | Library | Library to get structured LLM outputs (JSON, Pydantic) |
| DSPy | Library | Framework that systematically optimizes language model prompts and weights |
| Mirascope | Library | Python toolkit for building LLM applications. |
| Pydantic AI | Library | Pydantic integration for LLM applications. |
| Ollama | Model (local) | Easily run open source LLMs on your own machine. |
| OpenAI Agents SDK | Library | Agents framework by OpenAI SDK. |
| Pipecat | Agents | Open source framework for building real-time voice and multimodal conversational AI agents. |
| Amazon Bedrock | Model | Run foundation and fine-tuned models on AWS. |
| Google Vertex AI and Gemini | Model | Grants access to Google’s own series of Gemini models as well as various models via the Vertex Model Garden (e.g. Claude3) |
| AutoGen | Agent Framework | Open source LLM platform for building distributed agents. |
| Flowise | Chat/Agent UI | JS/TS no-code builder for customized LLM flows. |
| Langflow | Chat/Agent UI | Python-based UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows. |
| Dify | Chat/Agent UI | Open source LLM app development platform with no-code builder. |
| OpenWebUI | Chat/Agent UI | Self-hosted LLM Chat web ui supporting various LLM runners including self-hosted and local models. |
| Promptfoo | Tool | Open source LLM testing platform. |
| LobeChat | Chat/Agent UI | Open source chatbot platform. |
| Vapi | Platform | Open source voice AI platform. |
| Inferable | Agents | Open source LLM platform for building distributed agents. |
| Gradio | Chat/Agent UI | Open source Python library to build web interfaces like Chat UI. |
| Goose | Agents | Open source LLM platform for building distributed agents. |
| smolagents | Agents | Open source AI agents framework. |
| CrewAI | Agents | Multi agent framework for agent collaboration and tool use. |
| Spring AI | Library | Spring-based framework for AI development with built-in OTel tracing for AI calls. |
| Quarkus LangChain4j | Library | A Quarkus based integration of LangChain4j for AI development with built-in OTel tracing for AI calls |
| Firecrawl | Web Scraping | Web scraper that allows you to turn entire websites into LLM-ready markdown. |
| OpenRouter | Framework | OpenAI-compatible completion API to +280 language models |
| Portkey | Model Gateway | AI gateway that provides a unified interface to interact with 250+ AI models with built-in observability |
| xAI / Grok | Model | xAI’s Grok models |
| Cohere | Model | Cohere’s models |
| Fireworks AI | Model | Fireworks AI’s models |
| Novita AI | Model | Deployment for open source and specialized models |
| Cleanlab | Model / Framework | Automated Evaluations |
| VoltAgent | Agents | Open source Typescript toolkit to build LLM Agents. |
| Strands Agents | Agents | Open source Python framework for building distributed agents. |
| Agno Agents | Agents | Lightweight, high-performance library for building AI Agents |
Unsure which integration to choose? Ask us on Discord or in the chat.
⭐️
Stay updated: Star Langfuse on GitHub to get instant notifications about new releases.
Request a new integration
We use GitHub Discussions to track interest in new integrations. Please upvote/add to the list below if you’d like to see a new integration.
End to end examples
If you want to see how things work together, you can look at the end-to-end examples below. They are Jupyter notebooks that you can easily run in Google Colab or locally.
Generally, we recommend reading the get started guides for each integration first.
Integrations
Example Decorator Openai LangchainExample - Tracing and Evaluation for the OpenAI-Agents SDKExample - Trace and Evaluate LangGraph AgentsObservability for Agno with LangfuseObservability and Metrics for Amazon BedrockObservability for AutoGen with Langfuse IntegrationObservability for Strands Agents with LangfuseIntegration Azure Openai LangchainIntegrate Cohere with LangfuseObservability for CrewAI with Langfuse IntegrationIntegrate Databricks with LangfuseExample cookbook on how to monitor DeepSeek models with Langfuse using the OpenAI SDKDSPy - Observability & TracingMonitor Firecrawl Scraper with LangfuseIntegrate Fireworks AI with LangfuseObservability for Google Agent Development Kit with LangfuseObservability and Metrics for Google Vertex AI and GeminiOpen Source LLM Observability for GradioObservability for Groq models with Langfuse IntegrationIntegration HaystackObservability for Hugging Face Models with Langfuse IntegrationObservability & Tracing for InstructorIntegration LangchainOpen Source Observability for LangGraphLangserve IntegrationIntegration Litellm ProxyIntegration Llama-index-callbackIntegration Llama-index InstrumentationIntegration Llama-index Milvus-liteObservability for LlamaIndex with Langfuse IntegrationMonitoring LlamaIndex applications with PostHog and LangfuseObservability for LlamaIndex with Langfuse IntegrationIntegration MirascopeTrace Mistral models with LangfuseMonitor Novita AI with LangfuseOllama Observability and Tracing for local LLMs using LangfuseTrace the OpenAI Agents SDK with LangfuseOSS Observability for OpenAI Assistants APIIntegration Openai SdkObserve OpenAI Structured Outputs with LangfuseIntegrate Portkey LLM Gateway with LangfuseObservability for Pydantic AI with Langfuse IntegrationObservability for Semantic Kernel with Langfuse IntegrationObservability for smolagents with LangfuseMonitor Together AI with LangfuseIntegrate X.ai (Grok) with LangfuseJs Integration LangchainJs Integration Litellm ProxyLlamaIndex.TS IntegrationJs Integration OpenaiMLflow Integration via OpenTelemetryOpenLIT Integration via OpenTelemetryOtel Integration Openllmetry
Was this page helpful?