DocsIntegrationsOverview

Langfuse Integrations Overview

Integrate your application with Langfuse to explore production traces and metrics.

Objective:

  1. Capture traces of your application
  2. Add scores to these traces to measure/evaluate quality of outputs

Main Integrations

IntegrationSupportsDescription
SDKPython, JS/TSManual instrumentation using the SDKs for full flexibility.
OpenAIPython, JS/TSAutomated instrumentation using drop-in replacement of OpenAI SDK.
LangchainPython, JS/TSAutomated instrumentation by passing callback handler to Langchain application or using OpenTelemetry.
LlamaIndexPython, JS/TSAutomated instrumentation via LlamaIndex callback system.
HaystackPythonAutomated instrumentation via Haystack content tracing system.
LiteLLMPython, JS/TS (proxy only)Use any LLM as a drop in replacement for GPT. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs).
Vercel AI SDKJS/TSTypeScript toolkit designed to help developers build AI-powered applications with React, Next.js, Vue, Svelte, Node.js.
APIDirectly call the public API. OpenAPI spec available.

Packages integrated with Langfuse

NameTypeDescription
InstructorLibraryLibrary to get structured LLM outputs (JSON, Pydantic)
DSPyLibraryFramework that systematically optimizes language model prompts and weights
MirascopeLibraryPython toolkit for building LLM applications.
Pydantic AILibraryPydantic integration for LLM applications.
OllamaModel (local)Easily run open source LLMs on your own machine.
OpenAI Agents SDKLibraryAgents framework by OpenAI SDK.
PipecatAgentsOpen source framework for building real-time voice and multimodal conversational AI agents.
Amazon BedrockModelRun foundation and fine-tuned models on AWS.
Google Vertex AI and GeminiModelGrants access to Google’s own series of Gemini models as well as various models via the Vertex Model Garden (e.g. Claude3)
AutoGenAgent FrameworkOpen source LLM platform for building distributed agents.
FlowiseChat/Agent UIJS/TS no-code builder for customized LLM flows.
LangflowChat/Agent UIPython-based UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.
DifyChat/Agent UIOpen source LLM app development platform with no-code builder.
OpenWebUIChat/Agent UISelf-hosted LLM Chat web ui supporting various LLM runners including self-hosted and local models.
PromptfooToolOpen source LLM testing platform.
LobeChatChat/Agent UIOpen source chatbot platform.
VapiPlatformOpen source voice AI platform.
InferableAgentsOpen source LLM platform for building distributed agents.
GradioChat/Agent UIOpen source Python library to build web interfaces like Chat UI.
GooseAgentsOpen source LLM platform for building distributed agents.
smolagentsAgentsOpen source AI agents framework.
CrewAIAgentsMulti agent framework for agent collaboration and tool use.
Spring AILibrarySpring-based framework for AI development with built-in OTel tracing for AI calls.
Quarkus LangChain4jLibraryA Quarkus based integration of LangChain4j for AI development with built-in OTel tracing for AI calls
FirecrawlWeb ScrapingWeb scraper that allows you to turn entire websites into LLM-ready markdown.
OpenRouterFrameworkOpenAI-compatible completion API to +280 language models
xAI / GrokModelxAI’s Grok models
CohereModelCohere’s models
Fireworks AIModelFireworks AI’s models
Novita AIModelDeployment for open source and specialized models
CleanlabModel / FrameworkAutomated Evaluations
VoltAgentAgentsOpen source Typescript toolkit to build LLM Agents.
Strands AgentsAgentsOpen source Python framework for building distributed agents.
Agno AgentsAgentsLightweight, high-performance library for building AI Agents

Unsure which integration to choose? Ask us on Discord or in the chat.

⭐️
Stay updated: Star Langfuse on GitHub to get instant notifications about new releases.Langfuse GitHub stars

Request a new integration

We use GitHub Discussions to track interest in new integrations. Please upvote/add to the list below if you’d like to see a new integration.

End to end examples

If you want to see how things work together, you can look at the end-to-end examples below. They are Jupyter notebooks that you can easily run in Google Colab or locally.

Generally, we recommend reading the get started guides for each integration first.

Integrations

Example Decorator Openai LangchainExample - Tracing and Evaluation for the OpenAI-Agents SDKExample - Trace and Evaluate LangGraph AgentsObservability for Agno with LangfuseObservability for AutoGen with LangfuseObservability for Strands Agents with LangfuseIntegration Azure Openai LangchainIntegrate Cohere with LangfuseObservability for CrewAI with LangfuseIntegrate Databricks with LangfuseIntegration Deepseek Openai SdkIntegration DspyMonitor Firecrawl Scraper with LangfuseIntegrate Fireworks AI with LangfuseObservability for Google Agent Development Kit with LangfuseObservability and Metrics for Google Vertex AI and GeminiOpen Source LLM Observability for GradioIntegration Groq SdkIntegration HaystackIntegration Huggingface Openai SdkObservability & Tracing for InstructorIntegration LangchainOpen Source Observability for LangGraphLangserve IntegrationIntegration Litellm ProxyIntegration Llama-indexIntegration Llama-index InstrumentationIntegration Llama-index Milvus-liteMonitoring LlamaIndex applications with PostHog and LangfuseIntegration MirascopeTrace Mistral models with LangfuseMonitor Novita AI with LangfuseOllama Observability and Tracing for local LLMs using LangfuseTrace the OpenAI Agents SDK with LangfuseOSS Observability for OpenAI Assistants APIIntegration Openai SdkObserve OpenAI Structured Outputs with LangfuseTrace Pydantic AI agents with OpenTelemetryObservability for Semantic Kernel with LangfuseObservability for smolagents with LangfuseMonitor Together.ai with LangfuseIntegrate X.ai (Grok) with LangfuseJs Integration LangchainJs Integration Litellm ProxyLlamaIndex.TS IntegrationJs Integration OpenaiMLflow Integration via OpenTelemetryOpenLIT Integration via OpenTelemetryOtel Integration Openllmetry

Was this page useful?

Questions? We're here to help

Subscribe to updates