July 31, 2025Langfuse July Update
Langfuse July Update: Playground Side-by-Side Comparison, real-time alerts (Webhooks & Slack) for prompt changes, usage alerts on Langfuse Cloud, and one-click remote experiments for non-technical teammates.
With Q3 in full swing, we've shipped product updates to speed up your development: Side‑by‑side Playground testing, real‑time alerts (Webhooks & Slack) for prompt changes, usage alerts on Langfuse Cloud, and one‑click remote experiments for non‑technical teammates.
Q3 Roadmap Highlights & Townhall
Earlier this month, we held our Q3 planning and a community Townhall. Here are some of the highlights we will be working on in Q3:
- Agent observability: unified agent graphs, richer tracing (tool‑call span types), built‑in agent evaluations across conversation/response/turn/trajectory.
- Evaluation: rule‑based evaluators; LLM‑as‑judge at multiple levels with debugging & cost tracking; comparison dashboards (correlation, confusion matrix, overlap); SDK abstraction for dataset runs.
- Data, prompts & platform: multimodal support for Datasets & Playground; I/O schema validation; tool/function support in Prompt Experiments; platform webhooks; in‑app routing.
→ View the public roadmap → Watch the Town Hall Recording
Playground Side-by-Side Comparison
![]()
Open multiple chat windows in parallel to compare prompts, models, variable inputs, or tools, and restore the test state.
This enables faster A/B testing, fewer open tabs, and shorter feedback cycles.
Slack & Webhooks for Prompt Changes
![]()
We added Webhooks and a Slack integration to get real-time notifications for new prompt versions, changes to deployment labels or tags, and other edits.
We’re expanding webhook triggers to cover more Langfuse events soon.
Trigger Remote Custom Experiments
![]()
You can now trigger external Dataset Runs directly from the Langfuse UI. This feature enables non-technical users to run tests on Datasets without requiring code changes or manual setup.
→ Trigger a remote Dataset Run
New docs and integration pages
![]()
We reorganized our docs and integration guides to make discovery easier across observability, prompts, and evals.
→ Explore our new documentation and integration pages
More July Releases
- Usage Alerts (Cloud): Set a threshold for monthly events; we'll notify you once per billing cycle when you cross it.
- Sessions in the Annotation Queue: Integrate Sessions into your human annotation workflow.
- n8n Node: Fetch Prompts from Langfuse Prompt Management into your n8n workflow.
- Prompt Full-Text Search: Search through all your prompts to help find and organize large prompt collections.
- LiveKit Integration: Trace your LiveKit agents to see latencies, costs and use it together with other Langfuse features.