Langfuse launches AI Gateway Learn more

Run compliant financial services AI in production

Run compliantfinancial servicesΒ AIin production

Observe and evaluate AI agents across your institution. Give engineering, platform, and risk teams visibility into production behavior, with deployment in Langfuse Cloud or your own infrastructure.

  • 01

    Standardize observability and evals across teams: Bring agents across frameworks, models, and gateways into a shared view of traces and evaluations.

  • 02

    Ship reliable agents with clear deployment quality gates: evaluate model and agent changes against datasets before release.

  • 03

    Retain execution history: keep traces of AI executions as evidence for supervisory and regulatory reviews.

  • 04

    Flag potential policy violations: with evals that score outputs against your policies and regulations.

  • 05

    Self-host or air-gap: deploy with no internet access, lock to internal users via VPN to cater for data sensitivity needs.

ISO 27001SOC 2GDPR

Talk to a financial services expert at Langfuse

Loading form...

Run Langfuse where your data is allowed to live

  1. 01

    Never in the inference path

    Langfuse observes your model and tool calls; it does not proxy them. Docs β†’

  2. 02

    Deployment where your data must stay

    Langfuse Cloud in the EU, US or Japan, self-hosted in your VPC, or fully air-gapped. Docs β†’

  3. 03

    Multiple layers of data redaction

    Client-side and server-side PII protections before anything is stored. Docs β†’

  4. 04

    Enterprise access controls

    SSO and role-based access control scoped to organizations and projects. Docs β†’

  5. 05

    Audit logs

    Record both LLM activity and developer actions for internal and supervisory review. Docs β†’

Deployment mode

Managed cloud in the EU, US or Japan.

Your app→OTel SDK→Langfuse Cloud

Regions
EU, US, JP
Certifications
SOC 2 Type II, ISO 27001
Data residency
Pinned to region
Support
Enterprise SLA
Docs β†’

Built for AI evaluation needs of financial institutions

Platform and risk teams in financial services are looking for a complete observability and eval suite. Langfuse covers the full surface, and we are open about where the work lives in your pipeline rather than in our UI.

Evaluate AI quality

Test before release. Monitor production. Review with your experts.

Offline evaluation

Golden datasets built from production traces, versioned experiments with baseline comparison, and a release gate that fails the pull request on regression.

Docs β†’
Online evaluation

Deterministic sampling of live traffic, LLM-as-judge and code evaluators, and threshold alerts to Slack, webhooks, or GitHub Actions when quality drifts.

Docs β†’
Human review

Annotation queues for subject-matter experts, corrected outputs, and one-click promotion of failures into a permanent regression set.

Docs β†’
Judge calibration

Score Analytics measures agreement between human labels and model judges (Cohen's Kappa, F1, Pearson, Spearman) so you can defend the judge to model risk.

Docs β†’

Govern AI systems

Control changes, protect sensitive data, and manage access.

Prompt governance

Immutable versions, staging and production labels, protected labels for separation of duties, and full audit history.

Docs β†’
Redaction

Masking in the SDK before data leaves your application, with trace structure preserved for debugging.

Docs β†’
Administration

Organizations and projects as the data boundary, project-level RBAC, OIDC SSO with domain enforcement, SCIM provisioning, audit logs, and a metrics API for chargebacks.

Docs β†’

Use your own stack

Connect your models and manage deployment in your infrastructure.

Gateway & models

OTLP ingest from your AI gateway, judge models pinned to your own Bedrock, Azure OpenAI, Vertex, or OpenAI connection.

Docs β†’
Dashboards as code

Dashboards and widgets managed through the API and CLI, versioned in Git, deployed identically to dev, staging, and prod.

Docs β†’
Operations

Documented self-hosting on AWS with Terraform and Helm, a published release cadence, and autoscaling guidance.

Docs β†’

Use cases

What financial services teams build on Langfuse.

Compliance monitoring

Run evals that check AI outputs against loaded regulations and policies. Catch non-compliant responses across back-office and customer-facing flows before they ship.

AML (anti-money laundering)

Support anomaly detection and investigation workflows β€” reduce cost of service and risk with better observability of agent/tool behavior.

AI-powered advisory

Observe and improve multi-step advisory flows, score outcomes, and keep an audit trail suitable for model risk review. Evaluate your system on representative cases before it runs in production.

Credit onboarding & underwriting

Trace agents that combine identity, fraud and credit-bureau checks into a risk summary. Score decisions, flag drift, and keep the auditable trail that credit and model risk teams require.

Govern coding agents across the whole engineering organization

Trace Claude Code, Codex, Cursor, OpenCode, and GitHub Copilot β€” no proxy required. See cost per developer and model, replay failed sessions, and search across the org.

Learn how to ship reliable agents in financial services

Start with the steps from prototype to production, then see how teams like Trade Republic run Langfuse in production.

FAQ

Yes. You can deploy Langfuse in your own cloud, VPC, or on-premises infrastructure. Langfuse supports deployments without public internet access (air-gapped); features such as LLM-as-a-judge evaluations need a model endpoint reachable within your environment. Our team can help you assess the setup for your deployment and security requirements. Self-hosting, networking documentation.

Configure SDK masking to remove or replace sensitive inputs, outputs, and metadata before trace data leaves your application. You can also apply masking centrally through an OpenTelemetry Collector within your infrastructure. Combine these controls with project separation and role-based access to determine which teams can access the data you choose to retain. Masking, access controls.

Langfuse's observability integrations collect and export traces in the background while your application continues to call its model provider or gateway. You do not need to route model requests through Langfuse to use observability. If you also use prompt management, SDK caching and fallback prompts help keep your application resilient to connectivity issues. Background export, prompt availability.

Langfuse integrates with gateways such as Kong and LiteLLM to capture model calls, token usage, cost, and latency. Its OpenTelemetry support lets you add AI tracing and evaluation alongside your existing observability stack. Gateway integrations, LiteLLM, existing OpenTelemetry setups. The Langfuse AI Gateway (beta) brings model access controls together with tracing and cost tracking for OpenAI and Anthropic.

Configure retention policies per project and schedule exports of observations and evaluation scores to your own Amazon S3, Google Cloud Storage, or Azure Blob Storage. This lets you preserve exported records under your institution's storage and retention policies. Set up exports before data expires, as data deleted by retention policies cannot be recovered. Data retention, scheduled exports.

Langfuse Cloud is fully managed, with subscription plans and usage-based pricing. Self-Hosted Enterprise runs in your infrastructure, with enterprise administration features and support under a custom commercial agreement; your team operates the deployment. Both Enterprise options include unlimited users. Talk to us to compare features, support, and total costs for your requirements. Cloud pricing, Self-Hosted Enterprise pricing.

Working on AI in banking, insurance or capital markets?

Talk through deployment options, compliance needs, and how teams like Trade Republic use Langfuse in production.

or Talk to an expert

No credit card required, free tier available, self-hosting option


Was this page helpful?