Scores & Evaluation
Custom via SDKs/API

Custom Scores via API/SDKs

Langfuse gives you full flexibility to ingest custom scores via the Langfuse SDKs or API. This allows you to run custom quality checks on the output of your workflows at runtime, or to run custom human evaluation workflows.

Exemplary use cases:

  • Deterministic rules at runtime: e.g. check if output contains a certain keyword, adheres to a specified structure/format or if the output is longer than a certain length.
  • Custom internal workflow tooling: build custom internal tooling that helps you manage human-in-the-loop workflows. Ingest scores back into Langfuse.
    observation_id=message.generation_id, # optional
    comment="Factually correct", # optional

→ More details in Python SDK docs

Was this page useful?

Questions? We're here to help

Subscribe to updates