← Back to changelog

September 2, 2026

Create alerts for evaluators

Tobias Wochinger

Create score and cost alerts directly from evaluator pages and review every alert linked to an evaluator.

You can now create and manage alerts directly from the evaluator workflow. Langfuse prefills the metric and filters, so you only need to set the threshold and choose how your team should be notified.

• Get notified when an evaluator's average numeric or Boolean score drops below your quality target.
• Watch categorical score counts for changes in topics, failures, or policy outcomes.
• Set a cost threshold for one LLM-as-a-Judge evaluator or for all evaluators combined.