Can I get notified when a score drops?
Yes, with alerts. When you create an alert, choose a score data source (Scores (numeric), Scores (categorical), or Scores (boolean)), filter for your score name, and pick an aggregation and threshold, for example average helpfulness below 0.7 over the last hour. For boolean scores, the average is the share of true values.
When the alert fires, Langfuse notifies you through an automation: Slack, a webhook, or PagerDuty. You can also create alerts directly from an evaluator.
There is no webhook that fires for every individual score. Alerts evaluate aggregated score values over a time window.
Was this page helpful?
Last updated on
