Alerts
Set up alerts to get notified when your LLM metrics cross a threshold. Alerts are evaluated every 5 minutes against your recent trace data.
Supported Metrics
| Metric | Description |
|---|---|
error_rate | Percentage of requests that returned an error |
latency_p50 | Median latency |
latency_p95 | 95th percentile latency |
latency_p99 | 99th percentile latency |
cost_total | Total cost in USD within the evaluation window |
request_count | Number of requests within the evaluation window |
Conditions
Each alert uses a condition operator: gt (greater than), gte, lt, lte, eq.
Example: "Alert me when error_rate is gt 5" fires when your error rate exceeds 5%.
Notification Channels
| Channel | Target Format | Notes |
|---|---|---|
| email@example.com | Sent via Resend | |
| Slack | https://hooks.slack.com/services/... | Incoming webhook |
| Discord | https://discord.com/api/webhooks/... | Discord webhook |
| PagerDuty | Integration Key (32-char) | Events API v2 with auto-resolve |
| Webhook | https://your-server.com/alerts | POST with JSON payload |
Setting Up Alerts
Go to Settings → Alerts in your dashboard. Click "Create Alert" and configure the name, metric, condition, threshold, evaluation window, cooldown period, and notification channels.