Triage agent

The Triage Agent automatically prioritizes and scores Monte Carlo alerts, helping data teams cut through alert noise and focus on the incidents that matter most. It evaluates each alert on two dimensions, incident likelihood (how likely is this a real problem?) and alert impact (how large is the downstream blast radius?), and assigns a HIGH, MEDIUM, or LOW score to each.

By default, the Triage Agent runs automatically on every new alert. Automatic triage can be turned off, restricted, or overridden per domain from your settings (see Configuring the Triage Agent). You can also run triage on demand from the alerts feed, the Operations Agent, or through the MCP server with the Agent Toolkit.

How it works

When triggered, the Triage Agent runs a multi-step pipeline for each alert:

  1. Assessment β€” The agent gathers context about the alert in parallel: anomaly data, failed or futile queries, downstream impact via lineage, 60-day alert history, business criticality of affected assets, recent query changes, orchestrator issues (Airflow, dbt, Databricks), and monitor configuration details.

  2. Scoring β€” Using the gathered context, the agent scores the alert on two axes:

    • Incident likelihood β€” Is this anomaly likely to be a real data quality issue? (HIGH / MEDIUM / LOW)
    • Alert impact β€” If this is a real issue, how large is the downstream blast radius? (HIGH / MEDIUM / LOW)
  3. Optional deep investigation β€” The Triage Agent can chain the Troubleshooting Agent for deeper root cause analysis. This is controlled by the Automated troubleshooting setting, which is off by default. When you enable it, you choose the minimum priority that triggers an investigation: high priority alerts, high and medium priority alerts, or all triaged alerts. See Configuring the Triage Agent.

  4. Results β€” The agent stores the priority score and rationale directly on the alert. You'll see the score in the alerts feed, and can open View triage reasoning on any triaged alert for the full assessment.

Automatic triage

Automatic triage is on by default. Every new alert is triaged as it arrives, so priorities are already scored by the time your team looks at the feed. Triaged alerts show their score in the alerts feed β€” high, medium, and low priority are color-coded red, orange, and green.

Configuring the Triage Agent

You control automatic triage in two places: account-wide settings, and per-domain overrides.

Account-wide settings

Go to Settings > AI Agents (getmontecarlo.com/settings/ai-agents). Under Triage agent:

  • On / off toggle β€” Turn automatic triage on or off for the whole account. This sets the default β€” see Domain-level overrides below for how domain overrides interact with it.
  • Usage restrictions β€” Choose by:
    • Do not restrict (the default)
    • Limit to free usage only, which caps automatic triage at the free monthly allowance of triaged alerts (20 alerts).
    • Restrict to a monthly limit, which allows you to designate the maximum amount of alerts that can be triaged per month.

These limits apply account-wide, across every domain: once your account's monthly allowance is used, automatic and manual triages are paused.

  • Automated troubleshooting β€” Choose whether the Troubleshooting Agent runs automatically on triaged alerts, and at what minimum priority:
    • Do not troubleshoot automatically (default)
    • High priority alerts
    • High and medium priority alerts
    • All triaged alerts

A cost estimate based on your last 30 days of alerts is shown on the page to help you gauge the impact of your settings before you save.

ℹ️

The Troubleshooting Agent has its own usage restrictions in Settings > AI Agents, under Troubleshooting agent. These apply whenever it runs, including when it is chained to triage.

Domain-level overrides

Any domain can override the account-level triage automation settings for the alerts it contains. Open the domain, go to its About tab, and find the Triage agent section:

  • Automated triage β€” Inherit the account setting (default), or override it on or off for this domain.
  • Automated troubleshooting β€” Inherit the account setting, or override the minimum priority that triggers an investigation for this domain.

Leaving the domain settings to "inherit" will keep that domain in line with the account setting defaults. This lets you, for example, keep automatic triage on account-wide but turn off automated troubleshooting for a specific domain, or vice versa.

Running triage on demand

Automatic triage covers new alerts, but you can also run the Triage Agent yourself at any time.

In the Monte Carlo UI

  • Alerts page β€” Click the Triage alerts button to run the agent on your currently filtered alerts (up to 50 at a time). The agent processes alerts in batch and buckets them into high, medium, and low priority groups. Each triaged alert gets a View triage reasoning icon showing the agent's scoring rationale.
  • Operations Agent β€” Ask the Operations Agent to triage your alerts in natural language, and it routes to the Triage Agent automatically.

Results appear the same way as automatic triage: as a priority score on each alert, with the full rationale available via View triage reasoning.

Via the Agent Toolkit (MCP)

The automated-triage skill in the Agent Toolkit exposes triage through MCP tools in AI coding agents like Claude Code and Cursor. You can trigger it with natural language:

  • "Triage my alerts"
  • "What alerts are firing?"
  • "Triage alert <uuid>"

The skill provides these MCP tools: get_alerts, alert_assessment, run_troubleshooting_agent, get_troubleshooting_agent_results, update_alert, set_alert_owner, create_or_update_alert_comment, and mark_event_as_normal.

Access control

Two different permissions apply to the Triage Agent, and they are deliberately distinct:

  • May run triage on demand β€” ai-agents/triage/edit. Every built-in role grants it by default except mcd/viewer β€” because running triage updates alerts, it is a write operation. Viewers can still see triage priority scores and reasoning; only the ability to run triage is withheld. This permission gates the on-demand surfaces only (the Triage alerts button, the Operations Agent, and the Agent Toolkit).
  • May administer its settings β€” settings/ai-agents/access (read) and settings/ai-agents/edit (write). Govern who can open Settings > AI Agents and view or change the Triage Agent's configuration: the automatic-triage on/off toggle, usage restrictions and limits, and automated troubleshooting. This is separate from running triage: a user can run triage on demand without being able to change these account-wide settings, or vice versa.

Automatic triage is not gated by either run permission. It is account-level and system-initiated: once enabled, a background service user runs it on every new alert, gated by the account settings and budget β€” not by any individual user's permissions. So the lever that controls whether automatic triage executes account-wide is the Settings > AI Agents toggle, which means it is governed by settings/ai-agents/edit (who may flip the toggle), not by ai-agents/triage/edit (who may run triage by hand). A user who can edit that page can turn automatic triage on for the entire account β€” triggering background runs whose cost applies to the account β€” even if they cannot run triage on demand themselves. See Configuring the Triage Agent.

To restrict who can run triage on demand, or who can administer its settings, see Controlling access to the AI agents in the custom role recipes.

FAQ

How do I restrict access to the Triage Agent?

Running triage on demand is controlled by the ai-agents/triage/edit permission, which every built-in role grants by default except mcd/viewer (running triage updates alerts, so it is a write operation). To restrict who can run it, combine a custom role that denies the permission with your authorization groups. This gates only the on-demand surfaces β€” automatic triage runs account-wide and is controlled in Settings > AI Agents, not by per-user permissions. To control who can administer those settings β€” including who can turn automatic triage on or off for the account β€” restrict the settings/ai-agents permissions instead; this is a separate lever from the run permission. See Access control above, and the Controlling access to the AI agents recipe for the exact policy (deny both settings/ai-agents/access and settings/ai-agents/edit, not the wildcard).

Security & data privacy

For more detail on security and data privacy, see the AI Features and Technical Information documentation.


Did this page help you?