Backfill history

When a metric monitor is created, it backfills one year of historical metrics in order to quickly generate a threshold and understand any daily, weekly, or monthly seasonality. This happens through a series of queries that are executed shortly after the monitor is created. Thresholds will typically show in the Results tab once the backfill is complete AND the monitor has completed at least one scheduled run.

Backfills do not occur if the user has selected "Group rows by none" in the Choose data section. This is because a time field is needed to group the historical data into a meaningful time series.

Progress of the backfill is shown in the 'Backfill' section on the Monitor Details page. One of five states will be shown:

• In progress: the backfill queries are currently running, and a % progress will be shown.
• Incomplete: the backfill queries have errored or timed out. The user has the option to "Retry" the backfill.
• Complete: the backfill completed successfully
• Queued: when there are several other monitors backfilling at the same time, others will be queued to avoid overloading the warehouse. Specifically, no more than 4 monitors will be backfilling at the same time.
• Skipped: the backfill was not attempted, though the user can click to "try anyway". This state exists as a guardrail against excessively large queries. A reason for skipping will be displayed for the user, such as:
  • Backfills are not automatically run for tables larger than 1 TB
  • Backfills are not automatically run for monitors with more than 1000 segments
  • Backfills are not automatically run for monitors with more than 40 fields