Data exports (public preview)
Data exports are in public preview and will be GA in May 2025.
Overview
Monte Carlo's data exports make it easy to access and analyze critical metadata about your your data observability platform. It replaces our legacy "Insights" reports with a more aligned, flexible, and transparent approach to exporting Monte Carlo data.
With data exports, you can retrieve structured information on Monitors, Alerts, Events (the underlying events in an alert), and Assets—directly from the UI, via API/CLI, or through Snowflake data shares. These exports are refreshed daily and mirror what you see in Monte Carlo, allowing for easy integration into internal workflows, self-service reporting, and deep analysis.
Data exports are available to workspaces on the Scale and Enterprise plans.
Key Benefits
- Rich, structured data for Monitors, Alerts, Events, and Assets
- Reliable, daily-refreshed exports that match what you see in Monte Carlo
- Download directly from relevant Monte Carlo product pages for one-off analysis
- Snowflake data shares available through Monte Carlo customer support
Access methods
Method | Description |
---|---|
UI | Navigate to Monitors, Alerts, or Assets pages and download CSVs. |
API / CLI | For programmatic access. |
Snowflake | Access shared tables via Snowflake data share. Enable through Monte Carlo customer support. |
BigQuery | Example script to export from the CLI coming soon. |
Databricks | Example notebook to export from the CLI coming soon. |
Note: The Alerts export includes both Alerts and their related Events.
CLI
Follow the CLI guide to get set up and see the export CLI docs for more information. Direct download and direct upload to S3 are both options.
Snowflake data share
For Snowflake users, we offer the ability to use data exports via Snowflake's Data Sharing capabilities. This is an opt-in feature, and is available in the following Snowflake data warehouse regions:
AWS: us-east-1, us-east-2, us-west-2, ca-central-1, eu-west-1, eu-central-1, ap-northeast-1, ap-southeast-2
Azure: eastus2, centralus, westeurope, australiaeast, canadacentral
GCP: us-central1, us-east4
Please reach out to support@montecarlodata.com to enable the Snowflake data share.
Migration from Legacy Insights
We're sunsetting the legacy Insights system. Here's what to expect:
- The Insights tab will be removed from the UI
- The “Monitored Tables” insight has been moved to Settings → Table monitors
- Full deprecation will be July 1, 2025. If you have concerns about losing specific insight reports, please reach out to your customer success manager or support@montecarlodata.com.
FAQs
Are exports filtered by domain or audience?
No. Exports include all relevant records. Users restricted to specific domains do not have access to data exports.
Where can I find the export option in the UI?
Look for export/download buttons within the Monitors, Alerts, and Assets pages. There is no centralized "Exports" tab at this time.
How often are exports refreshed?
Daily, roughly between 01:00 - 03:00 UTC. You can generally expect the refresh to be available by 04:00 UTC daily.
Data export schemas
Each export contains a clean, well-documented schema. Fields are consistently named, and join keys are aligned across exports.
Monitors
Field | Description | Data Type | Example |
---|---|---|---|
MONITOR_ID | UUID of the monitor | STRING | 39280e8e-689a-49a8-9ccd-e70b7a7e1bcf |
MONITOR_TYPE | Type of monitor (e.g., validation, custom_sql) | STRING | Validation |
TITLE | Monitor name or description | STRING | SFDC → Account → Account info |
PRIORITY | Priority level | STRING | P3 |
STATUS | Monitor status | STRING | Enabled |
SCHEDULE | Human-readable schedule | STRING | every 1 week(s) starting at Nov 18th 2024 12:30 UTC |
CREATED_AT | Creation timestamp | TIMESTAMP | 2025-01-02T06:25:13.842Z |
CREATED_BY | Creator email | STRING | bhetzel@montecarlodata.com |
LAST_MODIFIED_AT | Last modified timestamp | TIMESTAMP | 2025-01-06T06:25:13.842Z |
LAST_MODIFIED_BY | Last modifier email | STRING | bhetzel@montecarlodata.com |
AUDIENCES | Audience names | LIST | ["data engineering"] |
MONITOR_TAGS | Custom tags | LIST | ["ADDP", "MC-Pilot"] |
DATA_QUALITY_DIMENSION | Dimension category | STRING | Completeness |
ASSET | Associated assets | LIST | ["raw.monolith_export.warehouse_tables"] |
ASSET_ID | UUIDs of assets | LIST | ["asset-123"] |
DOMAINS | Associated domains | LIST | ["Prod Analytics", "Gold Datamart"] |
MONITOR_URL | Link to monitor in UI | STRING | https://getmontecarlo.com/monitors/... |
Alerts
Field | Description | Data Type | Example |
---|---|---|---|
ALERT_ID | UUID of the alert | STRING | 646bb94d-28ec-4ab3-8b2e-283a7bd9e509 |
MONITOR_ID | Associated monitor ID | STRING | 6798620c-a44f-432a-b1cd-e68d585852ba |
DESCRIPTION | Alert message | STRING | Freshness anomalies in [snowflake] analytics:prod |
CREATED_AT | Alert creation time | TIMESTAMP | 2024-09-26T12:04:50.264Z |
STATUS | Current status (e.g., ACKNOWLEDGED) | STRING | Fixed |
FIRST_RESPONSE_TIMESTAMP | Time of first response | TIMESTAMP | 2024-09-27T12:04:50.264Z |
HOURS_TO_FIRST_RESPONSE | Time to respond (hours) | NUMBER | 24 |
RESOLVED_TIMESTAMP | Resolution time | TIMESTAMP | 2024-09-28T12:04:50.264Z |
HOURS_TO_RESOLVED | Time to resolve (hours) | NUMBER | 48 |
OWNER | Owner of the alert | STRING | wrobins@montecarlodata.com |
PRIORITY | Priority level | STRING | P3 |
IS_INCIDENT | Flag for incident status | BOOLEAN | TRUE |
SEVERITY | Severity level | STRING | SEV-2 |
AUDIENCES | Target audiences | LIST | ["platform_services", "data-engineering"] |
RECIPIENT_CHANNELS | Notification channels | LIST | ["wills-slack-channel", "bhetzel@montecarlodata.com"] |
EXTERNAL_LINKS | Linked issues (Jira, etc.) | LIST | ["https://sofi.atlassian.net/browse/ST-686"] |
DOMAINS | Associated domains | LIST | ["analytics"] |
ALERT_URL | Link to alert in UI | STRING | https://getmontecarlo.com/alerts/... |
Events
Field | Description | Data Type | Example |
---|---|---|---|
EVENT_ID | UUID of the event | STRING | e1800f7b-0cc4-4345-93aa-4b64c022a9fe |
ALERT_ID | Linked alert ID | STRING | e1800f7b-0cc4-4345-93aa-4b64c022a9fe |
MONITOR_ID | Linked monitor ID | STRING | 0277dba3-226c-473d-b738-51959a7d097e |
ASSET_ID | Associated asset UUID | STRING | asset-123 |
DATABASE_NAME | Source DB | STRING | raw |
SCHEMA_NAME | Source schema | STRING | monolith_export |
ASSET_NAME | Table or view name | STRING | warehouse_tables |
FULL_ASSET_NAME | Full asset path | STRING | raw.monolith_export.warehouse_tables |
EVENT_TYPE | Type of anomaly | STRING | null_rate |
FIELD | Affected field | STRING | event_app_url |
SEGMENTED_BY | Segment dimension or SQL | STRING | product_type |
SEGMENT | Segment value | STRING | loans |
CREATED_AT | Event timestamp | TIMESTAMP | 2025-01-07T06:25:13.842Z |
ANOMALY_TIMESTAMP | Timestamp of anomaly bucket | TIMESTAMP | 2025-01-06T03:00:00.000Z |
LOWER_THRESHOLD_VALUE | Lower bound | STRING | 0 |
UPPER_THRESHOLD_VALUE | Upper bound | STRING | .0167 |
ACTUAL_VALUE | Observed value | STRING | .35 |
SCHEMA_CHANGES | Changes to schema | LIST | ["fields_added: ['audiences']"] |
DOMAINS | Associated domains | LIST | ["equity_domain", "low_carbon_transition"] |
EVENT_URL | Link to event (if available) | STRING | TBD |
Assets
Field | Description | Data Type | Example |
---|---|---|---|
ASSET_ID | UUID of the asset | STRING | asset-123 |
SOURCE_NAME | Integration name | STRING | snowflake-staging |
DATABASE_NAME | Source DB | STRING | raw |
SCHEMA_NAME | Source schema | STRING | monolith_export |
ASSET_NAME | Table or view name | STRING | warehouse_tables |
FULL_ASSET_NAME | Full asset path | STRING | raw.monolith_export.warehouse_tables |
ASSET_TYPE | Object type | STRING | View |
IMPORTANCE_SCORE | Asset importance | NUMBER | .99 |
ASSET_TAGS | Custom tags | LIST | ["critical", "finance"] |
DOMAINS | Associated domains | LIST | ["Gold", "analytics"] |
ASSET_URL | Link to asset | STRING | TBD |
Updated 3 days ago