This guide is intended for new users to quickly acclimate themselves to your existing Monte Carlo instance.
If you'd like to learn more about setting up Monte Carlo, please visit the setup guide.
If you'd like to learn more about Monte Carlo in general, please visit the overview here.
In your Monte Carlo instance, you'll see the sections details below. Click on each to find out more about the features included in each.
- Assets - Single pane of glass for your data ecosystem
- Incidents - Command center for data incidents
- Monitors - Configuration for custom data monitoring
- Dashboards - Insights and reporting on your Monte Carlo instance
- Settings - Platform configurations (including notification setup)
Monte Carlo's Assets provides users with a single pane of glass to see all of the data assets that are connected to your Monte Carlo instance. All metadata about assets in the warehouse/lake as well as your BI tool are collated in Assets.
To start using Assets, try typing in a data asset you are interested in (Note: a data asset can be an external table, a table or a view). In this case, we are searching for a table called
subscription in the
staging schema. The catalog's search functionality allows you to search for keywords as well as filter by tags.
Clicking on the table we are interested in, we land on the summary page for that data asset. Here you will be able to see some general information on how often the table is updated and how many rows the table has.
With this view, you can see all metadata Monte Carlo has collected and created about a data asset. You can answer questions like:
- What data assets are upstream or downstream of this table? (See
- How are the fields in this table used upstream and downstream? (See
- How have the columns and data types in this table changed over time? (See
- What queries are being run on this table? (See
- What does the freshness and update pattern look like on this data asset? (See
- What are common patterns of columns in the table? (See
- What incidents have occurred on this table? (See
- What BI reports are connected to this table? (See
- What additional monitoring does this table have? (See
Incidents are data anomalies caught by Monte Carlo. You can learn more about the types of monitoring capabilities Monte Carlo has here.
Monte Carlo's Incidents section is your command center for understanding what is happening in your data ecosystem as well as providing tools to perform root cause analysis and manage the incident to resolution.
The landing page is a feed of all incidents. You can see some filters at the top to filter down to specific types of incidents. Each card on this page is a summary of the incident with a few quick access incident management tools. The
View Incident IQ button will take you to the detail page for a particular incident.
The summary tab of the Incident IQ page for a particular incident will let you know what issues were found, what tables were impacted and what the impact of the incident is. This should be the starting point for you to perform root cause analysis. You can answer questions like:
- What data assets are upstream and downstream of these incident tables? (See
- What queries have been run on the incident tables? (See
- What specific BI reports could be impacted by this incident (See
- Is this incident similar to past incidents that have occurred on this table? (See
Monitoring is the data observability layer of your data ecosystem. Monte Carlo provides base level monitoring out of the box, and also gives you the ability to opt into deeper coverage ML-based monitoring as well as the flexibility to set up monitoring based on your own custom rules. You can find out more about monitors here.
In the Monitors section, you'll see a summary of your instance at the top of the page including what automated monitors you have active, and in the bottom half of the page, you will see a list of all custom monitors that you have in place in addition to the automated monitoring.
Within Monitors, you will be able to perform the following actions:
- View and search through your existing custom monitoring estate
- Click into an existing monitor to see how it is configured, how it is running and what incidents it has generated
- Create new custom monitoring
In the custom monitors list, you can use the carrots on either side of the monitor to click into the detail page for that monitor.
Create Monitor button at the top right takes you to a workflow for setting up each monitor type. To learn more about setting up these monitors, see the Setting up monitors section in our docs.
Monte Carlo provides you with a suite or reporting and insights that you can use to understand your data reliability metrics, data ecosystem health and closely govern your data warehouse usage.
When you go to the Dashboards section, you will land on your Data Reliability dashboard. This is a high level view of your data ecosystem, including data uptime calculations that we create on your behalf. You can find out more about the reporting in this dashboard here. We recommend using this reporting to track progress towards your data quality strategy. This dashboard can answer questions like:
- How long does it take my team to respond to incidents?
- How long does it take my team to resolve incidents?
- What percentage of my tables are incident free?
- How many incidents are my custom monitors generating?
Our Table Health dashboard allows you to search for and view groupings of data assets and see what monitoring coverage they have, as well as how many incidents were related to those data assets. This dashboard is recommended to get a summarized but actionable view of your data observability. You can use it to answer questions like:
- What type of coverage do tables in a given dataset (aka schema) have?
- Do my most important tables have the right coverage?
- What are my noisiest tables?
Note that you can click on the tool icon to the right to set a default view and even set this view as your landing page when you log into Monte Carlo.
You will find our wide variety of point-in-time insights reporting in the Incidents and Insights tab. These reports cover a broad range of insights, but can be used to perform actions like:
- Track which tables we recommend removing due to low usage (see
Table Cleanup Suggestions)
- Track which users are consuming the most in your warehouse (see
Consumption by user)
- Track which queries have the heaviest consumption and which queries have deteriorating performance (See
You can see specifications for all of the insights reports here.
Our Settings section houses most configuration options available to you in terms of how your platform works. The following actions can be performed in this section:
- Manage users, auth groups and SSO setup (See
Single Sign Ontabs)
- Manage the connections for integrations in your data warehouse, BI tool, data orchestrator and notification mediums (See
- Create and manage API keys and run API calls (See
- Create and manage domains, which are logical groupings of data assets (See
- Mute noisy or unimportant datasets and tables (See
Muted Data and Filterstab)
- Use regex to remove unimportant nodes in your table lineage (See
Muted Data and Filters>
Updated 5 months ago
Now that you're familiar with the platform, try setting up some custom monitors