Setting Up Monte Carlo
In order for Monte Carlo to work, the system needs to be able to:
- Collect metadata from your data warehouses and lakes so it can see what data exists and how it is organized
- Ingest query logs from your data warehouse or lake so that it can understand how data is moving through your environments
- Run queries against your data to aggregate/ derive a handful of metrics and statistics used for anomaly detection
- Access metadata from your BI tools to display information about your reports and dashboards, such as titles and authors
To accomplish these goals, Monte Carlo uses the following architecture, which involves a data collector being installed in your own AWS environment. The data collector connects to your systems in order to perform the actions outlined above, and the necessary information is sent back to Monte Carlo to power anomaly detection, alerts and the dashboard.
A typical Monte Carlo setup will include the following steps:
- Creating a Monte Carlo account (3 minutes)
- Deploying Monte Carlo's collector (10 minutes)
- Connecting with your data warehouse (20 minutes) or data lake (several hours)
- Connecting with your BI tool (10 minutes)
Updated about 2 months ago
This architecture was designed with Security and Data Privacy top of mind. Read more details about our security practices here.