Setting Up Monte Carlo
Deprecated
As of January 2024, the Monte Carlo Data Collector Deployment Model has been deprecated in favor of the Agent and Object Storage Deployment models. Please see Architecture & Deployment Options for more information.
Overview
In order for Monte Carlo to work, the system needs to be able to:
- Collect metadata from your data warehouses and lakes so it can see what data exists and how it is organized
- Ingest query logs from your data warehouse or lake so that it can understand how data is moving through your environments
- Run queries against your data to aggregate/ derive a handful of metrics and statistics used for anomaly detection
- Access metadata from your BI tools to display information about your reports and dashboards, such as titles and authors
To accomplish these goals, Monte Carlo uses the following architecture, which involves a data collector being installed in your own AWS environment. The data collector connects to your systems in order to perform the actions outlined above, and the necessary information is sent back to Monte Carlo to power anomaly detection, alerts and the dashboard.
Setup process
A typical Monte Carlo setup will include the following steps:
- Creating a Monte Carlo account (3 minutes)
- Deploying Monte Carlo's collector (10 minutes)
- Connecting with your data warehouse (20 minutes) or data lake (several hours)
- Connecting with your BI tool (10 minutes)
Updated 10 months ago
This architecture was designed with Security and Data Privacy top of mind. Read more details about our security practices here.