Azure Synapse (beta)
What is Azure Synapse?
Azure Synapse is an enterprise analytics service that accelerates time to insight across data warehouses and big data systems. Azure Synapse brings together the best of SQL technologies used in enterprise data warehousing, Spark technologies used for big data, Data Explorer for log and time series analytics, Pipelines for data integration and ETL/ELT, and deep integration with other Azure services such as Power BI, CosmosDB, and AzureML.
Dedicated SQL Pools
Monte Carlo only connects to Azure Synapse Dedicated SQL Pools (formerly SQL DW). If you require additional Azure Synapse support, please fill out the form here.
Why Connect Azure Synapse to Monte Carlo?
Integrating Monte Carlo with your Azure Synapse Dedicated SQL Pool allows you to monitor your data and tables. Monte Carlo can detect anomalous volume changes out of the box. With the ability to run SQL queries on your Dedicated SQL Pool, you can create advanced monitors to analyze the data in your tables. For a full list of supported monitor types see Monitor Support.
After connecting Azure Synapse here is what you can expect to see out of the box:
Volume
Our volume monitors are active out of the box. By collecting metadata on your tables each hour, Monte Carlo's machine learning algorithm can set automatic thresholds to alert when a table has gone too long without a change in size or when an abnormal amount of rows are added or deleted.
Monitor Support
Below are the supported monitors for the Azure Synapse integration today. Please reach out to your Monte Carlo representative if you have requirements for additional Monitors.
| Category | Monitor Type | Support |
|---|---|---|
| Automated Anomaly Detection | Freshness | |
| Automated Anomaly Detection | Volume | ✅ |
| Automated Monitoring | Schema Changes | |
| Opt-in Monitor | SQL Rule | ✅ |
| Opt-in Monitor | Comparison Rule | ✅ |
| Opt-in Monitor | Field Quality Rule | ✅ |
| Opt-in Monitor | Freshness Rule | |
| Opt-in Monitor | Volume Rule | ✅ |
| Opt-in Monitor | Volume Anomaly Detection | ✅ |
| Opt-in Monitor | Field Health Monitor | ✅ |
| Opt-in Monitor | Dimension Tracking | ✅ |
| Opt-in Monitor | JSON Schema Changes |
Connecting to Azure Synapse
Now that we know the value connecting Azure Synapse to Monte Carlo can bring, here are the necessary steps to set up the integration.
Prerequisites
To create a readonly service account, you will need access to a SQL admin user.
This guide explains how to create a read-only service account for Monte Carlo in your Azure Dedicated SQL Pool.
To review all steps necessary to integrate a data warehouse with Monte Carlo, please see here.
Create a read-only service account
Connect to the master database as the SQL admin and run:
CREATE LOGIN montecarlo WITH PASSWORD = '<password>';
Connect to the Dedicated SQL Pool database as the SQL admin and run:
CREATE USER montecarlo FROM LOGIN montecarlo;
EXEC sp_addrolemember 'db_datareader', 'montecarlo';
FAQs
What hosting solutions are supported?
This integration supports any instance that is reachable from one of our hosting options. Please see the networking docs for more detail.
Updated 5 months ago