User can now select specific metrics to monitor within Field Health. By selecting just specific metrics, users can perform more targeted monitoring that are executed more efficiently.
Note, for new field health monitors, there are now just 4 metrics selected by default: % null% unique% zeromean. Additional metrics will need to be opted in.
Previously in the assets page we were only showing pull requests related to a table that were merged within the last 7 days. Now customers can see all past PRs up to the time when the Github integration was set up.
For Field Health monitors with segmentation fields selected, the initial execution of the monitor will now collect metrics from the trailing 7 days. This jumpstarts the training of the machine learning detectors, shortening the amount of time they need to 'warm up' and allowing users to receive meaningful anomalies, faster.
You'll see this on the Assets page, Incidents, Freshness and Volume Rule builder, and anywhere else where Freshness or Volume charts are displayed. The new look and feel allows for more better navigation and easier interpretation of the metrics being displayed by these monitor types, including:
Adjustable time-window slider on the X-axis
Cleaner, more reactive, and more informative tooltip
Synchronized actions between Freshness and Volume charts on the Assets page
Referential Integrity is a common test to ensure that the values in a field always have corresponding records in another table. For example, make sure that the customer field in orders table all have a matching customer in the customer_fact table.
You can now set these up through Monte Carlo without needing to write any SQL.
MC is releasing a brand new dashboard with the aim of helping you understand performance issues in your data stack. The dashboard allows you to explore the performance of "write" queries run in the past 4 weeks with a number of different filters as well as dig into each queryâs deeper context through a detail drawer with volume correlation, runtime breakdown, and other metadata. This is currently only enabled for Snowflake customers, however, we plan to release the dashboard for BigQuery and Redshift soon.
To use the Performance Dashboard, please click on the Performance tab in the MC UI.
Often checking the data output is not enough to fully understand a data incident. With the Monte Carlo Airflow Integration, you can quickly determine what Airflow DAG potentially caused an Incident. Root cause and time to resolution can happen faster than ever when you can get visibility between Airflow and your Data Warehouse in a single pane of glass. See more about the Airflow integrations in docs.
There is now a chart that displays dbt test run data for a model in the assets page for a table. This makes it a lot easier to spot test performance trends for a particular model!
We have introduced a new chart that appears above the dbt model run data table in the Assets page for a particular table in an effort to help you spot performance trends and anomalous runs.
You are now able connect your dbt Cloud account with MC through our UI on the Integrations page within Settings. This change makes the process to integrate a lot speedier and more intuitive as well as making it easier to create dbt Cloud integrations with webhooks, which enables us to get your dbt data in real-time.