We now have field lineage available for Databricks assets that are on Unity Catalog. To use this feature, make sure you have granted MC access to system table system.access.column_lineage. See details in docs here: https://docs.getmontecarlo.com/docs/overview-databricks#lineage

A beta version of the Motherduck integration is now available. Customers can run custom SQL monitors to observe data in Motherduck. See docs here https://docs.getmontecarlo.com/docs/motherduck

A new lineage experience is now available for all customers, which allows users to digest and navigate lineage more easily and intuitively.

You can now filter by Audiences on the Incidents feed, to quickly get to the list of alerts that match your notification channels.

With the v0.90.0 release of the CLI (scheduled for May 24, 2024), Python 3.7 will no longer be supported due to the the version EOL. You can continue to use Python 3.7 on older versions of the CLI, but going forward, Python 3.8 will be the minimum required version.

Note that, as part of this release, support for Python 3.12 was also added!

For dbt test failures and warnings, we now added in the incident details view
i) the compiled SQL code,
ii) the ability to run that SQL and return the rows,
iii) the ability to edit those queries for ad hoc investigations.

Metric monitors now allow users to define a custom metric using SQL. This allows users to create a metric that:

• Isn't available off the shelf, such asAPPROX_PERCENTILE(order_amount, 0.99)
• References multiple fields at once, such asAVG(price + tax_collected)

Currently, only manual thresholds are supported for custom metrics. See our docs to learn more.

Duplicate (count) is now available within Metric monitors. This metric is a useful alternative to the Unique (%)metric, particularly if you are looking to ensure a column is always 100% unique. On large tables, a small number of duplicates can cause 100% unique to become 99.99999% unique. Which can be hard to visualize in charts and can sometimes be rounded off.

Duplicate (count) is a much easier way to visualize uniqueness. Since if a duplicate emerges, it goes from 0 to 1 instead of 100% to 99.99999% unique.

Duplicate (count) is calculated as the difference between the total number of rows with non-null values and total number of distinct non-null values.

Check out our full list of available metrics.

Automated freshness and volume monitoring are now available for SAP HANA. See docs for more details.

We have revamped the account onboarding to streamline getting started with data observability for your organization. Think of it as a fresh coat of paint, but the engine got a big tune up too.