11.1.2021 Changelog

We're thrilled to announce field lineage and an early foray into using machine learning to help you determine root cause faster!

What's new

• Field level lineage: View exactly how fields are used to create relationships across tables and differentiate between direct SELECT field relationships and indirect non-SELECT relationships when fields are used in WHERE, JOIN, etc. clauses (learn more here

Improvements and fixes

• WHERE clause custom monitor filter validation: For customers that use WHERE clause filters for Field Health and Dimension tracking monitors, you can now test that the WHERE clause works directly from the UI
• 1st and last measurements for volume graphs: We now show both the 1st and last volume measurements for cases in which an incident was auto-resolved by a follow-on process or job

What's next

• Spark lineage: For our Spark customers, we're working on launching lineage which will allow you to map how queries interact to form lineage
• Circuit Breakers: Trigger Monte Carlo data quality checks and validate incidents with code to stop problematic jobs before they pass data downstream