6.6.2022 Changelog

What's new

• SQL Rules breach data profiling: for SQL rule breaches with sufficient number of breached rows, we now show overview of fields and types of the anomalous records, distribution metrics such as percentiles, and distribution of the most common field values. This feature is available for customers with data collector of version 2939 or later.
• Granular incident type selection: schema changes are now broken down to fields added, fields removed, field type change, and volume anomalies are now broken down to unchanged size, bytes/rows added, bytes/rows removed, and abnormal small size change. The granular types are available via incident feed filter as well as notification route filters.
• Volume SLI revamp and custom sampling: Revamped the volume SLI setup workflow to be more user-intuitive. Enabled volume metadata sampling at custom defined times. Currently supports SLIs based on total table size comparisons; SLIs based on table growth comparisons will be coming soon.
• Dynamic table tags in notifications: users can now add keys of table tags to pass the values of the tags to incident notifications.
• Monitor creation via catalog page: users can now directly create custom monitors from the catalog page of a table.
• In-app notifications: released in-app notifications for product change logs and data collector upgrade reminders.

Improvements and fixes

• Catalog search improvement: for catalog search, brought back the dropdown list of search matches that was previously removed; added grouping of search matches by categories, i.e. View, Table, Field.
• Warehouse credentials storage: customer warehouse credentials are now stored in HashiCorp Vault, an industry-standard secrets management system.
• SSO Disablement: SSO can now be disabled via the UI under Settings.
• Notification filter enhancement: users can now multi-select SQL rules and SLIs in notification filter settings without the selection list closing on every click.

What's next

• Field lineage integration with Looker: see field level dependencies with Looker dashboards.
• SQL rules variables: users will be able to set up custom SQL rules for multiple tables/fields at once, streamlining the creation and management of large number of SQL rules.
• Volume SLI based on table growth comparisons: the next version of release will enable customers to set up volume SLIs against volume growth measurements in addition to the existing total volume measurements.