[BETA Release] Field Profiling

🚧

Beta release disclaimer

When using Beta release features, you may encounter bugs and or edge case limitations. Additionally, there is no guarantee that an Beta feature will progress to the GA release stage.

Field Profiling provides a mechanism to view the metrics captured by Field Health monitors for each enabled field an easy to digest table format. These metrics can be used to better understand the nature of the data in a table to spot inconsistencies, make decisions about what monitors to apply and generally understand how the underlying data is structured.

Configuring Field Profiling for table fields

Field profiles are enabled when a Field Health monitor is applied to fields in a table. The configuration of the Field Health monitor will impact how the metrics are collected (read more below).

To enable field profiling on fields, follow the steps outlined here.

Calculating field profile metrics

The metrics displayed in the profile will be impacted by how the underlying Field Health monitor is configured. For example, if a Field Health monitor is configured to monitor for anomalies using All Records, the metrics will be calculated across all records. If instead, a Field Health monitor is configured to filter for recent data using a timestamp column, only the most recent added records will be used to calculate the metric.

Included metrics

To simplify the UX, we display a subset of collected metrics. View the table below to see which metrics are collected for each type of field.

Field data typeSupported metrics
Text% null
% unique
Min length
Max length
Avg length
Numeric% null
% unique
Min value
Max value
Avg value
% zero
% negative
Datetime% unique
% null
Boolean% unique
% null