Metastore + Query Engine Functionality Matrix

These charts provide a comparative view of Monte Carlo’s integrations across different data lake metastores and query engines. The matrices below outline which features are supported for each metastore–engine combination, so you can quickly understand what functionality is available in your specific setup.

Use this reference to:

  • Confirm supported capabilities for your current architecture
  • Compare functionality across different metastore and query engine options
  • Identify any limitations or considerations when planning an integration

Glue (metastore only)

CategoryMonitor / Lineage CapabilitiesGlue
Table MonitorFreshness (Time since last update)
Table MonitorFreshness (Time since last row count change)
Table MonitorVolume
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage

Glue + Athena

CategoryMonitor / Lineage CapabilitiesGlue + Athena
Table MonitorFreshness (Time since last update)🚧 (Determined from write Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage

Glue + Hive SQL

CategoryMonitor / Lineage CapabilitiesGlue + Hive SQL
Table MonitorFreshness (Time since last update)🚧 (Determined from write S3 Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage🚧 (Relies on S3 query logs)

Glue + Presto

CategoryMonitor / Lineage CapabilitiesGlue + Presto
Table MonitorFreshness (Time since last update)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage🚧 (Relies on S3 query logs)

Glue + Spark

CategoryMonitor / Lineage CapabilitiesGlue + Spark
Table MonitorFreshness (Time since last update)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage

Hive (metastore only)

CategoryMonitor / Lineage CapabilitiesHive (MS only)
Table MonitorFreshness (Time since last update)
Table MonitorFreshness (Time since last row count change)
Table MonitorVolume
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage

Hive MS + Hive SQL

CategoryMonitor / Lineage CapabilitiesHive MS + Hive SQL
Table MonitorFreshness (Time since last update)🚧 (Determined from write S3 Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage🚧 (Relies on S3 query logs)

Hive MS + Presto

CategoryMonitor / Lineage CapabilitiesHive MS + Presto
Table MonitorFreshness (Time since last update)🚧 (Determined from write S3 Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage🚧 (Relies on S3 query logs)

Hive MS + Spark

CategoryMonitor / Lineage CapabilitiesGlue + Spark
Table MonitorFreshness (Time since last update)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes
Metric MonitorMetric
Metric MonitorComparison
Validation MonitorCustom SQL
Validation MonitorValidation
Job MonitorQuery performance
LineageLineage