Guides
ChangelogStatus PageAPI ExplorerAPI ReferenceCLI ReferenceBlog

Metastore + Query Engine Functionality Matrix

These charts provide a comparative view of Monte Carlo’s integrations across different data lake metastores and query engines. The matrices below outline which features are supported for each metastore–engine combination, so you can quickly understand what functionality is available in your specific setup.

Use this reference to:

  • Confirm supported capabilities for your current architecture
  • Compare functionality across different metastore and query engine options
  • Identify any limitations or considerations when planning an integration

Glue (metastore only)

CategoryMonitor / Lineage CapabilitiesGlue
Table MonitorFreshness (Time since last update)❌
Table MonitorFreshness (Time since last row count change)❌
Table MonitorVolume❌
Table MonitorSchema Changes✅
Metric MonitorMetric❌
Metric MonitorComparison❌
Validation MonitorCustom SQL❌
Validation MonitorValidation❌
Job MonitorQuery performance❌
LineageLineage❌

Glue + Athena

CategoryMonitor / Lineage CapabilitiesGlue + Athena
Table MonitorFreshness (Time since last update)🚧 (Determined from write Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage✅

Glue + Hive SQL

CategoryMonitor / Lineage CapabilitiesGlue + Hive SQL
Table MonitorFreshness (Time since last update)🚧 (Determined from write S3 Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage🚧 (Relies on S3 query logs)

Glue + Presto

CategoryMonitor / Lineage CapabilitiesGlue + Presto
Table MonitorFreshness (Time since last update)❌
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage🚧 (Relies on S3 query logs)

Glue + Spark

CategoryMonitor / Lineage CapabilitiesGlue + Spark
Table MonitorFreshness (Time since last update)❌
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage❌

Hive (metastore only)

CategoryMonitor / Lineage CapabilitiesHive (MS only)
Table MonitorFreshness (Time since last update)❌
Table MonitorFreshness (Time since last row count change)❌
Table MonitorVolume❌
Table MonitorSchema Changes✅
Metric MonitorMetric❌
Metric MonitorComparison❌
Validation MonitorCustom SQL❌
Validation MonitorValidation❌
Job MonitorQuery performance❌
LineageLineage❌

Hive MS + Hive SQL

CategoryMonitor / Lineage CapabilitiesHive MS + Hive SQL
Table MonitorFreshness (Time since last update)🚧 (Determined from write S3 Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage🚧 (Relies on S3 query logs)

Hive MS + Presto

CategoryMonitor / Lineage CapabilitiesHive MS + Presto
Table MonitorFreshness (Time since last update)🚧 (Determined from write S3 Query Logs - not metadata)
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage🚧 (Relies on S3 query logs)

Hive MS + Spark

CategoryMonitor / Lineage CapabilitiesGlue + Spark
Table MonitorFreshness (Time since last update)❌
Table MonitorFreshness (Time since last row count change)🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorVolume🚧 (Only available when row count collection is enabled - Explicit thresholds unavailable)
Table MonitorSchema Changes✅
Metric MonitorMetric✅
Metric MonitorComparison✅
Validation MonitorCustom SQL✅
Validation MonitorValidation✅
Job MonitorQuery performance❌
LineageLineage❌

Updated 8 months ago

Did this page help you?