Databricks Metastore and Delta Lake support
about 3 years ago
Monte Carlo now can connect to any Databricks metastore (central, glue, or hive) and the upcoming Unity Catalog for both delta and non-delta tables to provide our standard freshness and volume detectors for any delta tables.
To learn more about this feature visit the docs here:
- Databricks central metastore + Delta: https://docs.getmontecarlo.com/docs/databricks-metastore
- Glue catalog or an external Hive metastore + Delta: https://docs.getmontecarlo.com/docs/delta-lake
Note: We do not yet support lineage Spark-based environments - we are working with the Databricks team to ingest lineage via their Unity Catalog when it ships to GA later this summer.