For many businesses, incoming data looks very different during major holidays. Maybe there is more or less data than normal, or the profile of that data is much different. For example, a financial technology firm may see less new data than normal on July 4, because markets are closed in the United States. Or an e-commerce company based in the United States may see more new data than normal on Black Friday, because it's one of the busiest shopping days of the year.

You can now easily use exclusion windows to Manage Holidays in order to:

  • Remove the unusual holiday data from influencing machine learning thresholds
  • Avoid receiving unwanted alerts during holidays

The available holidays include the 11 Federal Holidays within the United States, plus a few additional unofficial holidays that often influence data (e.g. Black Friday).

dbt Job and model info are now overlaid on lineage. Job info is shown on lineage edges, model last run status and timestamp are shown on nodes.

Table and column tags are now automatically imported from Unity Catalog to Monte Carlo. Table tags will show up on Assets page, General Information tab, column tags will show up on Field Lineage tab. Make sure your data collector is updated to the latest version.

Monte Carlo now has a dedicated native app in the Microsoft Teams Store. It allows anomaly detections to be sent to any public channel in your workspace for quick triage and collaboration.

Learn more in the revamped Microsoft Teams integration documentation.

The data operations dashboard provides a look at team operational metrics:

  • How quickly are we responding to alerts?
  • How many incidents did we have and of what severity?
  • How quickly are we resolving incidents?

The key changes around reporting on data operations are:

  • Reporting on alerts marked as incidents rather than just alerts
  • Drilling into dashboard content to see individual alerts and incidents
  • Filtering an any grouping of alerts: Domains, Data products, Audiences, and Tags (monitor tags coming soon!)
  • Ability to save custom dashboards based on filter sets you frequently visit

Learn more about metrics, filters, and saving dashboards in the Data operations (beta) documentation!

The data operations dashboard has replaced some of the content on the data reliability dashboard and the data reliability dashboard is being deprecated. Some of the content has moved to the Activity dashboard. If you have needs around deprecated content, please reach out here. This is a beta release.

The actions available on Slack notifications now match the alerts in the web application. With any alert, Acknowledge, Resolve, or Mark as incident with quick action buttons. You can still set owners, snooze rules, and more in the overflow actions.

Monte Carlo is upgrading its internal collection platform architecture and will be phasing out the Data Collector. To ensure a smooth transition and maintain seamless connectivity to active integrations, customers are required to perform specific actions within designated timeframes.

Starting July 31, 2024, account owners will be contacted if any action is required. The timelines for these actions may vary depending on your deployment. If you do not receive a notification, no action is necessary at this time. This post serves primarily as an informational update.

For further details, including documentation and FAQs, please visit: https://mc-d.io/Nq2ao1k

Should you have any questions, feel free to reach out to us at [email protected]. We are always here to assist you!