Setting Up Freshness SLI Monitors

🚧

Last Updated: August 1, 2022

Transcript

Hi there! In this video, we're going to see how to create a freshness monitor, or service level indicator monitor, in Monte Carlo. We'll start by navigating to the monitor tab, and then clicking on "Create New Monitor" here, to see the list of all the available custom monitors that you can create in Monte Carlo:

19121912

Create New Advanced Monitor

In this video, we're going to focus on this one - Freshness SLI:

522522

Freshness SLI

As you know, Monte Carla provides freshness monitoring and alerting as part of our machine learning, out of the box detectors. However, in certain cases, this out of the box detection may not be explicit enough, and you may want to supplement it with a freshness SLI which is more tailored to your business needs.

To provide a very sample use case for this monitor: imagine you are responsible for a table, which is needed to build a critical daily report or measure progress against an important KPI. This table needs to be updated every day before the report is run to ensure it's up to date with fresh data. In this case, you're going to set up a freshness SLI to ensure that you get alerted as soon as this table update hasn't occurred by the time it was expected. This way you can troubleshoot and fix the problem before the report is run with all data or notify the relevant stakeholder so they hold off from running the report until the problem is solved.

Let's see how to configure this monitor. The first thing after clicking on "Configure Monitor" will be to provide the table in which we want to configure this monitor, so I'll choose this table for example.:

19181918

Choose a Table

Then the second step will be providing the schedule for this monitor which is how frequent you want this monitor to run. You will specify a number of minutes, hours, days, or weeks for the frequency. And you will also providing a start time date and time:

19171917

Set the Frequency

Then as well as providing a freshness breach threshold which is basically telling Monte Carlo when you want to be alerted. In this case, you can choose to be notified when the table does not update within the last, for example, number of six minutes, hours, days, or weeks:

964964

Choose a Threshold

So going back to our previous example, let's imagine that this important report needs to be run every morning at 11:00 AM, so I want to make sure that the table that is used to build it is updated every morning around 10:00 AM. In that case, I want to set this up so that this run is run every one day, starting, for example, I will say tomorrow at 10:30 AM, and then I want to be notified if the update hasn't happened within the previous one hour:

951951

Setting Up the Example

That way if Monte Carta will be taking around 10:30 AM, I will be notified if an update hasn't happened in this table in the previous one hour. The last thing will be to provide a name for our monitor and click on "Continue":

952952

And that's it! We have created our Freshness SLI monitor. I hope this was helpful and please feel free to reach out to [email protected] or the chat bot in the lower right hand corner if you have any more questions.

Thank you for watching!


Did this page help you?