Skip to main content

Model Status and SLA Monitoring

Internal Guidelines

Ana Paula Capossio avatar
Written by Ana Paula Capossio
Updated over 7 months ago

Understanding the status of our predictive models is key to ensuring optimal campaign performance and prompt issue resolution. Below is an overview of the three status categories—Green, Yellow, and Red—along with their respective conditions and communication messages for internal use.

🟢 GREEN: Models Operating as Expected

  • Condition 1: Local Models are OK
    The local model is functioning within the expected SLA, using the latest data.

    • Message to Display:
      ​“Model is OK and using the latest data available.”

  • Condition 2: Campaign Forced to Use Global Model
    In some cases, the campaign is set to use a global model, even if the local model is OK.

    • Message to Display:
      ​“Models are OK, forced to use Global Model.”

  • Condition 3: Campaign was recently launched.
    At launch all campaigns use a global model until a local can be trained.
    Message to Display:

    • "Models are OK, Local model trying to train."

🟡 YELLOW: Models Near SLA Threshold or in Recovery

  • Condition 1: Approaching SLA Deadline
    Either the Win Rate or Goal Rate model is nearing its SLA limit, indicating that the model has not trained with the latest data for a certain period but continues to attempt updates daily.

    • Message to Display:
      ​“Model is OK and currently being updated with the latest data.”

  • Condition 2: SLA Breach with Fallout Mechanism Triggered
    If either the Win Rate or Goal Rate model breaches its SLA, the system triggers a fallback to the Global Model. The local model will continue trying to train and will reassign automatically when it recovers.

    • Message to Display:
      ​“Model is OK, Local model trying to train.”

🔴 RED: Models Not Meeting SLA

  • Condition: Both Models Breach SLA
    If both the Win Rate and Goal Rate models fail to meet the SLA, campaigns cannot rely on local models, and an urgent resolution is required.

    • Message to Display:
      ​“Models not meeting SLAs. Team is working on a resolution.”

Action Points for Teams

  1. Monitor Status : Keep an eye on model statuses, no need to worry before being in red.

  2. Red Status: Noticed, that the engineering or data science team will be working when models enter the Red zone

Did this answer your question?