Alert on SLOs

  • Service Level Indicators (SLI) represent a quantifiable measure of service reliability
  • Service Level Objectives (SLO) define how many times an SLI has to be achieved for users to be happy with your service, within a time interval
  • Error Budgets represent the amount of reliability that is left from an SLO

SLO thresholds

  • It’s a reactive approach, meaning, you’ll receive an alert only when there’s more than the accepted level of unreliability
  • Static thresholds are unable to keep up with your service’s evolution. Thresholds are defined around the conditions of today and can quickly become obsolete. Service changes, hardware upgrades, or library patches can impact the meaningfulness of a threshold

Error Budget Burned

  • 25% of error budget burned would trigger an email
  • 50% of error budget burned would trigger a message to slack
  • 75% of error budget burned would trigger a page

Burn rate

Error Budget Policies

  • If a single event consumes 25% or more of the error budget, a postmortem must be conducted, which must include a P0 action that addresses the reliability that caused it
  • If 75% of the error budget has been consumed, 50% of engineers must focus on reliability work
  • If the SLO has been breached, feature work must stop and all engineers must focus on restoring it. Only P0 issues and security fixes can be released until the service is back within SLO

Conclusion

--

--

--

An Alten Company, Cprime is a global consulting firm helping transforming businesses get in sync.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

A full mobile delivery automation setup in 5 minutes

The Project Reunion features were initially slated for .NET 5, but they missed the cut. They’re

How to Write App Development Request For Proposals (RFP) Correctly

Binary Heaps : Swift 5.0 | LeetCode | Part — 1

A Walkthrough On How To Create NFTs On AssetMantle’s Mantleplace DevNet

ICS patching without rebooting

Archiving Parquet files

Python CLI Tamed — Invoked

the weather in here

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Cprime

Cprime

An Alten Company, Cprime is a global consulting firm helping transforming businesses get in sync.

More from Medium

Does Kanban encourage working in silos?

3 Warning Signs That Your Backlog Refinement Is Failing, and 3 Ideas to Fix It

Designing Demand Management Process

Principles for virtual meetings