Challenge · Medium
Latency Hunt
Users say checkout is "sometimes broken". There is no dashboard yet, only an access log. Find the failing endpoint, count the damage and build the error-rate tool.
Practises the module Monitoring with Prometheus & Grafana.
The ticket
TICKET SRE-512: checkout sometimes fails
Support got 40 complaints in two hours. The only data is the web server's access log,
/var/log/nginx/access.log, one request per line with status code and response time (rt= seconds).