Challenge · Easy

Silent Alarm

The data disk is almost full, yet the disk alert never fired. Find out why the alarm stays silent and fix it, without making it cry wolf.

alertingcronshell scriptdf

Practises the module Monitoring with Prometheus & Grafana.

The ticket

POSTMORTEM: nobody was paged when /data hit 100%

/data filled up last week and the database went down. A check called disk-alert runs every minute and should have written an ALERT line to /var/log/alerts.log. It never did, and /data is filling up again right now.

Start the challenge →