Two cents after running this through prod traffic. Design the rollout so rollback takes minutes, not hours. A thin rules layer filtered 80% of noisy alerts.