@array@fedops did you have an Acceptance environment? I find most problems can be negated having a second place that’s in a production-like environment.
I’ve tried to take those types of experiences as lessons for what my boundaries are and try to raise them before they occur. E.g.; To release this website I need the following (someone else to test it too, an acceptance environment).
Humans make mistakes, good policies ensure they don’t cause downtime.