Impact
An unknown number of users encountered the Fluid Attacks Platform, which was unavailable. The issue started on UTC-5 23-11-17 11:25 and was proactively discovered 43.2 minutes (TTD) later by a staff member who encountered an error screen when attempting to log in to Platform during their regular workflow. The problem was resolved in 14.4 minutes (TTF), resulting in a total window of exposure of 57.6 minutes (WOE).
Cause
While updating the operational rules for our primary servers to limit unnecessary access, a crucial permission necessary for the Platform's functioning was inadvertently removed, leading to an unavailability after logging in [1].
Solution
The changes that introduced the error were reverted, restoring the typical access to the Platform [2].
Conclusion
These errors enter the production environment due to limitations in thorough testing within the development phase. The team is actively working to bridge the gap between the development and production environments, aiming to prevent such issues in the future [3]. MISSING_ALERT < IMPOSSIBLE_TO_TEST