Impact

An unknown number of users encountered the Fluid Attacks Platform unavailable. The issue started on UTC-5 23-11-17 11:25 and was proactively discovered 43.2 minutes (TTD) later by the staff of the product team, who encountered an error screen when attempting to logging in to Platform during their regular workflow. The problem was resolved in 14.4 minutes (TTF) resulting in a total impact of 57.6 minutes (TTR).

Cause

While updating the operational rules for our primary servers to limit unnecessary access, a crucial permission necessary for the Platform's functioning was inadvertently removed, leading to an unavailability after logging in [1].

Solution

The developer in charge reverted the changes that introduced the error, restoring the typical access to the Platform [2].

Conclusion

These errors enter the production environment due to limitations in thorough testing within the development phase. The team is actively working to bridge the gap between the development and production environments, aiming to prevent such issues in the future [3]. MISSING_ALERT < IMPOSSIBLE_TO_TEST