Greetings, Yesterday the gerrit server on review.trustedfirmware.org experienced
significant downtime outside of any announced or scheduled maintenance windows starting around 5pm UTC.
The downtime was caused by ansible deployment that was run to make some configuration changes and install a plugin. The deployment made several unintentional upgrades to other external plugins which were incompatible with our environment and prevented gerrit from restarting.
As a result, for a 12 hour period the gerrit server was either off line or highly unstable. As of 5am UTC today, gerrit had been returned to its original state and resumed stable operation.
I apologize for the unannounced downtime and any inconvenience that it caused, and we are reviewing the events to ensure a similar situation doesn't occur again,
Regards,
tf-openci@lists.trustedfirmware.org