Power failures in MA1 (Williams House)

Service Incident

published: 2020-05-11 14:07
started: 2020-05-11 11:40
resolved: 2020-05-13 18:29

We are aware of connectivity problems that have affected many providers in and around Manchester. Equinix MA1 (Williams House) is reporting power problems.


Timeline

2020-05-11 14:07

Equinix IBX Site Staff reports that a fire alarm has been triggered and the IBX was evacuated. There were no customers on site during the evacuation. IBX Engineers are investigating the cause of the alarm.

2020-05-11 14:48

Power seems to be stable, and all our providers have been back online for the last hour. However, we are awaiting an update from Equinix about the overall long-term state of the data-centre.

2020-05-11 14:59

Equinix IBX Site Staff reports that during routine maintenance an issue with UPS 1-3 system has been discovered and potential power outages to some customer feeds. IBX Engineers are investigating the issue. The UPS is currently supporting the load.

2020-05-11 15:49

“Equinix IBX Site Staff reports that the power to all affected customers has been restored. The UPS system is currently supporting the site load at N redundancy. The next update will be sent when there is a significant change to the situation.” — we believe this means that MA1 is currently running at risk with no power redundancy.

2020-05-13 11:51

The latest update from Equinix indicates that they are about to begin work to repair the generator. The whole of MA1 appears to still be at risk (“N” redundancy). “Equinix IBX site staff reports that they continue to work with the vendor to resolve the issues with the Units 1-3 UPS system. The works will involve transferring the load from utility supply to generator supply. The UPS system will then be transferred into bypass mode to enable the repairs works to continue. This work is scheduled to commence at 13-MAY-2020 12:30 Site Local Time. The redundancy remains at N.”

2020-05-13 18:29

Equinix IBX Site Staff reports that UPS system Units 1-3 are operational and the site load is supported by the utility supply. This issue is now resolved and service returned to normal as of 13-MAY-2020 19:05 Site Local Time.