Router Crash in Equinix MA1 (Williams House) Backbone

Event Started
2022-11-06 08:04
Report Published
2022-11-06 08:15
Last Updated
2022-11-10 08:57
Event Finished
Ongoing

We've received a number of alerts that cao.w.faelix.net (an aggregation router in Equinix MA1, Williams House), has flapped its ports numerous times before going unresponsive.

Timeline (most recent first)
  • 2022-11-10
    09:00:00

    We will be bringing the router back into service over the course of today.

  • 2022-11-09
    10:00:00

    The replacement power supply has fixed the unit. We will monitor the device for a period, to make sure there are no other hardware issues, before we gradually bring it back into service in MA1 Kilburn House.

  • 2022-11-06
    15:30:00

    We believe the router has a faulty internal power supply. We have removed it from Williams House pending further testing, and potentially replacement of the suspect PSU.

  • 2022-11-06
    08:22:00

    The router appears to be stuck in a reboot loop, flapping all its ports every few minutes, but not establishing any connectivity.

    We will send engineers to site to investigate further.