Switch failure in Equinix MA1 Williams House Backbone

Event Started
2024-03-30 07:00
Report Published
2024-03-30 07:13
Last Updated
2024-03-30 20:59
Event Finished
Ongoing

A core switch in MA1 has stopped responding at almost exactly 07:00. We're investigating the cause.

Timeline (most recent first)
  • 2024-03-30
    20:58:00

    After monitoring the situation for a few hours, we believe this incident is resolved.

  • 2024-03-30
    17:05:00

    We believe things are back to normal, and are monitoring the situation.

  • 2024-03-30
    13:09:00

    The engineer is leaving site. We're about to start performing tests and configuration changes to bring the switch into service.

  • 2024-03-30
    13:06:00

    The failed switch has been powered down, pending replacement.

  • 2024-03-30
    13:05:00

    Repatching is complete. We're now going to perform some tests before bringing services back up via the hot spare switch.

  • 2024-03-30
    12:15:00

    The switch rs164.w.faelix.net has failed, and after power-cycling entered into a boot-loop. The engineer is now repatching onto a spare switch.

  • 2024-03-30
    12:00:00

    An engineer is now on-site to intervene.