Failure of Aggregation Router in Equinix MA1 Kilburn House

Event Started
2025-10-23 03:30
Report Published
2025-10-23 03:58
Last Updated
2025-10-23 09:03
Event Finished
Ongoing

Our monitoring systems have alerted us to numerous issues at Equinix MA1. We are investigating.

Timeline (most recent first)
  • 2025-10-23
    04:51:00

    We believe all single-homed services have been moved to be served by cao.w.faelix.net in the adjacent building.

  • 2025-10-23
    03:45:00

    The router remains unreachable by any means, currently flapping its 1G ports from down to up occasionally. The 10G ports remain hard down, as does its management port. We've seen this happen in this model of router once before, and it likely indicates a PSU system faillure. We're going to apply configuration changes to another router in Equinix MA1 to take over the affected services.

  • 2025-10-23
    03:37:00

    The issue appears to be limited to servers and customer tails which are single-homed behind rae.m.faelix.net which is our aggregation router in MA1 Kilburn.