Edge Router BGP Crash

Customer Notice

published: 2019-09-29 03:26
started: 2019-09-29 04:00
expected: 2019-10-04 12:00:00
resolved: 2019-10-10 00:00:00

We are investigating the crash of the BGP process on one of our core routers in Williams House, Manchester.


Timeline

2019-09-29 04:07

We have worked around the problem while we continue to diagnose the fault and rectify routing via bly.w.faelix.net

2019-09-29 04:35

We have restored service via bly.w.faelix.net and are monitoring the situation.

2019-09-29 21:49

We have put in place numerous corrective actions: put in place workarounds, put in place a failsafe workaround, submitted bug reports to the vendor, and we have been monitoring the router since. We will also be establishing some additional control plane protections as we suspect a targetted attack may have been involved earlier today.

2019-10-01 16:05

We have deployed the control plane protections as planned.