Archive of Incidents and Maintenance

2024

Outage to Status Page (irony) 2024-11-27 14:49:00
Winter Change Freeze 2024-2025 2024-12-13 17:30:00
Disk Failure in rexal 2024-08-24 16:00:00
Core Link Failure: WIL-THN 2024-05-16 10:48:00
Disk Failure in remo 2024-05-02 06:30:00
Core Link Failures 2024-04-30 21:40:00
Crash of openvswitchd on cg.d.faelix.net 2024-04-30 09:30:00
Crash of VPS Host lu.n.faelix.net 2024-04-28 23:35:00
VM Host Crash, kai.w.faelix.net 2024-04-19 01:45:00
Suspected Fibre Break between Manchester and London 2024-04-16 21:57:00
Router in Interxion LON2 has dropped all BGP sessions 2024-04-12 00:30:00
Suspected Fibre Break in London 2024-04-10 06:44:00
Switch failure in Equinix MA1 Williams House 2024-03-30 07:00:00
Core and Backbone Upgrade 2024-04-07 00:00:00
Disk Failure in renfield 2024-01-07 14:00:00

2023

Winter Change Freeze 2023-2024 2023-12-20 23:59:00
Packet Loss on Core Link 2023-11-29 21:32:00
Core Switch Issue in Telehouse West 2023-10-26 04:50:00
Suspected Fibre Break in London 2023-07-21 11:30:00
Optical Transmission Failure between Leeds and Bradford 2023-07-18 09:20:00
Interface Flap in Interxion LON2 2023-05-23 10:13:00
Suspected Fibre Problem between Manchester and Leeds 2023-03-14 17:04:00
Disk failure in hosting node kazan 2023-02-03 09:00:00
Core Switch Fault in Telehouse West 2023-02-03 00:48:00
Manchester-Leeds Fibre Path Flap 2023-01-20 12:58:00
VM Host Crash of lu.n.faelix.net 2023-01-06 22:04:00

2022

Wholesale Broadband Connectivity Flap 2022-12-15 09:40:00
RADIUS Timeouts on New 3G/4G/5G Sessions 2022-11-16 23:40:00
High Packet Loss Affecting Core Link 2022-11-15 20:55:00
Fault with Dark Fibre Link in London 2022-11-11 15:54:00
Core Ring at Risk 2022-11-07 09:00:00
Winter 2022 Change Freeze 2022-11-21 00:00:00
Router Crash in Equinix MA1 (Williams House) 2022-11-06 08:04:00
BGP Process Crash/Restart on Peering Router for LINX LON1 2022-10-31 19:40:00
Fibre Break in London 2022-10-25 11:58:00
Fire Suppression Triggered at MA2 (Reynolds House) - Numerous Hard Disks Damaged 2022-10-21 09:00:00
Router Upgrades in Telehouse West 2022-09-22 03:00:00
Incorrect SIM Deactivations 2022-09-20 01:00:00
LINX Manchester Connectivity Issue 2022-09-05 13:15:00
Problems with Zen Wholesale Interconnection in Manchester 2022-09-07 08:15:00
Fibre Break Affecting Bolton 2022-08-25 13:33:00
Emergency Reboot of gunn (peering and transit router in Interxion London) 2022-08-08 13:42:00
Suspected Fibre Break between Manchester and Leeds 2022-07-26 08:49:00
Fibre Fault affecting Chester Moor 2022-07-13 00:15:00
Power Issue at Equinix MA1 2022-05-24 09:01:00
Suspected Crash of VPS host lu.n.faelix.net 2022-05-09 18:17:00
Router and Switch Upgrades in Interxion LON2 2022-05-10 02:00:00
Router Upgrades in Telehouse West 2022-05-12 02:00:00
Switch Upgrades in Telehouse North 2022-05-09 02:00:00
Switch Crash in Telehouse North 2022-04-24 09:15:00
Upstream Provider Connectivity Problem in Geneva 2022-04-14 12:25:00
BGP Router Crash in Telehouse North 2022-04-13 10:46:00
Closure of Equinix MA2 (Reynolds House) 2022-06-30 23:59:00
Line Fault Causing Reduced Bandwidth 2022-04-12 21:52:00
Deployment at Bishopgate Gardens 2022-05-04 12:00:00

2021

Upgrade to BGP peering and transit routers in London 2021-08-09 10:59:00

2020

Upgrade to network operating system for earhart.n.faelix.net 2020-12-28 11:05:00
Upgrade to network operating system for aebi.m.faelix.net 2020-12-28 11:01:00
Upgrade to network operating system for dekker.d.faelix.net 2020-12-28 10:59:00
Equinix Global Change-Freeze 2020-09-11 14:56:00
Upstream Maintenance at Geneva Hosting Facility 2020-06-23 07:44:00
Fire Alarm at Reynolds House 2020-06-15 12:24:00
Optical Network Failure between Bradford and Leeds 2020-05-26 10:48:00
Power Failure at AQL DC2 2020-05-14 12:37:00
Power failures in MA1 (Williams House) 2020-05-11 14:07:00
Core router crash: aebi.m.faelix.net 2020-04-17 07:54:00
Network upgrades at AS44749 2020-04-08 15:59:00
Bringing up peering at LINX LON1 2020-04-01 10:36:00
Emergency: reboot of router aebi.m.faelix.net 2020-03-23 21:34:00
Coronavirus Response 2020-03-19 10:51:00
Router Flap in Manchester 2020-02-16 14:56:00

2019

Power warning in Reynolds House 2019-12-06 09:11:00
Equinix Change Freeze 2019-09-02 11:05:00
PDU failure in Reynolds House 2019-10-28 06:05:00
Edge Router BGP Crash 2019-09-29 03:26:00
Router Upgrades to Manchester Network 2019-09-22 18:25:00
Urgent Maintenance: Core Switch Update 2019-09-18 21:52:00
Reynolds House Generator Testing 2019-07-21 11:34:00
Upstream provider line card reboot in London 2019-08-05 12:01:00
Switch crash of fs113 in Reynolds House, Manchester 2019-07-16 19:45:00
Upstream provider maintenance 2019-05-27 14:05:00
Connectivity provider optical maintenance 2019-05-22 16:00:00
Upstream provider routing issues 2019-05-16 10:30:00
Reynolds House Car Accident 2019-03-20 21:25:00

2018

SSD failure in vlad 2018-12-29 09:32:00
Change Freeze 2018 2018-09-15 12:17:00
Reachability Problems to Virgin Media 2018-09-27 09:04:00
Packet loss in London 2018-09-18 11:56:00
Suspected Capacity Problems at Upstream Provider 2018-09-05 11:23:00
Emergency replacement of router in Williams House, cao.w.faelix.net 2018-08-17 15:56:00
Upgrade to Cogent transit in Reynolds House 2018-07-09 17:46:00
Generator Load Test at Equinix MA2 (Reynolds House) 2018-06-25 21:22:00
Switch Crash in Manchester 2018-07-24 15:57:00
Routing Process Crash on soto.m.faelix.net 2018-06-24 13:27:00
Upstream Provider Announces Emergency Maintenance 2018-06-18 23:12:00
Developing new incident handling system 2018-06-16 13:49:00
Storage failure in lexx 2018-04-29 07:45:00

2017

Christmas 2017 change freezes 2017-12-19 00:00:00
Crash of router "haro" 2017-09-30 18:30:00
Crash of router "fuca" 2017-09-25 10:12:00
Networking fault for virtual hosts on "muffy" 2017-06-04 13:07:00
Problems with one upstream provider 2017-05-12 15:30:00
BGP crash on core router "soto" 2017-03-18 00:55:00

2016

Christmas change freezes 2016-12-19 00:00:00
RIPE Atlas probe failure in Geneva 2016-12-17 11:49:00
fifi RAID optimisation 2016-12-07 06:00:00
Geneva network build 2016-09-12 09:00:00

2015

Drive failure in fifi 2015-02-08 06:20:00