00:07 Connectivity between Servology and the rest of the internet is intermittent and/or broken. There appears to be some kind of problem with BGP but I am not yet sure what. I am investigating urgently.
00:21 I have disconnected the Servology network from one of our upstream providers CityFibre, and connectivity seems to have stabilised via our other upstream provider, hSo. Both upstream connections appear to have been unstable so I am unsure what was happening. I will continue to investigate.
01:56 After a period of network stability I have reconnected our BGP sessions to CityFibre, first the IPv6 session which I monitored for about 20 minutes, then the IPv4 session. Both seem to be stable and I will continue to monitor until at least 02:30, being ready to shut down the BGP sessions via emergency remote access links if they appear to cause any more problems.
02:37 I have seen no further problems. The timeline of this outage appears to have been as follows: intermittent connectivity from around 23:28 on 1 February until about midnight. At this point I logged in via emergency remote access to investigate and shut down our CityFibre BGP sessions. This caused a short full outage lasting several minutes from approx 00:01 to 00:06 on 2 February. After that, connectivity appears to have been stable, including during the reconnection of the BGP sessions at 01:29 (IPv6) and 01:53 (IPv4).