Tor2 Emergency network maintenance – 10-Jul-2016 – 11:59pm
Posted: Fri Jul 08, 2016 10:02 pm
Hi Folks,
Please be advised of the following emergency maintenance window:
Maintenance Window: Sunday July 10th, 11:59pm - 3:00am Eastern Time.
Facility: Tor2
Affected Device(s): core03.tor2, core04.tor2, dist03.tor2, dist04.tor2
Affected Customers: Tor2 facility customers
Service Impacting: Yes - Customers should expect intermittent connectivity issues as devices are rebooted/IOS upgrades are applied/etc.
Details: We will be performing extensive network maintenance regarding the outage experienced on 08-Jul-2016, specifically the routing anomaly which has been impacting the Tor2 network at random when transport circuits are downed in a specific manner.
It is our belief that the anomaly is the result of something amiss in either the ISIS routing protocol, or our specific deployment in relation to it. On our transit (BGP) network, we will be removing the underlying ISIS routing which connects the two sites, and moving to an EBGP setup. In doing this we will be moving the Tor2 network to its own/originally intended ASN (AS53999, which is currently only utilized for specific sessions).
While we have scheduled a several hour window to perform these tasks (as multiple devices need to have configuration changes), we expect the actual outages (on a per customer/device basis) to be much shorter, and we will ensure that changes are made in the most efficient manner possible.
We will also be updating each devices IOS image to the most recent/applicable images during this process, since a reboot will be required on our networking gear either way.
Regards,
Please be advised of the following emergency maintenance window:
Maintenance Window: Sunday July 10th, 11:59pm - 3:00am Eastern Time.
Facility: Tor2
Affected Device(s): core03.tor2, core04.tor2, dist03.tor2, dist04.tor2
Affected Customers: Tor2 facility customers
Service Impacting: Yes - Customers should expect intermittent connectivity issues as devices are rebooted/IOS upgrades are applied/etc.
Details: We will be performing extensive network maintenance regarding the outage experienced on 08-Jul-2016, specifically the routing anomaly which has been impacting the Tor2 network at random when transport circuits are downed in a specific manner.
It is our belief that the anomaly is the result of something amiss in either the ISIS routing protocol, or our specific deployment in relation to it. On our transit (BGP) network, we will be removing the underlying ISIS routing which connects the two sites, and moving to an EBGP setup. In doing this we will be moving the Tor2 network to its own/originally intended ASN (AS53999, which is currently only utilized for specific sessions).
While we have scheduled a several hour window to perform these tasks (as multiple devices need to have configuration changes), we expect the actual outages (on a per customer/device basis) to be much shorter, and we will ensure that changes are made in the most efficient manner possible.
We will also be updating each devices IOS image to the most recent/applicable images during this process, since a reboot will be required on our networking gear either way.
Regards,