Emergency Maintenance - core01.tor1 Router - 07-Feb-2015

Announcements concerning Networking & Related News, Planned Outages, Anything which may affect your services.

Moderator: Admins

Post Reply
Site Admin
Posts: 676
Joined: Wed Jun 12, 2002 5:57 pm
Location: Toronto, Ontario

Emergency Maintenance - core01.tor1 Router - 07-Feb-2015

Post by porcupine »

Hi Folks,

Please be advised of the following emergency maintenance window:

Maintenance Window: Saturday February 7th, 2015, 12:01am - 2:00am Eastern Time
Facility: Tor1
Affected Device: core01.tor1
Affected Customers: Physically connected customers
Service Impacting: Directly/Physically connected customers - Yes, indirectly connected customers - No

Details: We will be performing an emergency replacement of the supervisor card in the core01.tor1 core router. As some customers had experienced, on 01-Feb-2015 the core01.tor1 router experienced an unexplained routing hiccup at approximately 11:40pm Eastern time, then again on 05-Feb-2015 at approximately 8:50pm Eastern time, both resulting in several minutes of unavailability through specific routes.

The second incident (on 05-Feb-2015) revealed the direct cause of both incidents: The memory (or memory control components) in the supervisor card are failing, and the card must be replaced with a standby unit.

We will be preparing the replacement card (pre-configuring, testing, etc.) in a spare chassis we maintain for this purpose, then replacing the active supervisor card in core01.tor1, after re-routing all non-local traffic around the box (to minimize disruption).

We expect the maintenance will take less than 20 minutes during this window, and we expect this to only impact customers who are directly/physically connected to core01.tor1 (colocation customers with their own BGP routers, with "core01.tor1" in their MRTG URL's).

Updates will be posted to our twitter feed (as usual) at http://www.twitter.com/pcolomaint

Myles Loosley-Millman
Priority Colo Inc.
Post Reply