حالة الشبكة أخبار و معلومات

Data102 saw our BGP sessions with Level3 this evening fail around 21:43, 21:48, and 21:52 MST. Our logs and routers indicate that the BGP hold timer failed. We have opened ticket a ticket with Level3 for more information as to what occurred – we did not observe any other BGP flaps, router reloads or other issues, just Level3 flapping on both v4 and v6.

Event Summary
At 2017-08-09 10:24am MST Data102 observed that the SIP proxy labelled SIP2 stopped routing SIP packets. Two separate alert systems informed of this issue, and at 10:25am, automated remediation restarted the SIP routing service on that server. By 10:27am the server resumed full functionality and service was restored.

Customers with endpoints that register to the SIP2 server may have been unable to create new outbound calls, and were unable to receive calls during this brief period; in-progress or calls in the connecting phase may have been interrupted. Calls that were already established were not impaced. Customers with endpionts registered to any other SIP proxy were not impacted.

Root Cause
The service interruption was caused by a software crash on SIP2. This software crash is due to a known memory allocation bug in the SIP proxy software. We have been advised that this kind of issue will continue to occur more frequently as our customer base and call volume increases.

Resolution & Scheduled Maintenance
Due to this being a known bug causing the SIP proxy software to crash, the resolution is to upgrade our software to avoid hitting the bug again. As such, we are scheduling an urgent software upgrade for 2017-08-10 at 12:30am MST.