Thread regarding Verizon Communications Inc. layoffs

FIOS service disruption

Cloudflare Chief Technology Officer John Graham-Cumming told the Washington Post that Verizon failed to intercept the issue from a fiber-optic network services provider. This caused a routing leak that led to the widespread system outage.

“Normally a large network would do some kind of filtering,” Graham-Cumming said. “But in this case, [Verizon] passed it on.”

Because of this, Verizon customers lost large chunks of internet access and passed on the faulty information to other networks, including Cloudflare and Amazon Web Services, Graham-Cumming said. This affected 10 percent of Cloudflare’s traffic.

Graham-Cumming added that Verizon still has not responded to the company’s outreach. Cloudflare CEO Matthew Prince echoed this on Twitter.

Matthew Prince 🌥

@eastdakota

· 1h

The teams at @verizon and @noction should be incredibly embarrassed at their failings this morning which impacted @Cloudflare and other large chunks of the Internet. It’s absurd BGP is so fragile. It’s more absurd Verizon would blindly accept routes without basic filters.

Matthew Prince 🌥

@eastdakota

It’s networking malpractice that the NOC at @verizon has still not replied to messages from other networking teams they impacted, including ours, hours after they mistakenly leaked a large chunk of the Internet’s routing table.

by
| 1869 views | | 6 replies (last June 29, 2019) | Reply
Post ID: @OP+ZIf8pWJ

6 replies (most recent on top)

The fact is. We all know Verizon is falling to sh--!

by
| | Reply
Post ID: @5spq+ZIf8pWJ

FIOS has 5 million users which is 4,999,999 more users than Yahoo and AOL combined

by
| | Reply
Post ID: @5soy+ZIf8pWJ

So your saying fios still has subscribers?

by
| | Reply
Post ID: @5xeo+ZIf8pWJ

A network engineered to be its best shouldn't have let the routes propagate and that's what Verizon failed to do. I wonder if the team that engineered the incorrect route policy, who did not "secure" the BGP protocol properly to filter routes, lost team members due to VSP? Food for thought. I feel bad for the unlucky engineer who gets the blame for the effort of their department.

by
| | Reply
Post ID: @2zoq+ZIf8pWJ

Definitely a tech company. High tech always propagates errors down the line. If you go down let others too :)

by
| | Reply
Post ID: @wgb+ZIf8pWJ

What's this got to do with layoffs?

Also, another company screwed up and it's VZs fault? What's the point of a Dynamic Routing Protocol if you're going to hard code filters into it? All BS...I'd like to know what company really caused the disruption. VZ should throw them under the bus.

by
| | Reply
Post ID: @bps+ZIf8pWJ

Post a reply

: