|
Hope it dies.
|
|
#
?
Oct 4, 2021 20:19
|
|
|
|
| # ? May 24, 2024 00:10 |
|
|
facialimpediment posted:It appears that facebook really, really hosed up. I'm all here for this dumb social media meltdown. Outside of everyone losing their minds over not being able to post on Facebook, Instagram, and Whatsapp, my next favorite thing is folks on Instagram celebrating their independence from evil corporate social media entities...on Twitter.
|
|
#
?
Oct 4, 2021 20:25
|
|
|
WhatsApp being down will no poo poo have an impact over the international shipping industry, poo poo’s pretty much replaced telex at this point.
|
|
#
?
Oct 4, 2021 20:29
|
|
|
I would loooooooove to see Zuckerbot's meltdown.
|
|
#
?
Oct 4, 2021 20:32
|
|
|
FrozenVent posted:WhatsApp being down will no poo poo have an impact over the international shipping industry, poo poo’s pretty much replaced telex at this point. *gnaws on carrot* Ehh... WhatsApp, dock?
|
|
#
?
Oct 4, 2021 20:32
|
|
|
Comrade Blyatlov posted:I would loooooooove to see Zuckerbot's meltdown. He can’t connect to his emotion cloud rn.
|
|
#
?
Oct 4, 2021 20:39
|
|
|
FrozenVent posted:He can’t connect to his emotion cloud rn. That's not good, he'll most likely try to stick his dick in a wallsocket now seeking to restore the emotional connection
|
|
#
?
Oct 4, 2021 20:43
|
|
|
facialimpediment posted:It appears that facebook really, really hosed up. So, I've seen some huge screw ups in my time. I've seen plenty of DNS screw ups in my time. Hell, I've screwed up some important routers (and their BGP config) before. I have never, ever, just killed the BGP routes to DNS before. I haven't even seen someone screw up that bad, especially on something this large. Does the employee have a gofundme up yet? They are going to need one.
|
|
#
?
Oct 4, 2021 20:44
|
|
|
What does that mean, exactly?
|
|
#
?
Oct 4, 2021 20:49
|
|
Comrade Blyatlov posted:What does that mean, exactly? You don’t know? Jfc someone explain it to him.
|
|
|
#
?
Oct 4, 2021 20:51
|
|
|
Comrade Blyatlov posted:What does that mean, exactly? They've hosed up so badly the internet address book has forgotten who they are, their own systems don't know who they are so they can't get in to fix them. This includes the physical doors.
|
|
#
?
Oct 4, 2021 20:52
|
|
|
Comrade Blyatlov posted:What does that mean, exactly? Ok: Someone knocked out their DNS name records (the address book for their IPs associated with their website), as well as wiped out their BGP routes. So, DNS is how you look up who your destination server is like a phone book. BGP helps all the routers in the internet tell all the other routers how to get there, like a map. So, without any way to lookup that info, and without any way to figure out how to get there, they effectively ceased to exist outside their Datacenter. Right now, its most likely that someone internally at FB accidentally or maliciously deployed network changes that did this. All we know right now for sure is they are down. Hard.
|
|
#
?
Oct 4, 2021 20:53
|
|
|
Have they tried turning it off and on again?
|
|
#
?
Oct 4, 2021 20:53
|
|
|
boop the snoot posted:You don’t know? I break engines, not internet. CommieGIR posted:Ok: Someone knocked out their DNS name records (the address book for their IPs associated with their website), as well as wiped out their BGP routes. So, DNS is how you look up who your destination server is like a phone book. BGP helps all the routers in the internet tell all the other routers how to get there, like a map. Thank you. Also, hahahahahahahahahahahahhahahahahaahahahahahaha
|
|
#
?
Oct 4, 2021 20:54
|
|
|
poo poo's probably gonna be fixed before the evening in US TZ, but I can't wait for the anger and tears from Euros since this hit pretty much during prime going-out hours over here. Nevermind the actual repercussions that matter, tomorrow's social media is gonna be aflame with folks pissed they were "completely unable" to "meet up" in their bar of choice.
|
|
#
?
Oct 4, 2021 20:55
|
|
|
https://twitter.com/benschwartz_/status/1445097797523427328?s=21 I prefer this explanation.
|
|
#
?
Oct 4, 2021 20:55
|
|
|
Comrade Blyatlov posted:What does that mean, exactly? Imagine if someone gave you the address to a random tacobell in a state over, and you had to get there without asking directions or using any sort of map or navigation aids. edit: beaten.
|
|
#
?
Oct 4, 2021 20:58
|
|
|
I am 100% certain it was an automated deployment, and they had no redundancy to handle if a major network change went bad.
|
|
#
?
Oct 4, 2021 20:58
|
|
|
Comrade Blyatlov posted:What does that mean, exactly? Imagine you’re at full away one hour notice, and I go and cut the cables to the bridge control and emergency telegraph, and also I reprogrammed the sound powered telephone so the ECR rings the galley and the C/E very rings the smoking room. Edit: also for some reason the CPP is stuck at 0 but the load is still 80% MCR FrozenVent fucked around with this message at 21:01 on Oct 4, 2021 |
|
#
?
Oct 4, 2021 20:59
|
|
|
CommieGIR posted:I am 100% certain it was an automated deployment, and they had no redundancy to handle if a major network change went bad. IAC strikes again? I know it won't, but could you imagine how much better the world might be if they accidentally broke facebook beyond any repair somehow. Defenestrategy fucked around with this message at 21:01 on Oct 4, 2021 |
|
#
?
Oct 4, 2021 20:59
|
|
|
Comrade Blyatlov posted:What does that mean, exactly? Someone will have a better analogy, but this is how I explain it: Imagine having to manually dial phone numbers for everything. Make a call? Dial number. Email? Dial number. Security badge? Dial number. Load SA to browse the forums? Dial a number. The DNS acts like a phone book. It has all the "phone numbers" matched up to terms we actually use. Jim's phone number is next to his name, your email is firstname.lastname@email.com (not an endless string of numbers no one can remember), google.com (not 8.8.8.8 in the address bar). The "phone book" only works if all the connected stuff knows where to look. In this case they either lost or partially destroyed the phone book, then burned down the building the phone book lives in, and never told people where it now lives. Every service that Facebook has, as long as it requires a network of some kind, will not work until they fix this. Someone, altered things no one, EVER, should alter. Edit: as predicted, beaten
|
|
#
?
Oct 4, 2021 21:01
|
|
|
FrozenVent posted:and also I reprogrammed the sound powered telephone so the ECR rings the galley and the C/E very rings the smoking room. Poor analogy, this would enhance capability
|
|
#
?
Oct 4, 2021 21:02
|
|
|
This one right here bothers me the most, because it implies that their badge scanners rely on external DNS servers and holy poo poo is that a terrible thing to do.
|
|
#
?
Oct 4, 2021 21:02
|
|
|
The problem is too that a large company like FB should have network redundancy and you should only roll large network changes to half the network at a time to ensure High Availability. Whatever happened, they rolled a change that changed everything at once. Not what you should ever do as a best practice.
|
|
#
?
Oct 4, 2021 21:03
|
|
|
I can’t tell you how much I appreciate that this means that Workplace is gone too  
|
|
#
?
Oct 4, 2021 21:03
|
|
|
Raerlynn posted:This one right here bothers me the most, because it implies that their badge scanners rely on external DNS servers and holy poo poo is that a terrible thing to do. I suspect they are internal, it sounds like they somehow nuked portions of the DNS table that include internal servers. You know in your heart of hearts the doors ping off of internal.security.facebook or some poo poo.
|
|
#
?
Oct 4, 2021 21:05
|
|
|
ASAPI posted:I suspect they are internal, it sounds like they somehow nuked portions of the DNS table that include internal servers. You know in your heart of hearts the doors ping off of internal.security.facebook or some poo poo. And the routes. If it was just the DNS, some portions would still work. Their routes got nuked too.
|
|
#
?
Oct 4, 2021 21:09
|
|
|
https://twitter.com/PhilipinDC/status/1445108187355566086 I wonder how many lives are being saved by all this downtime 
|
|
#
?
Oct 4, 2021 21:14
|
|
|
aphid_licker posted:Have they tried turning it off and on again? Literally what they're trying to do but their tests may not match the reality of a black start.
|
|
#
?
Oct 4, 2021 21:14
|
|
|
Yeah the routes going away is the real nuke. It is not outside the realm of possibility that there will need to be in-person visits to all of FB's data centers to recover their connections with each other (because they can no longer communicate securely with the outside world). It's not a perfect analogy, but for those of you that read up on "black starting" a power grid during the Texas Freeze, this is equivalent to that, just with servers and routers instead of generators.
|
|
#
?
Oct 4, 2021 21:17
|
|
|
hopefully the phonebook and map are never found and facebook quielty fucks off into the night
|
|
#
?
Oct 4, 2021 21:21
|
|
|
Wombot posted:Yeah the routes going away is the real nuke. It is not outside the realm of possibility that there will need to be in-person visits to all of FB's data centers to recover their connections with each other (because they can no longer communicate securely with the outside world). https://twitter.com/MikeIsaac/status/1445118465258364928 Wellllllllp.
|
|
#
?
Oct 4, 2021 21:23
|
|
|
Comrade Blyatlov posted:What does that mean, exactly? Imagine for a second to get you’re a ferryman living in New Zealand, and that for the sake of argument, you’re best friends with a white shepherd named, uh, Luca. Imagine one day that you endeavor to play with Luca. “Go get your ball, Luca!” You intone, gazing deep into his wide, open eyes as they beam with excitement. Luca bounds off to find his ball, but he thinks “Wait- did the Ferryman say the green ball or the red ball? Or was it the blue one?” He eventually decides to bring you a yellow ball. “No, Luca, go get the other ball! You know which one!” You say. Luca goes back and studies his ball collection. Maybe the Human wanted green? And so he picks it up and trots back. “No, Luca- your special ball!” By now poor Luca is thoroughly confused and starting to get mad. He brings you ball after ball as you chide him to go get THE ball until finally he can’t take it anymore. He throws back his head and angrily barks at the ceiling while aggressively squatting and taking an enraged poo poo on the carpet while you weep and wail in despair. In this example you are a ferryman living in New Zealand, Luca is the Internet and the ball is Facebook.
|
|
#
?
Oct 4, 2021 21:25
|
|
|
Since I'm a regular user of facebook, instagram, and messenger, I have no choice but to assume that it's my curse that has taken it all down.
|
|
#
?
Oct 4, 2021 21:25
|
|
|
pantslesswithwolves posted:Imagine for a second to get you’re a ferryman living in New Zealand, and that for the sake of argument, you’re best friends with a white shepherd named, uh, Luca. I mean this is the best so far, but I am familiar with DNS I'd just never heard of BGP nor why it was such a massive fuckup.
|
|
#
?
Oct 4, 2021 21:26
|
|
Comrade Blyatlov posted:Since I'm a regular user of facebook, instagram, and messenger, I have no choice but to assume that it's my curse that has taken it all down. Thank you for your service.
|
|
|
#
?
Oct 4, 2021 21:27
|
|
|
pantslesswithwolves posted:
Best analogy right here.
|
|
#
?
Oct 4, 2021 21:27
|
|
|
Comrade Blyatlov posted:I mean this is the best so far, but I am familiar with DNS I'd just never heard of BGP nor why it was such a massive fuckup. BGP is literally the underlyding highway that the internet rides on. Its the only reason anybody knows the route to get to anything in this hell hole. DNS just gives you the address, BGP is google maps.
|
|
#
?
Oct 4, 2021 21:29
|
|
|
CommieGIR posted:Ok: Someone knocked out their DNS name records (the address book for their IPs associated with their website), as well as wiped out their BGP routes. So, DNS is how you look up who your destination server is like a phone book. BGP helps all the routers in the internet tell all the other routers how to get there, like a map. I think that Facebook did this intentionally so they can clean house before the Congressional testimonies.
|
|
#
?
Oct 4, 2021 21:32
|
|
|
|
| # ? May 24, 2024 00:10 |
|
|
How hard are safety issues or poo poo like customer data gonna be affected by this? Not so much concerned about myself since I've decoupled from Facebook several years ago, but I'm kinda curious if this is gonna give malicious actors a chance to go hog wild. Still lolling at the situation. Going to bed now watching Sunshine, looking forward to a million posts on the morrow
|
|
#
?
Oct 4, 2021 21:35
|
|