|
this poo poo is getting out of hand. how many outages does this make in just the past 30 days?
|
# ? Oct 7, 2020 19:58 |
|
|
# ? May 25, 2024 09:53 |
|
We've been migrating people to O365 this last month and our users are not impressed. Either is management.
|
# ? Oct 7, 2020 20:01 |
|
during the last outage my VP asked me "what is our DR plan for outages like these?" the gist of my response was "lol, pen and paper?"
|
# ? Oct 7, 2020 20:02 |
|
It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too.
|
# ? Oct 7, 2020 20:11 |
|
Honestly, at least from a medium-size nonprofit IT standpoint, we couldn't reasonably hope to match Microsoft's uptime even with a significant budget and personnel increase. I mean it sucks, but when poo poo completely goes sideways, it'll always come back up with people in the $1million/year skill level at the helm know what needs to be done instead of being stuck with situations like two different vendors blaming each other for a week but refuse to meet with each other over a problem we don't have the necessary specialist-level knowledge to solve.
|
# ? Oct 7, 2020 21:00 |
|
Graph api was down too. None of my O365 python scripts were working, all timing out with a 504. Seemed to start working again right about 2pm CDT.
|
# ? Oct 7, 2020 21:21 |
|
I mean, I had to live through #NA14 (nevar forget), but at least when my company blows up our cloud, it's a bunch of businesses freaking out over sales numbers, and not end users melting down. I'm also feeling extremely smug for working in a Gapps shop right now
|
# ? Oct 7, 2020 21:24 |
|
I have to wonder... why do they have so many outages. When Google has one, it usually only affects some accounts with some services, rarely is a service completely down for everyone. When MS has one, it affects several services at once typically for everyone and sometimes entire regions are completely blacked out. Based on just that alone I feel like maybe Google's architecture is more distributed maybe? And MS is more centralized? GApps has had exactly one outage this year that affected us. Mail still worked, it was just slow, or some people would occasionally get a timeout in Gmail. It lasted a couple hours at best.
|
# ? Oct 7, 2020 21:45 |
|
we're a k-8 school so there's absolutely no reason for us to even be on o365 instead of gapps at all. it makes no sense because there's nothing our students need to do that gapps can't handle, often much more simply than o365 does, and all of the high schools our kids end up at also use google so it's not like we're even teaching them any immediately useful skills
|
# ? Oct 7, 2020 21:56 |
|
stevewm posted:I have to wonder... why do they have so many outages. Everything is tied to Azure which has an NT4 domain controller running the primary AD on a 1998 Compaq P590 desktop with 128MB RAM.
|
# ? Oct 7, 2020 21:56 |
|
Azure is really funny. you have two possibilities MS is trying to run a global distributed cloud platform on windows (LOL) MS is trying to run a global distributed cloud platform on linux (LOL)
|
# ? Oct 7, 2020 22:01 |
|
AlexDeGruven posted:Everything is tied to Azure which has an NT4 domain controller running the primary AD on a 1998 Compaq P590 desktop with 128MB RAM. Someone rebooted it with a floppy still in the drive.
|
# ? Oct 7, 2020 22:02 |
Super Soaker Party! posted:It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too.
|
|
# ? Oct 7, 2020 22:05 |
|
Methanar posted:Azure is really funny. you have two possibilities Iirc, it’s modified Windows data center and hyper-v For my money though, the reason the MS outages get as bad as they do is because a bunch of their services are tightly integrated and if one fails it has knock-on effects across the platform That tight integration is also one of the advantages tho So
|
# ? Oct 7, 2020 22:11 |
|
if it's that precarious you'd think they'd be a little more careful with it https://twitter.com/MSFT365Status/status/1313932490361499655
|
# ? Oct 7, 2020 22:17 |
|
The Fool posted:Iirc, it’s modified Windows data center and hyper-v MS actually does run parts of Azure on linux. Particularly their networking/sdn stack, probably even more stuff now That's why MS had their big thing about releasing support for Linux, like porting their .NET CLR and SQL server to linux a few years back. MS themselves needed their stuff to work on Linux. Methanar fucked around with this message at 22:39 on Oct 7, 2020 |
# ? Oct 7, 2020 22:37 |
|
Super Soaker Party! posted:It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too. And is 10000% better than just running it yourself on prem. It could be down for the next week, I give no fucks.
|
# ? Oct 7, 2020 23:11 |
|
The Fool posted:Iirc, it’s modified Windows data center and hyper-v Yeah, I actually looked it up today because of the irony of getting a "Azure is super reliable" email right before everything went to poo poo. Turns out O365, Bing, X-Box Live all run on their own private stacks and physical data centers and not on Azure. Still incredibly bad optics for MS from a reliability perspective in general. Joke on work Slack: Most companies try for five 9s. MS aims for nine 5s.
|
# ? Oct 8, 2020 01:11 |
|
Sickening posted:And is 10000% better than just running it yourself on prem. It could be down for the next week, I give no fucks. Oh I'm by no means implying that people should go back to running Exchange on-prem. I'm quite happy never to have to admin a DAG ever again. Just that there's a lot of people who imagine "the cloud" is going to magically solve everything 100% of the time, and don't understand that there's always tradeoffs and downsides to anything in IT and moving to cloud setups without a clear knowledge of those potential issues is loving stupid. See also people who don't back up their email on 365 because "it's in the cloud". edit: or try to use B2 or other cloud backup for their office over a Comcast 100/10 connection
|
# ? Oct 8, 2020 01:22 |
|
Super Soaker Party! posted:Oh I'm by no means implying that people should go back to running Exchange on-prem. I'm quite happy never to have to admin a DAG ever again. Just that there's a lot of people who imagine "the cloud" is going to magically solve everything 100% of the time, and don't understand that there's always tradeoffs and downsides to anything in IT and moving to cloud setups without a clear knowledge of those potential issues is loving stupid. Real talk, I haven’t been part of an org that backs up office 365 email and I don’t know if I ever want to.
|
# ? Oct 8, 2020 02:23 |
|
We backup o365 to on prem. But we are in a region where it is a perfectly reasonable dr scenario to lose internet to the rest of the world and still need to do business.
|
# ? Oct 8, 2020 02:26 |
|
Sickening posted:Real talk, I haven’t been part of an org that backs up office 365 email and I don’t know if I ever want to. Veeam makes it real easy (though of course it's a per-user cost). You just need, y'know, a decent chunk of space and a fast connection.
|
# ? Oct 8, 2020 05:04 |
|
Super Soaker Party! posted:It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too. And remind them that yes there is an SLA in place, but in practice that just means you get a small refund on your monthly bill, not that your uptime will truly be 99.9% always.
|
# ? Oct 8, 2020 17:09 |
|
Can't you take additional legal action over repeatedly violation of their contract? (SLA IS a contractual agreement)
|
# ? Oct 8, 2020 17:17 |
|
Someone in a Discord dropped this gem today:quote:aside: had someone attempt to put in "warding prayers" in the comments to prevent "evil intentions" from crossing their source code. except they werent comments and it was in the javascript so it broke everything
|
# ? Oct 8, 2020 18:19 |
|
Dirt Road Junglist posted:Someone in a Discord dropped this gem today: When praising the Omnissiah and attempting to placate the Machine Spirit, make sure said prayers are appropriately escaped!
|
# ? Oct 8, 2020 18:59 |
|
Thoughts and prayers don't work: Javascript Edition
|
# ? Oct 8, 2020 19:02 |
|
Man I sure do love it when a SIP phoneline cutover gets pushed to 3:00pm on a Friday before a long weekend with an hour to test beforehand.
|
# ? Oct 8, 2020 23:31 |
|
Entropic posted:Man I sure do love it when a SIP phoneline cutover gets pushed to 3:00pm on a Friday before a long weekend with an hour to test beforehand. It's a real shame something* came up and you have to push this to Tuesday/Wednesday. *common sense.
|
# ? Oct 8, 2020 23:40 |
|
had a guy call in and just immediately jump in my poo poo because of something incomprehensible with volume gently caress you too, buddy
|
# ? Oct 9, 2020 01:47 |
|
same jackass who called last week to see if we could help him set up his iot netgear poo poo which we don't sell and don't recommend because... oh, lots of reasons
|
# ? Oct 9, 2020 01:49 |
|
A ticket came in...quote:My Brick is Dead That is the entirety of the ticket.
|
# ? Oct 9, 2020 20:51 |
|
They have pills for that
|
# ? Oct 9, 2020 20:53 |
|
Maybe they're building up to it.
|
# ? Oct 9, 2020 21:32 |
|
GnarlyCharlie4u posted:A ticket came in... I mean, I would interpret that as being the power adapter, and assuming you standardize your laptop models, that's enough information to know what to do. I'd verify, but I can't imagine what else it might be.
|
# ? Oct 9, 2020 23:31 |
|
I always learn about showbiz news here first.
|
# ? Oct 9, 2020 23:36 |
|
guppy posted:I mean, I would interpret that as being the power adapter, and assuming you standardize your laptop models, that's enough information to know what to do. I'd verify, but I can't imagine what else it might be.
|
# ? Oct 9, 2020 23:39 |
|
guppy posted:I mean, I would interpret that as being the power adapter, and assuming you standardize your laptop models, that's enough information to know what to do. I'd verify, but I can't imagine what else it might be. What makes you think the problem had anything to do with a computer? (also they don't have a laptop.) they broke their mouse usb cable
|
# ? Oct 9, 2020 23:44 |
|
GnarlyCharlie4u posted:What makes you think the problem had anything to do with a computer? (also they don't have a laptop.) This is the best punchline possible
|
# ? Oct 10, 2020 00:29 |
|
|
# ? May 25, 2024 09:53 |
|
GnarlyCharlie4u posted:What makes you think the problem had anything to do with a computer? (also they don't have a laptop.) Clearly my imagination is inadequate for the marvels of user problem analysis.
|
# ? Oct 10, 2020 01:52 |