Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
Weedle
May 31, 2006




this poo poo is getting out of hand. how many outages does this make in just the past 30 days?

Adbot
ADBOT LOVES YOU

GreenNight
Feb 19, 2006
Turning the light on the darkest places, you and I know we got to face this now. We got to face this now.

We've been migrating people to O365 this last month and our users are not impressed. Either is management.

The Fool
Oct 16, 2003


during the last outage my VP asked me "what is our DR plan for outages like these?"

the gist of my response was "lol, pen and paper?"

SyNack Sassimov
May 4, 2006

Let the robot win.
            --Captain James T. Vader


It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too.

klosterdev
Oct 10, 2006

Na na na na na na na na Batman!
Honestly, at least from a medium-size nonprofit IT standpoint, we couldn't reasonably hope to match Microsoft's uptime even with a significant budget and personnel increase. I mean it sucks, but when poo poo completely goes sideways, it'll always come back up with people in the $1million/year skill level at the helm know what needs to be done instead of being stuck with situations like two different vendors blaming each other for a week but refuse to meet with each other over a problem we don't have the necessary specialist-level knowledge to solve.

ssb
Feb 16, 2006

WOULD YOU ACCOMPANY ME ON A BRISK WALK? I WOULD LIKE TO SPEAK WITH YOU!!


Graph api was down too. None of my O365 python scripts were working, all timing out with a 504. Seemed to start working again right about 2pm CDT.

Dirt Road Junglist
Oct 8, 2010

We will be cruel
And through our cruelty
They will know who we are
I mean, I had to live through #NA14 (nevar forget), but at least when my company blows up our cloud, it's a bunch of businesses freaking out over sales numbers, and not end users melting down.

I'm also feeling extremely smug for working in a Gapps shop right now :smug:

stevewm
May 10, 2005
I have to wonder... why do they have so many outages.

When Google has one, it usually only affects some accounts with some services, rarely is a service completely down for everyone. When MS has one, it affects several services at once typically for everyone and sometimes entire regions are completely blacked out.

Based on just that alone I feel like maybe Google's architecture is more distributed maybe? And MS is more centralized?


GApps has had exactly one outage this year that affected us. Mail still worked, it was just slow, or some people would occasionally get a timeout in Gmail. It lasted a couple hours at best.

Weedle
May 31, 2006




we're a k-8 school so there's absolutely no reason for us to even be on o365 instead of gapps at all. it makes no sense because there's nothing our students need to do that gapps can't handle, often much more simply than o365 does, and all of the high schools our kids end up at also use google so it's not like we're even teaching them any immediately useful skills

AlexDeGruven
Jun 29, 2007

Watch me pull my dongle out of this tiny box


stevewm posted:

I have to wonder... why do they have so many outages.

When Google has one, it usually only affects some accounts with some services, rarely is a service completely down for everyone. When MS has one, it affects several services at once typically for everyone and sometimes entire regions are completely blacked out.

Based on just that alone I feel like maybe Google's architecture is more distributed maybe? And MS is more centralized?


GApps has had exactly one outage this year that affected us. Mail still worked, it was just slow, or some people would occasionally get a timeout in Gmail. It lasted a couple hours at best.

Everything is tied to Azure which has an NT4 domain controller running the primary AD on a 1998 Compaq P590 desktop with 128MB RAM.

Methanar
Sep 26, 2013

by the sex ghost
Azure is really funny. you have two possibilities

MS is trying to run a global distributed cloud platform on windows (LOL)

MS is trying to run a global distributed cloud platform on linux (LOL)

Jaded Burnout
Jul 10, 2004


AlexDeGruven posted:

Everything is tied to Azure which has an NT4 domain controller running the primary AD on a 1998 Compaq P590 desktop with 128MB RAM.

Someone rebooted it with a floppy still in the drive.

Zereth
Jul 9, 2003



Super Soaker Party! posted:

It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too.
cloud2butt except instead of butt it's "other people's computers"

The Fool
Oct 16, 2003


Methanar posted:

Azure is really funny. you have two possibilities

MS is trying to run a global distributed cloud platform on windows (LOL)

MS is trying to run a global distributed cloud platform on linux (LOL)

Iirc, it’s modified Windows data center and hyper-v

For my money though, the reason the MS outages get as bad as they do is because a bunch of their services are tightly integrated and if one fails it has knock-on effects across the platform

That tight integration is also one of the advantages tho

So :shrug:

Weedle
May 31, 2006




if it's that precarious you'd think they'd be a little more careful with it

https://twitter.com/MSFT365Status/status/1313932490361499655

Methanar
Sep 26, 2013

by the sex ghost

The Fool posted:

Iirc, it’s modified Windows data center and hyper-v

For my money though, the reason the MS outages get as bad as they do is because a bunch of their services are tightly integrated and if one fails it has knock-on effects across the platform

That tight integration is also one of the advantages tho

So :shrug:

MS actually does run parts of Azure on linux. Particularly their networking/sdn stack, probably even more stuff now

That's why MS had their big thing about releasing support for Linux, like porting their .NET CLR and SQL server to linux a few years back.

MS themselves needed their stuff to work on Linux.

Methanar fucked around with this message at 22:39 on Oct 7, 2020

Sickening
Jul 16, 2007

Black summer was the best summer.

Super Soaker Party! posted:

It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too.

And is 10000% better than just running it yourself on prem. It could be down for the next week, I give no fucks.

Proteus Jones
Feb 28, 2013



The Fool posted:

Iirc, it’s modified Windows data center and hyper-v

For my money though, the reason the MS outages get as bad as they do is because a bunch of their services are tightly integrated and if one fails it has knock-on effects across the platform

That tight integration is also one of the advantages tho

So :shrug:

Yeah, I actually looked it up today because of the irony of getting a "Azure is super reliable" email right before everything went to poo poo.

Turns out O365, Bing, X-Box Live all run on their own private stacks and physical data centers and not on Azure. Still incredibly bad optics for MS from a reliability perspective in general.

Joke on work Slack: Most companies try for five 9s. MS aims for nine 5s.

SyNack Sassimov
May 4, 2006

Let the robot win.
            --Captain James T. Vader


Sickening posted:

And is 10000% better than just running it yourself on prem. It could be down for the next week, I give no fucks.

Oh I'm by no means implying that people should go back to running Exchange on-prem. I'm quite happy never to have to admin a DAG ever again. Just that there's a lot of people who imagine "the cloud" is going to magically solve everything 100% of the time, and don't understand that there's always tradeoffs and downsides to anything in IT and moving to cloud setups without a clear knowledge of those potential issues is loving stupid.

See also people who don't back up their email on 365 because "it's in the cloud".

edit: or try to use B2 or other cloud backup for their office over a Comcast 100/10 connection

Sickening
Jul 16, 2007

Black summer was the best summer.

Super Soaker Party! posted:

Oh I'm by no means implying that people should go back to running Exchange on-prem. I'm quite happy never to have to admin a DAG ever again. Just that there's a lot of people who imagine "the cloud" is going to magically solve everything 100% of the time, and don't understand that there's always tradeoffs and downsides to anything in IT and moving to cloud setups without a clear knowledge of those potential issues is loving stupid.

See also people don't back up their email on 365 because "it's in the cloud".

edit: or try to use B2 or other cloud backup for their office over a Comcast 100/10 connection

Real talk, I haven’t been part of an org that backs up office 365 email and I don’t know if I ever want to.

The Fool
Oct 16, 2003


We backup o365 to on prem.

But we are in a region where it is a perfectly reasonable dr scenario to lose internet to the rest of the world and still need to do business.

SyNack Sassimov
May 4, 2006

Let the robot win.
            --Captain James T. Vader


Sickening posted:

Real talk, I haven’t been part of an org that backs up office 365 email and I don’t know if I ever want to.

Veeam makes it real easy (though of course it's a per-user cost). You just need, y'know, a decent chunk of space and a fast connection.

SixFigureSandwich
Oct 30, 2004
Exciting Lemon

Super Soaker Party! posted:

It's a great opportunity to remind people that as wonderful as "the cloud" is in some respects, it's still just a bunch of servers run by someone else, and if that someone else fucks up, congrats you're hosed too.

And remind them that yes there is an SLA in place, but in practice that just means you get a small refund on your monthly bill, not that your uptime will truly be 99.9% always.

RFC2324
Jun 7, 2012

http 418

Can't you take additional legal action over repeatedly violation of their contract? (SLA IS a contractual agreement)

Dirt Road Junglist
Oct 8, 2010

We will be cruel
And through our cruelty
They will know who we are
Someone in a Discord dropped this gem today:

quote:

aside: had someone attempt to put in "warding prayers" in the comments to prevent "evil intentions" from crossing their source code. except they werent comments and it was in the javascript so it broke everything

dragonshardz
May 2, 2017

Dirt Road Junglist posted:

Someone in a Discord dropped this gem today:

When praising the Omnissiah and attempting to placate the Machine Spirit, make sure said prayers are appropriately escaped!

Relentless
Sep 22, 2007

It's a perfect day for some mayhem!


Thoughts and prayers don't work: Javascript Edition

Entropic
Feb 21, 2007

patriarchy sucks
Man I sure do love it when a SIP phoneline cutover gets pushed to 3:00pm on a Friday before a long weekend with an hour to test beforehand.

Wizard of the Deep
Sep 25, 2005

Another productive workday

Entropic posted:

Man I sure do love it when a SIP phoneline cutover gets pushed to 3:00pm on a Friday before a long weekend with an hour to test beforehand.

It's a real shame something* came up and you have to push this to Tuesday/Wednesday.

*common sense.

Shugojin
Sep 6, 2007

THE TAIL THAT BURNS TWICE AS BRIGHT...


had a guy call in and just immediately jump in my poo poo because of something incomprehensible with volume


gently caress you too, buddy

Shugojin
Sep 6, 2007

THE TAIL THAT BURNS TWICE AS BRIGHT...


same jackass who called last week to see if we could help him set up his iot netgear poo poo


which we don't sell and don't recommend because... oh, lots of reasons

GnarlyCharlie4u
Sep 23, 2007

I have an unhealthy obsession with motorcycles.

Proof
A ticket came in...

quote:

My Brick is Dead

That is the entirety of the ticket.

klosterdev
Oct 10, 2006

Na na na na na na na na Batman!
They have pills for that

Jaded Burnout
Jul 10, 2004


Maybe they're building up to it.

guppy
Sep 21, 2004

sting like a byob

GnarlyCharlie4u posted:

A ticket came in...


That is the entirety of the ticket.

I mean, I would interpret that as being the power adapter, and assuming you standardize your laptop models, that's enough information to know what to do. I'd verify, but I can't imagine what else it might be.

Moo the cow
Apr 30, 2020



I always learn about showbiz news here first.

Arquinsiel
Jun 1, 2006

"There is no such thing as society. There are individual men and women, and there are families. And no government can do anything except through people, and people must look to themselves first."

God Bless Margaret Thatcher
God Bless England
RIP My Iron Lady

guppy posted:

I mean, I would interpret that as being the power adapter, and assuming you standardize your laptop models, that's enough information to know what to do. I'd verify, but I can't imagine what else it might be.
Same.

GnarlyCharlie4u
Sep 23, 2007

I have an unhealthy obsession with motorcycles.

Proof

guppy posted:

I mean, I would interpret that as being the power adapter, and assuming you standardize your laptop models, that's enough information to know what to do. I'd verify, but I can't imagine what else it might be.

What makes you think the problem had anything to do with a computer? (also they don't have a laptop.)

they broke their mouse usb cable

Renegret
May 26, 2007

THANK YOU FOR CALLING HELP DOG, INC.

YOUR POSITION IN THE QUEUE IS *pbbbbbbbbbbbbbbbbt*


Cat Army Sworn Enemy

GnarlyCharlie4u posted:

What makes you think the problem had anything to do with a computer? (also they don't have a laptop.)

they broke their mouse usb cable

This is the best punchline possible

Adbot
ADBOT LOVES YOU

guppy
Sep 21, 2004

sting like a byob

GnarlyCharlie4u posted:

What makes you think the problem had anything to do with a computer? (also they don't have a laptop.)

they broke their mouse usb cable

Clearly my imagination is inadequate for the marvels of user problem analysis.

  • 1
  • 2
  • 3
  • 4
  • 5