|
DigitalMocking posted:that should take like 4 hours, tops? I don't think I could get it all done correctly with 10 minutes per server to configure them...
|
#
?
Feb 4, 2019 22:06
|
|
|
|
| # ? May 25, 2024 22:53 |
|
|
You don't have enough of the deployment automated then
|
|
#
?
Feb 4, 2019 22:08
|
|
|
Several Hundred Tickets Came In...
|
|
#
?
Feb 4, 2019 22:25
|
|
|
Entropic posted:Several Hundred Tickets Came In... Well, my sympathies. For living in T-bay, obviously 
|
|
#
?
Feb 4, 2019 22:38
|
|
|
The Fool posted:You don't have enough of the deployment automated then You're not wrong; we don't have any deployment of servers automated at this time.
|
|
#
?
Feb 4, 2019 22:38
|
|
|
Canuck-Errant posted:Well, my sympathies. For living in T-bay, obviously I don't actually work for the phone company, so it's not really our problem, but we do get all the tickets coming in from the people whose phone systems or networks we manage wondering why their phones don't work. From what I hear the city crew completely severed a conduit carrying major fibre and copper links when they were trying to dig up a busted water main with a backhoe. I don't envy the line guys who have to try to fix that -- since there's still a broken water main there. And it's snowing.
|
|
#
?
Feb 4, 2019 22:52
|
|
|
Entropic posted:Several Hundred Tickets Came In... Wait, are you saying it's NOT DNS this time? 
|
|
#
?
Feb 4, 2019 23:45
|
|
|
iospace posted:Wait, are you saying it's NOT DNS this time? Technically DNS also isn't working, so yeah, it was still DNS.
|
|
#
?
Feb 4, 2019 23:49
|
|
|
Entropic posted:I don't actually work for the phone company, so it's not really our problem, but we do get all the tickets coming in from the people whose phone systems or networks we manage wondering why their phones don't work. Oh, no, absolutely that's gonna suck for the teleco guys; I feel for anyone doing splices in this poo poo. Wasn't T-Bay under a freezing rain warning today too, or was that further east?
|
|
#
?
Feb 5, 2019 01:35
|
|
|
Entropic posted:Several Hundred Tickets Came In... Tell the attending techs to take pictures, because if they can't drag slack cable into place and splice, then it's gotta be pretty spectacular.
|
|
#
?
Feb 5, 2019 03:45
|
|
|
kensei posted:You're not wrong; we don't have any deployment of servers automated at this time. Do you at least have a virtual environment with templates you can roll out? Or are you literally going to have to build a bunch of physical servers, cos that would suck and I would say something like "welcome to 2005".
|
|
#
?
Feb 5, 2019 11:21
|
|
|
Neddy Seagoon posted:Tell the attending techs to take pictures, because if they can't drag slack cable into place and splice, then it's gotta be pretty spectacular. Surely if you can drag the cables next to each other, the burst water main will provide water, the snow will freeze the water and therefore the cables being in place will freeze back together and we will all go home on time tonight. Obviously.
|
|
#
?
Feb 5, 2019 14:47
|
|
|
angry armadillo posted:Surely if you can drag the cables next to each other, the burst water main will provide water, the snow will freeze the water and therefore the cables being in place will freeze back together and we will all go home on time tonight. And ice is transparent, so even the fiber cables will work!
|
|
#
?
Feb 5, 2019 14:49
|
|
|
Dunno-Lars posted:And ice is transparent, so even the fiber cables will work! Description: Ice join of fiber cable from Feb 2019 has melted, connection lost
|
|
#
?
Feb 5, 2019 15:15
|
|
|
An email came in: "Can't connect to share". A reply went out within 2 minutes: "Please log off and on again, it'll reconnect the shares". A phone call came in 5 minutes later from the same user: "Can't connect to share". "I know, I already replied to your email". "Oh, didn't see that yet".
|
|
#
?
Feb 5, 2019 15:20
|
|
|
Well about a dozen tickets have come in saying users cannot search contacts in Skype/Lync. The first few I was alright with repairing Lync address book caches, but I guess there's probably something else going on.
|
|
#
?
Feb 5, 2019 19:20
|
|
|
Latest update: “flushing ice and water from ducts from each manholes. More updates to follow.” Someone’s having a fun day.
|
|
#
?
Feb 5, 2019 19:51
|
|
|
I've had similar happen - manhole in a lower section of road got flooded, then temps dropped. Literally froze into an underground ice cube and split every box/cable in there. IIRC, it was about 12 hours with a steam and pump truck to just get access to the manhole to assess damages and start repairs.
|
|
#
?
Feb 5, 2019 20:28
|
|
|
You know who else is having a fun day? An engineer having his second day on the job just deleted a production S3 bucket for a customer of mine. A ticket comes in: is there any way for you to recover this bucket? Me: nope
|
|
#
?
Feb 5, 2019 21:14
|
|
|
Agrikk posted:You know who else is having a fun day? That's a feels bad.
|
|
#
?
Feb 5, 2019 21:23
|
|
|
Agrikk posted:You know who else is having a fun day?
|
|
#
?
Feb 5, 2019 21:23
|
|
|
I almost go out of my way to never touch Delete on anything not belonging to me because that feeling is horrible.
|
|
#
?
Feb 5, 2019 21:27
|
|
|
Drop the permissions off the thing first, the cost of a few more days storage isn't going to ruin people's lives.
|
|
#
?
Feb 5, 2019 21:31
|
|
|
Thanks Ants posted:Drop the permissions off the thing first, the cost of a few more days storage isn't going to ruin people's lives. ...and guess which customer has been putting off a well-architected discussion for the last few months? One guess what topic suddenly became a critical meeting to be scheduled ASAP.
|
|
#
?
Feb 5, 2019 21:34
|
|
|
Agrikk posted:You know who else is having a fun day? Versioning isn't on? edit: oh lmao he deleted the entire bucket. I disable that at the policy level http://awspolicygen.s3.amazonaws.com/policygen.html
|
|
#
?
Feb 5, 2019 21:37
|
|
|
sixth and maimed posted:An email came in: "Can't connect to share". See, what happened is that you didn't fix their problem. You told them to do something. Firing a complaint at you out of a cannon and then staring at their computer until the lights start blinking is the most they can be expected to do, after all.
|
|
#
?
Feb 5, 2019 21:38
|
|
|
Nuclearmonkee posted:Versioning isn't on? So many questions: What were they doing giving a second day employee elevated access? more importantly we provide so many means for customers to protection themselves 1. MFA on delete, 2. CRR, 3. Versioning. 4. Lifecycle policies. etc. Why weren’t any of these in place?
|
|
#
?
Feb 5, 2019 21:41
|
|
|
It's the cloud though so you don't need to worry about backups
|
|
#
?
Feb 5, 2019 21:42
|
|
|
Agrikk posted:So many questions: You know the answer. 
|
|
#
?
Feb 5, 2019 21:42
|
|
|
Agrikk posted:So many questions: Holy poo poo. I feel like a company giving that many user Riggs day two will not have a blameless RCA for everyone to learn from this....
|
|
#
?
Feb 6, 2019 03:16
|
|
|
Today, a domain policy applied to the Phase 1 patch testing group in AD somehow ended up turning off the local SYSTEM's ability to do things like "turn on the DHCP service" and "start the Windows/Office licensing services". For people both within and not within that group. I'm not sure how this happened, but being on the service desk, I had to be the one to tell people that no, Office is broken for more than just you and no, we don't have a fix or an ETA. Last week, someone somehow got assigned a group for a completely different division which made them see a bunch of completely empty mapped drives instead of their own. Also last week, the domain admins added distribution groups to printer security groups for a new site and I was the one to figure out that that doesn't work, which is why the users weren't seeing the printers. I think I know why people jump ship from the department's IT staff given the slightest opportunity to go elsewhere.
|
|
#
?
Feb 6, 2019 04:20
|
|
|
Agrikk posted:So many questions: We were spending too much money on storage so last year someone went through and put lifecycle policies on everything in s3. One of those buckets that got a 14 day policy had a prefix where our feature flags were dumped from a database into a flat file each time the database updated, that ECS containers would pull on launch. I'm sure you already guessed what happened - over the holidays nobody turned on or off any feature flags and the file got wiped and everything exploded. It was quick to diagnose and fix so it ended up just being hilarious - the guy who set up the lifecycle policies doesn't even work there anymore so we couldn't give him poo poo and make him buy the on-call a beer.
|
|
#
?
Feb 6, 2019 08:47
|
|
|
Thanks Ants posted:Drop the permissions off the thing first, the cost of a few more days storage isn't going to ruin people's lives. It isn't an exact solution to "LOL, the actual bucket", but few things are as easy to roll back as repointing DNS to the new box.
|
|
#
?
Feb 6, 2019 09:14
|
|
|
A ticket came in from the wife. And she gave me the “I don’t care. just make the internet work” line as I tried to troubleshoot her issue. She had some important work video conference call to be on or some poo poo. I am forty seven years old and I don’t think I have ever reverted to petulant and contrary teenager faster. “Honey. Love of my life. My sweet. Your loving problem is not my loving problem. Either you lighten up or I’ll go back to my book and hot tea on the couch.” This is why I mandated that we both have our own office when we were looking for a new house. Agrikk fucked around with this message at 18:08 on Feb 6, 2019 |
|
#
?
Feb 6, 2019 18:05
|
|
|
Agrikk posted:A ticket came in from the wife. And she gave me the “I don’t care. just make the internet work” line as I tried to troubleshoot her issue. 
|
|
#
?
Feb 6, 2019 18:11
|
|
|
And he spent the next 4 weeks on that couch.
|
|
#
?
Feb 6, 2019 18:13
|
|
|
GreenNight posted:And he spent the next 4
|
|
#
?
Feb 6, 2019 18:24
|
|
|
Agrikk posted:A ticket came in from the wife. And she gave me the “I don’t care. just make the internet work” line as I tried to troubleshoot her issue. I didn't realize that when I got married, I'd be signing up for a lifetime of end user support for my wife's parents. I didn't know people could be so bad at technology and I have literally had to explain to people that physically moving the mouse around is how you move the cursor on the screen, and pressing down on the front-left or front-right side actuates a button that performs an action. On the up side, I refused to support their printer and just ordered a Brother Laser Jet MFP with next day shipping. 
|
|
#
?
Feb 6, 2019 18:29
|
|
|
GnarlyCharlie4u posted:On the up side, I refused to support their printer and just ordered a Brother Laser Jet MFP with next day shipping. Cheap LJ printers are killing off inkjet printers in such a lovely way. I have a color HP LJ that I picked up open-box on Amazon 4 years ago for $125. Best $125 I've ever spent. When my in-laws' inkjet printer bit it, I got them the MFP version that uses the exact same cartridges and it ended up being the same price. Death to all inkjet. AlexDeGruven fucked around with this message at 22:41 on Feb 6, 2019 |
|
#
?
Feb 6, 2019 18:33
|
|
|
|
| # ? May 25, 2024 22:53 |
|
|
I have several years of networking experience and it still took me a year to run cat6 12 feet across the "computer room" for my wife's PC because . So like, 25 feet of cable around the perimeter including around door trim. The last thing I want to do when I get home from work, especially now that we have a toddler, is more troubleshooting.
|
|
#
?
Feb 6, 2019 19:12
|
|