|
Our server room air conditioning manages to fail hard every other summer or so, during the night before it's about to get really hot outside. Doesn't care if it's close to freezing that particular night, it's going to fail, and the next day we're going to have 42 degrees C in the shade, exacerbating the problem. It's also just how things work. We've changed the unit, changed the service/model, nothing helped. The room is cursed or something, it's getting really really weird. We've learned to deal with it if it happens by using a series of large fans to funnel in air from the unused underground parking lot next to the room (because of course it's always something that can't be fixed right away, it always takes several hours, sometimes more than a day to fix). It's always nice and cold in there. Not ideal, but we don't have to close shop at least, there's ~100 people working off these servers. It's happened this summer, too, so it's probably not happening next year though. Yay?
|
# ? Nov 2, 2014 15:53 |
|
|
# ? Jun 5, 2024 07:02 |
|
That's weird because yeah, Friday morning our colo site had HVAC issues. Things shut down.
|
# ? Nov 2, 2014 19:35 |
|
Pyroclastic posted:SCCM Treat SCCM like its a loaded gun.
|
# ? Nov 2, 2014 20:27 |
|
Always keep SCCM aimed downrange.
|
# ? Nov 2, 2014 21:24 |
|
Collateral Damage posted:Always keep SCCM aimed downrange. /
|
# ? Nov 2, 2014 21:28 |
|
incoherent posted:Treat SCCM like its a loaded gun. I wish SCCM were treated like a loaded handgun under the law. Then again, I'm in the UK.
|
# ? Nov 2, 2014 21:48 |
|
evol262 posted:"We're not going to break kernel ABI by trying to backport enormous patches which change ioctl handling for edge cases, like leaving ethool running for so long that it blocks other processes" isn't "no interest". It's fixed upstream and fixed in RHEL7, but a fix is unlikely to land in RHEL6 unless someone presents a really compelling use case with common reproducers. I realise this is old but "ethtool running for so long that it blocks other processes" was instantaneous at least in this case, opening a new ssh session failed while ethtool was running (services on some other ports continued to run). As mentioned, people are still on RHEL6 because it is in long term support, maybe I am biased because I got hit by it, but I think it really should be fixed or at least mitigated...
|
# ? Nov 2, 2014 22:14 |
|
Ataraxia posted:I realise this is old but "ethtool running for so long that it blocks other processes" was instantaneous at least in this case, opening a new ssh session failed while ethtool was running (services on some other ports continued to run). As mentioned, people are still on RHEL6 because it is in long term support, maybe I am biased because I got hit by it, but I think it really should be fixed or at least mitigated... No, I mean, ethtool blocks as soon as it's run. Just that most people don't leave it running long enough to cause significant problems or TCP timeouts for existing connections, which is what I meant. RHEL 7.1 isn't even out. 99% of our customer base is still on 6. It's a bug, and invasive or not, should be fixed. Open cases. I can't say a lot about it, other than that I agree it's a problem. But maybe there wasn't a lot of demand. And if more cases are opened about it, it may get rethought. Infer from that.
|
# ? Nov 3, 2014 00:53 |
|
A ticket came in... from home. My wifes backup drive for her photography business failed. Of course the drive that had all of the original data on also failed 6 months ago and she never thought it might be a good idea to keep the backup data mirrored somewhere else since it was now the only surviving copy. The is, of course, entirely my fault and now my problem. Does anyone have any experience with Crashplan or any cloud backup solutions? any recommendations?
|
# ? Nov 3, 2014 11:59 |
|
DigitalRaven posted:I wish SCCM were treated like a loaded handgun under the law. Then again, I'm in the UK. Kept in the trunks of special Police units? I wouldn't mind that. (I used to use MDT, in my new(ish) job I'm learning SCCM)
|
# ? Nov 3, 2014 12:00 |
|
Dravs posted:A ticket came in... from home. I am using Backblaze, $5/month for unlimited backup size. Highly recommend it. If you want something more interactive, PictureLife may also be interesting to your wife. A little more expensive but it allows direct access to all your pictures and videos, with a great web and smartphone apps.
|
# ? Nov 3, 2014 12:33 |
|
SCCM can gently caress everything up very fast, very easily. I once deployed antivirus/fw clients with very specific port rules for clients to about 5 servers with a wrong click. I never RDP'd that fast.
|
# ? Nov 3, 2014 12:36 |
|
Dravs posted:A ticket came in... from home. Carbonite is pretty alright (for consumer grade stuff) full click of death failure?
|
# ? Nov 3, 2014 12:50 |
|
Crowley posted:Kept in the trunks of special Police units? I wouldn't mind that. And nowhere else. Compared to other CM systems it's alternately a clownshoes attempt at how things should be done, or actively hostile to the principles of good configuration management. (Disclaimer: I work for the place that invented LCFG, and thus a good chunk of the theory of configuration management as we know it).
|
# ? Nov 3, 2014 12:58 |
|
DigitalRaven posted:And nowhere else. wait. you mean Microsoft doesn't understand its customer base? Hmmm. explains server 2012. FUN TICKET OF THE MORNING: Touchscreen computer attracts fingerprints. Reply: Yes. .. almost has a haiku quality to it. TehRedWheelbarrow fucked around with this message at 13:06 on Nov 3, 2014 |
# ? Nov 3, 2014 13:02 |
|
Dravs posted:A ticket came in... from home. I've been using Crashplan for a couple years now and it's one of those things that Just Works. Highly recommended.
|
# ? Nov 3, 2014 14:12 |
Yeah pretty much any of the constant sync backup programs Just Work. They all have their little quirks and they have slightly different features, but the core idea is simple. Find the one with the features you need and roll with it. They all have free trials too.
|
|
# ? Nov 3, 2014 14:25 |
|
nthalp posted:wait. you mean Microsoft doesn't understand its customer base? Hmmm. explains server 2012. Workaround: Get a stylus. The place where I volunteer has a touchscreen tablet used for tracking volunteer hours, and the stylus is kept right next to it. I've never seen it with fingerprints.
|
# ? Nov 3, 2014 15:13 |
|
PurpleButterfly posted:Workaround: Get a stylus. The place where I volunteer has a touchscreen tablet used for tracking volunteer hours, and the stylus is kept right next to it. I've never seen it with fingerprints. Not a bad idea.
|
# ? Nov 3, 2014 15:33 |
|
Sirotan posted:I've been using Crashplan for a couple years now and it's one of those things that Just Works. Highly recommended. Yeah, I finally ponied up for Crashplan because I never had any backups of anything because I am terrible, but it is pretty great.
|
# ? Nov 3, 2014 15:55 |
|
A nice thing about Crashplan too (maybe the other cloud backup companies have similar/identical features) is for my family members who I know aren't as fastidious about backups as I am, I can set up Crashplan Free on their machines, point their backup locations to my hard disk, and then include that location as a part of my paid backup plan. Their poo poo gets backed up ~to the cloud~ and I've now CYAed them for 14th time they get a virus/delete things they shouldn't!
|
# ? Nov 3, 2014 15:59 |
|
The only thing I would change about Crashplan is being able to setup extra folders to be backed up locally but not to ~the cloud~.
|
# ? Nov 3, 2014 16:06 |
|
This backup talk would motivate me to set up additional stuff for mine...if I didn't have an absolute poo poo internet connection that lags when my wife pulls up her Tumblr page. It'd be really nice if our internet connection speed in the US could get to a point where more people could get some serious use out if it. The idea of backing up my computer to the cloud at this speed is one of those "you won't finish the backup before the next one starts" kind of things.
|
# ? Nov 3, 2014 16:28 |
|
For private use Crashplan is an excellent piece of ware, that everyone should use. The only drawback is that they don't have a referral program. I wouldn't have to pay for it ever again with all the customers I've sent their way.
|
# ? Nov 3, 2014 16:42 |
Ursine Asylum posted:This backup talk would motivate me to set up additional stuff for mine...if I didn't have an absolute poo poo internet connection that lags when my wife pulls up her Tumblr page. All of the continuous data protection (CDP) backups (Crashplan, Carbonite, BackBlaze, etc) work like this: It backs up everything eligible for backup. This takes as long as it takes, and is mostly dependent on your upload speed. Most of the clients do allow you to back up only at certain times (like overnight) or allow you to throttle the speeds, or both. This allows you to use them without killing your other internet needs. Once that's done, individual files are backed up as necessary, at the block level. This means that only the changed blocks are uploaded for existing files. New files, of course, have to be uploaded in their entirety. Once your initial backup is done, even the shittiest connection can usually keep up with the changes. Big exception is if you do lots of multimedia work, like photography. Media files are usually quite large.
|
|
# ? Nov 3, 2014 17:00 |
|
Ursine Asylum posted:This backup talk would motivate me to set up additional stuff for mine...if I didn't have an absolute poo poo internet connection that lags when my wife pulls up her Tumblr page. If you don't want to wait and are ok with shelling out the cash, Crashplan et al. will send you a hard drive to fill up and return through the mail, to get your backups started: http://support.code42.com/CrashPlan/Latest/Backup/Seeded_Backup
|
# ? Nov 3, 2014 17:07 |
|
orange sky posted:SCCM can gently caress everything up very fast, very easily. I once deployed antivirus/fw clients with very specific port rules for clients to about 5 servers with a wrong click. I never RDP'd that fast. I've never managed to forcefully reimage All Systems, but telling a still-very-green junior sysadmin that he's now responsible for SCCM and no training read a book was not the best idea my then boss ever had. one of my first orders of business was to accidentally deploy about 1.5 years worth of back Windows updates to all the computers in the company responsible for credit card processing, with no maintenance windows defined, in the middle of the day. A lot of tickets Came In. I am currently training my replacement on that platform and I have him properly scared shitless of not double checking his settings before he deploys something. I hope.
|
# ? Nov 3, 2014 17:30 |
|
So I was onsite last Friday. The client had some questions about moving some vending machines from one side of the shop to the other. The machines need network connections so no problem, they need to add more runs. Then they start asking me about electrical load on the breakers. I tell them that im not an electrician and cannot answer their questions. They need to have someone certified come out and look at it. This morning I get an email with the detailed electrical specs for the vending machines looking for an answer.
|
# ? Nov 3, 2014 17:35 |
|
ConfusedUs posted:All of the continuous data protection (CDP) backups (Crashplan, Carbonite, BackBlaze, etc) work like this: That's actually moderately tempting. afflictionwisp posted:I've never managed to forcefully reimage All Systems, but telling a still-very-green junior sysadmin that he's now responsible for SCCM and no training read a book was not the best idea my then boss ever had. one of my first orders of business was to accidentally deploy about 1.5 years worth of back Windows updates to all the computers in the company responsible for credit card processing, with no maintenance windows defined, in the middle of the day. A lot of tickets Came In. Deploying anything at all ever is one of the most nerve-wracking parts of my job. It doesn't help that our (very nice, very streamlined) deploy process for production is almost identical to the process for staging and development, with the major difference being "the name of the dsh group". I've not yet managed to power-roll production with a dev image in the middle of the day via a typo, but I do have nightmares about it.
|
# ? Nov 3, 2014 17:36 |
|
Inspector_666 posted:The only thing I would change about Crashplan is being able to setup extra folders to be backed up locally but not to ~the cloud~. I believe you can have multiple backup sets with different targets. I think I have one that only goes to my NAS - will check that when I get home.
|
# ? Nov 3, 2014 17:36 |
Inspector_666 posted:The only thing I would change about Crashplan is being able to setup extra folders to be backed up locally but not to ~the cloud~. You can do that. Enable the Backup Sets function, then you can configure several sets that each include different locations, and control for each set which destinations it can back up to, as well as frequency and retention policies.
|
|
# ? Nov 3, 2014 17:39 |
|
nielsm posted:You can do that. Enable the Backup Sets function, then you can configure several sets that each include different locations, and control for each set which destinations it can back up to, as well as frequency and retention policies. dorkanoid posted:I believe you can have multiple backup sets with different targets. I think I have one that only goes to my NAS - will check that when I get home. Oh well then, thanks dudes.
|
# ? Nov 3, 2014 17:44 |
|
blackswordca posted:So I was onsite last Friday. "Thank you for following up with me about this. Once again, as I am not a licensed electrician, it would be illegal for me to help you further in attempting to determine this answer for you. I'm afraid that you will need to upgrade to our "Too Big to Fail" plan to continue this conversation, or failing that, contact a licensed electrician as first proposed. "
|
# ? Nov 3, 2014 18:30 |
|
Dravs posted:A ticket came in... from home. Sup photog-wife buddy Thanks for posing the question. My wife's office is full of blinking USB hard drives that she doesn't want to get rid of. I just explained CryptoRansom to her and explained that if something gets clicked wrong, all of those are paperweights unless we fork over the cash. Going to start pushing CrashPlan on her.
|
# ? Nov 3, 2014 21:34 |
|
Volmarias posted:"Thank you for following up with me about this. Once again, as I am not a licensed electrician, it would be illegal for me to help you further in attempting to determine this answer for you. I'm afraid that you will need to upgrade to our "Too Big to Fail" plan to continue this conversation, or failing that, contact a licensed electrician as first proposed. " The only answer. Please don't "compromise" just to get them off your back.
|
# ? Nov 3, 2014 21:40 |
|
Che Delilas posted:The only answer. Please don't "compromise" just to get them off your back. I wont be making any compromises with that.
|
# ? Nov 3, 2014 22:47 |
|
orange sky posted:SCCM can gently caress everything up very fast, very easily. Well, there was that case over at Emory university when someone accidentally wiped everything.
|
# ? Nov 3, 2014 23:16 |
I love that story. It's so good.
|
|
# ? Nov 4, 2014 00:18 |
|
After 2 months, I'm finally caught up in this thread, starting from my last post in the previous thread in early 2012. Since that time I've gotten two new jobs and landed in a pod for my day job. Of course, I still have my side business doing residential tech support. Recent calls I've gotten include the ever popular WiFi switch on a laptop as well as a wireless keyboard that started malfunctioning the day after a soda was spilled into it. But this might be the best I've gotten lately. I get a call that a guy has the FBI ransom virus on his computer, again. I cleaned it off his computer two years ago. Now he remembers that last time I created a separate user account to clean this thing and he goes into it and run Malwarebytes to clean it up this time. Malwarebytes finds nothing at all on the machine. I have him do a full scan, still nothing. Despite having a busy evening, I agree to squeeze him in after dinner. I go check it out and he briefly shows me the account that's gotten hit before he switches to the cleaner account and shows me Malware not finding anything. I notice that the ransom message this time says Interpol, which is weird being in NJ. This should have been a bigger red flag to me than it was. I then spend 20 minutes poking around online trying to find something I can do from the clean account to clean up the infected account and I can't find any trace of the virus at all in the system. Finally I go back to the original account to take another look at this thing. That's when I notice that his start bar is still visible, the thing hasn't gone completely full screen and I can click around. Then I notice that it's because he doesn't have the virus, he has an incognito Chrome tab that has a message on it that contains the ransom demand. Then I look at what was the previous tab that spawned this one, porn. So I get to tell the guy that the good news is he doesn't have a virus, it's just a pop-up window spawned from this other tab here about Asian girls. Then I just killed Chrome entirely and rebooted the computer, made sure it really was as clean as it could be. Then I gave him the bad news that I'm still charging a full hour for this. Overall, my customers don't bother me too much. But I've got to expand my business in NJ as much as I can, because while I landed in a pod for my day job, my marriage fell apart and I'm getting divorced. Now I need all the extra money for groceries I can get.
|
# ? Nov 4, 2014 00:53 |
|
|
# ? Jun 5, 2024 07:02 |
|
I've had at least two Macs come in because they had "a virus" where it turned out just to be that Safari was stuck on a page with a scary-looking pop up and the "re-open programs in the state they were in when you last closed them" default was set.
|
# ? Nov 4, 2014 05:02 |