Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Docjowles
Apr 9, 2009

Tab8715 posted:

That's best part about corporate IT.

My last gig turned into literal ghost town during the holidays. Every high-level manager was busy burning through their 5-weeks PTO and the rest of us just took it easy making sure everything was running smoothly.

that sounds spooky as gently caress :ghost: :stonk: :ghost:

Adbot
ADBOT LOVES YOU

Zaepho
Oct 31, 2013

FISHMANPET posted:

Interview in 1 hour, bundle of nerves, etc etc.

Good luck!

Did mine, wasn't bad. not needing the job sure helped with not having the usual level of nerves. The rest indicator of how it went will be if they make an offer or not though.

ghostinmyshell
Sep 17, 2004



I am very particular about biscuits, I'll have you know.
Thanks .net updates, 3 hour windows update sessions for an OOTB 2012R2 server to current.

evol262
Nov 30, 2010
#!/usr/bin/perl

Docjowles posted:

that sounds spooky as gently caress :ghost: :stonk: :ghost:

Best post in the thread.

Richard Noggin
Jun 6, 2005
Redneck By Default

ghostinmyshell posted:

Thanks .net updates, 3 hour windows update sessions for an OOTB 2012R2 server to current.

And this is why I keep VMware templates of 2008 R2, 2012, and 2012 R2 patched and current.

dogstile
May 1, 2012

fucking clocks
how do they work?

Tab8715 posted:

That's best part about corporate IT.

My last gig turned into literal ghost town during the holidays. Every high-level manager was busy burning through their 5-weeks PTO and the rest of us just took it easy making sure everything was running smoothly.

Happened to me too. Sat on an install, had done my part of the job. Watched a season of supernatural while the data guy upstairs was panicking and working like crazy. I didn't want to head back to the hotel as that mean I would have to pay for wifi and stop getting paid.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Richard Noggin posted:

And this is why I keep VMware templates of 2008 R2, 2012, and 2012 R2 patched and current.
Briantist has some PowerShell scripts to automate this, he should probably post them.

mewse
May 2, 2006

Docjowles posted:

that sounds spooky as gently caress :ghost: :stonk: :ghost:

Load up Doom on one of the company projectors :toot:

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


Docjowles posted:

that sounds spooky as gently caress :ghost: :stonk: :ghost:

I see what you did there :smith:

Richard Noggin
Jun 6, 2005
Redneck By Default

Misogynist posted:

Briantist has some PowerShell scripts to automate this, he should probably post them.

I'll elaborate a bit - we keep "template" VMs running, with Automatic Updates enabled. Periodically, we run a script that leverages ovftool to shut down the VMs, make an ovf template, and copy them to a web server. From there, we can just point VMware at the web server and we have up-to-date templates available from anywhere.

Docjowles
Apr 9, 2009

Tab8715 posted:

I see what you did there :smith:

Today I learned Maddox still exists. Hadn't thought about that dude since about 1998.

JHVH-1
Jun 28, 2002
Does anyone know if any open source tools exist to scan an applications log files and look for information which may be sensitive (personal info, passwords, etc.).

Ideally it should be up to our developers to have sane logging, but if a tool exists that would be handy to point these things out.

stubblyhead
Sep 13, 2007

That is treason, Johnny!

Fun Shoe

FISHMANPET posted:

Interview in 1 hour, bundle of nerves, etc etc.

How did it go?

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams
Um, well I guess? I have no idea how to read these things though. It's kind of discouraging when they ask you a bunch of questions about technologies you have no experience with because your current employer is stuck in the early 90s. But eventually we got into the stuff I really do know (System Center), and also I learned how Senior this "Senior Sysadmin" role is. There's going to be another round of interviews with even more people next week or week after if they're still interested in me. So we'll see.

evol262
Nov 30, 2010
#!/usr/bin/perl

JHVH-1 posted:

Does anyone know if any open source tools exist to scan an applications log files and look for information which may be sensitive (personal info, passwords, etc.).

Ideally it should be up to our developers to have sane logging, but if a tool exists that would be handy to point these things out.

Any scripting language you want.

Seriously, without knowing what your logs are formatted like, this is an impossible question.

Pudgygiant
Apr 8, 2004

Garnet and black? More like gold and blue or whatever the fuck colors these are
Even WITH knowing, sanitization is hard as hell:
IPv4
code:
^(([1-9]?\d|1\d\d|2[0-5][0-5]|2[0-4]\d)\.){3}([1-9]?\d|1\d\d|2[0-5][0-5]|2[0-4]\d)$
IPv6
code:
(\A([0-9a-f]{1,4}:){1,1}(:[0-9a-f]{1,4}){1,6}\Z)|
(\A([0-9a-f]{1,4}:){1,2}(:[0-9a-f]{1,4}){1,5}\Z)|
(\A([0-9a-f]{1,4}:){1,3}(:[0-9a-f]{1,4}){1,4}\Z)|
(\A([0-9a-f]{1,4}:){1,4}(:[0-9a-f]{1,4}){1,3}\Z)|
(\A([0-9a-f]{1,4}:){1,5}(:[0-9a-f]{1,4}){1,2}\Z)|
(\A([0-9a-f]{1,4}:){1,6}(:[0-9a-f]{1,4}){1,1}\Z)|
(\A(([0-9a-f]{1,4}:){1,7}|:):\Z)|
(\A:(:[0-9a-f]{1,4}){1,7}\Z)|
(\A((([0-9a-f]{1,4}:){6})(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3})\Z)|
(\A(([0-9a-f]{1,4}:){5}[0-9a-f]{1,4}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3})\Z)|
(\A([0-9a-f]{1,4}:){5}:[0-9a-f]{1,4}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,1}(:[0-9a-f]{1,4}){1,4}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,2}(:[0-9a-f]{1,4}){1,3}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,3}(:[0-9a-f]{1,4}){1,2}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,4}(:[0-9a-f]{1,4}){1,1}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A(([0-9a-f]{1,4}:){1,5}|:):(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A:(:[0-9a-f]{1,4}){1,5}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)
And that's for KNOWN things. Email addresses, phone numbers, street addresses are drat near impossible.

JHVH-1
Jun 28, 2002

evol262 posted:

Any scripting language you want.

Seriously, without knowing what your logs are formatted like, this is an impossible question.

I've seen email filters do things like detect credit card numbers so I was wondering if anything already existed. Not to detect everything, just to help find things that may be suspect. I guess I'll just take some log samplings and toss them into splunkstorm to see what the field discovery finds.

evol262
Nov 30, 2010
#!/usr/bin/perl

Pudgygiant posted:

Even WITH knowing, sanitization is hard as hell:
IPv4
code:
^(([1-9]?\d|1\d\d|2[0-5][0-5]|2[0-4]\d)\.){3}([1-9]?\d|1\d\d|2[0-5][0-5]|2[0-4]\d)$
IPv6
code:
(\A([0-9a-f]{1,4}:){1,1}(:[0-9a-f]{1,4}){1,6}\Z)|
(\A([0-9a-f]{1,4}:){1,2}(:[0-9a-f]{1,4}){1,5}\Z)|
(\A([0-9a-f]{1,4}:){1,3}(:[0-9a-f]{1,4}){1,4}\Z)|
(\A([0-9a-f]{1,4}:){1,4}(:[0-9a-f]{1,4}){1,3}\Z)|
(\A([0-9a-f]{1,4}:){1,5}(:[0-9a-f]{1,4}){1,2}\Z)|
(\A([0-9a-f]{1,4}:){1,6}(:[0-9a-f]{1,4}){1,1}\Z)|
(\A(([0-9a-f]{1,4}:){1,7}|:):\Z)|
(\A:(:[0-9a-f]{1,4}){1,7}\Z)|
(\A((([0-9a-f]{1,4}:){6})(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3})\Z)|
(\A(([0-9a-f]{1,4}:){5}[0-9a-f]{1,4}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3})\Z)|
(\A([0-9a-f]{1,4}:){5}:[0-9a-f]{1,4}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,1}(:[0-9a-f]{1,4}){1,4}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,2}(:[0-9a-f]{1,4}){1,3}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,3}(:[0-9a-f]{1,4}){1,2}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A([0-9a-f]{1,4}:){1,4}(:[0-9a-f]{1,4}){1,1}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A(([0-9a-f]{1,4}:){1,5}|:):(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)|
(\A:(:[0-9a-f]{1,4}){1,5}:(25[0-5]|2[0-4]\d|[0-1]?\d?\d)(\.(25[0-5]|2[0-4]\d|[0-1]?\d?\d)){3}\Z)
And that's for KNOWN things. Email addresses, phone numbers, street addresses are drat near impossible.

You don't have to parse every field of every line. Email addresses alone are much harder than that article. See Mail::RFC822::Address for validating. Don't write your own validator for this poo poo, especially with regexes :drat:

Use a library based on 822 for email. Try opening a socket to ipv6 (which will return an error or exception in your language of choice). Use a mapping api for addresses.

You know that old jwz quip about regexes? It's not always true. But it is in some cases. Like the one I quoted.

Logs have a regular format. Show a couple examples of bad lines and a competent person can generalize it. Obviously you can't catch a username or password in a log with plain regular expressions, since they're regular text and any field (auditd, kernel, system, etc) could conceivably be either.

JHVH-1 posted:

I've seen email filters do things like detect credit card numbers so I was wondering if anything already existed. Not to detect everything, just to help find things that may be suspect. I guess I'll just take some log samplings and toss them into splunkstorm to see what the field discovery finds.

Credit cards are easily matched with regular expressions and can be determined as valid or not with simple math. Are your usernames or passwords as unusual and easy to calculate as 16-19 digit numbers with mod10?

evol262 fucked around with this message at 06:25 on Nov 25, 2014

J
Jun 10, 2001

mewse posted:

Load up Doom on one of the company projectors :toot:

Load up five nights at freddy's 2 :getin:

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


Docjowles posted:

Today I learned Maddox still exists. Hadn't thought about that dude since about 1998.

He still has his site but now he's added videos and somewhat of a radio thing with Dick Masterson. If you got some time to kill, it's alright.

Question, I feel like whenever I read about about OpenStack I understand the product (is it even a product?) but then a week later I'm thinking to myself "What the hell is this?".

Is OpenStack directly analogous to Amazon AWS (S3, EC2) and/or Microsoft Azure? As opposed as different company doing the hosting, managing underlying tech and hardware you'd be doing it all yourself. You have your own cloud platform.

Am I on the right track?

Docjowles
Apr 9, 2009

There's so many players involved in OpenStack that there's definitely a lot of jostling to make it "all things to all people". At least in terms of how vendors market it :) But yes, when you boil it down it's about running your own cloud/IaaS platform. Most of the projects that make up OpenStack map to AWS products in some way, even if it's not exactly 1:1

EC2 == nova (compute virtualization) + neutron (SDN)
S3 == Swift
EBS == cinder
RDS == trove
CloudFormation == Heat
IAM == Keystone
GUI Dashboard == Horizon
AMI's == Glance images

The same can probably be said about Azure and GCE but I'm not as familiar with those.

Docjowles fucked around with this message at 18:14 on Nov 25, 2014

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


That makes much more sense, thanks!

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.
I just moved 250 server instances from EC2 to GCE, ask me anything.

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


Why'd you leave Amazon in the first place? How difficult was moving all the instances?

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Tab8715 posted:

Why'd you leave Amazon in the first place? How difficult was moving all the instances?
Google has a program for startups where eligible companies can be offered $100,000 in platform credits. That was a no-brainer to get us to evaluate it in the first place. While the platform seems to be a little immature and a bit more moody than EC2, we found that the cost and performance were both more compelling than what Amazon is offering. The network performance, especially between GCE regions, is an order of magnitude better than what Amazon offers. There's no concept of regular instances vs. reserved instances -- instances are billed by the minute with a 10-minute minimum, and the price goes down the longer you have an instance running. Performance is very predictable because most instance types have dedicated cores, so you're not constantly running up against CPU steal issues under contention the way that you do on EC2. Since we run a real-time communications platform, predictable latency matters.

Ease-of-use falls somewhere in between EC2 and DigitalOcean. It's a commodity service, not a premium-priced offering like DO. At the same time, most resources are named, unlike on EC2 where you need to use randomly-generated instance and AMI names for everything. The CLI is beautiful and really easy to use. Because of the way GCE handles key management, it's very difficult to get locked out of an instance the way you can on EC2.

It doesn't have a lot of the bells and whistles of AWS; for example, there's no RDS equivalent. I have no idea how well their load balancing system works because we use HAProxy. We're pretty much their ideal use case right now: people who are doing pretty much nothing but pure compute.

Moving the instances was pretty trivial. It took us about a day to retool our Chef dependencies to abstract away the AWS bits, and a few hours to spin up new server instances. We wrote a few scripts to make bootstrapping easier -- for example, we wrote a script that locates all the filesystems on block devices attached to the box and mounts them in the right place with the right permissions before service start -- so getting the majority of servers online was basically a simple command run with a few hundred others in a for loop. Migrating might be harder if you have lots of pets and few cattle, though.

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


Misogynist posted:

Performance is very predictable because most instance types have dedicated cores, so you're not constantly running up against CPU steal issues under contention the way that you do on EC2. Since we run a real-time communications platform, predictable latency matters.

Interesting, so you can't predict this enough in AWS? I'm not too well versed in cloud computing but why would this so unique or are you sharing cpu cores with other customer instances?

evol262
Nov 30, 2010
#!/usr/bin/perl

Tab8715 posted:

Interesting, so you can't predict this enough in AWS? I'm not too well versed in cloud computing but why would this so unique or are you sharing cpu cores with other customer instances?

AWS runs on Xen, with all that implies.

You can limit usage with cgroups, but weighted averages are kinda the norm. You're pretty much contending for CPU time on every virt platform. Some people rely on the fact that a lot of virtualized/cloud services are underutilized or memory heavy and light on CPU, so you can reliably steal CPU from other people (hypothetical 2 CPU server with 2 guests, each allocated 1 core -- if one is idling on CPU, the other one can potentially get both cores to use). That's assuming it's not oversold with 2 guests with 2 vCPUs each on a system with 2 cores, and they're both busy. It's a balancing act.

And it can go the other way. So your app which expects X amount of CPU time may get less if it's on an overcommitted box or on the same machine as someone running some giant data transformation which is using 100% of their shares. The hypervisor will try to give them a little more if it's available, which can make for interesting scheduler problems.

Local virt setups also have these issues, including RHEV, Hyper-V, and VMware's products, but configuring caps for hostile multi-tenant environments isn't generally a problem internally.

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


So, GCE is doing the resource balancing act better than AWS? Or at least more reliably with less latency?

Picardy Beet
Feb 7, 2006

Singing in the summer.
New episode of Picardy Beet job extreme revenganza : did the final interview with the HR manager - even if it was biased, i was coopted by a lot of people at my future company, having worked with them before. The raise will be even more than expected (40%). And this doesn't take account of the car and mobile advantages. Really should have take the merc mentality before.

Mrit
Sep 26, 2007

by exmarx
Grimey Drawer
Always take as much money as you can get. Your company would(and many do) fire you in an instant if they could save a few bucks a year. 'Company Loyalty' is a scam to keep timid people in their jobs for less money.

A new hire at my company worked for 5 years at a large retail company with no raises. While they let go 3 employees because he worked so hard(and cutbacks). When he went back to school and was offered a new job with us, they offered him a massive raise(like 50%). He finally realized they had been screwing him the whole time.

Get what you can from your job, because otherwise you will be walked on.

evol262
Nov 30, 2010
#!/usr/bin/perl

Tab8715 posted:

So, GCE is doing the resource balancing act better than AWS? Or at least more reliably with less latency?

It's extremely likely that Google is heavily using cgroup cpusets, especially given how much Google uses containers internally (which were a custom cgroup thing until recently, and a lot of it still is from what I hear since not everyone's migrated from home-grown containers to kubernetes yet, and may never be, but Volmarias probably knows more).

You can combine cpuset pinning and sharing so you're not sitting with idle cores, but it's a tradeoff in the same way as any sharing is, and I don't know whether their dedicated cores are actually dedicated (cpusets allocated to just your user) or just a smaller subset of the cores with a higher share ratio for your user.

The resource balancing is just as configurable on AWS if Amazon wanted to do it, but it's a zero sum game. Every gain somewhere means a loss somewhere. There's no "better" or "worse", except as they relate to given workloads and provider capacity.

BaseballPCHiker
Jan 16, 2006

http://www.zdnet.com/cios-make-progress-but-still-get-no-respect-7000035990/

quote:

The survey results showed most CEOs still regard their CIOs as itinerant specialists.… Most CEOs thought the best next step for their CIOs would be to do the same job in the same industry or in another industry. Few thought they would move on to a business leadership role.

It's been reading things like this, and the general feeling I get from sitting in on some meetings with executives that make me think I shouldn't try to be the IT generalist with some business background. More and more I think I should focus on networking or SCCM or something else and just go as deep as I can in that one niche. I was talking to some old IT warhorse project managers and they mentioned that CIO's/IT directors are always the first to go when budget cuts happen or the company decides to shake things up.

I guess the article isn't really a surprise, but it's still an interesting read.

Sheep
Jul 24, 2003
Don't you see though, IT only generates red numbers!

syg
Mar 9, 2012

BaseballPCHiker posted:

http://www.zdnet.com/cios-make-progress-but-still-get-no-respect-7000035990/


It's been reading things like this, and the general feeling I get from sitting in on some meetings with executives that make me think I shouldn't try to be the IT generalist with some business background. More and more I think I should focus on networking or SCCM or something else and just go as deep as I can in that one niche. I was talking to some old IT warhorse project managers and they mentioned that CIO's/IT directors are always the first to go when budget cuts happen or the company decides to shake things up.

I guess the article isn't really a surprise, but it's still an interesting read.

Pretty interesting. I'm trying to decide between moving more towards a project management / IT manager role in the next few years or specializing in networking with a side of vmware. I definitely see this culture in our business, as our IT director is still asked to move tables and fix television sets at the chairman of the board's house. And me as the most senior technical guy is seen as nothing more than a smartphone wizard and apple tv fixer to the CEO.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

There are a lot of jobs where the IT department is treated really well, but they are generally going to be places where technology is integral to how the business functions and not just a convenience. Find a place where outages mean lost revenue and not merely inconvenience and you'll often find IT staff that are treated better, or at least paid better and not expected to fix the CEOs daughters laptop on their lunch break.

Or go work for a technology company and become a profit center.

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer
My IT department generates revenue by reselling our internal services to outside companies who share our core business. That's a fancy way of saying other banks outsource their data processing to us.

meanieface
Mar 27, 2012

During times of universal deceit, telling the truth becomes a revolutionary act.

NippleFloss posted:

Or go work for a technology company and become a profit center.

Where people use your metrics to justify your salary--it's good and bad all at once.

Fiendish Dr. Wu
Nov 11, 2010

You done fucked up now!

adorai posted:

My IT department generates revenue by reselling our internal services to outside companies who share our core business. That's a fancy way of saying other banks outsource their data processing to us.

My IT department generates revenue by reselling or internal services to other departments inside the company. :shrug:

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

meanieface posted:

Where people use your metrics to justify your salary--it's good and bad all at once.

No matter where you work someone is always trying to justify your salary based on some formula or another.

Adbot
ADBOT LOVES YOU

Dr. Arbitrary
Mar 15, 2006

Bleak Gremlin
I've got some pro shortcuts for you all:

8 Game-Changing Keyboard Shortcuts You Need To Be Using

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply