Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

evol262 posted:

Tooling took a while to get there with containers also. I'm not saying this is super practical yet, but the isolation offered by using virt is an active area of research. Tooling comes later, mostly.

They mimicked container workloads. Logging and telemetry in containers is handled from the host level. This is just more tooling missing.

To be honest, they should have compared to process isolation with bare cgroups, which docker (and all the others) is/are basically a wrapper around.

I'm basically taking this as "in 2 years, we expect that there will be a container-like solution which leverages virtualization for more isolation"

isn't that basically intel's clear containers?

Adbot
ADBOT LOVES YOU

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

minato posted:

But in my experience SWEs don't want to know all that stuff, they just want to push a button and get their feature into prod. They're actively resistant to learning about how the sausage is made. They just want a magic "PaaS 2.0" where they click a button and get a deployment pipeline, telemetry, logs, alerts, & reliability. They don't want to know anything about configuration, auto-scaling, backups, availability-zones, security, load-balancing or service meshes; that's just an opaque implementation detail to them. And I can see their point.
Brendan Burns did a really interesting talk about this at Velocity NYC this year. The videos are paywalled in O'Reilly Safari, but there's an older and less-fleshed-out version of his talk from KubeCon last year:

https://www.youtube.com/watch?v=VQ7kpxPXTm4

PCjr sidecar posted:

isn't that basically intel's clear containers?
It's not exactly the same approach, but they're along the same road.

minato
Jun 7, 2004

cutty cain't hang, say 7-up.
Taco Defender

Vulture Culture posted:

Brendan Burns did a really interesting talk about this at Velocity NYC this year. The videos are paywalled in O'Reilly Safari, but there's an older and less-fleshed-out version of his talk from KubeCon last year:
I like this idea, it seems to be the natural progression. Right now it seems that K8s apps configure one of the various Kubernetes generic controllers, I feel has a few disadvantages: the config is typically maintained separately from the app, it's maintained by Ops (or at least k8s experts), and if a custom controller is required then that code is also separately maintained. If I understand what he's getting at, then it's a novel idea to invert this and make the controller the app's "entrypoint", so to speak. It not only unifies the controller and app codebases, it forces the developer to think about the service deployment pattern up front.

Emmideer
Oct 20, 2011

Lovely night, no?
Grimey Drawer
I’m trying to learn VMware basics (presale and vtsp stuff for now) from scratch using the courses on the vmware site. Would this be a case where I’d be served by the book mentioned in the OP?

freeasinbeer
Mar 26, 2015

by Fluffdaddy
I’m gonna be a hipster, but unless you have a compelling reason like your current job site having VMware with no plans to send it to the cloud, you’d be better served spending that time learning the basics of aws.

Maybe Azure if you are a windows heavy shop.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Punkbob posted:

I’m gonna be a hipster, but unless you have a compelling reason like your current job site having VMware with no plans to send it to the cloud, you’d be better served spending that time learning the basics of aws.

Maybe Azure if you are a windows heavy shop.

VMware ain’t that hard to learn and there’s still a ton of it out there. The human brain is big enough to learn both things and depending on location VMware is going to be a much more employable skill in the short term.

H2SO4
Sep 11, 2001

put your money in a log cabin


Buglord
The whole notion that VMs are going away everywhere and are being replaced by containers or serverless or four line perl scripts or whatever it is this week is rather annoying.

It's something you should keep on top of, like the rest of the field, but VMs aren't going away for a long time. The landscape needs to mature a whole hell of a lot more before it makes any sense for businesses to start completely rearchitecting their apps. The architecture isn't useless by any means, it's great in certain circumstances but not every app intrinsically benefits from such a large architecture change to be worth it. Cattle are coming eventually but nobody's gassing all of their pets.

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer
Seriously, there are still places that run everything on bare metal.

freeasinbeer
Mar 26, 2015

by Fluffdaddy
I know that people run on prem. But running a single node ESXi node isn’t going to be as useful to get basic concepts past what you could with a VMware workstation/fusion.

Using AWS or equivalent you can cheaply mess with some advanced concepts that are transferrable. To me knowing how to architect a redundant system is more of an abstract thing then mastering managing a single host.

evol262
Nov 30, 2010
#!/usr/bin/perl

Punkbob posted:

I know that people run on prem. But running a single node ESXi node isn’t going to be as useful to get basic concepts past what you could with a VMware workstation/fusion.

Using AWS or equivalent you can cheaply mess with some advanced concepts that are transferrable. To me knowing how to architect a redundant system is more of an abstract thing then mastering managing a single host.

I have no idea why you think you can't design redundant systems with a single host. Sure, you could do the same in workstation, but there's no real reason not to pretend to do the 'real thing'.

Nested virtualization is a real thing which lets you set up whatever labbing environments you want to test failures.

If you think the average AWS 'admin' has any idea how the redundancy in AWS actually works beyond 'scale my app out' and "don't keep all my critical stuff in the same AZ", I don't know what to tell you. I'd probably argue that in-house sysadmins (virtualization guys or not) have a much better idea of how to design redundant systems (storage, network, compute, etc) than the "AWS handles all that stuff for me!" crowd. Not to mention that what qualifies as 'redundant' differs between the two.

freeasinbeer
Mar 26, 2015

by Fluffdaddy
I’d argue that knowing the concepts behind virtualization is useful, but learning the nitty gritty of esxi is not useful. I would never hire someone who built a home lab to build out a VMware environment. Learning the nitty gritty of esxi is putting the cart before the horse. I’d be much more inclined to hire a sysadmin that got the concepts behind the workflows that it enables as well as having a strong background in being a server janitor. A home lab is a small bonus in an interview but it can also be a major turn off of a candidate if they don’t get “it”.

Internet Explorer
Jun 1, 2005





It shows passion and drive. Everything else can be taught.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Punkbob posted:

I’d argue that knowing the concepts behind virtualization is useful, but learning the nitty gritty of esxi is not useful. I would never hire someone who built a home lab to build out a VMware environment. Learning the nitty gritty of esxi is putting the cart before the horse. I’d be much more inclined to hire a sysadmin that got the concepts behind the workflows that it enables as well as having a strong background in being a server janitor. A home lab is a small bonus in an interview but it can also be a major turn off of a candidate if they don’t get “it”.

If someone is looking for their first real sysadmin job they’re much more likely to be put in front of VCenter than the AWS management console, and knowing your way around it will be of great benefit to that person’s rapid advancement on to other, more interesting things.

fordan
Mar 9, 2009

Clue: Zero

Punkbob posted:

I’d argue that knowing the concepts behind virtualization is useful, but learning the nitty gritty of esxi is not useful. I would never hire someone who built a home lab to build out a VMware environment. Learning the nitty gritty of esxi is putting the cart before the horse. I’d be much more inclined to hire a sysadmin that got the concepts behind the workflows that it enables as well as having a strong background in being a server janitor. A home lab is a small bonus in an interview but it can also be a major turn off of a candidate if they don’t get “it”.

I can't imagine a scenario where having a home lab (be it physical hardware at home or a setup in a cloud service) would be a negative for me as an interviewer since it demonstrates at least some drive to learn outside of work/school environments. Even if I disagree with the relevance of what they're doing with the lab the existence of it isn't a negative.

TheFace
Oct 4, 2004

Fuck anyone that doesn't wanna be this beautiful

adorai posted:

Seriously, there are still places that run everything on bare metal.

And there's still use cases to run certain things on bare metal, even in virt heavy environments.

evol262
Nov 30, 2010
#!/usr/bin/perl

Punkbob posted:

I’d argue that knowing the concepts behind virtualization is useful, but learning the nitty gritty of esxi is not useful. I would never hire someone who built a home lab to build out a VMware environment. Learning the nitty gritty of esxi is putting the cart before the horse. I’d be much more inclined to hire a sysadmin that got the concepts behind the workflows that it enables as well as having a strong background in being a server janitor. A home lab is a small bonus in an interview but it can also be a major turn off of a candidate if they don’t get “it”.

Great. Don't hire them. But AWS/GCE skills and architecture are only vaguely in the same domain as traditional, on-prem virt (self-hosted openstack is the only place I'd consider both). Believe it or not, lots of people still use on-premises.

Frankly, targeting application resiliency, region resiliency, and scale-out don't have much to do with virtualization in the classic sense, and labbing in ESXi teaches something totally different. The point is not "my lab in ESXi mirrors production issues", but "I've touched vcenter and I have a vague idea of how to set up vswitches, LUNs, etc". Other than building images, which is similar across both.

The concepts and workflows behind managing your own storage, network, and compute resources vs "gimme another SDN, some buckets/volumes, and here's some cash for a larger instance" aren't comparable.

AWS admins are better suited as ex-devops guys who can help structure the application for scale and failure. Not new/ex admins who know the underlying resources more than they understand the application.

Cheesus
Oct 17, 2002

Let us retract the foreskin of ignorance and apply the wirebrush of enlightenment.
Yam Slacker
VMware's Black Friday sales have started.

When Workstation 14 was announced, the NIC bandwidth control was one of the better features I'd seen in it for several releases, since I work on a networking product. Now in the post-Net Neutrality era, I bet it will come even more handy.

Mayne
Mar 22, 2008

To crooked eyes truth may wear a wry face.
This might be a better thread to ask in: what would be a good backup solution to daily back up VMs from my Win10 PC that I use as a Hyper-V host?

Mr Shiny Pants
Nov 12, 2012

Mayne posted:

This might be a better thread to ask in: what would be a good backup solution to daily back up VMs from my Win10 PC that I use as a Hyper-V host?

Are you willing to spend money? That will be a big factor in the options available to you.

There is a free edition of Veeam, don't know if it runs on Win10 non server versions.

bobfather
Sep 20, 2001

I will analyze your nervous system for beer money

Mr Shiny Pants posted:

Are you willing to spend money? That will be a big factor in the options available to you.

There is a free edition of Veeam, don't know if it runs on Win10 non server versions.

Veeam Endpoint does, I believe.

SlowBloke
Aug 14, 2017

bobfather posted:

Veeam Endpoint does, I believe.

Endpoint works for clients/physical servers not vm-hosts, https://hyperv.veeam.com/free-hyper-v-backup/ does hyper-v backup but features are limited(no scheduling for instance)

bobfather
Sep 20, 2001

I will analyze your nervous system for beer money

SlowBloke posted:

Endpoint works for clients/physical servers not vm-hosts, https://hyperv.veeam.com/free-hyper-v-backup/ does hyper-v backup but features are limited(no scheduling for instance)

I think he's just looking to backup his Hyper-V guests.

As a free solution Endpoint Backup would work fine for him. He'd just have to be willing to install it on all his Windows guests.

SlowBloke
Aug 14, 2017

bobfather posted:

I think he's just looking to backup his Hyper-V guests.

As a free solution Endpoint Backup would work fine for him. He'd just have to be willing to install it on all his Windows guests.

Nothing stops him from installing veeam backup free on the hyper-v hosts, if it's a homelab it's certainly less hassle than multiple veeam endpoint installs(I wouldn't do it on a prod enviroment).

bobfather
Sep 20, 2001

I will analyze your nervous system for beer money

SlowBloke posted:

Nothing stops him from installing veeam backup free on the hyper-v hosts, if it's a homelab it's certainly less hassle than multiple veeam endpoint installs(I wouldn't do it on a prod enviroment).

That's fair. I use ESXi free so Veeam Backup Free was never really an option for me.

That said, in a small environment Endpoint backup is literally set once and forget forever.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Mayne posted:

This might be a better thread to ask in: what would be a good backup solution to daily back up VMs from my Win10 PC that I use as a Hyper-V host?
Mount your storage as iSCSI from a ZFS host, take incremental filesystem snapshots

freeasinbeer
Mar 26, 2015

by Fluffdaddy

Vulture Culture posted:

Mount your storage as iSCSI from a ZFS host, take incremental filesystem snapshots

Then ship it off to s3 for cold storage.

Jaded Burnout
Jul 10, 2004


I'm looking for some virtualisation / containerisation advice.

I'm a developer and I regularly run low-traffic low-availability-need apps for a variety of business and personal reasons. I'll soon be building one or more physical servers for my home office and I'm looking for the simplest way to run my apps.

I've worked with docker, which is fine, but the orchestration is crummy.
I've worked with triton, which is fine, but it gives you a VM on which you still have to set up the environment (either via puppet/chef or manually).
I've briefly looked at k8s but its relationship with bare metal vs e.g. vmware/openstack is difficult for me to comprehend.

I won't be running this on a thousand hosts.
I don't want to spend a bunch on licences.
I can write puppet if I have to but I'd prefer not to, because it's a lot of work.
I'd like the flexibility to choose on-prem vs cloud hosting without dramatically changing the mechanism of packaging/deployment.

Something I've found is typical for when I do any research, there's always some fresh new way of doing this that's *just* around the corner, never actually available. Last round it was joyent's public cloud, this time it's AWS EKS.

Any ideas?

Erwin
Feb 17, 2006


Terraform has a Docker provider. One Terraform configuration can spin up infrastructure locally or on any remote docker host on any provider. If you need better availability, Terraform also has a Kubernetes provider.

edit: Alternatively you can use docker-compose and then use the same .yml file against AWS ECS.

Erwin fucked around with this message at 06:39 on Dec 7, 2017

Jaded Burnout
Jul 10, 2004


Erwin posted:

Terraform has a Docker provider. One Terraform configuration can spin up infrastructure locally or on any remote docker host on any provider.

I've used Terraform for some basic stuff against AWS and that's fine, I guess I can look into how well it handles docker stuff.

Erwin posted:

edit: Alternatively you can use docker-compose and then use the same .yml file against AWS ECS.

I've tried docker-compose at various times including sat face to face with the authors when it was still called fig and I still couldn't get it to orchestrate in the way I wanted, e.g. some nodes waiting for dependant resources to come online, but maybe that's a pipe dream and too heavily influenced by the way I was trying to do dev work at the time.

chutwig
May 28, 2001

BURLAP SATCHEL OF CRACKERJACKS

Does anyone have experience with doing nested virtualization in Linux guests in VMware Workstation?

I have a Xenial guest in Workstation 12 that I use for multi-VM Vagrant environments, using both VirtualBox and KVM through libvirt. The nested VMs are very unstable; if they have multiple cores allocated it's a 100% guarantee that processes in them will segfault constantly. With only one core allocated, stability improves but is still not great. I have various Ansible playbooks and build scripts for building these environments, and it sucks when they constantly fall over and explode.

By way of comparison, the same multi-VM environments are totally stable non-nested. I've tested on VirtualBox on a Mac and also with KVM on a regular Linux server and everything is fine there. I would like to set up another nested virtualization test using VMware Fusion on a Mac but haven't had time to do so yet. My main incentives for getting the nested virt working are because the desktop workstation I have is much more powerful than my MBP and has a lot more memory, so I can build much bigger and more elaborate test environments (and I don't want to tie up a $20k server for my virt experiments when I can get them all done on a much cheaper workstation). However, it has to run Windows, so I can't put Linux right on the machine.

Volguus
Mar 3, 2009

chutwig posted:

Does anyone have experience with doing nested virtualization in Linux guests in VMware Workstation?

I have a Xenial guest in Workstation 12 that I use for multi-VM Vagrant environments, using both VirtualBox and KVM through libvirt. The nested VMs are very unstable; if they have multiple cores allocated it's a 100% guarantee that processes in them will segfault constantly. With only one core allocated, stability improves but is still not great. I have various Ansible playbooks and build scripts for building these environments, and it sucks when they constantly fall over and explode.

By way of comparison, the same multi-VM environments are totally stable non-nested. I've tested on VirtualBox on a Mac and also with KVM on a regular Linux server and everything is fine there. I would like to set up another nested virtualization test using VMware Fusion on a Mac but haven't had time to do so yet. My main incentives for getting the nested virt working are because the desktop workstation I have is much more powerful than my MBP and has a lot more memory, so I can build much bigger and more elaborate test environments (and I don't want to tie up a $20k server for my virt experiments when I can get them all done on a much cheaper workstation). However, it has to run Windows, so I can't put Linux right on the machine.

The title of the thread was supposed to be a joke. Or so I thought.

DevNull
Apr 4, 2007

And sometimes is seen a strange spot in the sky
A human being that was given to fly

Volguus posted:

The title of the thread was supposed to be a joke. Or so I thought.

I work on the monitor team at VMware and we run several machines dedicated to nested testing. Mostly ESX in ESX, but we have a few WS in ESX as well. It is slower, but we expect the same correctness.

Volguus
Mar 3, 2009

DevNull posted:

I work on the monitor team at VMware and we run several machines dedicated to nested testing. Mostly ESX in ESX, but we have a few WS in ESX as well. It is slower, but we expect the same correctness.

You, I understand. You are supposed to test all kinds of wacky configurations your customers may have. It's the customers that I don't get :). But anyway, is VM in VM @ VMWare now supported? I tried it back in the early 2000s (2003 maybe?) when VMs were the new cool thing and VMWare workstation caught me trying to install it in an VMWare VM and basically refused to let me do it. Again, not that I would have had a need for it, but experimenting is fun.

bobfather
Sep 20, 2001

I will analyze your nervous system for beer money

Volguus posted:

You, I understand. You are supposed to test all kinds of wacky configurations your customers may have. It's the customers that I don't get :). But anyway, is VM in VM @ VMWare now supported? I tried it back in the early 2000s (2003 maybe?) when VMs were the new cool thing and VMWare workstation caught me trying to install it in an VMWare VM and basically refused to let me do it. Again, not that I would have had a need for it, but experimenting is fun.

Not only are nested VMs fine, but they’re a fine way to simulate weird network topographies for an amateur homelabber.

TheFace
Oct 4, 2004

Fuck anyone that doesn't wanna be this beautiful
Anyone have experience with vSAN & AppVolumes?

My new company is getting into using AppVolumes, which I've done before, but the majority of their storage is all vSAN based which means there isn't a (decent) storage device (or devices depending on how big we scale) for the AppVolume AppStacks outside of the vSAN datastore itself. I can't seem to find any good reference for using vSAN as the AppStack storage other than poo poo that says you can... I have the following concerns:

1) The AppStack vmdk's aren't associated with a VM so I can't assign a specific Storage Policy to them, does this mean the default storage policy applies (which in our case basically mirrors)? Or does no storage policy apply (meaning it puts it on which ever hosts services the request for uploading the file)?
2) If the vmdk only really resides on the local storage of one (or two, depending on question 1) host(s) all reads to the AppStack VMDK are going to hammer that single host instead of distribute across the cluster? This would be my biggest concern.
3) Would there be a way to configure AppVolumes, or vSAN to distribute the vmdk's evenly across the cluster so that the benefit of vSAN servicing (in most cases) the closest storage to the VM is maintained, ie VM1 has AppStack1 assigned to it, it reads the VMDK copy off the disk on the Host that VM1 is running off of?

I'm trying either resolve these (as I see them) issues, or if I can't I want to make the case that we'd need dedicated shared storage with decent Read performance.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

It’s going to use the default storage policy for the AppStack vmdks.

Since AppStacks are read only it should end up in the cache layer for VSAN on whatever host owns the frequently accessed apps and stay there. Writable volumes aren’t one to many, so those won’t create any single host traffic patterns.

If you really want to force a VMDK to stripe across multiple hosts you can crank up the stripes setting in your default VSAN policy to force each object to stripe across multiple magnetic drives. If you set it to a value larger than the number of magnetic drives in a single host it will force it only multiple hosts.

VSAN also distributes reads in a round robin fashion across replica copies based on the block offset, so if your ftt is set to two you’re getting at least two hosts active in servicing reads for that AppStack VMDK.

TheFace
Oct 4, 2004

Fuck anyone that doesn't wanna be this beautiful

YOLOsubmarine posted:

It’s going to use the default storage policy for the AppStack vmdks.

Since AppStacks are read only it should end up in the cache layer for VSAN on whatever host owns the frequently accessed apps and stay there. Writable volumes aren’t one to many, so those won’t create any single host traffic patterns.

If you really want to force a VMDK to stripe across multiple hosts you can crank up the stripes setting in your default VSAN policy to force each object to stripe across multiple magnetic drives. If you set it to a value larger than the number of magnetic drives in a single host it will force it only multiple hosts.

VSAN also distributes reads in a round robin fashion across replica copies based on the block offset, so if your ftt is set to two you’re getting at least two hosts active in servicing reads for that AppStack VMDK.

Perfect, that was what I was figuring but couldn't find any proof for some reason. Thanks so much for the info!

DevNull
Apr 4, 2007

And sometimes is seen a strange spot in the sky
A human being that was given to fly

Volguus posted:

You, I understand. You are supposed to test all kinds of wacky configurations your customers may have. It's the customers that I don't get :). But anyway, is VM in VM @ VMWare now supported? I tried it back in the early 2000s (2003 maybe?) when VMs were the new cool thing and VMWare workstation caught me trying to install it in an VMWare VM and basically refused to let me do it. Again, not that I would have had a need for it, but experimenting is fun.

I am pretty sure that it is supported. You can select the guest type as vmkernel from the UI. It is way better now that everything is running HV instead of binary translation. Not only is it for for experimenting, but it can also help test your deploy when moving to a new version. Lots of places deploy into VMs to make sure everything is compatible before rolling it out on their hardware.

BeastOfExmoor
Aug 19, 2003

I will be gone, but not forever.
I'm using an old desktop (AMD FX-8350) as my "server". My plan was to install Windows Server and run some VM's in Hyper-V, but Hyper-V apparently doesn't have some of the features I wanted (USB passthrough, etc.) so I installed VMWare workstation, which apparently has an issue with Windows Server 2016's Credential Guard feature. Before I go through the rigmarole of turning that off I figured I'd pop in here and see if there's some other path I should be taking? Should I be running another VM product on the bare metal and then VM's on top of that? I'd like to run a couple Windows VM's, a Linux VM, and perhaps an OSX VM if I can managed to get that going on an AMD processor.

Adbot
ADBOT LOVES YOU

Rexxed
May 1, 2010

Dis is amazing!
I gotta try dis!

BeastOfExmoor posted:

I'm using an old desktop (AMD FX-8350) as my "server". My plan was to install Windows Server and run some VM's in Hyper-V, but Hyper-V apparently doesn't have some of the features I wanted (USB passthrough, etc.) so I installed VMWare workstation, which apparently has an issue with Windows Server 2016's Credential Guard feature. Before I go through the rigmarole of turning that off I figured I'd pop in here and see if there's some other path I should be taking? Should I be running another VM product on the bare metal and then VM's on top of that? I'd like to run a couple Windows VM's, a Linux VM, and perhaps an OSX VM if I can managed to get that going on an AMD processor.

I've got an AMD FX 8300 running ESXi. The onboard network card drivers for the MSI motherboard I have it in weren't recognized so I could've added them to the iso through some method but I just put an intel nic in there. I haven't tried to virtualize macos on it but I've run freebsd, linux, Windows XP, 7, 8, and 10 without issue.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply