Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
wibble
May 20, 2001
Meep meep
Its not my money... :butt:

Adbot
ADBOT LOVES YOU

Saukkis
May 16, 2003

Unless I'm on the inside curve pointing straight at oncoming traffic the high beams stay on and I laugh at your puny protest flashes.
I am Most Important Man. Most Important Man in the World.
Why would you subject yourself to Oracle's licensing extortion if you don't absolutely have to. I didn't choose Oracle, but I was one of the people who had to design, purchase and build a new VMware cluster after Oracle sent their goons for a visit. I would have had better things to do.

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug

wibble posted:

Its not my money... :butt:

Why not VMWare then, or gently caress even Xenserver would be better than Oracle licensing nightmares. (Oracle Virtualization Server is basically just Xenserver with an Oracle GUI wrapped over it anyways)

Zorak of Michigan
Jun 10, 2006

God save us all but OVM can actually solve licensing problems with Oracle RDBMS. It's one of the few on-prem solutions for which they allow sub-capacity licensing. I've pondered it but concluded that the extra time and energy spent dealing with it would exceed the the cost of just eating full capacity licensing.

Maneki Neko
Oct 27, 2000

Zorak of Michigan posted:

God save us all but OVM can actually solve licensing problems with Oracle RDBMS. It's one of the few on-prem solutions for which they allow sub-capacity licensing. I've pondered it but concluded that the extra time and energy spent dealing with it would exceed the the cost of just eating full capacity licensing.

You can also hire a firm to fight the oracle people in some kind of cage match situation which might also balance out $$$ wise, but yeah "this is the result of a licensing audit" is the only reason I've ever seen anyone using OVM.

wibble
May 20, 2001
Meep meep

Zorak of Michigan posted:

God save us all but OVM can actually solve licensing problems with Oracle RDBMS. It's one of the few on-prem solutions for which they allow sub-capacity licensing. I've pondered it but concluded that the extra time and energy spent dealing with it would exceed the the cost of just eating full capacity licensing.

Yeah its to run Oracle software so we can avoid their messing around with licensing.

ghostinmyshell
Sep 17, 2004



I am very particular about biscuits, I'll have you know.

wibble posted:

Has anyone got experiance of Oracle Linux Virtualization Manager? :(
Is it any good? Any issues? :tinfoil:

We migrated from the XEN to KVM version last year and it's been a night and day improvement. It's currently running only our oracle apps and dbs.


Good:
Nicer interface and when you click things they are responsive.
Easier to troubleshoot issues with the availability of KVM articles.
Our Oracle admins are much healthier not having to worry about XEN related poo poo.

Bad:
You still have to deal with oracle licensing as you may have to pin servers to particular cores, and of course doesn't save you if a DBA uses a function you aren't licensed for.
A lot of our tools we use to monitor to VMWare and other virtualization setups don't work with it of course.
We had to start literally over with our OL servers though as none of our migration methods would keep thin provisioning working and we couldn't deal with 300GB OS disks. At least this helped me understand how cobol licensing worked :smith:

ghostinmyshell fucked around with this message at 22:25 on Jun 27, 2022

jaegerx
Sep 10, 2012

Maybe this post will get me on your ignore list!


I have ibm mugs I accidentally took home with me if you’d like to buy to get your oracle payments down.

TheShazbot
Feb 20, 2011

So, if I was on the path to specialize as a virtualization/storage engineer with VMWare, I should move away from that since the Broadcom purchase?

Also, I've got a three-node PowerEdge R320 cluster right now that I'm wondering whether it's worth it to upgrade CPU/RAM for better performance (I'm mostly doing cluster-based homelab stuff, so three identical nodes is what I'd like to keep) or, should I save and upgrade to DDR4-based systems? I haven't been following whether or not pricing for v3/v4 machines is coming down quickly or whether or not the supply chain is still an issue.

I've done some of my own research already and I'm still on the fence whether I want to spend several hundred dollars on servers that are still using DDR3.

Pile Of Garbage
May 28, 2007



TheShazbot posted:

So, if I was on the path to specialize as a virtualization/storage engineer with VMWare, I should move away from that since the Broadcom purchase?

VMware has >75% market share for on-premises virtualisation and I doubt that even Broadcom can gently caress that up. Technology and feature-wise VMware remains the gold-standard and are the most unobjectionable choice. They've also got VMC (VMware Cloud, basically VMware-as-a-Service running on AWS) which seems somewhat popular as it makes setting up a "DR site" easier.

So yeah, there's no reason why you shouldn't still specialise in VMware. However I would recommend that you also specialise in AWS and Azure virtualisation as "lift-and-shift" VMware engagements are increasingly common.

TheShazbot posted:

Also, I've got a three-node PowerEdge R320 cluster right now that I'm wondering whether it's worth it to upgrade CPU/RAM for better performance (I'm mostly doing cluster-based homelab stuff, so three identical nodes is what I'd like to keep) or, should I save and upgrade to DDR4-based systems? I haven't been following whether or not pricing for v3/v4 machines is coming down quickly or whether or not the supply chain is still an issue.

I've done some of my own research already and I'm still on the fence whether I want to spend several hundred dollars on servers that are still using DDR3.

IMO running three physical servers for a homelab is overkill. You'd be better off with one physical box and just do nested-virtualisation.

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

The world will always need VMware admins in the same way the world will always need mainframe admins. Whether that’s how you want to spend your career is up to you.

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

skipdogg posted:

I see no lies in what this guy wrote. Apologies for the linkedin article but that’s where he posted it.


https://www.linkedin.com/pulse/brian-maddens-brutal-unfiltered-thoughts-broadcom-vmware-brian-madden

Reposting this for a good read on vmware’s current and future market position.

Mr. Crow
May 22, 2008

Snap City mayor for life

in a well actually posted:

The world will always need VMware admins in the same way the world will always need mainframe admins. Whether that’s how you want to spend your career is up to you.

That's a dumb take and there are still and will always be a lot of use cases for staying on-prem

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug
Yeah deapite the rhetoric on prem isnt anywhere near going away (much like mainframes havent gone away either)

Even the largest companies in the cloud only have ~20% of their workload in the cloud, the rest us in prem

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

Mr. Crow posted:

That's a dumb take and there are still and will always be a lot of use cases for staying on-prem

There may be lots of use cases for staying on prem, but fewer that require VMware. Grudgingly maintained reliance on enterprise tech from a vendor focused on extraction-maximising subscription revenue while planning on reducing headcount in development and support is a common pattern, and not one I’d be excited about building my career around. It’s not going anywhere; I’m sure people make good money running Oracle, too.

Mr. Crow
May 22, 2008

Snap City mayor for life

in a well actually posted:

Grudgingly maintained reliance on enterprise tech from a vendor focused on extraction-maximising subscription revenue while planning on reducing headcount in development and support is a common pattern,

Exactly, literally every business that dominates a market does this, vmware isn't unique, NVidia is doing it, Intel tried to do it, loving video games are doing it, Google is doing it, the list is endless. This is just bog standard capitalism hell world complaining.

I dont have any love for VMware but they're the market leader and will stay the market leader barring unforeseen circumstances, if thats what you find fun go hog wild, comparisons to mainframes and Oracle are pretty disingenuous.

Pile Of Garbage
May 28, 2007



in a well actually posted:

There may be lots of use cases for staying on prem, but fewer that require VMware. Grudgingly maintained reliance on enterprise tech from a vendor focused on extraction-maximising subscription revenue while planning on reducing headcount in development and support is a common pattern, and not one I’d be excited about building my career around. It’s not going anywhere; I’m sure people make good money running Oracle, too.

drat this is a dogshit post. No one stays on-prem to meet use cases they do it to meet requirements. VMware is never required for any solution, rather it is chosen because you'd be laughed out of the room to choose anything else. Also I think you're confusing becoming familiar with a technology/product to further ones career with actively endorsing the technology/product.

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

I mean, you could read that blog post; you could read Broadcom’s investor PR about increasing revenue and reducing costs, or you could look at the trajectory of enterprise platforms (enterprise- not dominant tech companies; NVIDIA isn’t selling P100s and charging a subscription for cuda.)

Their core products are stagnant in tech and in revenue. They may be dominant now, but IBM was dominant in the 80s and Oracle in the 00s.
No CIO wants to pay Oracle or IBM or SAP, but they do, and they’ll pay Broadcom.

It’s not going away, but I wouldn’t advise a generalist to investing in developing skills in it, because I personally think things that look like cost centers or have ongoing maintenance that aren’t tied to revenue are less valued by leadership and less compensated, particularly when there’s a fountain of cash for highly transferrable skills in other areas.

Mr. Crow
May 22, 2008

Snap City mayor for life

in a well actually posted:

NVIDIA isn’t selling P100s and charging a subscription for cuda.)

They literally do I deal with enterprise nvidia bullshit as part of my job

https://www.nvidia.com/en-us/data-center/data-center-gpus/





Also doom and gloom about how broadcom will ruin them but tbh there isn't much to ruin, VMware hasn't been innovative in over a decade and it blew my mind reading that article that they had 40k employees. That doesn't change the fact there isn't a large market that they will hold for the foreseeable future, unless you think xenserver or proxmox are gonna take over (lol)

Methanar
Sep 26, 2013

by the sex ghost
I'm actively participating in a 2 year long effort to move workloads out of aws and into on-prem rawdogging bare metal no vm ama

TheShazbot
Feb 20, 2011

You're absolutely correct that I should also learn AWS/Azure (I've got a small amount of experience, but I wouldn't say that I'd be anything above a junior-level at best - still a lot of "what does this do")

Pile Of Garbage posted:

IMO running three physical servers for a homelab is overkill. You'd be better off with one physical box and just do nested-virtualisation.

I wasn't aware that I could use vSAN with nested hypervisors.

I would normally agree that three physical servers is overkill, but the purpose of this is to somewhat mirror the type of environments I work with daily. (yes, it's small, I know)

in a well actually posted:

There may be lots of use cases for staying on prem, but fewer that require VMware. Grudgingly maintained reliance on enterprise tech from a vendor focused on extraction-maximising subscription revenue while planning on reducing headcount in development and support is a common pattern, and not one I’d be excited about building my career around. It’s not going anywhere; I’m sure people make good money running Oracle, too.

I'm definitely not super excited about the direction we all expect Broadcom to take the product, but in the short-term - it's not a bad career move (in my opinion) with where I'm at, which is a mid-range generalist sysadmin firefighter while I continue to learn other things and get my confidence up with knowing how to use containers correctly, automation and orchestration.

Methanar
Sep 26, 2013

by the sex ghost

TheShazbot posted:

I would normally agree that three physical servers is overkill, but the purpose of this is to somewhat mirror the type of environments I work with daily. (yes, it's small, I know)

Don't personally pay for your own hardware to simulate a work environment.

Your job should have a dev environment for simulating your prod environments.

TheShazbot
Feb 20, 2011

Methanar posted:

Don't personally pay for your own hardware to simulate a work environment.

Your job should have a dev environment for simulating your prod environments.

Everywhere I've historically worked has not.

I had this before I started at this job anyway, it just happens to be useful now.

Shumagorath
Jun 6, 2001
Hoping this is the right place:

Is there a type-1 hypervisor I can deploy on a desktop and have it boot a specific VM / image automatically unless I hit some magic keys to get a console and deploy a new image / snapshot? I have a particularly troublesome client for whom steady-state software like Deep Freeze doesn't work due to some quirk of how Windows handles their device drivers, but I've managed to get it to play nice with VM pass-through. Now all I need is non-persistence and no way for them to gently caress with the host OS. Ideally I'd have them save their work to external and make the guest VM revert to snapshot on every boot.

I found a couple reddit threads about this but the info was either old, thin or inconsistent.

1000101
May 14, 2003

BIRTHDAY BIRTHDAY BIRTHDAY BIRTHDAY BIRTHDAY BIRTHDAY FRUITCAKE!

Zorak of Michigan posted:

God save us all but OVM can actually solve licensing problems with Oracle RDBMS. It's one of the few on-prem solutions for which they allow sub-capacity licensing. I've pondered it but concluded that the extra time and energy spent dealing with it would exceed the the cost of just eating full capacity licensing.

just build a separate vsphere/whatever hypervisor cluster off to the side and license those sockets. You don't need a separate vcenter or air gap despite what sales says and if you push back they'll eventually cave.

Also they only license for allocated capacity in cloud providers too so that's an option as well.

Mr Shiny Pants
Nov 12, 2012

Shumagorath posted:

Hoping this is the right place:

Is there a type-1 hypervisor I can deploy on a desktop and have it boot a specific VM / image automatically unless I hit some magic keys to get a console and deploy a new image / snapshot? I have a particularly troublesome client for whom steady-state software like Deep Freeze doesn't work due to some quirk of how Windows handles their device drivers, but I've managed to get it to play nice with VM pass-through. Now all I need is non-persistence and no way for them to gently caress with the host OS. Ideally I'd have them save their work to external and make the guest VM revert to snapshot on every boot.

I found a couple reddit threads about this but the info was either old, thin or inconsistent.

Hacky, but should be doable: Use KVM and passthrough the videocard and some usb controllers?
Use something like ZFS to rollback the filesystem back to its original state whenever you start the VM. KVMs Qcow2 format probably has something as well.

Set the VM to boot on OS host boot and it should work. A shell script should not be that difficult to build that checks for something before booting the VM. Otherwise you can always use SSH.

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb
I wanted to play around with Proxmox before setting it up on a new machine, but I'm having some trouble with the networking configuration.

On my Windows machine I created a VirtualBox VM as my playground for it, with a Bridged Adapter:


Networking Config in Proxmox was then:


That seems to work fine. Proxmox itself is able to get to the internet, and can ping my other devices on the network:


Then I created a Debian VM in Proxmox with the following network device:


Setup networking as follows in the Debian VM (I'm using a desktop environment here since I plan to run a GUI based app on it, accessed through VNC):


However, this Debian VM isn't able to ping anything on the network, and can't get to the internet. Furthermore, my ability to use the Proxmox web interface seems to randomly cut out, and it will suddenly come back as soon as I ping 192.168.69.13 from my Windows machine...what's going on here?!

Shumagorath
Jun 6, 2001

Mr Shiny Pants posted:

Hacky, but should be doable: Use KVM and passthrough the videocard and some usb controllers?
Use something like ZFS to rollback the filesystem back to its original state whenever you start the VM. KVMs Qcow2 format probably has something as well.

Set the VM to boot on OS host boot and it should work. A shell script should not be that difficult to build that checks for something before booting the VM. Otherwise you can always use SSH.
This is sort of what I started putting together minus the ZFS part (though I was gravitating toward Xen for some reason). Thanks for the tips; will report back if I get this off the ground.

Perplx
Jun 26, 2004


Best viewed on Orgasma Plasma
Lipstick Apathy

Shumagorath posted:

Hoping this is the right place:

Is there a type-1 hypervisor I can deploy on a desktop and have it boot a specific VM / image automatically unless I hit some magic keys to get a console and deploy a new image / snapshot? I have a particularly troublesome client for whom steady-state software like Deep Freeze doesn't work due to some quirk of how Windows handles their device drivers, but I've managed to get it to play nice with VM pass-through. Now all I need is non-persistence and no way for them to gently caress with the host OS. Ideally I'd have them save their work to external and make the guest VM revert to snapshot on every boot.

I found a couple reddit threads about this but the info was either old, thin or inconsistent.

You could also use bare metal and boot off iscsi and script it so it’s always a fresh snapshot on boot.

Shumagorath
Jun 6, 2001

Perplx posted:

You could also use bare metal and boot off iscsi and script it so it’s always a fresh snapshot on boot.
I need this to work on the road :suicide:

Zorak of Michigan
Jun 10, 2006

Shumagorath posted:

I need this to work on the road :suicide:

iSCSI is routable!

BlankSystemDaemon
Mar 13, 2009



Shumagorath posted:

I need this to work on the road :suicide:
UEFI HTTPS Boot is, in theory, a thing.

Whether vendors implement it is anyone's guess, but it's part of the spec.

H2SO4
Sep 11, 2001

put your money in a log cabin


Buglord

fletcher posted:

However, this Debian VM isn't able to ping anything on the network, and can't get to the internet. Furthermore, my ability to use the Proxmox web interface seems to randomly cut out, and it will suddenly come back as soon as I ping 192.168.69.13 from my Windows machine...what's going on here?!

Did you edit the subnet mask after the last picture? I can imagine things starting to act wonky with an all zeroes subnet mask.

Edit: Let's take a step back and clarify exactly what you want to happen here. Do you want the VM to behave as if it's a regular machine plugged into your network, do you want it to use NAT and have the Proxmox box act as its gateway, or do you want a new isolated subnet for that VM to live on? i.e. is the rest of your network 192.168.69.0 as well?

H2SO4 fucked around with this message at 18:03 on Jul 31, 2022

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

H2SO4 posted:

Did you edit the subnet mask after the last picture? I can imagine things starting to act wonky with an all zeroes subnet mask.

Edit: Let's take a step back and clarify exactly what you want to happen here. Do you want the VM to behave as if it's a regular machine plugged into your network, do you want it to use NAT and have the Proxmox box act as its gateway, or do you want a new isolated subnet for that VM to live on? i.e. is the rest of your network 192.168.69.0 as well?

Thanks for taking a look! My goal is for the VM to behave exactly as if it's a regular machine plugged into my network. The rest of my network is on the 192.168.69.0 subnet

Mr Shiny Pants
Nov 12, 2012

fletcher posted:

Thanks for taking a look! My goal is for the VM to behave exactly as if it's a regular machine plugged into my network. The rest of my network is on the 192.168.69.0 subnet

Try this:

echo 0 > /proc/sys/net/bridge/bridge-nf-call-iptables
echo 0 > /proc/sys/net/bridge/bridge-nf-call-arptables

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

Mr Shiny Pants posted:

Try this:

echo 0 > /proc/sys/net/bridge/bridge-nf-call-iptables
echo 0 > /proc/sys/net/bridge/bridge-nf-call-arptables

Looks like these already had a value of 0 in both files

I got the rest of my parts so I'll give it a go with some real hardware now and see how it goes

Saukkis
May 16, 2003

Unless I'm on the inside curve pointing straight at oncoming traffic the high beams stay on and I laugh at your puny protest flashes.
I am Most Important Man. Most Important Man in the World.
One thing that looked suspect to me was the CIDR for vmbr0 in the second picture. I'm not familiar with Proxmox, but I would have assumed it should be 192.168.69.13/24.

It may be useful if you post the output from 'ip address' and 'ip route show'.

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

Saukkis posted:

One thing that looked suspect to me was the CIDR for vmbr0 in the second picture. I'm not familiar with Proxmox, but I would have assumed it should be 192.168.69.13/24.

It may be useful if you post the output from 'ip address' and 'ip route show'.

I ended up getting everything working when I tried it with real hardware rather than proxmox inside virtualbox. I'm pretty sure the subnet was where I was going wrong with the VirtualBox attempt.

Here's what I ended up for the proxmox host network config:


Then provisioned my Debian VM as follows:


Left the Debian config as DHCP and then assigned it a static IP address from my router (Unifi)

Everything is working great! SPICE is really cool, I had never heard of it before last week. I was running into an issue setting up VNC and came across NoMachine and SPICE while I was poking around. Proxmox had built in support for SPICE so I went with that. Auto-resize of guest display, support for audio, etc. Unfortunately it doesn't seem that shared folders is supported using virt-viewer for Wnidows when connecting to a Linux guest, not a big deal though. The performance seems great so far and I don't notice any difference between Proxmox+SPICE and VirtualBox as of yet.

fletcher fucked around with this message at 22:08 on Aug 6, 2022

Mr Shiny Pants
Nov 12, 2012

fletcher posted:

I ended up getting everything working when I tried it with real hardware rather than proxmox inside virtualbox. I'm pretty sure the subnet was where I was going wrong with the VirtualBox attempt.

Here's what I ended up for the proxmox host network config:


Then provisioned my Debian VM as follows:


Left the Debian config as DHCP and then assigned it a static IP address from my router (Unifi)

Everything is working great! SPICE is really cool, I had never heard of it before last week. I was running into an issue setting up VNC and came across NoMachine and SPICE while I was poking around. Proxmox had built in support for SPICE so I went with that. Auto-resize of guest display, support for audio, etc. Unfortunately it doesn't seem that shared folders is supported using virt-viewer for Wnidows when connecting to a Linux guest, not a big deal though. The performance seems great so far and I don't notice any difference between Proxmox+SPICE and VirtualBox as of yet.

Spice works funky when using some BSD variants (repeating keys and the like). Just a heads up. Switch it to VNC and it works fine.

Adbot
ADBOT LOVES YOU

Subjunctive
Sep 12, 2006

✨sparkle and shine✨

I’ve got a small Ubuntu home server running Home Assistant and a Unifi Controller under a creaky qemu/kvm setup, plus some other under-maintained services. I also have a Steam Deck which is shockingly compatible with the things I’ve been playing. I have virtualization questions about both arenas!

For the home server, I think I’d like to get rid of the mini tower and move to a NUCish form factor, and beef it up so I can play with some more modern homelab/clustering things. My light reading has led me to a Simply NUC Ruby r8 on which I will stick proxmox and then figure out how I want containers and VMs to interplay. And then stub my face on k3s, probably. Is this a sane path to pursue?

For gaming, the time for my Zen 4/Lovelace upgrade is coming and I’m seriously thinking of giving Linux gaming a shot for the first time since “Civ: Call to Power”. If it doesn’t work out for everything, I will probably want to do GPU+USB passthrough to Windows 11 or similar. Can I plausibly do that with a single NVIDIA GPU? I’ve heard tell, but I don’t know how reliable it is.

What’s the state of the art for doing things like clipboard in/out of VMs? I’ve only used the VMware stuff for that, and I’d rather not entangle myself with their stack if I can avoid it.

Thanks for any guidance you can provide!

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply