Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Hadlock
Nov 9, 2004

The Iron Rose posted:

How do yall handle caching authentication tokens between multiple pods/processes/etc? Current practice is to just toss a 5min TTL JWT into the cluster local redis so the authentication service doesn’t get swamped with requests.

I'd probably renegotiate your auth system with your vendor or fix the rate limit

You can store the token as a Kubernetes secret, then use reflector to push the "secret" across the cluster, and reloader to verify the pod gets reloaded when the secret changes? I dunno how fast or scalable that is compared to redis, but that gives you a pure Kubernetes solution, at least in theory

Edit: at 30k pods you're probably going to bring etcd to it's knees, making your cluster really grim performance wise, don't do this

This is a great interview question

Hadlock fucked around with this message at 22:19 on Apr 23, 2024

Adbot
ADBOT LOVES YOU

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


Didn't IBMs buyout of Red Hat not work out that well? Maybe people will go back to using Azure Bicep :haw:

madmatt112
Jul 11, 2016

Is that a cat in your pants, or are you just a lonely excuse for an adult?

Does anyone have a link/resource about why Broadcom is such a widely vilified company? The only thing I know them for is like mobile chips or the like. Did they do something specific with a software company that I’m not aware of?

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

madmatt112 posted:

Does anyone have a link/resource about why Broadcom is such a widely vilified company? The only thing I know them for is like mobile chips or the like. Did they do something specific with a software company that I’m not aware of?
They basically treat their acquisitions the same as a private equity firm, vulture capitalism

https://www.crn.com/news/virtualization/2024/broadcom-tells-partner-negotiating-for-charity-vmware-is-not-for-everybody

Docjowles
Apr 9, 2009

Yeah the MO seems to be acquiring companies that have become indispensable to operations and then jacking up the prices to an insane degree because they know they have customers over a barrel. Which on the one hand, :capitalism: but on the other hand sure does piss everyone off.

Hadlock
Nov 9, 2004

They have a history of not providing open source drivers for their hardware, particularly the binary blob needed to boot the raspberry pi* (which boots via it's GPU for some reason) broadcom was always a real dick about their Linux driver support. I remember spending countless nights working with USB sticks to get Linux laptops online because distros couldn't/wouldn't include broadcom drivers

*This may have finally changed, haven't checked in a while

madmatt112
Jul 11, 2016

Is that a cat in your pants, or are you just a lonely excuse for an adult?

Vulture Culture posted:

They basically treat their acquisitions the same as a private equity firm, vulture capitalism

https://www.crn.com/news/virtualization/2024/broadcom-tells-partner-negotiating-for-charity-vmware-is-not-for-everybody

That is some evil bullshit, yikes.

Hadlock
Nov 9, 2004

Developers want better visibility into their build and deploy process (of course, for good reason) most of this happens either in GitHub actions, or ArgoCD

I've identified, I think, 13 distinct build and deploy tasks across the front and back end for our monolith, touching a bunch of services across multiple vendors (GitHub, AWS, cloudflare, code analysis tools etc)

How do you add visibility into this at your place, what kind of pattern

I'm thinking of two slack channels, one "short" channel with the high level green or red light for the overall deploy, so maximum two kinds of alerts, and a "verbose" channel that includes all 13 slack messages, that have a link to the query in the logging where the problem can be better inspected

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Hadlock posted:

Developers want better visibility into their build and deploy process (of course, for good reason) most of this happens either in GitHub actions, or ArgoCD

I've identified, I think, 13 distinct build and deploy tasks across the front and back end for our monolith, touching a bunch of services across multiple vendors (GitHub, AWS, cloudflare, code analysis tools etc)

How do you add visibility into this at your place, what kind of pattern

I'm thinking of two slack channels, one "short" channel with the high level green or red light for the overall deploy, so maximum two kinds of alerts, and a "verbose" channel that includes all 13 slack messages, that have a link to the query in the logging where the problem can be better inspected
Treat each task as a span in a distributed trace and use your existing distributed tracing practice to monitor your deployment health

This is more or less how Datadog's CI/CD monitoring product handles it, anyway, just with a pretty bow on it

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.
And it's official

https://www.hashicorp.com/blog/hashicorp-joins-ibm

Collateral Damage
Jun 13, 2009

We did some napkin math and our vmware licensing cost is likely going to at least triple (likely more) next year when it's time to renew, so now we're scrambling to find an alternative. We're using NSX so if we want to keep that we're stuck with the expensive licensing options.

poo poo sucks. I was hoping to do some interesting stuff this year, not spend it rebuilding what we already have just because some useless fuckwits want their third solid gold yacht.

Docjowles
Apr 9, 2009

A cool 6.4 billion god drat :homebrew: Speaking of gold yachts

kaaj
Jun 23, 2013

don't stop, carry on.

Collateral Damage posted:

We did some napkin math and our vmware licensing cost is likely going to at least triple (likely more) next year when it's time to renew, so now we're scrambling to find an alternative.

Same at my place. Seven digit renewal costs scared few people so a bunch of teams were scrambling to get a good alternative (easy) in time before renewal (hard)

Gucci Loafers
May 20, 2006

Ask yourself, do you really want to talk to pair of really nice gaudy shoes?


Vulture Culture posted:

They basically treat their acquisitions the same as a private equity firm, vulture capitalism

https://www.crn.com/news/virtualization/2024/broadcom-tells-partner-negotiating-for-charity-vmware-is-not-for-everybody

madmatt112 posted:

That is some evil bullshit, yikes.

From the interview with the Scale CEO Jeff Ready,

quote:

The strategy is working, though, right? Broadcom is doing better than it ever has been.

The strategy does work from a financial standpoint. The company’s strategy. But they are not technologists. The reason I got into tech was not to seek profit harvesting. It was so you could create something. You could solve problems. And you could solve problems for other people and 100 percent, that is what VMware started out as.

quote:

What are they missing? What is the big picture that Broadcom is not seeing?

It depends on your long-term strategy. This profit harvesting thing. This is something you apply to mature businesses. Which means they’re not innovating for the future. They’re not trying to see what they can do with the technology. They think virtualization is in a sunset phase. They’re going to milk it.

Docjowles
Apr 9, 2009

Apropos of nothing, I saw Ray Ozzie mentioned in an article tonight and it reminded me that I used to be best friends with his kid when I was like kindergarten age. Really wish my parents had kept up that relationship! "CTO of Microsoft", "creator of Lotus Notes", and "board of directors for HP" would have been useful as a job reference here and there

Cyril Sneer
Aug 8, 2004

Life would be simple in the forest except for Cyril Sneer. And his life would be simple except for The Raccoons.
Hiya, I'm setting up a little vanity web server on my own hardware (a lower-end mini PC). Separately from this I have my development machine. I'm trying to put together my own little cutesy ci/cd workflow but need some (a lot) of guidance. I'm comfortable with git but not much beyond that.

(1) One approach would be to simply install Python (using FastAPI + uvicorn here), git, and just run the code.

- This basically gets me all the way there, but I'd still be manually using git to pull any changes -- automating this would be nice!
- Keeping the two Python environments the same could require some manual tinkering.

(2) Install Docker and run it as a docker image..

- This is interesting in that I don't have to install anything (other than Docker)
- The deployment process is even more vague to me. If I build the image on my dev machine, how do I get it onto the server?
- Part of the site uses a local database -- would this have to be in the image, or can it stay outside (i.e., can code running inside access outside, local files)?
- Performance. I'm a bit concerned how this might run on my low-spec hardware.

I'm on a bit of a learning journey here. Hope this isn't too simplistic a question!

Collateral Damage
Jun 13, 2009

At least OpenTofu is a drop-in replacement. Probably going to make that my task next week.

The license change last year was so transparently a step towards selling the company.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Cyril Sneer posted:

Hiya, I'm setting up a little vanity web server on my own hardware (a lower-end mini PC). Separately from this I have my development machine. I'm trying to put together my own little cutesy ci/cd workflow but need some (a lot) of guidance. I'm comfortable with git but not much beyond that.

(1) One approach would be to simply install Python (using FastAPI + uvicorn here), git, and just run the code.

- This basically gets me all the way there, but I'd still be manually using git to pull any changes -- automating this would be nice!
- Keeping the two Python environments the same could require some manual tinkering.

(2) Install Docker and run it as a docker image..

- This is interesting in that I don't have to install anything (other than Docker)
- The deployment process is even more vague to me. If I build the image on my dev machine, how do I get it onto the server?
- Part of the site uses a local database -- would this have to be in the image, or can it stay outside (i.e., can code running inside access outside, local files)?
- Performance. I'm a bit concerned how this might run on my low-spec hardware.

I'm on a bit of a learning journey here. Hope this isn't too simplistic a question!
Welcome to a cool journey!

Generally, you have somewhere to host your artifacts. This might be something like Docker Hub, GitHub, or GitLab's container registries. You build somewhere, you push to a central location. Then you have your deployment target initiate an image pull from that repository and launch the container. You can use something like Ansible to initiate that image pull and container creation over an SSH connection without needing to install any agents or other dependencies on the server.

You can run a database service in a container too, but you generally don't want this to be in the same container as your app. You want one container for each service, one container for your database, and you want to network them together. (It will be fast, like connecting to localhost over TCP, because in a single-host configuration your traffic will never leave the host.) And make sure you mount a data volume into your DB container, otherwise you'll be deleting all your data every time you restart the database!

Performance hit from Docker should be really negligible, if your host is already running Linux. If you're running Docker Desktop under Windows or macOS on the mini PC you're using as a deployment target, things get a lot more complicated for you.

Cyril Sneer
Aug 8, 2004

Life would be simple in the forest except for Cyril Sneer. And his life would be simple except for The Raccoons.

Vulture Culture posted:

Welcome to a cool journey!

Generally, you have somewhere to host your artifacts. This might be something like Docker Hub, GitHub, or GitLab's container registries. You build somewhere, you push to a central location. Then you have your deployment target initiate an image pull from that repository and launch the container. You can use something like Ansible to initiate that image pull and container creation over an SSH connection without needing to install any agents or other dependencies on the server.

I'm comfortable with git, so I'm currently using github with a client-side GUI (Fork) for doing this. Also I've used github actions at work before, but I wasn't involved in setting those up so not sure if that functionality would help here?

Will definitely look into Ansible.

Vulture Culture posted:

You can run a database service in a container too, but you generally don't want this to be in the same container as your app. You want one container for each service, one container for your database, and you want to network them together. (It will be fast, like connecting to localhost over TCP, because in a single-host configuration your traffic will never leave the host.) And make sure you mount a data volume into your DB container, otherwise you'll be deleting all your data every time you restart the database!

Okay, that's helpful. I think for now I'll just see what I can do with accessing the (external) db from within the container, without the network aspect. Its a read-only affair anyway.

Vulture Culture posted:

Performance hit from Docker should be really negligible, if your host is already running Linux. If you're running Docker Desktop under Windows or macOS on the mini PC you're using as a deployment target, things get a lot more complicated for you.

Hah, I'm running Windows at the moment though I'm planning to switch to Linux eventually.

Tom Collins
Aug 25, 2000


this ruined my day, no lie. used to go to Hashiconf every year, good times. IBM is still a soulless monstrosity where interesting things go to die, IMO.
witness just how dead CentOS is now; it doesn't matter to me any more how well the distros that are trying to take its place do, I'm never going back to that entire ecosystem unless someone literally forces me

The Fool
Oct 16, 2003


our terraform enterprise license agreement is up next year and management is freaking out about how ibm might make changes

unrelated, how is spacelift?

Hadlock
Nov 9, 2004

The Fool posted:

how ibm might make changes

"Might"

They need to make $6 billion in something like ~3 years in fees to not call it a loss

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

The Fool posted:

our terraform enterprise license agreement is up next year and management is freaking out about how ibm might make changes

unrelated, how is spacelift?
The product seems solid but the UX on it feels wobbly as gently caress in the same way as, like, ArgoCD. Definitely not as polished as TFC but it will get the job done

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Hadlock posted:

"Might"

They need to make $6 billion in something like ~3 years in fees to not call it a loss
I was trying to buy HPC software from Platform Computing when IBM acquired them. IIRC, despite being a life sciences nonprofit and having Janis Landry-Lane, actual head of IBM life sciences, on our account, the quote added an entire 0

Adbot
ADBOT LOVES YOU

vanity slug
Jul 20, 2010

Vulture Culture posted:

The product seems solid but the UX on it feels wobbly as gently caress in the same way as, like, ArgoCD. Definitely not as polished as TFC but it will get the job done

i feel the opposite tbh, spacelift's ux is way more refined than tfc

the pricing and support is good too

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply