Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
FlapYoJacks
Feb 12, 2009
If you want a stable ABI you use RHEL.

Adbot
ADBOT LOVES YOU

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?
RHEL guarantees a stable kernel ABI for drivers?

Progressive JPEG
Feb 19, 2003

what's a driver?

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?
a miserable pile of I/Os

pseudorandom name
May 6, 2007

an opportunity for incompetency on a grand scale

RocketLunatic
May 6, 2005
i love lamp.
The nice thing about Linux is that the person installing the OS is always doing it wrong.

FlapYoJacks
Feb 12, 2009

eschaton posted:

RHEL guarantees a stable kernel ABI for drivers?

The kernel version is locked and only security patches and backported iirc.

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?

pseudorandom name posted:

an opportunity for incompetency on a grand scale

I thought k8s was the solution to scaling Linux (along with an orchestration system atop it)

after all, why just use VM, JCL, and the like when you can reinvent it?

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?

FlapYoJacks posted:

The kernel version is locked and only security patches and backported iirc.

does RHEL guarantee this, or a particular version of RHEL?

if Linux were a grownup operating system, a driver built for some architecture running RHEL 6 would continue to work without even a recompile on RHEL 8

FlapYoJacks
Feb 12, 2009

eschaton posted:

does RHEL guarantee this, or a particular version of RHEL?

if Linux were a grownup operating system, a driver built for some architecture running RHEL 6 would continue to work without even a recompile on RHEL 8

Let me know what “grown up” operating system does this. :allears:

sb hermit
Dec 13, 2016





oh man

the flexibility of not being tied down to a specific kernel driver binary abi is probably yet another good reason why linux is so widespread

sb hermit
Dec 13, 2016





having said that, google is working on a binary driver abi for android so your wildest dreams will finally come true

FlapYoJacks
Feb 12, 2009
*tries to install a windows 2000 driver on windows 11 *

Why doesn’t this piece of poo poo work? I thought Windows was a grown-up OS!

FlapYoJacks fucked around with this message at 00:51 on Jul 21, 2022

Athas
Aug 6, 2007

fuck that joker
So much of the community is scared of recompiling, holy poo poo.

Hot take: if you cannot recompile the binary, then don't use the binary.

BlankSystemDaemon
Mar 13, 2009



Athas posted:

So much of the community is scared of recompiling, holy poo poo.

Hot take: if you cannot recompile the binary, then don't use the binary.
same can be said about debugging

Splicer
Oct 16, 2006

from hell's heart I cast at thee
🧙🐀🧹🌙🪄🐸

eschaton posted:

a miserable pile of I/Os
But enough talk.
IRQ

Truga
May 4, 2014
Lipstick Apathy

Splicer posted:

But enough talk.
IRQ

:hmmyes:

my homie dhall
Dec 9, 2010

honey, oh please, it's just a machine

eschaton posted:

if Linux were a grownup operating system, a driver built for some architecture running RHEL 6 would continue to work without even a recompile on RHEL 8

good bit

BlankSystemDaemon
Mar 13, 2009



FlapYoJacks
Feb 12, 2009

Dracula getting killed by a preemptive scheduler.

Captain Foo
May 11, 2004

we vibin'
we slidin'
we breathin'
we dyin'

Kazinsal
Dec 13, 2011


RobobTheGreat
Jul 14, 2003

Mind your manners when talking to the king!

Splicer posted:

But enough talk.
IRQ

:yeah:

Tankakern
Jul 25, 2007

ooh maybe they'll finally tick off that missing feature that zfs zealots keeps nagging about

[PATCH RFC v2 00/16] btrfs: add fscrypt integration

BlankSystemDaemon
Mar 13, 2009



looking forward to hearing all the stories of dataloss

Sapozhnik
Jan 2, 2005

Nap Ghost
excellent, fantastic idea, next, btrfs should add transparent WAL transaction support for individual files or hey, multiple files at once, why not
also let's add support for B-tree files as well so that people can roll their own ISAM implementation easily on top of these features. it's right there in the name, let the user instantiate the filesystem's data structures directly
while we're at it let's add an ioctl that performs transparent audio and video compression and decompression, oh and maintains a seek index as well obviously

Tankakern
Jul 25, 2007

lol

BattleMaster
Aug 14, 2000

Sapozhnik posted:

while we're at it let's add an ioctl that performs transparent audio and video compression and decompression, oh and maintains a seek index as well obviously

I don't know what the rest means but did anyone ever try to make thing a thing???

Antigravitas
Dec 8, 2019

Die Rettung fuer die Landwirte:
We built a system for archival of large files.

It is extremely slow "all of a sudden" and I was called in to investigate.

It is completely swamped with random iops, and just an utter deluge of stat() and whatnot calls, just absolutely murdered.

Here's a file size histogram of just one directory.
pre:
  1k: 669933
  2k: 119527
  4k: 125188
  8k: 115541
 16k:  97343
 32k:  75153
 64k:  52402
128k:  29671
256k:  11723
512k:   3304
  1M:    755
  2M:     42
That's only a few gigabyte of data. The dataset is 80TB, and it all looks like this.

:shepface:

Beeftweeter
Jun 28, 2005

OFFICIAL #1 GNOME FAN

Antigravitas posted:

We built a system for archival of large files.

It is extremely slow "all of a sudden" and I was called in to investigate.

It is completely swamped with random iops, and just an utter deluge of stat() and whatnot calls, just absolutely murdered.

Here's a file size histogram of just one directory.
pre:
  1k: 669933
  2k: 119527
  4k: 125188
  8k: 115541
 16k:  97343
 32k:  75153
 64k:  52402
128k:  29671
256k:  11723
512k:   3304
  1M:    755
  2M:     42
That's only a few gigabyte of data. The dataset is 80TB, and it all looks like this.

:shepface:

sounds like its not working to archive large files

Antigravitas
Dec 8, 2019

Die Rettung fuer die Landwirte:
That's a conclusion I have reluctantly come to as well.

It was built for nice, clean, large streaming writes and reads to saturate 10Gbps. Those were the requirements.
Instead, someone is using it in literally the absolute worst access pattern possible.

ngl, I feel a bit betrayed. We were assured it wasn't going to be used in this way.

:argh: MATLAB

NihilCredo
Jun 6, 2011

iram omni possibili modo preme:
plus una illa te diffamabit, quam multæ virtutes commendabunt

Antigravitas posted:

We were assured it wasn't going to be used in this way.

were you assured in writing?

if you were, crack open a cold one and relax with the clean conscience of a job well done

if you weren't, now you know why you should have been

Antigravitas
Dec 8, 2019

Die Rettung fuer die Landwirte:
The stakes aren't that high, but yes, I have the documentation that they specifically asked for the opposite of this.

But regardless, no file system will perform well when used like this.

Lmao, not all file system metadata fits in cache and any directory walk generates a storm of random I/O.

I'll have to actually help them get their code to not do the thing they are doing…

outhole surfer
Mar 18, 2003

seems like reiserfs would kill it in this situation

Perplx
Jun 26, 2004


Best viewed on Orgasma Plasma
Lipstick Apathy
just throw some optane drives at

Antigravitas
Dec 8, 2019

Die Rettung fuer die Landwirte:

Perplx posted:

just throw some optane drives at

I do not want to enter the university finance labyrinth. Not my budget :sun:.

Sure, special vdev, l2arc, more RAM. Is there still money left in the grant? Who knows, not me. Putting lipstick on a pig anyway, the system is designed for the opposite use pattern and it's working as designed.

It's either educating users to use it as designed, or design another system. That's what I've communicated to the work group.

BlankSystemDaemon
Mar 13, 2009



Optimizing for that workload with allocation classes and special vdevs can absolutely be done, but not on an existing pool that's made for handling large files at 1Gbps linespeed.
I don't envy you, it's a poo poo situation with no good outcome.

Tankakern
Jul 25, 2007

or maybe just dont use zfs for anything

fritz
Jul 26, 2003

Adbot
ADBOT LOVES YOU

The_Franz
Aug 8, 2003

linus did his usual sunday release, which isn't surprising, but...

quote:

On a personal note, the most interesting part here is that I did the
release (and am writing this) on an arm64 laptop. It's something I've
been waiting for for a _loong_ time, and it's finally reality, thanks
to the Asahi team. We've had arm64 hardware around running Linux for a
long time, but none of it has really been usable as a development
platform until now.

It's the third time I'm using Apple hardware for Linux development - I
did it many years ago for powerpc development on a ppc970 machine.
And then a decade+ ago when the Macbook Air was the only real
thin-and-lite around. And now as an arm64 platform.

Not that I've used it for any real work, I literally have only been
doing test builds and boots and now the actual release tagging. But
I'm trying to make sure that the next time I travel, I can travel with
this as a laptop and finally dogfooding the arm64 side too.

Anyway, regardless of all that, this obviously means that the merge
window (*) will open tomorrow. But please give this a good test run
before you get all excited about a new development kernel.

Linus

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply