Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Klyith
Aug 3, 2007

GBS Pledge Week

SocksAndSandals posted:

I should probable get a decent set of small, magnetic screwdrivers.

IMO the ifixit kits are really worth the money. They're the nicest exchangeable-bit drivers I've used, and have nice strong magnets. Can't recommend highly enough.

Adbot
ADBOT LOVES YOU

Ardryn
Oct 27, 2007

Rolling around at the speed of sound.


So I'm trying to make sense of the Gigabyte x670 Elite's M.2 section of the manual, I can see that two of the slots are CPU but two are listed as SB, which despite my searching I haven't been able to find an answer as to what that means exactly. I also notice the manual doesn't mention using those slots will disable SATA ports, but I did see something about them potentially using PCIe lanes (from the other PCIe slots?). So my question is: will filling M.2 slot 3 and 4 disable those extra PCIe slots? Still disable SATA ports? What's going on here exactly?

I've also looked at MSI's tomahawk wi-fi and asus's tuf gaming wi-fi x670s and I didn't see mention of M.2 disabling ports or PCIe slots in those manuals either.

Klyith
Aug 3, 2007

GBS Pledge Week

Ardryn posted:

So I'm trying to make sense of the Gigabyte x670 Elite's M.2 section of the manual, I can see that two of the slots are CPU but two are listed as SB, which despite my searching I haven't been able to find an answer as to what that means exactly.

SB are connected to the mobo chipset(s). See the block diagram on page 5. SB probably stands for "south bridge".

The useful information is that you should arrange your drives fastest -> slowest in order M2A -> M2D. (Though M2A and M2B will be identical unless you have a gen5 drive.)

M2C_SB is connected to the primary chipset chip, and M2D_SB is connected to the secondary chipset chip such that data has to hop through the primary one to get to the CPU. Theoretically adds more latency, but probably makes exactly zero difference in practice.


Ardryn posted:

I also notice the manual doesn't mention using those slots will disable SATA ports, but I did see something about them potentially using PCIe lanes (from the other PCIe slots?). So my question is: will filling M.2 slot 3 and 4 disable those extra PCIe slots? Still disable SATA ports? What's going on here exactly?

No. Between the new CPU having more PCIe lanes and the X670 dual chipset, there's enough IO that they can populate everything on the board with dedicated connections.

Subjunctive
Sep 12, 2006

✨sparkle and shine✨

I think I don’t want a QLC drive because I’ve been playing with big ML models and recording video, but in spite of reading this thread religiously I am still not confident in my ability to choose a good drive. If I want a 4TB Gen 4 drive for primary boot, games, and occasionally write-heavy loads, is that the SN850x? Should I just get two SN770 and figure out some RAID setup to bridge them? I’d really like to have them as a unified pool, I think.

Ardryn
Oct 27, 2007

Rolling around at the speed of sound.


Klyith posted:

Answered

Thank you, that was very helpful!

Klyith
Aug 3, 2007

GBS Pledge Week

Subjunctive posted:

I think I don’t want a QLC drive because I’ve been playing with big ML models and recording video, but in spite of reading this thread religiously I am still not confident in my ability to choose a good drive. If I want a 4TB Gen 4 drive for primary boot, games, and occasionally write-heavy loads, is that the SN850x? Should I just get two SN770 and figure out some RAID setup to bridge them? I’d really like to have them as a unified pool, I think.

How much GPU do you have? :)

I'm no expert on ML, but the nvidia DGX platforms have default setups with 1:1 enterprise NVMe drives to GPUs. And those have pretty fierce GPUs in them. They can support up to 2:1 drive:gpu, but I'm guessing that would be more about needing extra storage space rather than than bandwidth.

So my guess would be that a single big SN850x would be adequate and that you don't need to raid 2 SN770s. Unless you have 2 4090s or something.


edit: 2x2TB SN770s is a substantial cost savings vs a 4TB SN850x, but my inclination says that's a question of cost vs the hassle of a raid, and not a raid supporting better ML performance.

Klyith fucked around with this message at 19:01 on Apr 9, 2023

Subjunctive
Sep 12, 2006

✨sparkle and shine✨

I just have the one 4090, so I’ll go with the SN850x and make things easier. Thank you!

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!
Based on some random complaints thread over on reddit, I checked mine. How in the gently caress is that even possible? Why's there like a third more writes than reads?!



--edit:
69TB over ~22000 hours, that's like 3GB/h.

Klyith
Aug 3, 2007

GBS Pledge Week

Combat Pretzel posted:

Based on some random complaints thread over on reddit, I checked mine. How in the gently caress is that even possible? Why's there like a third more writes than reads?!

AFAIK this is 100% normal. All of my drives that report total reads have more write than read, though to less of a degree than yours. More in the 10-20% zone.

The normal operation of a PC throws lots of data around that never gets looked at again. Like, probably 95% of data that gets dumped to swap just sits there untouched until a program closes, and then the OS deletes it. And your OS & programs constantly do small writes of useful state information.

People getting excited and complaining about poo poo on reddit are frequently totally off-base.

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!
The reddit thing was more like the amount of writes. Dude had like 24TB in under five months.

Well then. The drive of mine has 600TBW endurance, anyway. Should last another 190000 hours.

Klyith
Aug 3, 2007

GBS Pledge Week

Combat Pretzel posted:

The reddit thing was more like the amount of writes. Dude had like 24TB in under five months.

Playing a lot of games with video recording turned on can rack up that much. Default settings for shadowplay is like 22 GB/hr, and you can triple that if you push the slider all the way up.

For people that play games for multiple hours per day and record everything, it's a potential reason to keep a HDD around.

Combat Pretzel posted:

Well then. The drive of mine has 600TBW endurance, anyway. Should last another 190000 hours.

Also every time anyone has ever tested it, SSDs have long out-lived their spec endurance.

I kinda figure more recent drives, especially QLC ones, aren't doing the same 50x better than spec like they used to. But still.

Dr. Video Games 0031
Jul 17, 2004

Klyith posted:

Playing a lot of games with video recording turned on can rack up that much. Default settings for shadowplay is like 22 GB/hr, and you can triple that if you push the slider all the way up.

For people that play games for multiple hours per day and record everything, it's a potential reason to keep a HDD around.

Or you just switch to OBS which lets you hold the replay buffer in memory.

redeyes
Sep 14, 2002

by Fluffdaddy
Im at the point SSDs are so cheap I don't care anymore. Just give me TB and some good IOPS and im happy as a clam. Also please make the NAND not die.

Shaocaholica
Oct 29, 2002

Fig. 5E
Ok dumb hypothetical. Core2quad was the best. But all of those shipped with spinning drives back in ~2009. Then they got a breath of new life with SATA3 SSDs. They don't support NVME SSDs but what if they did? How much more performance can be eeked out of a top end C2Q if it supported say a Gen4 NVME?

SamDabbers
May 26, 2003



It should be possible to get an NVMe drive working on a C2Q with a PCIe slot adapter, it just wouldn't be bootable due to lack of BIOS support. Do the science if you still have such a machine and let us know how it goes!

Klyith
Aug 3, 2007

GBS Pledge Week

Shaocaholica posted:

Ok dumb hypothetical. Core2quad was the best. But all of those shipped with spinning drives back in ~2009. Then they got a breath of new life with SATA3 SSDs. They don't support NVME SSDs but what if they did? How much more performance can be eeked out of a top end C2Q if it supported say a Gen4 NVME?

First, do you have an application where the SATA -> NVMe upgrade is a non-trivial performance gain on a current PCs?

orcane
Jun 13, 2012

Fun Shoe
Even if you could boot from the NVMe, aren't the chipsets limited to PCI-e 2.0?

makere
Jan 14, 2012
I used one of high end C2Q on my server until couple years ago with a Sata SSD, it's not great anymore and kinda lags behind on basic tasks. I guess with NVMe your best bet would be to have a storage controller that can handle all 16 lanes of PCIE and distribute the 4x speeds of newer M2 drive to utilize entire bus.

necrobobsledder
Mar 21, 2005
Lay down your soul to the gods rock 'n roll
Nap Ghost

Klyith posted:

First, do you have an application where the SATA -> NVMe upgrade is a non-trivial performance gain on a current PCs?
The latency difference is pretty huge when it comes to ZFS allocation classes for small writes it appears. I have a pile of SATA SSDs from work and now I'm kind of bummed they're not as useful as I would have hoped. Seems like the best bet really is going to be QD1 random IOPS performance from ye olde Intel Optane drives here. Might do some benchmarks to do proper comparisons for the workloads I have but for virtualization cases it was kind of staggering how important random IOPS are once you reach the 128 GB RAM point in ZFS systems.

Shaocaholica
Oct 29, 2002

Fig. 5E

orcane posted:

Even if you could boot from the NVMe, aren't the chipsets limited to PCI-e 2.0?

It was just a hypothetical in which the chipset would support full gen4 speeds.

Perplx
Jun 26, 2004


Best viewed on Orgasma Plasma
Lipstick Apathy
You could get 4GB/s with a WD Black AN1500. You can also boot nvme on any chipset using a boot loader.

Shaocaholica
Oct 29, 2002

Fig. 5E

It's not Core2 but its the oldest machine I have with a free PCIe slot right now.

Anime Schoolgirl
Nov 28, 2002

Klyith posted:

Also every time anyone has ever tested it, SSDs have long out-lived their spec endurance.

I kinda figure more recent drives, especially QLC ones, aren't doing the same 50x better than spec like they used to. But still.
IIRC a lot of earlier Intel drives go into read only mode once the warranty TBW is passed, but they were the only times I've heard of that happening.

Shaocaholica
Oct 29, 2002

Fig. 5E
Are people actually throwing away SSDs after 5yr?

BeastOfExmoor
Aug 19, 2003

I will be gone, but not forever.
I grabbed a 2TB SN770 for $110 and installed it a couple days ago as an upgrade to a ~4yr old HP EX920. I wasn't expecting much change performance-wise since this system is PCIE 3.0, but there was actually a noticeable performance increase in day-to-day tasks and the benchmark differences were even more significant.

Shaocaholica
Oct 29, 2002

Fig. 5E
Is there a recommended tool for secure erasing non boot SSDs in windows? The Samsung bootable tool is clunky when you have to do many.

Klyith
Aug 3, 2007

GBS Pledge Week

Shaocaholica posted:

Is there a recommended tool for secure erasing non boot SSDs in windows? The Samsung bootable tool is clunky when you have to do many.

No, there's pretty much just the mnfr tools. Or spend $50 on a paid app.

Linux live usb stick is also an option.

Shaocaholica
Oct 29, 2002

Fig. 5E

Klyith posted:

No, there's pretty much just the mnfr tools. Or spend $50 on a paid app.

Linux live usb stick is also an option.

It’s weird you need these hyper niche specific tools for a standardized(?) ATA command?

WhyteRyce
Dec 30, 2001

You don’t need niche tools unfortunately there is no nvmecli equivalent in windows and it makes me mad

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.
Windows is so bad for anything low level. I wish you could get stuff like nvmecli and lspci in an admin powershell!!

Shaocaholica
Oct 29, 2002

Fig. 5E
Ok I bought a few used 970 Evo pluses and I'm finally getting around to checking and erasing them. What does it mean if a 2TB model has 250T worth of writes on it? The Samsung spec is TBW-1500 for the 2T model. So 250/1500 is 17% wear. What's hypothetically going to happen at 100% wear? Not saying I'll ever get there with these but just wondering.

Klyith
Aug 3, 2007

GBS Pledge Week

Shaocaholica posted:

Ok I bought a few used 970 Evo pluses and I'm finally getting around to checking and erasing them. What does it mean if a 2TB model has 250T worth of writes on it? The Samsung spec is TBW-1500 for the 2T model. So 250/1500 is 17% wear. What's hypothetically going to happen at 100% wear? Not saying I'll ever get there with these but just wondering.

Your warranty will be invalid, even if you hop in a time machine and go back to when the drive was less than 3 years old.

Aside from that nothing.

Klyith posted:

Also every time anyone has ever tested it, SSDs have long out-lived their spec endurance.

Shaocaholica
Oct 29, 2002

Fig. 5E
Thanks. So has anyone taken an SSD way past its endurance either synthetically or in production to see what the limits are? Or its literally not reasonably possible even in a home lab?

Geemer
Nov 4, 2010



Shaocaholica posted:

Thanks. So has anyone taken an SSD way past its endurance either synthetically or in production to see what the limits are? Or its literally not reasonably possible even in a home lab?

There was a test that did it years ago for a pretty sizeable selection of drives that were current back then.

If I recall correctly only one or two drives actually failed and the others kept chugging along for many several times their rates endurance.

WhyteRyce
Dec 30, 2001

As mentioned, some drives from some vendors will go to read-only mode the second they hit 100% media wear

Some drives from some vendors will flag smart critical warning once it hits 100% but continue on their merry way

Other drives will just continue on as if nothing happened (with some differences between whether the media wear counter will exceed 100% or not).

I've taken a data center class drive and saturated the 8-bit counter without any bad blocks. An enterprise level 1TB drive doing non-stop writes in my testing generally gets to 100% in 3-4 months so its very doable in a home lab environment. Probably even quicker if you just do something like just sequential writes at 128K QD128

WhyteRyce fucked around with this message at 00:26 on Apr 15, 2023

Subjunctive
Sep 12, 2006

✨sparkle and shine✨

priznat posted:

Windows is so bad for anything low level. I wish you could get stuff like nvmecli and lspci in an admin powershell!!

Can you do this through WSL maybe?

Someone suggested this for lspci:

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.
Could be! I tried installing WSL once on a work PC and because the network stuff is locked down it was a huge pain in the rear end so I kind of gave up. Linux is just a lot better for that stuff.

Subjunctive
Sep 12, 2006

✨sparkle and shine✨

it looks like on Windows you can only send CRYPTO SCRAMBLE EXT from WinPE (the pre-installation environment) if using the Windows driver stack, so that might be why Samsung’s thing makes you boot into it

Klyith
Aug 3, 2007

GBS Pledge Week

WhyteRyce posted:

As mentioned, some drives from some vendors will go to read-only mode the second they hit 100% media wear

Some drives from some vendors will flag smart critical warning once it hits 100% but continue on their merry way

Other drives will just continue on as if nothing happened (with some differences between whether the media wear counter will exceed 100% or not).

The question here is, what does a drive mean by "media wear"? Welcome to the wonderful world of SMART: where the definitions are made up and the specs don't matter! :v:


For some SSDs, media wear equals how much of their internal over-provision space is left. SSDs all start with more flash capacity than the drive space they show you, both to store their own internal housekeeping and to cover for blocks that go bad. As blocks fail through over-use or defect that extra space shrinks. When there is no extra space, the SSD is pretty crippled -- it can't guarantee data integrity, and also over-provision is pretty critical to how SSDs function. They need the extra space to shuffle data around.

These drives will tend to go read-only or throw critical errors when they hit 100% media wear. And for good reason. Flash will normally fail on an ever-escalating curve. You may only have a limited time for data recovery before the drive is kaput.


OTOH, some drives will use media wear as TB written / whitepaper spec endurance. If a drive has 250TB written, the whitepaper spec is 1500TB, and the media wear attribute also says 17%, then you can be pretty sure the drive is in this category.

These drives will happily keep running and are still perfectly good, because write endurance spec ranges between very conservative and crazy conservative.

Adbot
ADBOT LOVES YOU

WhyteRyce
Dec 30, 2001

generally with every enterprise model I've used, media wear % is tied to the TBW written guarantee which is generally based around some number of drive writes per day * 3 or 5 years. The separate available spare % field is supposed to be used to communicate spare capacity available, but I have no idea if some cheaper client drives use them other ways. And yes, the spec does define that field as vendor specific estimate so it could mean literally anything and the vendor doesn't need to share with you

the default smart log is lacking in many ways which is why the OCP smart log page fills in many more gaps, such as being able to calculate WAF yourself or view the number of bad blocks or a pcie correctable error counter if you're one of those people who need proof your pcie link is garbage. You probably won't ever find that log on client drives though

WhyteRyce fucked around with this message at 05:07 on Apr 15, 2023

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply