Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
Is a fuller harddrive slower to use?
A hard drive with many things on it is just as fast as one with 1 thing.
If your hard drive has lots of data, it is slower to make your way around it all. It bogs you down.
View Results
 
  • Post
  • Reply
Skylark
Apr 27, 2007



︵‿୨🤍୧‿︵
༶⋆˙⊹。⋆ʚ🦢ɞ ✩ ˛˚.
An interesting thought I had: If you want to load something particular from a hard drive,and there is a lot of other stuff on it, it may take longer to find the thing you're looking for. Imagine a storage unit full of boxes: if you were trying to find one particular thing, which is in one of the boxes, you would have to look through a bunch of other stuff first, before you find it; possibly opening many unwanted boxes along the way.

As computer users in the modern age, we love the idea of a big hard drive that is full of lots of data. But could it be the case that all of this precious data is slowing us down? Because when we want to load it, there is other data in the way.

Adbot
ADBOT LOVES YOU

polyester concept
Mar 29, 2017

maybe if you organized the files in order of frequent use and keep related stuff in sequential order, it would make searching a little faster. no idea if anyone has tried this but worth a shot

ADINSX
Sep 9, 2003

Wanna run with my crew huh? Rule cyberspace and crunch numbers like I do?

I think some old computers could read data off the edge of the disk faster than the inside and programmers would write optimizations to put all their data right on the edge :c00l:

InternetOfTwinks
Apr 2, 2011

Coming out of my cage and I've been doing just bad
Huh, apparently this in fact sort of a thing with ssd's, I had assumed it was a relic of old school platter drives that had gotten badly defragged.

mediaphage
Mar 22, 2007

Excuse me, pardon me, sheer perfection coming through
does it matter with modern indexing and solid state storage

also isn't it always a little faster to have data on the edge of spinning rust? the edge is always going to be moving fastest

Beeftweeter
Jun 28, 2005

a medium-format picture of beeftweeter staring silently at the camera, a quizzical expression on his face
yeah its exactly like when you eat too much but cant poop

Cat Face Joe
Feb 20, 2005

goth vegan crossfit mom who vapes



no

Cat Face Joe
Feb 20, 2005

goth vegan crossfit mom who vapes



wait

Cat Face Joe
Feb 20, 2005

goth vegan crossfit mom who vapes



yes

little munchkin
Aug 15, 2010
an empty harddrive is full of zeros (big and round), but a hard drive with a bunch of files will have a bunch of ones, which will take up less space, op

echinopsis
Apr 13, 2004

by Fluffdaddy
windows 95 introduced TRIM which is about pubes

N.Z.'s Champion
Jun 8, 2003

Yam Slacker
a single gigabyte file is faster than 1000 1mb files

https://www.youtube.com/watch?v=-fC2oke5MFg

Dijkstracula
Mar 18, 2003

You can't spell 'vector field' without me, Professor!

this question has different answers based on what you mean by the "thing" in "finding something", various layers of the operating system, file system, and HDD controller either come into play or don't depending

Dijkstracula fucked around with this message at 05:51 on Jun 21, 2023

akadajet
Sep 14, 2003

is a full hard drive heavier than an empty hard drive?

echinopsis
Apr 13, 2004

by Fluffdaddy

akadajet posted:

is a full hard drive heavier than an empty hard drive?

surely not

is a shuffled deck of cards heavier than a unshuffled deck all other factors being the same

Buck Turgidson
Feb 6, 2011

𓀬𓀠𓀟𓀡𓀢𓀣𓀤𓀥𓀞𓀬

akadajet posted:

is a full hard drive heavier than an empty hard drive?

little munchkin posted:

an empty harddrive is full of zeros (big and round), but a hard drive with a bunch of files will have a bunch of ones, which will take up less space, op

Farmer Crack-Ass
Jan 2, 2001

this is me posting irl
it makes sense. it makes sense. if i eat a huge amount of food i sure won’t be moving fast any time soon

Tunicate
May 15, 2012

akadajet posted:

is a full hard drive heavier than an empty hard drive?

yes, by about 10^-14 grams per terabyte

echinopsis
Apr 13, 2004

by Fluffdaddy

Tunicate posted:

yes, by about 10^-14 grams per terabyte

is a hard drive ever empty ??? isn’t it always 100% full of information even if it’s noise/garbage/zeros?

The Management
Jan 2, 2010

sup, bitch?
this is a multi-dimensional question, op. so let’s look at its individual components.

for a spinning disk:
a fuller drive is likely to be more fragmented. this means non-contiguous reads and writes, which slows spinning disks considerably, since seek times are brutally slow.
a fuller drive also requires the heads to move further to find the data, as it may be on the inner sectors or the outer sectors of the disk. an emptier drive, properly defragged, is going to have all of the data in adjacent sectors to minimize head movement.

for ssds:
ssds are effectively copy on write, which can lead to lots of fragmentation in the physical block layer. when there are fewer empty pages to deal with, garbage collection often resorts to coalescing fragmented pages (I.e., copying the valid blocks to a new page so the current page can be erased). this is a lot of write amplification.
fuller drives, particularly fragmented ones, will have more complex flash translation layer (FTL) mapping tables. these translate logical block addresses to physical ones. finding a block may require reading more levels of entries, and rewriting one adds more maintenance effort to the ftl data structures.
while ssds are far better at scatter-gather IO than spinning disks, it is still suboptimal to linear IO, especially if blocks are interleaved on parallel nands chips (kind of a raid 1 setup)

for filesystems in general:
many file systems scale pretty poorly with many files or lots of files in a single directory. finding the index nodes for a file may require linear searches through long directory entries, meaning they need to be read, often with multiple layers of indirection, just to find the intended file. this is the slowdown we are used to when dealing with many small files.

so, in conclusion, disks suck and are bad. would not recommend.

The Management
Jan 2, 2010

sup, bitch?

echinopsis posted:

is a hard drive ever empty ??? isn’t it always 100% full of information even if it’s noise/garbage/zeros?

a magnetic disk is never empty.
flash media is “full” when it’s erased. writing frees trapped electrons so it gets lighter.

The Management
Jan 2, 2010

sup, bitch?
I forgot your ram, op. your OS page cache is less likely to contain the data in the full drive, because there is more of it. it is less likely to have cached copies of the directory entries your care about or the index nodes for the files you want to read. that’s going to cost you a lot more in io overhead,

echinopsis
Apr 13, 2004

by Fluffdaddy

The Management posted:

a magnetic disk is never empty.
flash media is “full” when it’s erased. writing frees trapped electrons so it gets lighter.

:hmmyes:


so flash media is a whore for electrons but we want to introduce it to christ

Buck Turgidson
Feb 6, 2011

𓀬𓀠𓀟𓀡𓀢𓀣𓀤𓀥𓀞𓀬
If you think about the original hard drive, chiseled stone, it would get lighter as you stored more data on it.

Jabor
Jul 16, 2010

#1 Loser at SpaceChem
a curious device. gets lighter as you write to it, and even lighter as you erase.

fart simpson
Jul 2, 2005

DEATH TO AMERICA
:xickos:

The Management posted:

this is a multi-dimensional question, op. so let’s look at its individual components.

for a spinning disk:
a fuller drive is likely to be more fragmented. this means non-contiguous reads and writes, which slows spinning disks considerably, since seek times are brutally slow.
a fuller drive also requires the heads to move further to find the data, as it may be on the inner sectors or the outer sectors of the disk. an emptier drive, properly defragged, is going to have all of the data in adjacent sectors to minimize head movement.

for ssds:
ssds are effectively copy on write, which can lead to lots of fragmentation in the physical block layer. when there are fewer empty pages to deal with, garbage collection often resorts to coalescing fragmented pages (I.e., copying the valid blocks to a new page so the current page can be erased). this is a lot of write amplification.
fuller drives, particularly fragmented ones, will have more complex flash translation layer (FTL) mapping tables. these translate logical block addresses to physical ones. finding a block may require reading more levels of entries, and rewriting one adds more maintenance effort to the ftl data structures.
while ssds are far better at scatter-gather IO than spinning disks, it is still suboptimal to linear IO, especially if blocks are interleaved on parallel nands chips (kind of a raid 1 setup)

for filesystems in general:
many file systems scale pretty poorly with many files or lots of files in a single directory. finding the index nodes for a file may require linear searches through long directory entries, meaning they need to be read, often with multiple layers of indirection, just to find the intended file. this is the slowdown we are used to when dealing with many small files.

so, in conclusion, disks suck and are bad. would not recommend.

nerd

fart simpson
Jul 2, 2005

DEATH TO AMERICA
:xickos:

Buck Turgidson posted:

If you think about the original hard drive, chiseled stone, it would get lighter as you stored more data on it.

be careful though. with the next type of hard drive, cast bronze, it could be the opposite

The Management
Jan 2, 2010

sup, bitch?

thanks. i couldn’t sleep last night so I typed this thing and then I could sleep. thanks yospos

Beeftweeter
Jun 28, 2005

a medium-format picture of beeftweeter staring silently at the camera, a quizzical expression on his face
when you delete too many files the drive disintegrates. its just physics

akadajet
Sep 14, 2003

a heavy hard drive. full of bbw porn

Best Bi Geek Squid
Mar 25, 2016
getting swole by downloading a lot of linux isos before lifting my computer

Best Bi Geek Squid
Mar 25, 2016
*pats hard drive* yep I got like 60 lbs of cat pics in this bad boy

Cybernetic Vermin
Apr 18, 2005

full drives work faster, if x% of the capacity is used there's a x% chance that your data is under the head already, so when you issue the request "give me my data" a 100% full drive can always just immediately start giving it to you.

akadajet
Sep 14, 2003

remember to defrag that poo poo so all the data is sequential.

tk
Dec 10, 2003

Nap Ghost
All the extra data allows the disk to spin faster, not slower.

Archduke Frantz Fanon
Sep 7, 2004

akadajet posted:

remember to defrag that poo poo so all the data is sequential.

wouldn't that put all the 1s on a single side and you get an out of control washing machine scenario

akadajet
Sep 14, 2003

Archduke Frantz Fanon posted:

wouldn't that put all the 1s on a single side and you get an out of control washing machine scenario

if you use full disk encryption the data has high entropy, so that doesn't happen.

Crime on a Dime
Nov 28, 2006
so, we've arrived at Cyber Gravity. the idea that a hard drive with more data will operate slower than one with less. This belief likens data to a physical burden, a peculiar, and quite honestly, flawed concept.

Crime on a Dime
Nov 28, 2006

akadajet posted:

remember to defrag that poo poo so all the data is sequential.

in the infinite vastness of the world the whispers of such theories echo through the endless grids of cyberspace, casting a shroud of doubt upon the minds of many. its a haunting song, a narrative spun from the threads of confusion and misconception, a nocturnal dance in the realm of the irrational

Adbot
ADBOT LOVES YOU

ADINSX
Sep 9, 2003

Wanna run with my crew huh? Rule cyberspace and crunch numbers like I do?

I miss the defrag util in windows

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply