|
Kevin Mitnick P.E. posted:i have several hundred TB and need to scan it in 1MB chunks and spinny disks are unacceptable for these reasons: you joke but the reasons actually exist
|
#
?
Dec 7, 2018 08:11
|
|
|
|
| # ? May 23, 2024 21:18 |
|
|
at my current job, my team has stopped using spinning disks and sas entirely we don't need the performance of nvme drives, but it is just easier to deal with from an organisational point of view. they fail less often than spinning rust, and they don't require a disk controller the way sas ssds did. does it make sense? not really do we give a flying gently caress? when it's 20% of the cost of a server that costs fuckall, not really
|
|
#
?
Dec 7, 2018 08:14
|
|
|
Notorious b.s.d. posted:you joke but the reasons actually exist yes I’m aware that hdds are niche now and their hold isn’t so great even in that niche. but I noticed hdds were not mentioned and hoped the reason was something like cto mandated no more spinny disks after he upgraded his gaming rig and codblops loads so fast now
|
|
#
?
Dec 7, 2018 08:40
|
|
|
Kevin Mitnick P.E. posted:yes I’m aware that hdds are niche now and their hold isn’t so great even in that niche. but I noticed hdds were not mentioned and hoped the reason was something like cto mandated no more spinny disks after he upgraded his gaming rig and codblops loads so fast now sometimes the cto does that kind of thing but often the reason is just ordinary organisational friction i tried to provide an example of the latter case
|
|
#
?
Dec 7, 2018 08:51
|
|
|
in other words, you ain't wrong, kevin. just you ain't right, neither spinning rust is now a niche thing
|
|
#
?
Dec 7, 2018 08:53
|
|
|
being right is boring
|
|
#
?
Dec 7, 2018 09:08
|
|
|
Kevin Mitnick P.E. posted:i have several hundred TB and need to scan it in 1MB chunks and spinny disks are unacceptable for these reasons: Because I gotta go fast like sanic instead of reading bits from specs of rust like a dipshit
|
|
#
?
Dec 7, 2018 17:24
|
|
|
the real answer is that the storage controllers are the bottleneck. I could do this with SAS drives but the cost per gb of those is the same as cheapo read-optimized SSDs so why bother. My choices are basically to have an array of 10-12 SSDs in RAID5 which are bottlenecked on their SAS links back to the storage controller which is then bottlenecked to 64gpbs on the PCIe lanes since I can only support a single one in all but the quad-socket Dell configs, and the processor and parity calcs on the controller may have overhead as well to slows throughput. Or that entire mess can be replaced with a single NVMe drive on the PCIe bus. And I can load up to 8 of those in to a single 2U which would give me 384gpbs theoretical throughput and the new Epyc platforms can handle that
|
|
#
?
Dec 7, 2018 17:30
|
|
|
lol Jesus Christ intel get your poo poo together
|
|
#
?
Dec 7, 2018 22:00
|
|
|
lol @ calling hdds "spinning rust" what is it with nerds having to give things they don't like/understand cutesy, embarrassing nicknames?
|
|
#
?
Dec 8, 2018 05:43
|
|
|
BangersInMyKnickers posted:the real answer is that the storage controllers are the bottleneck. I could do this with SAS drives but the cost per gb of those is the same as cheapo read-optimized SSDs so why bother. My choices are basically to have an array of 10-12 SSDs in RAID5 which are bottlenecked on their SAS links back to the storage controller which is then bottlenecked to 64gpbs on the PCIe lanes since I can only support a single one in all but the quad-socket Dell configs, and the processor and parity calcs on the controller may have overhead as well to slows throughput. Or that entire mess can be replaced with a single NVMe drive on the PCIe bus. And I can load up to 8 of those in to a single 2U which would give me 384gpbs theoretical throughput and the new Epyc platforms can handle that ty for informative reply to my dumb posts
|
|
#
?
Dec 8, 2018 05:55
|
|
|
Stymie posted:lol @ calling hdds "spinning rust" i dont know. do you have any theories, stymie
|
|
#
?
Dec 8, 2018 05:56
|
|
|
stymie believes that rotational storage is failure free and ssds will delete all data
|
|
#
?
Dec 8, 2018 05:57
|
|
|
Kevin Mitnick P.E. posted:i dont know. do you have any theories, stymie i dunno, but i wish they'd stop because it's tiresome any time you hear "spinning rust" or "crotch droppings" or whatever for the umpteenth time
|
|
#
?
Dec 8, 2018 06:05
|
|
|
pram posted:stymie believes that rotational storage is failure free and ssds will delete all data nah, hdds fail all the time, but less frequently than ssds and the data on ssds isn't deleted, just rendered inaccessible
|
|
#
?
Dec 8, 2018 06:06
|
|
|
i like both spinny rust for my large media library as well as SSDs for every single loving thing else of importance even down to negligible importance
|
|
#
?
Dec 8, 2018 06:26
|
|
|
stymie is the larry the cable guy of "hot" "takes"
|
|
#
?
Dec 8, 2018 07:01
|
|
|
Modern hard drives essentially all use cobalt alloys for their magnetic layers anyway, and earlier hard drives with iron-based magnetics used magnetite (Fe3O4), not "rust" (hematite, Fe2O3).
|
|
#
?
Dec 8, 2018 07:13
|
|
|
nobody cares
|
|
#
?
Dec 8, 2018 08:45
|
|
|
i thought this was a friendly place
|
|
#
?
Dec 8, 2018 12:38
|
|
|
Sagebrush posted:Modern hard drives essentially all use cobalt alloys for their magnetic layers anyway, and earlier hard drives with iron-based magnetics used magnetite (Fe3O4), not "rust" (hematite, Fe2O3). 
|
|
#
?
Dec 8, 2018 14:15
|
|
|
spinning rust versus swinging tits
|
|
#
?
Dec 8, 2018 15:25
|
|
|
Sniep posted:nobody cares Face it, you got smoked
|
|
#
?
Dec 8, 2018 17:35
|
|
|
thoughts on backblaze
|
|
#
?
Dec 9, 2018 10:56
|
|
|
cinci zoo sniper posted:thoughts on backblaze They produce cool reports about hard drive failure rates
|
|
#
?
Dec 9, 2018 12:08
|
|
|
spankmeister posted:They produce cool reports about hard drive failure rates and their product?
|
|
#
?
Dec 9, 2018 12:50
|
|
|
cinci zoo sniper posted:thoughts on backblaze I have been using both their personal machine backup as well as B2 for archival of every lovely picture I ever take. The personal machine backup software runs and I don’t have to worry about it. Occasionally it emails me to let me know it’s successfully backing up; one time it emailed me to let me know something was wrong. I haven’t needed to do a full restore of everything, but I did spot restore something once and it worked well enough. B2 I pop in a memory card and a script runs that uses some open source tool to copy to B2 and I don’t have to worry about it. Both products are priced very reasonably for what I’m getting from them.
|
|
#
?
Dec 9, 2018 15:02
|
|
|
tk posted:I have been using both their personal machine backup as well as B2 for archival of every lovely picture I ever take. sounds good, i don’t want to spring for a nas to do full machine backup locally
|
|
#
?
Dec 9, 2018 15:49
|
|
|
Sagebrush posted:Modern hard drives essentially all use cobalt alloys for their magnetic layers anyway, and earlier hard drives with iron-based magnetics used magnetite (Fe3O4), not "rust" (hematite, Fe2O3). this is possibly the most sagebrush post of all time
|
|
#
?
Dec 9, 2018 17:01
|
|
|
cinci zoo sniper posted:thoughts on backblaze unnecessary ask yourself: what would be the worst thing that could happen if you lost your data? how long would the repercussions last? would it be better or worse than if you got rid of that data now? don't be a hoarder
|
|
#
?
Dec 9, 2018 19:28
|
|
|
i just got a job at a startup that just gives me a stipend for tech instead of buying it for me i think i want a thin client laptop and a lil server box with processing power that i can ssh into whenever i need to do a compute but i havent tried to buy either thing in like ten years so i dont know where to look newegg seems bad now?? the laptops with good reviews have almost no reviews and the department of homeland security told me Not to buy huaqei anyway
|
|
#
?
Dec 9, 2018 20:01
|
|
|
instead of doing something weird like that just buy yourself an xps 15 or a macbook pro.
|
|
#
?
Dec 9, 2018 20:08
|
|
|
akadajet posted:instead of doing something weird like that just buy yourself an xps 15 or a macbook pro.
|
|
#
?
Dec 9, 2018 21:58
|
|
|
Corla Plankun posted:i just got a job at a startup that just gives me a stipend for tech instead of buying it for me no dont do this if you occasionally need a big load of cpu and ram do a spot request on AWS or w/e if you need it often then buy the big laptop
|
|
#
?
Dec 10, 2018 05:12
|
|
|
yeah seriously what kind of dumbass plan is that
|
|
#
?
Dec 10, 2018 14:47
|
|
|
i just like having a computer in the building so i can do crons and stuff without having to worry about what i'll be connected to, idk
|
|
#
?
Dec 10, 2018 15:53
|
|
|
cloudwatch events scheduled rule -> lambda -> fargate or skip the container if it's a little thing
|
|
#
?
Dec 10, 2018 16:53
|
|
|
i take back what i said about velop. comcast is having an outage and velop wont let me access any of my local devices - nas, etc - without an internet connection. just flashes a red light and the app tells me its offline. dogshit.
|
|
#
?
Dec 20, 2018 00:32
|
|
|
sincerely, KOTEX GOD OF BLOOD
|
|
#
?
Dec 20, 2018 00:37
|
|
|
|
| # ? May 23, 2024 21:18 |
|
|
tesla stymie has poor taste in gadgets what a surprise
|
|
#
?
Dec 20, 2018 02:32
|
|