|
Excuse the double-post, but I found a paper on A Study of SSD Reliability in Large Scale Enterprise Storage Deployments that I think might be interesting because unlike previous studies, it also looks at RAID. The presentation slides are also available if you want the highlights. There'll also eventually be a presentation (USENIX FAST'20 took place in late-September), but those tend to lag behind a month or two, because of processing/editing. And since it's NetApp, FreeBSD is involved somewhere in the stack.
|
#
?
Mar 16, 2020 16:20
|
|
|
|
| # ? May 16, 2024 06:56 |
|
|
Well, as I mentioned earlier, Usenet is my backup. I'm mainly just trying to strike a balance in the case of failure between having to download 30 TB and money/time spent on a local copy of the data. I've already got the USB drives pre-shucking, so the leading plan right now is that I'm going to copy the data to the drives as-is and hope none of them dies. Then I'll make some new smaller pools out of the disks in the existing pool.
|
|
#
?
Mar 16, 2020 16:25
|
|
|
D. Ebdrup posted:Despite devops screaming into the void about all their nonsense, there is a difference between prototype and production environments. no, you see, *everyone* is a canary H2SO4 fucked around with this message at 16:36 on Mar 16, 2020 |
|
#
?
Mar 16, 2020 16:33
|
|
|
Thermopyle posted:Well, as I mentioned earlier, Usenet is my backup. I'd do it as the individual drive method instead of trying to treat all the USB devices as a pool, especially if your worst case is queuing up a bunch of poo poo in radarr. Also strongly recommend doing a dump of ls /tank/movies or whatever to some safe place so you know what was in the pool if this all shits the bed.
|
|
#
?
Mar 16, 2020 18:32
|
|
|
IOwnCalculus posted:Also strongly recommend doing a dump of ls /tank/movies or whatever to some safe place so you know what was in the pool if this all shits the bed. Excellent idea.
|
|
#
?
Mar 16, 2020 18:57
|
|
|
H2SO4 posted:no, you see, *everyone* is a canary
|
|
#
?
Mar 16, 2020 19:41
|
|
|
D. Ebdrup posted:Mods? MODS! you'll float too
|
|
#
?
Mar 16, 2020 22:21
|
|
|
Thermopyle posted:Excellent idea. Archive and properly back up the actual NZB files used to get all your stuff too. That will make recovery extra easy, and if you compress NZBs they should take barely any space at all
|
|
#
?
Mar 16, 2020 23:12
|
|
|
Paul MaudDib posted:you'll float too You'll never take me alive! 
|
|
#
?
Mar 16, 2020 23:21
|
|
|
ILikeVoltron posted:Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz x10dri-t buddies :wassup: yes I know I need more ram but I'm only running 1 CPU and dense DIMMs are expensive. 
|
|
#
?
Mar 17, 2020 10:01
|
|
|
14TB easystores are $200 again.
|
|
#
?
Mar 17, 2020 14:09
|
|
|
drat, sold out by the time I saw this.
|
|
#
?
Mar 17, 2020 15:03
|
|
|
I was going to buy 2 
|
|
#
?
Mar 17, 2020 15:14
|
|
|
Gay Retard posted:I was going to buy 2 Fuckin  Dammit. Although it's probably a good thing.
|
|
#
?
Mar 17, 2020 16:28
|
|
|
Crunchy Black posted:x10dri-t buddies :wassup: Anybody upgraded to the new not-FreeNAS yet? 
|
|
#
?
Mar 17, 2020 16:29
|
|
|
Crunchy Black posted:x10dri-t buddies :wassup: Fun fact: the x10dri/x10sri motherboards are one of the few my work has found to support pcie hotplug! Windows doesn’t really support it but linux does. So if you want to yank out your u.2 nvme drives go for it 
|
|
#
?
Mar 17, 2020 16:45
|
|
|
It really is one of the best motherboard families ever designed. Incredibly resilient and robust featureset. About the only way it could be better is if the onboard 10G wasn't copper but that probably would've put it at over 550 street price when it was new.
|
|
#
?
Mar 17, 2020 16:55
|
|
|
priznat posted:Fun fact: the x10dri/x10sri motherboards are one of the few my work has found to support pcie hotplug! Windows doesn’t really support it but linux does. So if you want to yank out your u.2 nvme drives go for it
|
|
#
?
Mar 17, 2020 17:20
|
|
|
D. Ebdrup posted:PCI-ex hotplug is supported fine in FreeBSD, it's what underpins the use of docks for ThinkPad which I use - so as far as I'm aware it also works for Windows and Linux. It can work with windows too but requires the drive vendors to provide a driver for it, apart from intel none of the other ones have that (so far). With the whitebox driver it will bsod (with server 2016 anyway 2019 might be better)
|
|
#
?
Mar 17, 2020 17:24
|
|
|
I see $179 on those 14TBs with a business account, too. Insane.
|
|
#
?
Mar 17, 2020 17:25
|
|
|
I hit the 50% usage point on my 18TB Unraid box (4x 6GB HGST drives) on the weekend, time to start think bout adding on!
|
|
#
?
Mar 17, 2020 17:26
|
|
|
priznat posted:It can work with windows too but requires the drive vendors to provide a driver for it, apart from intel none of the other ones have that (so far). With the whitebox driver it will bsod (with server 2016 anyway 2019 might be better) Yeah my XPS 13 does it in Win10 (9365, I think?)
|
|
#
?
Mar 17, 2020 17:32
|
|
|
How's the quality of the 14tb WD white labels compared to say, the HGST Ultrastars? I've got 4x8TB of those right now (in a DS918+) but am down to about 5TB free and starting to sweat.
|
|
#
?
Mar 17, 2020 19:47
|
|
|
CommieGIR posted:Anybody upgraded to the new not-FreeNAS yet? Reminds me of the first few years of fancy XBMC skins or worse... PowerBI
|
|
#
?
Mar 17, 2020 19:58
|
|
|
Constellation I posted:Reminds me of the first few years of fancy XBMC skins or worse... PowerBI Yeah, they've got some work to do on it. Like, AFAIK, there's no way to hide any of those panels, so you'll always get a big 'ol red mark for any network ports you have that aren't up, which is obnoxious on board with 4 ports that you only need 1 of.
|
|
#
?
Mar 17, 2020 20:15
|
|
|
DrDork posted:Yeah, they've got some work to do on it. Like, AFAIK, there's no way to hide any of those panels, so you'll always get a big 'ol red mark for any network ports you have that aren't up, which is obnoxious on board with 4 ports that you only need 1 of.
|
|
#
?
Mar 17, 2020 20:34
|
|
|
D. Ebdrup posted:ifconfig <interface> down? It's already down (no PHY connection)--setting it to down with ifconfig doesn't do anything here, unfortunately. FreeNAS also won't let you straight up delete a physical interface, it seems. Maybe there's another way to do it, but I've yet to find one.
|
|
#
?
Mar 17, 2020 21:35
|
|
|
DrDork posted:It's already down (no PHY connection)--setting it to down with ifconfig doesn't do anything here, unfortunately. FreeNAS also won't let you straight up delete a physical interface, it seems. Maybe there's another way to do it, but I've yet to find one.
|
|
#
?
Mar 17, 2020 21:56
|
|
|
DrDork posted:It's already down (no PHY connection)--setting it to down with ifconfig doesn't do anything here, unfortunately. FreeNAS also won't let you straight up delete a physical interface, it seems. Maybe there's another way to do it, but I've yet to find one. Yeah, I tried a couple different ways, it just clutters the whole thing with NICs that are unplugged, and doesn't rank them in the display by "In Use"
|
|
#
?
Mar 17, 2020 23:15
|
|
|
Indeed. Overall it's still an improvement over the 9.x dashboard, but there's a lot of room for improvement, still. Same with reporting, which while much prettier and all, still doesn't have a way (again, as far as I've found) to enable auto-refresh/update, so you can't actually watch disk usage or whatever progress easily.
|
|
#
?
Mar 17, 2020 23:37
|
|
|
Crunchy Black posted:x10dri-t buddies :wassup: I just upgraded to 128 gigs and it feels sweeeeeet
|
|
#
?
Mar 18, 2020 03:22
|
|
|
Folks if I'm not really looking to tinker is there any benefit to doing a homebuild vs a prebuilt NAS? I've had a NFS set up that does what I want well enough, but plugging USB drives into this old laptop server only goes so far. It'd be nice to get a "proper" solution set up that would be a bit easier to manage than my current solution if for not other reason to to get Mrs. Burd to back up her stuff to it so I don't have to deal with it.
|
|
#
?
Mar 18, 2020 21:53
|
|
|
Warbird posted:Folks if I'm not really looking to tinker is there any benefit to doing a homebuild vs a prebuilt NAS? I've had a NFS set up that does what I want well enough, but plugging USB drives into this old laptop server only goes so far. It'd be nice to get a "proper" solution set up that would be a bit easier to manage than my current solution if for not other reason to to get Mrs. Burd to back up her stuff to it so I don't have to deal with it. DIY is cheaper, more powerful, and more feature-filled, at the obvious expense of your own time and effort. Free/TrueNAS, Unraid, etc., all have really dropped the bar for entry in terms of the software side of things--you can easily be up and running in 30 minutes. That said, you still would have to select, purchase, and assemble the hardware, and none of the software offerings are quite as slick as what you'll find on Synology (though Xpenology comes real close). DIY also has the future advantage of being able to support arbitrary numbers of drives; pre-mades you're locked into however may bays it has, with the only other option being expensive disk-rack expanders. But pre-mades are also tiny little boxes; it's very hard to get a DIY box down anywhere near that small. Basically if you value 4-5hrs of your time more than the few hundred dollar price difference, go with a pre-made. If you want the best performance and lowest price, go DIY.
|
|
#
?
Mar 18, 2020 22:01
|
|
|
Does Free/True/etc ect handle the networking end of things well? I'm totally down to slap some stuff together, but things tend to get wild for troubleshooting if one thing goes sideways. If I can throw some drives in a setup and just get a GUI over IP to do everydamnthingelse then I don't mind doing a self build.
|
|
#
?
Mar 18, 2020 22:19
|
|
|
Warbird posted:Folks if I'm not really looking to tinker is there any benefit to doing a homebuild vs a prebuilt NAS? I've had a NFS set up that does what I want well enough, but plugging USB drives into this old laptop server only goes so far. It'd be nice to get a "proper" solution set up that would be a bit easier to manage than my current solution if for not other reason to to get Mrs. Burd to back up her stuff to it so I don't have to deal with it. If you want a high WAF and she runs a Mac you can do direct time machine backups to a synology. You can get that going on diy too but that is one thing that you get out of the box. Storage management is something you are either passionate about or not in my opinion. You can do all the server stuff regardless of how you handle persistent storage.
|
|
#
?
Mar 18, 2020 22:22
|
|
|
Warbird posted:Does Free/True/etc ect handle the networking end of things well? I'm totally down to slap some stuff together, but things tend to get wild for troubleshooting if one thing goes sideways. If I can throw some drives in a setup and just get a GUI over IP to do everydamnthingelse then I don't mind doing a self build. True/FreeNAS are basically exclusively GUI-over-IP. I mean, there's a console if you should need it, but it's not the recommended way of doing anything. Networking is pretty stupid simple with it, unless you want to start playing with multiple NICs, in which case the "only one can have DHCP enabled" is annoying, but manageable with some foresight. If it's just one NIC you're planning on using then you can't really get much simpler: plug in and let it figure it out, then load up whatever IP it pulls in your browser of choice and go from there. The big limitation to *NAS is also generally seen as its biggest strength: ZFS. Upsides: super reliable, pretty fast, probably the most "durable" storage solution out there, especially when backed by ECC RAM. Downside: you can't add single drives to it later--if you have a 3-drive array now and want to expand to a 4-drive array later, you're SOL and stuck trying to life-boat the data somewhere else while you upgrade. Synology/QNAP (and Xpenology for the DIY option) generally don't have that limitation, but their backing storage solution also isn't as robust. So that's something to consider.
|
|
#
?
Mar 18, 2020 23:24
|
|
|
If you want to slowly expand a zfs pool over time you can do it with striped mirrors (like raid10). Start with two drives, then add two more later, and so on. Downside is your capacity is only 50% at all times, but you get better performance and more flexibility in exchange. You can even use different sized drives as long as each mirrored pair is the same size to each other
|
|
#
?
Mar 18, 2020 23:32
|
|
|
Failed drives in a rack mount synology vs a big brand SAN is night and day HP overnights is a drive. Synology has us go through the regular RMA process with WD/Intel We just use it as one of three backup targets so no huge deal if it takes a few days to get a new drive. But what if the unit had a hardware issue?
|
|
#
?
Mar 18, 2020 23:49
|
|
|
True, but this is for a dude's home storage, so he's not getting anyone to overnight him a drive except maybe Amazon. You can expand ZFS by mirrors like that, but it's dreadfully space-inefficient compared to something like RAIDZ or SHR, and most home users are going to be limited by their Gig-E (at best) home network, not pool performance.
|
|
#
?
Mar 18, 2020 23:59
|
|
|
|
| # ? May 16, 2024 06:56 |
|
|
DrDork posted:True, but this is for a dude's home storage, so he's not getting anyone to overnight him a drive except maybe Amazon. It was just a general comment. Home stuff, YOLO
|
|
#
?
Mar 19, 2020 00:29
|
|