|
minute posted:Yea, I figured it’s recovering successfully from the other mirror each time, since it reports no data errors. 
|
#
?
Jun 13, 2023 17:13
|
|
|
|
| # ? May 15, 2024 09:54 |
|
|
Yeah I got kind of worried when I saw the devices with names like "USB30-blah". There are lots of layers of abstraction there for something like ZFS which would like direct access to your storage. "Lots of links in the chain" is bad from a system reliability standpoint.
|
|
#
?
Jun 13, 2023 17:26
|
|
|
Hoping for some Synology help. I just got a new DS423+ to replace my DS218+. They 218+ I have set up with docker and many apps blah. I thought I could just do a back up of the config in update&restore, but when I put it into the ds423 the drives didn't come up with the migration wizard. I set up the same information and then did a restore from configuration. it looks like it restored my users and a few things, but I thought it would pick up the previous information/installed apps etc? Am I boned as for easy set up? Docker should be easy enough etc. But i'd rather a 30 min setup than a 5 hr :p
|
|
#
?
Jun 13, 2023 18:33
|
|
|
Quick sanity check, I've never replaced a zfs disk before. I have 5 refurb HGST 10TB disks that I've gambled on, in raidz2. The first disk has started SMART errors and had scrub errors after 1 year. I'm still ok getting the disks at half price. To replace a disk, is something like this the correct process? #Shutdown #Replace disk #Start up #determine old disk GUID zpool status tank1 #find new disk path ls -la /dev/disk/by-id #replace old disk by GUID with new path /by-id/ sudo zpool replace tank1 $oldDiskGUID /dev/disk/by-id/$NEWDISK Dyscrasia fucked around with this message at 03:15 on Jun 15, 2023 |
|
#
?
Jun 15, 2023 02:58
|
|
|
Yep, that's it, and half of that is because I assume you don't have hot swap drive bays and/or an empty drive bay.
|
|
#
?
Jun 15, 2023 03:49
|
|
|
IOwnCalculus posted:Yep, that's it, and half of that is because I assume you don't have hot swap drive bays and/or an empty drive bay. Exactly that. Thanks!
|
|
#
?
Jun 15, 2023 12:44
|
|
|
Down to my last 4TB Seagate (out of four ST4000DM000 originals) in my 6-disk zpool that was created back in 2015. Dead drive is currently squeaking, which we all know is an excellent portent of recovery. The other two originals were WD WD40EZRX which are still chugging along with 0 SMART errors, while the last Seagate has ~100 reallocated sectors. The prior two failures (2020ish) were replaced by more 2015-vintage Seagates I had bought at the same time. Interesting to see that 4TB drives still pretty much cost the same as they did 8 years ago (replacing with a WD40EFPX, and picking up a spare for when that last Seagate dies) lurksion fucked around with this message at 22:59 on Jun 15, 2023 |
|
#
?
Jun 15, 2023 22:53
|
|
|
'tis the season, apparently.code:
|
|
#
?
Jun 15, 2023 23:13
|
|
|
Bought a pair of 18TB Toshiba N300 drives (HDWG51JUZSVA) as the £/TB was just too tempting, which I'll use to enter the world of ZFS. Four 8TB probably would faster but until I move beyond 1GBe I won't worry about that. I couldn't find good benchmarking of NAS-focused drives on the net, so here's the results from gnome-disks.
|
|
#
?
Jun 16, 2023 20:13
|
|
|
Pablo Bluth posted:Bought a pair of 18TB Toshiba N300 drives (HDWG51JUZSVA) as the £/TB was just too tempting, which I'll use to enter the world of ZFS. Four 8TB probably would faster but until I move beyond 1GBe I won't worry about that. I couldn't find good benchmarking of NAS-focused drives on the net, so here's the results from gnome-disks. I recently had my first Toshiba disk die (well, start to die). It's a 3TB from 2013 and it's been in use for 2773 days!  Pretty good! I have older disks that are still going but I can't complain about this one, especially since it still turns on.
|
|
#
?
Jun 16, 2023 20:55
|
|
|
For years I kept ending up buying Toshiba X300 series hard drives as they always seem to be best price/TB, but these are my first N300. Honestly, it's never my internal drives that give me problems; it's the USB drives that seem to keep dying on me. In theory 18TB of usable space should keep me going for a while but by the time I use it to backup my windows PC (raw photos and some video), then consolidated the years of detritus spread around various Linux drives, it'll be half gone...
|
|
#
?
Jun 16, 2023 22:27
|
|
|
lurksion posted:that was created back in 2015.
|
|
#
?
Jun 18, 2023 07:00
|
|
|
H110Hawk posted:I would use a reputable disk from a major brand and call it a day. It's all linux under the hood. Don't use the write cache and it will never matter. Would you advice against using write cache? I have the same Synology model and is also considering adding those drives as cache
|
|
#
?
Jun 18, 2023 13:11
|
|
|
Surprised how easily i managed to get my 2x18TB setup as network-shared ZFS; install FreeBSD inside KVM, pass through the sata controller as a PCIE device, run a single command to add the two drives as a mirrored vdev, install and setup samba. Still need to setup an NFS for better access on linux devices. Is there a good open source file syncing program people recommend? There's a few directories (Documents, Music, etc) that I want to keep synced between the new ZFS storage and my windows machine.
|
|
#
?
Jun 18, 2023 13:28
|
|
|
Pablo Bluth posted:Surprised how easily i managed to get my 2x18TB setup as network-shared ZFS; install FreeBSD inside KVM, pass through the sata controller as a PCIE device, run a single command to add the two drives as a mirrored vdev, install and setup samba. Still need to setup an NFS for better access on linux devices. syncthing for syncing duplicati if you want incremental backups
|
|
#
?
Jun 18, 2023 15:19
|
|
|
Pablo Bluth posted:Surprised how easily i managed to get my 2x18TB setup as network-shared ZFS; install FreeBSD inside KVM, pass through the sata controller as a PCIE device, run a single command to add the two drives as a mirrored vdev, install and setup samba. Still need to setup an NFS for better access on linux devices. Also, agreeing with e.pilot on syncthing.
|
|
#
?
Jun 18, 2023 15:57
|
|
|
Unraid 6.12.0 with ZFS support has been released. Is there any reason I'd want to re-format an xfs or btrfs formatted NVMe SSD to zfs?
Corb3t fucked around with this message at 19:25 on Jun 18, 2023 |
|
#
?
Jun 18, 2023 19:19
|
|
|
Is there a software solution that is similar to Plex/Emby/Jellyfin (scrapes media information) but doesn't stream or transcode, just lets me download? Ideally it'd set up a web server, scrape a media folder and then generate a website where people on my network can click and download. I'm doing a summer camp like setup with limited connectivity but a decent LAN and there's no way I can get hardware to support 50+ people all transcoding and streaming. I've done some research, Kodi looks like it can scrape from web servers but you'd have to configure everyone's client individually to access the http address and then each Kodi site would scrape-- looking for the opposite. I know I could just do a directory index but that doesn't give anyone an idea of what a movie would be about etc.. Anyone know of a solution? Pretty niche I know. Thanks for any suggestions!
|
|
#
?
Jun 18, 2023 20:06
|
|
|
Corb3t posted:Unraid 6.12.0 with ZFS support has been released. Is there any reason I'd want to re-format an xfs or btrfs formatted NVMe SSD to zfs? Probably not for just a single drive. I think zfs is a lot more interesting if you’re dealing with pools of drives. There is compressions and snapshots to gain but i think btrfs also has those?
|
|
#
?
Jun 18, 2023 20:58
|
|
|
With Emby (and I assume jellyfin, but don't have it running atm to check), you can toggle a checkbox per user to disable media playback. They can still download files if that's enabled for them.
|
|
#
?
Jun 18, 2023 21:00
|
|
|
Corb3t posted:Unraid 6.12.0 with ZFS support has been released. Is there any reason I'd want to re-format an xfs or btrfs formatted NVMe SSD to zfs? SpaceInvader One put out a video on how to do this, and mentioned some things coming in upcoming videos. -Making top level folders in a share their own dataset, so each of your containers in appdata can be snapshotted independently for easy rollback. -Auto snapshotting and auto-replication from dataset to dataset
|
|
#
?
Jun 18, 2023 21:10
|
|
|
Ceros_X posted:Is there a software solution that is similar to Plex/Emby/Jellyfin (scrapes media information) but doesn't stream or transcode, just lets me download? Ideally it'd set up a web server, scrape a media folder and then generate a website where people on my network can click and download. I'm doing a summer camp like setup with limited connectivity but a decent LAN and there's no way I can get hardware to support 50+ people all transcoding and streaming. hasn’t been updated in a while, but air video hd will do this, minus the metadata scraping
|
|
#
?
Jun 19, 2023 05:18
|
|
|
Any current wisdom on HDD vendors / types for NAS in 2023? This would be for an unraid NAS for home media storage and some work project data but it would be a 2nd redundancy for those. I've always tried to just stick to WD drives but wanted to see if anything else was decent out there. I'm looking at a couple drives in the 8-10-12 tb range.
|
|
|
#
?
Jun 19, 2023 11:55
|
|
|
THF13 posted:With Emby (and I assume jellyfin, but don't have it running atm to check), you can toggle a checkbox per user to disable media playback. They can still download files if that's enabled for them. Yep, for Jellyfin in users > profile there's a checkbox for allowing media playback. There's also a download checkbox further down the page.
|
|
#
?
Jun 19, 2023 12:24
|
|
|
That Works posted:Any current wisdom on HDD vendors / types for NAS in 2023? This would be for an unraid NAS for home media storage and some work project data but it would be a 2nd redundancy for those. I've always tried to just stick to WD drives but wanted to see if anything else was decent out there. I'm looking at a couple drives in the 8-10-12 tb range.
|
|
#
?
Jun 19, 2023 12:54
|
|
|
Corb3t posted:Unraid 6.12.0 with ZFS support has been released. Is there any reason I'd want to re-format an xfs or btrfs formatted NVMe SSD to zfs? I'm setting the minor version over/under at 3.5, this time around.
|
|
#
?
Jun 19, 2023 14:23
|
|
|
My truenas setup has two sets of disks in the main pool. "raidz1-0" is 1TB SSD's and "raidz1-1" is 500gb SSD's, I have a bunch more 1TB SSD's now and I can probably replace the 500GB vdev with 1TB disks and get the same or more capacity with less disks. Is there a way to do this without just blowing the whole pool away, recreating it with the new disks and restoring a backup to it? Can I do an in-place upgrade? See below for config code:
|
|
#
?
Jun 19, 2023 15:08
|
|
|
New to zfs so I might be wrong: If it's the same number of disks — I think you can replace & rebuild one disk at a time, then once all the disks are at the larger capacity, have it expand to the larger size. For a different number of disks - I believe there is a newish (circa 2021) ability to increase the disks in raidz but nothing to reduce the number. Thus it is required to build fresh. If you have enough slots to run all the new and old disks at the same time, you could build the new pool then do zfs replication to move the data.
|
|
#
?
Jun 19, 2023 15:53
|
|
|
That Works posted:Any current wisdom on HDD vendors / types for NAS in 2023? This would be for an unraid NAS for home media storage and some work project data but it would be a 2nd redundancy for those. I've always tried to just stick to WD drives but wanted to see if anything else was decent out there. I'm looking at a couple drives in the 8-10-12 tb range. I ordered some WD Red CMR drives directly from WD because I have seen how Amazon packs their boxes. The box I got from WD was amazing: foam surrounding the boxes for the HDDs, and the HDDs themselves in foam within their boxes. I have also seen that they don't give you the full warranty if you don't order directly from them, but I don't know too much about that. E: I was having a bunch of trouble with my TrueNAS Scale install getting apps to see the storage I have already because of how it handles Apps accessing mounted data. The Truecharts discord helped a bit but it was a combo of that and banging my head against the wall that got me working. Permissions man, permissions. KKKLIP ART fucked around with this message at 17:38 on Jun 19, 2023 |
|
#
?
Jun 19, 2023 17:34
|
|
|
Yeah, Pablo Bluth has it mostly right. With raidz1 you can replace one drive per vdev at a time, and raidz2 allows two drives per vdev at a time, and with raidz3 you can replace three disks per vdev at a time. If you've got a hotplug-capable SAS chassis, you can do it using zpool-offline(8) and zpool-replace(8). If they're just SATA disks not connected to a backplane with capasitors to soak up the in-rush current, I'd recommend shutting down the machine before pulling out and replacing the disk physically. ZFS raidz expansion hasn't yet been added to OpenZFS, and according to the second-to-last OpenZFS leadership meeting in April, it still needs more code review and testing in order to land. I think the FreeBSD Foundation is looking to hire someone to do that work as well.
|
|
#
?
Jun 19, 2023 17:38
|
|
|
BlankSystemDaemon posted:ZFS raidz expansion hasn't yet been added to OpenZFS, and according to the second-to-last OpenZFS leadership meeting in April, it still needs more code review and testing in order to land. This has taken loving forever, but I'm glad progress is being made 
|
|
#
?
Jun 19, 2023 18:58
|
|
KKKLIP ART posted:I ordered some WD Red CMR drives directly from WD because I have seen how Amazon packs their boxes. The box I got from WD was amazing: foam surrounding the boxes for the HDDs, and the HDDs themselves in foam within their boxes. I have also seen that they don't give you the full warranty if you don't order directly from them, but I don't know too much about that. I ended up ordering a couple WD Red Pro 10tb CMR drives as well. Thanks to you and others for the input.
|
|
|
#
?
Jun 19, 2023 19:12
|
|
|
KKKLIP ART posted:
I had similar issues and ended up just copping out. Everything on the NAS is permed to my personal user from top to bottom. I circumvent the safety of permissions and just mash in uid 1000 for everything so that poo poo works right.
|
|
#
?
Jun 19, 2023 21:09
|
|
|
Not sure which thread was best for this, apologies if it's too offtopic. I'm running an Unraid server for media files of little consequence, and using it also as secondary physical backup for some work-related files (DNA sequencing stuff, big files). I have those files cloud stored and also on a primary physical, so this server is not exactly the most mission critical thing. Anyway, I am learning as I go and trying to work more on security with it. Should I be setting it up to use https (instead of http) to connect to the server on my local network? Are there any issues / consequences for doing so? For remote access I have tailscale running on an opnsense router already so I don't need to tunnel to the nas or put it on a public domain etc. The server is not visible outside the LAN etc.
|
|
|
#
?
Jun 20, 2023 12:26
|
|
|
I for sure don't think this is the right place for this, but is there a spot where we can talk naming conventions for files? I want to go through my NAS and rename files (pictures, ebooks, movies, etc) in a way that makes sense instead of it being an absolute hot mess. Is there either a thread or a resource that y'all have used to help come up with a naming convention?
|
|
#
?
Jun 20, 2023 13:49
|
|
|
Use lots of directories and err on the side of verbosity? Documents/Books/Non-Fiction/Hartley, J.R./Fly Fishing by J.R. Hartley.epub should be findable down the road.
|
|
#
?
Jun 20, 2023 14:01
|
|
|
KKKLIP ART posted:I for sure don't think this is the right place for this, but is there a spot where we can talk naming conventions for files? I want to go through my NAS and rename files (pictures, ebooks, movies, etc) in a way that makes sense instead of it being an absolute hot mess. Is there either a thread or a resource that y'all have used to help come up with a naming convention? I think it's trashguides that recommends having your *arrs rename directories to include IMDb/tvdb references to help Plex in the event of a library rebuild. I'm not sure if there is a similar best practice for books and music, but to be safe all my Tidal rips use their unique identifiers in the album directory names too, though if your id3 tagging is on point that's probably redundant.
|
|
#
?
Jun 20, 2023 15:52
|
|
|
Always 'Surname, Firstname' when cataloguing. 'Firstname Surname' is for heatens...
|
|
#
?
Jun 20, 2023 16:04
|
|
|
If you're using ZFS or something else like it, I'll definitely recommend using filesystems over directories, for the simple reason that it's a lot easier to ensure things are backed up, and also makes it easier to readjust your collection. Also, look into flexget; it can handle all sorts of fun things that let you have complete control over your collection of what I'm sure are FreeBSD ISOs. EDIT: You can even set it up so that you just place either a link in a file or a metadata (torrent, nzb, or something else), and it'll do everything for you via the rather extensive plugin system. BlankSystemDaemon fucked around with this message at 18:14 on Jun 20, 2023 |
|
#
?
Jun 20, 2023 18:10
|
|
|
|
| # ? May 15, 2024 09:54 |
|
|
KKKLIP ART posted:I for sure don't think this is the right place for this, but is there a spot where we can talk naming conventions for files? I want to go through my NAS and rename files (pictures, ebooks, movies, etc) in a way that makes sense instead of it being an absolute hot mess. Is there either a thread or a resource that y'all have used to help come up with a naming convention? I personally chose to align with one of Plex, Emby, Jellyfin or Kodi for naming conventions. It makes media metadata scraping easier and it was close to what I had already anyway.
|
|
#
?
Jun 20, 2023 18:12
|
|