Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Beve Stuscemi
Jun 6, 2001




Is there a NAS distribution thats built around disk speed? I currently use unraid, which tends to store entire files on a single disk, regardless of size. I have a 10GB link from it to my video editing PC, but I feel like I cant really take advantage of it since everything is streaming off one disk. The unraid is currently all spinning disks, but I am looking to rebuild with SATA SSD's very soon.

Is there a distro that is more built for fast file movement?

Adbot
ADBOT LOVES YOU

Beve Stuscemi
Jun 6, 2001




BlankSystemDaemon posted:

A 100GB link? Nice.

Its a 10GB SPF Direct cable

Beve Stuscemi
Jun 6, 2001




VostokProgram posted:

Just to be extremely clear: gigabits or gigabytes?

I had to check the hardware profile, but it looks like bits

quote:

Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

Beve Stuscemi
Jun 6, 2001




Wibla posted:

TrueNAS Scale or Core will do what you need. Unraid is literally the opposite of what you need to solve your needs in this instance, for the reasons you've already stated. While you're figuring out how to get from what you have today, to a fully functioning NAS, you can add an NVMe drive to your unraid server to use as a scratch drive for editing, but that means you need to manually copy files to and from that drive.

I would NOT buy a bunch of SATA SSD's in 2023. At least not without a clearly defined goal :haw:

Please tell us what your goals for a new NAS is, and we'll help you get there, hopefully without too much bickering.

I do have a cache 1TB SATA SSD in my unraid, but again, its the limitations of a single disk that come into play.

I am looking to store a modest amount of data (currently about 5.5TB) in a redundant way so that I do not get a single point of failure (this is why I don't have it all sitting on a single 10TB disk, despite that being by far the easiest option). I also would like to take advantage of the 10Gbit link between the server and my video editing PC. It would be nice to be able to store everything on the NAS and edit directly from there. I'm mostly dealing with 4K and some 6K footage. Other than that its simple file storage accessible over gigabit ethernet or wifi, one or two VM's and a plex docker that just occasionally serves my local LAN on the box.

I have access to a bunch of ex-datacenter stuff (which is where I got the 10GB SFP cards for the unraid box and my video editing box). Everything currently runs on a Dell Poweredge T420 with 8 Drive bays filled with spinning disks on a PERC 6GB unit of some sort that has been flashed to HBA mode, 2x E5-2430 V2's and 192GB DDR3

I also have a stack of 1TB SATA SSD's, which, should get me 7TB usable under the current unraid standard, assuming 8 of them in use. Since I already have the SSD's I was hoping to put them to use as an upgrade in both speed, heat generation and power consumption over the spinning rust.

I also have the option of moving this all over to an HP DL380 G9 with 2x E5-2640 V3's, 128GB DDR4, and a 12GB/S SAS controller, but I'm guessing the 12GB/s unit wont gain me anything without using 12GB/s drives with it.

Nothing that I own as a candidate for a NAS can accept an NVME drive. Its all a bit too old for that.

Beve Stuscemi fucked around with this message at 21:22 on Mar 31, 2023

Beve Stuscemi
Jun 6, 2001




Wibla posted:

hol up!

You have all that poo poo sitting already? Is that an SFF (16 bay) DL380?

I would lab the DL380 with 8x1TB setup in striped ZFS mirrors (one pool with multiple mirrored vdevs) and see how it performed for that use case. That'd get you around 3.something TB formatted capacity for actual high-speed storage, with reasonable redundancy. You could probably run them in RAIDZ2 and still get good enough performance for your needs.

You can also get cheap ($20) pci-e riser cards that will fit a single nvme drive. I have one in my DL360p Gen8 and it works great. There are versions with multiple NVMe slots, but they require PCI-e bifurcation and your mileage will vary there.

Yeah, its all here just sitting, its an 8-bay 2.5" drive DL380. I do have a free PCI-E slot after I would add the SFP card to it, so the NVME is something to look at then.

Beve Stuscemi fucked around with this message at 22:29 on Mar 31, 2023

Beve Stuscemi
Jun 6, 2001




BlankSystemDaemon posted:

HPE branded Microsemi RAID controller?

It is an HPE branded controller, although I don’t know what kind offhand without opening it up and it’s at my office right now. A cursory google suggested that it has an inbuilt HBA mode that you can switch to

Beve Stuscemi
Jun 6, 2001




BlankSystemDaemon posted:

Huh, I'd completely forgotten about both these.

Yeah, that's the trouble - I don't know for sure that the HBA mode is the same as an initiator target mode.
A lot of RAID controllers think it's fine to just add each individual disk in a raid0 of their own, but this doesn't work both because it means you're locked into using RAID controllers that support the vendors RAID implementation, but worse yet it usually still means that ZFS has no control over disk and cache flushing (which it can't work properly without).

Only way I know of is to try it, and then use hd(1) or similar tools to look at the raw/character device (usually at the beginning, the end, or both), and then try moving the disk to another machine entirely and repeating.

I’ll do some research on it. I know the perc controller in my current Dell should be fine, so worst case scenario I can swap that in because I believe it’s normal pci-e

Beve Stuscemi
Jun 6, 2001




VelociBacon posted:

Hoping someone can help, I can't remember the name of some software that was recommended, basically it was like Plex but better at hosting media that isn't movies or shows (in my case it's motorsport stuff). Anyone remember what this was called or have another recommendation for this? Ideally I would be able to install an app like Plex on phone/tablet and be able to stream this media from outside of the LAN.

Jellyfin

Beve Stuscemi
Jun 6, 2001




Yeah, you get to keep it all in one device and have to janitor fewer devices. Also my unraid server will transcode on CPU just fine. You might not even need a GPU

Beve Stuscemi
Jun 6, 2001




I'm still chasing a high performance NAS setup for editing video from. I think I have the hardware figured out, my problem is that I have a mixture of 1TB and 500GB SSD SATA disks. RAIDZ seems to want to use all similarly sized disks, and most JBOD solutions seem to not split data over different drives, which results in read speeds limited by the speed of a single drive.

I have recently come into a decent used gaming PC (i7-6700K, 32GB RAM) that can accept M.2 drives, so I have the option to do that if I want to as well, along with throwing a SATA card in it to take the disks. I also have a 10Gigabit link that can go between the NAS and my editing PC, so I'm thinking of connecting the two over iSCSI?

Is truenas the solution for all that? If so, what is the best way to set it up to use differently sized disks?

I also have an option to throw all of that out and put the drives in a Synology DS2419+ that has a 10Gbit SFP+ card in it, but no NVME capability unless I buy their adapter card for it.

So do I build my own thing with Truenas, or just pres the easy button with the Synology?

Beve Stuscemi fucked around with this message at 21:14 on Apr 24, 2023

Beve Stuscemi
Jun 6, 2001




I want to say 4x 1tb drives and 10x 500gb drives? Between the sata on the motherboard and the sata card I have, I can cover the 14 drives.

Beve Stuscemi
Jun 6, 2001




I’ll give that a shot. Normally I’d feel like it’s a bad idea to use this many disks, but they all probably draw less power than one spinning disk anyway

Beve Stuscemi fucked around with this message at 12:46 on Apr 25, 2023

Beve Stuscemi
Jun 6, 2001




I've been running Unraid for I think 3 years now and the amount of janitoring is basically "log in and see if there are updates"

Unless you have wonky hardware its pretty hands off after initial setup

Beve Stuscemi
Jun 6, 2001




The only reason im considering Truenas is because I'm chasing performance, and Unraid just doesnt do it, other than that its fantastic

Beve Stuscemi
Jun 6, 2001




My power save setup is a bunch of SSD’s. My current server idles at about 115w even with the spinny disks put to sleep.

Moving from a server with redundant power supplies and 800 fans to a PC with an AIO water loop and SSD’s will hopefully solve a lot.

Beve Stuscemi
Jun 6, 2001




I’d imagine the synologys are pretty efficient. A lot of them use intel atom cpus

Beve Stuscemi
Jun 6, 2001




Does it make sense to use iSCSI rather than NFS or SMB to connect my video editing PC to a TrueNAS machine? I can connect the two over 10Gbit SFP+

My understanding is that iSCSI would be better for the video editing machine?

Beve Stuscemi
Jun 6, 2001




drat that’s clean! I’m for sure not posting mine now lol

Beve Stuscemi
Jun 6, 2001




OK, I'm using TrueNAS for the first time, and I'm having trouble getting basic SMB sharing going.

Here's what I've got:

A Pool consisting of two Vdevs made of 500GB and 1TB SATA drives






Under that pool is a dataset called "SSD Pool Dataset", I dont really understand what datasets are yet





The Pool ACL, specifically giving datauser full access




I've created a user called Datauser that I plan to use to log into the SMB share remotely





I have an SMB Share, sharing the pool





The Share ACL




I'm getting access denied when I try to write to the share with a remote computer. I dont know enough yet to know what I did wrong though

Beve Stuscemi
Jun 6, 2001




Wait, I was trying to write to SSD Pool, should I be trying to write to SSD Pool Dataset? Because that does actually work

Beve Stuscemi
Jun 6, 2001




Ok I think I had it correct the whole time and just didn’t know where to put data

Beve Stuscemi
Jun 6, 2001




Is there any way in truenas to see how full each individual physical disk is? It lets you see the pool, but I can’t find remaining capacity for the disks themselves

Beve Stuscemi
Jun 6, 2001




Zorak of Michigan posted:

I thought I remembered one, but I can't track it down anywhere. Why does it matter?

I guess it doesnt matter, because I did not know that

IOwnCalculus posted:

everything in a given vdev should have identical usage.

That clears up why I cant find the per-disk usage. I'm more used to Unraid, which will fill disks in a couple different ways, depending on how you have it set up


Thanks!

Beve Stuscemi
Jun 6, 2001




It figures as soon as I migrate everything off of unraid and onto truenas, unraid comes out with ZFS

:cripes:

Beve Stuscemi
Jun 6, 2001




I logged in to see a warning on my TrueNas today. Running "zpool status -v" reports the following:

code:
  pool: SSD Pool
 state: ONLINE
status: One or more devices has experienced an unrecoverable error.  An
        attempt was made to correct the error.  Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
        using 'zpool clear' or replace the device with 'zpool replace'.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-9P
config:

        NAME                                            STATE     READ WRITE CKSUM
        SSD Pool                                        ONLINE       0     0     0
          raidz1-0                                      ONLINE       0     0     0
            gptid/60067486-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/60088fdf-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            da11p2                                      ONLINE      11     0     0
            gptid/6006e637-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe3d749-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
          raidz1-1                                      ONLINE       0     0     0
            gptid/5fe75fa3-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fc32848-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/602a2292-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/6007789f-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe46b13-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe532c0-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe62066-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe570d1-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/60080272-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe4f3dd-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0

errors: No known data errors

  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:08 with 0 errors on Sat May 20 03:45:08 2023
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          ada0p2    ONLINE       0     0     0

errors: No known data errors

Disk on the way out I'm assuming?

Beve Stuscemi
Jun 6, 2001




Most perc cards need to be flashed to work well with nas software.

Beve Stuscemi
Jun 6, 2001




Decommissioning my NAS by Old Yellering it

Beve Stuscemi
Jun 6, 2001




VGA, like serial, will never go away

Beve Stuscemi
Jun 6, 2001




My truenas setup has two sets of disks in the main pool. "raidz1-0" is 1TB SSD's and "raidz1-1" is 500gb SSD's, I have a bunch more 1TB SSD's now and I can probably replace the 500GB vdev with 1TB disks and get the same or more capacity with less disks.

Is there a way to do this without just blowing the whole pool away, recreating it with the new disks and restoring a backup to it? Can I do an in-place upgrade? See below for config

code:
root@truenas[~]# zpool status
  pool: SSD Pool
 state: ONLINE
config:

        NAME                                            STATE     READ WRITE CKSUM
        SSD Pool                                        ONLINE       0     0     0
          raidz1-0                                      ONLINE       0     0     0
            gptid/60067486-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/60088fdf-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            da11p2                                      ONLINE       0     0     0
            gptid/6006e637-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe3d749-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
          raidz1-1                                      ONLINE       0     0     0
            gptid/5fe75fa3-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fc32848-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/602a2292-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/6007789f-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe46b13-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe532c0-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe62066-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe570d1-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/60080272-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0
            gptid/5fe4f3dd-e64a-11ed-88b6-d0509979f5c4  ONLINE       0     0     0

errors: No known data errors

  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:09 with 0 errors on Fri Jun 16 03:45:09 2023
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          ada0p2    ONLINE       0     0     0

Beve Stuscemi
Jun 6, 2001




Anyone know of any performance comparisons done between ZFS implementations in unraid vs truenas?

Now that unraid supports ZFS I’m seriously considering leaving truenas for it, because I like using unraid much better.

Beve Stuscemi
Jun 6, 2001




Synology question: I have a DS1819+ that I just came into possession of, and 7 out of 8 disks are working, but that’s still enough space to store what I need.

Can I create the storage pool now and then add the 8th disk to expand it later? Or does synology use a ZFS-like system that can’t be expanded?

Beve Stuscemi
Jun 6, 2001




They are all 10tb, so btrfs, but I can’t expand it? Can I use the extra as a hot spare at least when I replace it?

Beve Stuscemi
Jun 6, 2001




What do you all consider good temps for drives?

My synology has 7x Seagate IronWolf 10TB drives sitting at about 30C/86F. Thats basically the temp of a normal warm day. Where do you start getting worried about them? Should I be shooting more for ambient (which in my basement is around 65F)?

Beve Stuscemi
Jun 6, 2001




I'm sort of surprised we can get helium to stay in drives considering it eventually exits most other containers

Beve Stuscemi
Jun 6, 2001




I recently left unraid for synology. I was pushed over the edge by the extremely dumb unraid licensing system deciding that my flash drive GUID was blacklisted one day (I think they updated the blacklist after the fact and mine got caught in it).

This resulted in me emailing them for a new key, waiting for it and then finding it didn’t work because I moved servers earlier in the year and that meant I had already exceeded my license transfers for the year. Then I had to email them again to have them bump my license transfer limit up so I could use the new flash drive I had to buy so that I could use the software I paid for after my old drive got blacklisted out of the blue.

It’s super frustrating to pay for a product and then be treated at every step like I’m trying to steal it

synology on the other hand has been very straightforward and requires next to no janitoring. I’m happy so far.

Beve Stuscemi
Jun 6, 2001




They’re fine. Drives that are jostled around when they’re powered off are really resilient.

Beve Stuscemi
Jun 6, 2001




Is there an easy way to DIY a DAS? I have a little stack of 4TB drives hanging around and it would be kinda nice to be able to raid them together and hook them up over USB.

Basically, can you home build something like a Lacie?

Beve Stuscemi
Jun 6, 2001




That Mass Storage Gadget looks promising. I think by connecting it with a PCIE->USB-C card you'd be pretty good to go on most PC's

There is of course the problem of running it on a real PC, shutting it down cleanly, etc. The amazon $100 disk box is probably the way to go, even though building one would be more fun

Beve Stuscemi
Jun 6, 2001




Every day I open palm slam my hand into the basement door, walk over by my NAS and scream at the top of my lungs. 2 hours, including wind down

Adbot
ADBOT LOVES YOU

Beve Stuscemi
Jun 6, 2001




other people posted:

Wow that is some embarrassing my-first-php level poo poo.

Yeah this really does reek of “testing script that accidentally made it to production” lol

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply