Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Mr Shiny Pants
Nov 12, 2012
You could take a look at Proxmox, if you are considering FreeNAS because of the GUI.

Proxmox would do the same for your virtualisation needs as FreeNAS would for your storage and it has ZFS onboard.

Adbot
ADBOT LOVES YOU

Horn
Jun 18, 2004

Penetration is the key to success
College Slice
Or UnRaid if you want something really simple. I'm using it to host about 10 docker images and a couple of VMs. So far I have no complaints coming from ESX.

BlankSystemDaemon
Mar 13, 2009



SamDabbers posted:

How about using the HighPoint card in JBOD/non-RAID mode (so you don't need an expander) and running a storage VM under Hyper-V with the disks passed through? Then you aren't limited in your choice of OS or file system for software RAID, and you can export the storage via SMB/NFS/iSCSI/etc to use it outside of the VM.

The Pro versions of Windows 8 and 10 come with Hyper-V built-in. Windows Server 2016 Technical Preview supports proper PCI passthrough of the whole controller, but both motherboard and CPU must support VT-d, which isn't likely on desktop-class hardware.

I'd do two 8-drive RAIDZ2/6 volumes if I was trying to maximize available storage space without sacrificing too much redundancy. Otherwise, I'd say it depends on requirements of your application.
Any card that adds host-busses to the motherboard is called a Host Bus Adapter - most HBAs for storage run either no raid at all (JBOD-only, but only some of them support SATA Passthrough which ZFS (and other software RAID?) needs to control write cache), normal RAID, or fake-RAID (these two last you don't want to run with any software RAID like ZFS, BTRFS, HAMMER, or StorageSpaces; and the latter you want to avoid at all costs).
Your solution requires him to use Hyper-V in Windows 10/Server 2012 (which needs its own disk(s)) as a semi-baremetal hypervisor with both host-OS and an appliance guest-OS on top (which needs even more disks), at which point might be more efficient to take a little time and get used to FreeBSD with the handbook, so you can use ZFS directly on the disks (plus ZFS as a root file system, meaning FreeBSD itself will be faster and more reliable) and bhyve for a semi-baremetal hypervisor if he needs it - because, let's be honest here, while most of the appliance OS' that give you a NAS device are quite good, none of them let you get away with much more than simple filesharing without at least a good bit of command-line fiddling.

SAS expanders are enclosures with all disks hooked up to a minimum of two external connectors which makes it possible to provide both daisy-chaining for expandability and redundancy, but require specific storage HBAs that can handle a lot more disks - whereas SAS enclosures are enclosures with one external connector for each four disks which gives you zero expandability or redundancy, but you can use any storage HBA.

IOMMU (the generic name for the technology that Intel and AMD respectively call VT-d and IOV) is available for quite a few desktop CPUs, and has been a feature on non-k Intel CPUs since Sandy Bridge and has been a feature on the higher-end i7 -k CPUs (including HEDT), since Haswell(-e).
I'm not entirely sure that motherboards need to support it, unlike with ECC memory support, for example. EDIT: Turns out that all motherboard manefacturers have to do is enable the feature in the BIOS, at least according to this.


I agree with Horn that if he's looking for a solution that's the least linuxy, going with UnRAID is the best option for now - at least until FreeNAS 10 comes out, which may change things. I also think it's worth mentioning that I don't think this thread will ever come to any consensus about what is best - and we're all too lazy to keep a consistently up-to-date list of pros and cons for which-ever flavour we like - so the best suggestion may be to just tell people to take a little time and try things out, before they settle on a permanent solution.

BlankSystemDaemon fucked around with this message at 21:50 on Jun 8, 2016

eightysixed
Sep 23, 2004

I always tell the truth. Even when I lie.

IOwnCalculus posted:

Synology seems to be reasonably well liked. More expensive than DIY but reasonably quick.

Counterpoint: DIY Xpenology - easiest DIY there is. Done in 5 minutes.

Hi Jinx
Feb 12, 2016
Thanks guys for all the suggestions and advice. I'm up and running with FreeNAS in a VM. It was pretty painless all things considered.

My main gripe is that the mapping between the disks in the VM and the HighPoint LUNs is completely lost. I might be able to build a spreadsheet based on the disk serial numbers, or maybe the GPT IDs, but it's less than ideal. Also, performance is only 60MBps for both sequential read and write, with no apparent CPU bottleneck anywhere. It could be the HighPoint HBA, it could be FreeBSD being FreeBSD, but at this point this will do. I'll probably move to a host with Linux on it in the fall, and run ZFS natively. I would imagine the ZFS disks are interchangeable between FreeBSD and Linux?

IOwnCalculus
Apr 2, 2003





If you're passing through LUNs / VMDKs then you probably can't actually put those disks in a baremetal ZFS setup.

BlankSystemDaemon
Mar 13, 2009



FreeNAS should, in theory, be able to import the zpool directly, but I'm not sure any other appliance NAS can import the pool - and even importing it in FreeBSD is a bitch because of the way FreeNAS uses GEOM to setup partitions and encrypt them (in software, if AES-NI is not available) by default.

Best practices for creating a zpool involve setting the gpt label of the partition to the serial number of the disk before pool creation, then adding devices by label (ie. /dev/label/<sn> instead of /dev/ada0), and putting physical labels on the disks where you can easily see them without taking them out - it can be done after pool creation but involves exporting your pool and importing it with the -d switch.

BlankSystemDaemon fucked around with this message at 08:28 on Jun 9, 2016

Mr Shiny Pants
Nov 12, 2012

Hi Jinx posted:

Thanks guys for all the suggestions and advice. I'm up and running with FreeNAS in a VM. It was pretty painless all things considered.

My main gripe is that the mapping between the disks in the VM and the HighPoint LUNs is completely lost. I might be able to build a spreadsheet based on the disk serial numbers, or maybe the GPT IDs, but it's less than ideal. Also, performance is only 60MBps for both sequential read and write, with no apparent CPU bottleneck anywhere. It could be the HighPoint HBA, it could be FreeBSD being FreeBSD, but at this point this will do. I'll probably move to a host with Linux on it in the fall, and run ZFS natively. I would imagine the ZFS disks are interchangeable between FreeBSD and Linux?

Nope, as mentioned GEOM throws a spanner in the works. Linux, Solaris and OSX are fine.

BlankSystemDaemon
Mar 13, 2009



FreeBSD (through bsdinstall or manual root-on-zfs setup via a shell on the netinstall.iso) is fine too - it's just FreeNAS that uses GEOM, and I can't really fathom why.

Stutes
Oct 13, 2005

Tonight's the Night
Learned an important lesson today: I need to periodically shut down my Synology, remove the drives, and clear out all of the accumulated dust. My HDDs are currently idling 15°F cooler :stare:

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

Stutes posted:

Learned an important lesson today: I need to periodically shut down my Synology, remove the drives, and clear out all of the accumulated dust. My HDDs are currently idling 15°F cooler :stare:

I thoroughly dust all my computers every few weeks with this thing, it kicks rear end. Just make sure your fans don't spin when you blow air on them.

Naffer
Oct 26, 2004

Not a good chemist
I would like a dual NIC 4-bay NAS with easy to use user accounts/permissions. Is the QNAP TS-451 a decent NAS? It's almost half the price of the Synology DS415+.

PerrineClostermann
Dec 15, 2012

by FactsAreUseless

fletcher posted:

I thoroughly dust all my computers every few weeks with this thing, it kicks rear end. Just make sure your fans don't spin when you blow air on them.

That...doesn't seem ESD safe.

Touchfuzzy
Dec 5, 2010

PerrineClostermann posted:

That...doesn't seem ESD safe.

I know three other people, plus myself, that use that thing regularly and I've never had a single problem.

thegoat
Jan 26, 2004
Make that four. That thing is awesome

redeyes
Sep 14, 2002

by Fluffdaddy
I use one of these to blow out my computers:
https://www.amazon.com/Toro-51585-E...ric+leaf+blower

MagusDraco
Nov 11, 2011

even speedwagon was trolled

PerrineClostermann posted:

That...doesn't seem ESD safe.

Well there is an ESD safe version that's not sold directly by amazon (third parties or from the company's website) but :shrug:

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

PerrineClostermann posted:

That...doesn't seem ESD safe.

Has anybody ever actually had ESD issues when working on computers? I never even think about it, even when I'm working on carpet and poo poo

UndyingShadow
May 15, 2006
You're looking ESPECIALLY shadowy this evening, Sir

fletcher posted:

Has anybody ever actually had ESD issues when working on computers? I never even think about it, even when I'm working on carpet and poo poo

I still compulsively touch a grounded surface every time I work on something but no, as far as I know, ESD has never been the component killing boogeyman they taught us to fear.

IOwnCalculus
Apr 2, 2003





Last (and honestly only) time I saw an ESD issue, was gently caress i'm old 16 years ago or so at a LAN party. I forget why but someone was screwing around in someone else's desktop and I believe they fried the RAM.

It might've been powered on at the time too.

Thanks Ants
May 21, 2004

#essereFerrari


I just leave the power lead connected so the thing is grounded.

Saukkis
May 16, 2003

Unless I'm on the inside curve pointing straight at oncoming traffic the high beams stay on and I laugh at your puny protest flashes.
I am Most Important Man. Most Important Man in the World.

fletcher posted:

Has anybody ever actually had ESD issues when working on computers? I never even think about it, even when I'm working on carpet and poo poo

Ages ago we used to have computers with the original Antec Sonata at work and I occasionally wore pants that generated quite a bit of static electricity. I noticed a phenomenon that if I touched the chromed USB port cover on the Sonata it would immediately reboot. What's disturbing is that I couldn't figure any kind of electrical connection from the cover to the computer. It was just chromed plastic cover attached to the plastic case front with about 1 cm distance to the USB ports. Still rebooted every time.

I would wish someone tested ESD. Take an old computer and see how big a static discharge it would take to fry the RAM sticks.

MeruFM
Jul 27, 2010
I converted my always-on computer from windows to unraid and the plex performance has greatly dropped.

Windows, it would take about 2-3 seconds for the video to start. On unraid, it takes around 10 seconds. Is it because it's now running in the docker sandbox? Should I try installing plex as a plugin instead?

Chilled Milk
Jun 22, 2003

No one here is alone,
satellites in every home
The new FreeNAS UI looks pretty nice. Not just visually, seems like feedback and responsiveness is vastly improved.

https://www.youtube.com/watch?v=8TS6vvpP1yQ

Edit: bhyve+docker will be a huge shot in the arm for the ecosystem.

Chilled Milk fucked around with this message at 06:36 on Jun 11, 2016

Furism
Feb 21, 2006

Live long and headbang
Finally got to build my DIY NAS and throw Nas4Free on top. So far I'm quite happy! I went from about 40 MB/s of throughput on my older Synology to 80 MB/s on the new NAS. And it's just faster overall (GUI, listing directories, etc). At 70W it does consume more power though.

I was wondering if anybody had recommendations for the fine tuning of the system? For instance, I'm wondering about the Power Management and Acoustic Level settings - since the NAS is right next to me, it'd be nice to save on the decibels. I'll definitively run some tests to see how that impacts the performance, but any tip could be good to know!

E: Also, SyncThing on Nas4Free is still version 12.x. My other computers run the latest major release, 13x. And those are not compatible. How dangerous would it be to just copy the FreeBSD build manually on the NAS (keeping in mind to keep the correct ownership etc) ?

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!

The Milkman posted:

The new FreeNAS UI looks pretty nice. Not just visually, seems like feedback and responsiveness is vastly improved.

https://www.youtube.com/watch?v=8TS6vvpP1yQ
Definitely looks nice. Hope they're not trying to prevent you from accessing a regular shell to do custom stuff. I really don't like GEOM and a regular shell seems the only way to create traditional whole disk zpools.

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.
Does freenas10 support volume expansion like synology?

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!
FreeNAS uses ZFS. You can enlarge RAIDZ or mirror arrays by swapping drives one after another for bigger ones. You can't expand a RAIDZ by adding more drives to it.

poverty goat
Feb 15, 2004



Newegg in their current promo email has 4tb HGST NAS drives for $139.99

Skandranon
Sep 6, 2008
fucking stupid, dont listen to me

MeruFM posted:

I converted my always-on computer from windows to unraid and the plex performance has greatly dropped.

Windows, it would take about 2-3 seconds for the video to start. On unraid, it takes around 10 seconds. Is it because it's now running in the docker sandbox? Should I try installing plex as a plugin instead?

One of the features of Unraid is it will spin down the drives and only spin up the ones you are reading from. It sounds like maybe this is happening and the extra time is spinning the drive back up. You can turn this off, see if that changes things.

Hi Jinx
Feb 12, 2016

Don Lapre posted:

Does freenas10 support volume expansion like synology?

Kind of. You can't expand it with a single disk at a time and keep everything redundant, but you can add more vdevs to a pool.

So if your initial configuration is:

code:
pool
    raidz
      disk0
      disk1
      disk2
You can add 2 more disks in mirror or 3 more disks in raidz (or whatever you like) and have the new disks expand your pool:

code:
pool
    raidz
      disk0
      disk1
      disk2
    raidz
      disk3
      disk4
      disk5
My config a couple of days ago was:

code:
        NAME        STATE     READ WRITE CKSUM
        poole       ONLINE       0     0     0
          raidz2-0  ONLINE       0     0     0
            sds     ONLINE       0     0     0
            sde     ONLINE       0     0     0
            sdf     ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdg     ONLINE       0     0     0
          raidz2-2  ONLINE       0     0     0
            sdh     ONLINE       0     0     0
            sdj     ONLINE       0     0     0
            sdi     ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0
        logs
          sdo       ONLINE       0     0     0
        cache
          sdp       ONLINE       0     0     0
I added 6 more disks, one for a hot spare and the other five into a third raidz2 array, and pool capacity went from 33 terabytes to 49.5:

code:
        NAME        STATE     READ WRITE CKSUM
        poole       ONLINE       0     0     0
          raidz2-0  ONLINE       0     0     0
            sds     ONLINE       0     0     0
            sde     ONLINE       0     0     0
            sdf     ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdg     ONLINE       0     0     0
          raidz2-2  ONLINE       0     0     0
            sdh     ONLINE       0     0     0
            sdj     ONLINE       0     0     0
            sdi     ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0
          raidz2-3  ONLINE       0     0     0
            sdk     ONLINE       0     0     0
            sdl     ONLINE       0     0     0
            sdm     ONLINE       0     0     0
            sdn     ONLINE       0     0     0
            sdq     ONLINE       0     0     0
        logs
          sdo       ONLINE       0     0     0
        cache
          sdp       ONLINE       0     0     0
        spares
          sdr       AVAIL
So far I'm loving this. By the way guys, I moved to a Linux VM to host ZFS from FreeNAS, and Ubuntu imported the pool perfectly. I did not expect it to as per what was said above, but it worked. Looks like GEOM is just additional metadata and not a fundamental change to the basic disk layout, so Linux just ignores it and ZFS keeps on working. (I wasn't using encryption though, which I imagine would have made this impossible.)

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.
I'd like to build a FreeNAS setup but so far the sticking point is finding a motherboard that supports ECC that is not too expensive, any good options out or on the horizon? Cheapest I have seen are around $200CAD.

I'd like to get a pentium or possibly i3, socket 1151 for the potential for upgrades.

Or if I go with a non-ECC setup am I just asking for problems with freenas/ZFS?

BlankSystemDaemon
Mar 13, 2009



That's a :can: right there - you'll find plenty of people on the FreeNAS forums and elsewhere who are adamant that ZFS doesn't need ECC possibly because they haven't yet observed data corruption caused by a lack of ECC memory, but probably because they misunderstand the nuanced statement of one of the ZFS developers who said that it no more needs it than any other software based RAID needs it, as there are good reasons why every software-based RAID user would want ECC for their memory (although the article only mentions ZFS, it applies equally to all software-based RAID solutions). Ultimately, it's worth noting that ZFS was designed for enterprise storage where data integrety is key, and that it needs ECC because it does not handle memory corruption.
So, can you get away with not using ECC and still have safe data? Science says not in the long run, but since a cloud based backup solution costs as little as 10 bux a month, you can probably justify it since you're going to need a backup solution anyway.

As for systems that'll support ECC, you're gonna be as angry with Intel as every other home builder is, because none of desktop CPUs support ECC for market segmentation reasons. Besides that, ECC also requires motherboard support - so you're probably looking at either a workstation or a server motherboard of some description.
The biggest problem with desktop CPUs is that they don't support that much memory - 32GB being the upper end outside of HEDT - and ZFS is very memory hungry as you ought to have discovered if you've been doing your homework.

BlankSystemDaemon fucked around with this message at 21:35 on Jun 11, 2016

PerrineClostermann
Dec 15, 2012

by FactsAreUseless
ECC is a problem for all use of consumer systems, not just data storage.

phosdex
Dec 16, 2005

There are a number of Pentium and i3 chips that support ECC btw. If you want to go backwards a socket, the 1150 Supermicro x10sl7 is used by a number of people for FreeNAS. There's one on ebay right now for $150 USD, doesn't really state if thats new or used but I would assume used. But that price basically includes an LSI 2308 controller which on its own would be a couple hundred.

phosdex fucked around with this message at 21:58 on Jun 11, 2016

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!

D. Ebdrup posted:

So, can you get away with not using ECC and still have safe data? Science says not in the long run, but since a cloud based backup solution costs as little as 10 bux a month, you can probably justify it since you're going to need a backup solution anyway.
If bitrot via memory doesn't get detected, it eventually ends up in your online backup.

D. Ebdrup posted:

The biggest problem with desktop CPUs is that they don't support that much memory - 32GB being the upper end outside of HEDT - and ZFS is very memory hungry as you ought to have discovered if you've been doing your homework.
A NAS at home doesn't need 32GB. Unless you insist on dedup, which is a big can of worms.

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.
Thanks for the responses on that! I'm thinking perhaps going with a B150 chipset + Pentium 4400 and running something like unraid instead..

All I need is something for a media server/downloader really.

I've been going back and forth between building one and just getting a synology/qnap for ages now.

Hi Jinx
Feb 12, 2016

priznat posted:

I'd like to build a FreeNAS setup but so far the sticking point is finding a motherboard that supports ECC that is not too expensive, any good options out or on the horizon? Cheapest I have seen are around $200CAD.

ZFS won't make things worse than they would be with a cheap non-ECC NAS or a consumer motherboard RAID. Maybe I'm wrong, because the regular scrub runs could actually gently caress up your data due to random bit errors when otherwise it'd be safe on disk? You're probably still better off with ZFS.

In any case, if you can buy Xeons, there's no reason to run consumer level stuff. You can find plenty of used Xeon boards on ebay, with CPU and RAM, even for under a hundred bucks. If that isn't your idea of fun, the next step up would be, as far as I know, an entry-level Xeon board like the ASRock Mini ITX, or a Xeon D board, but I doubt you can pull either off for less than $500 with CPU, and then you'll need to add RAM.

8-bit Miniboss
May 24, 2005

CORPO COPS CAME FOR MY :filez:
If you're going to spend that much anyways, try looking at a Lenovo TS120 (or TS440 on the high end) or a Dell T20. They're regularly on sale at very affordable prices.

Adbot
ADBOT LOVES YOU

BlankSystemDaemon
Mar 13, 2009



Combat Pretzel posted:

If bitrot via memory doesn't get detected, it eventually ends up in your online backup.

A NAS at home doesn't need 32GB. Unless you insist on dedup, which is a big can of worms.
A good backup solution has two very important properties.
1: It offers you previous versions of files
2: It isn't continuous.
This means anything can be restored even with eventual bitrot (which can happen even with ECC memory*, an article that I also linked in my previous post), and that it isn't suceptible to crypto-lockers.

As for ZFS and memory, if you follow the guideline of 1GB memory for every 1TB of raw storage, even a 4x4TB pool in raidz1 would need 16GB memory - and that leaves absolutely no memory for the OS itself, or additional applications that you might want to run.

*: Presumably this applies to any other software RAID that depends on ECC memory for its in-memory corruption protection.

BlankSystemDaemon fucked around with this message at 11:39 on Jun 12, 2016

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply