|
xgalaxy posted:If I have 15x 750GB drives what would be the optimal raidz2 configuration? With 2 raidz pools, you can combine them into a single zfs pool, and can even expand the pool later with another 7 750GB drives.
|
# ? Jul 3, 2010 06:50 |
|
|
# ? May 22, 2024 17:57 |
|
Combat Pretzel posted:What the gently caress is it with recent SATA drives? I think we came to a point where the industry has come to consider mechanical hard drives as replaceable, and to the average consumer, infinite in size. I can see where hard drive manufactures will think to themselves - why make a 2TB drive reliable, nobody will ever fill it? Plus, considering that most consumer drivers are under $150 now-a-days, why should they even try?
|
# ? Jul 3, 2010 07:02 |
|
adorai posted:If it were me I would do 2x 5+2 raidz2 pools w/ 1 hot spare, leaving you with a single zfs pool w/ an effective size of 7.5Tibi, which is more like 6.5 TB. If you don't really need the iops you might be able to do a single 11+3 raidz3 w/ a hot spare. This is storage for an htpc serving video and audio data. I'm not sure if I would need incredible amounts of iops. At first glance the 11+3 sounds appealing, but looking further it's really only increasing my usable capacity by another 750GB. Are there any other advantages? Are there any advantages to the 5+2 setup? (eg. can one of the pools spin down if its not being utilized). Thanks.
|
# ? Jul 3, 2010 07:19 |
|
xgalaxy posted:it's really only increasing my usable capacity by another 750GB. Are there any other advantages? Are there any advantages to the 5+2 setup? (eg. can one of the pools spin down if its not being utilized).
|
# ? Jul 3, 2010 16:18 |
|
Also about the PSU, if you're running that system 24/7 and accessing it frequently, the cost of electricity may need to be considered. When starting up that machine from cold (or hell, warm) boot, it'll use a lot of space unless your controller supports staggered spin-up. Anyone have a recommendation on Solaris compatible (or LiveCD) burn-in software for RAID arrays? My usual deal of testing out drives individually before putting them in an array might not work so hot now I think about it. Even then, I just have a script that loops around the drive doing dd reads and writes back and forth from the first sector to the last, and that's pretty lame.
|
# ? Jul 3, 2010 19:58 |
|
I'm getting random file system corruption on my RAID array. The RAID controller seems the most likely culprit. How can I go about testing/narrowing things down? Neither Windows nor the controller software are reporting any sort of events; I just have random corrupt files and chkdsk errors.
|
# ? Jul 3, 2010 20:51 |
|
adorai posted:With 2 raidz pools, you can combine them into a single zfs pool, and can even expand the pool later with another 7 750GB drives. So I was thinking about the same thing a few days ago but, never got around to testing it If I have a parent zfs pool tank which is composed of a single raidz pool, I can just continue to expand the tank pool by adding other raidz pools under it. Essentially creating a growing drive while maintaining raidz protection of my data? Basically trying to get a large pool of protected storage from jbods (in the literal sense of a pile of unused drives) ATLbeer fucked around with this message at 21:47 on Jul 3, 2010 |
# ? Jul 3, 2010 21:34 |
|
ATLbeer posted:So I was thinking about the same thing a few days ago but, never got around to testing it Yeah. You start with a single zpool composed of a raidz vdev. You can add additional vdevs to the pool, provided each vdev is of the same type. So you could have a 4+1 raidz vdev, a 6+1 raidz vdev, and a 2+1 raidz vdev all in one big pool, and ZFS gives no shits. It might have funny performance as it hits each vdev in turn hunting for the files in needs, but it'll work just as reliably as a homogeneous pool of 5+1 vdevs.
|
# ? Jul 3, 2010 23:44 |
|
Concerning an opensolaris install; Is there an optimum bios configuration I should be using a guide? I have a ta785ge mobo, and while I can get it to install/boot to/from a sata device, trying to use IDE results in failure in getting fdisk started during the gui install from the live cd, yet I can still see the ide device in the format utility and so on... (Ideally I want to install to an IDE drive while making a zpool of 6x1tb sata drives).
|
# ? Jul 3, 2010 23:58 |
|
Methylethylaldehyde posted:Yeah. You start with a single zpool composed of a raidz vdev. You can add additional vdevs to the pool, provided each vdev is of the same type.
|
# ? Jul 4, 2010 02:17 |
|
Methylethylaldehyde posted:Yeah. You start with a single zpool composed of a raidz vdev. You can add additional vdevs to the pool, provided each vdev is of the same type. So you could have a 4+1 raidz vdev, a 6+1 raidz vdev, and a 2+1 raidz vdev all in one big pool, and ZFS gives no shits. It might have funny performance as it hits each vdev in turn hunting for the files in needs, but it'll work just as reliably as a homogeneous pool of 5+1 vdevs. I haven't done this in a while and I think I'm forgetting something here I have created a bunch of files to use to create my raidz vdevs code:
code:
|
# ? Jul 4, 2010 02:31 |
|
You created two pools. You want to create one pool comprised of the two vdevs:code:
|
# ? Jul 4, 2010 02:40 |
|
lilbean posted:You created two pools. You want to create one pool comprised of the two vdevs: Thanks
|
# ? Jul 4, 2010 02:46 |
|
I realized I have enough spare stuff around that I can build a FreeNAS box with enough storage to fit everything important on it (possibly everything if I can find a my 4th 300gb drive, or get a good compression ratio). Unfortunately, my spare stuff does not include a CD drive, and trying to install FreeNAS without using a CD drive is not making me happy.
|
# ? Jul 4, 2010 03:15 |
|
Any tips for maintaining throughput with ZFS compression enabled? I'm stuck with 100mbit ethernet for now, so things aren't exactly blazing along in the first, and enabling gzip compression cuts throughput another 10-20%. It's not a CPU limit; at gzip-6 it's not even breaking 15% usage.
|
# ? Jul 4, 2010 07:11 |
|
Ok.. I need a recommendation here.. 2 trips to Fry's and two strike-outs on PCI eSATA cards. Both used Silicon Image chips (3512, 3112) and both will only recognize the first drive on my array with a SATA multiplier. I've been going through NewEgg trying to find other cards not using the SIL chipset and finally found one http://www.newegg.com/Product/Product.aspx?Item=N82E16816124011 But, eventually found buried in the reviews http://www.newegg.com/Product/ProductReview.aspx?Item=N82E16816124011 quote:Thank you for purchasing our products. We apologize for any inconvenience. The eSATA port only works with regular enclosure with one hard drive. Please make sure the external storage device you use does not have a port multiplier which have more than one hard drive (RAID tower enclosure or similar). All of our products come with at least 3 years warranty. Please don't hesitate to contact us at support-us@syba.com for replacement. All I'm looking for at this point is a PCI card that gives me a SATA (I have a SATA-eSATA cable) or eSATA port which works with a downstream SATA multiplier. Sigh..
|
# ? Jul 5, 2010 20:15 |
|
ATLbeer posted:Ok.. I need a recommendation here.. http://desc.shop.ebay.co.uk/i.html?LH_TitleDesc=1&LH_AvailTo=3&_nkw=sil3124 thats probably a good starting point.
|
# ? Jul 5, 2010 20:25 |
|
HERAK posted:I had the same problem a few months back you need something with the Sil 3124 chipset and the latest bios and drivers from the silicon image website. I eventually found a card from a seller in hong kong via ebay. This is probably your best bet not to be ripped off. Thanks for the insight on the right SIL chipset to get. Looking through SIL's website the chipset you mentioned seems to support what I need http://www.siliconimage.com/products/product.aspx?pid=27 NewEgg has SIL3124 products but, they are all SYBA... http://bit.ly/9KkINt Eeny, meeny, miny, moe.... Which one will be card purchase #3 Just found this guy... http://www.newegg.com/Product/Product.aspx?Item=N82E16816321010 Here's another one but, actually has very promising reviews for a function almost identical to mine - http://www.newegg.com/Product/Product.aspx?Item=N82E16816318004 ATLbeer fucked around with this message at 23:54 on Jul 5, 2010 |
# ? Jul 5, 2010 23:45 |
|
Zhentar posted:Any tips for maintaining throughput with ZFS compression enabled? Solution: use more than one thread New problem: FreeNAS SMB is incredibly slow. When I'm copying one or two large files, I have no problem saturating my network connection. But many smaller files, like 100k sized, and a 32-thread robocopy only hits 1-2 mbit/s. Getting the folder size/file count for a directory with 71,000 files took over 10 minutes.
|
# ? Jul 6, 2010 15:35 |
|
So, I've managed to get a crap load of DDR3 ECC BUFFERED ram (From a server install) Does anyone know of a motherboard that can support this ram ?
|
# ? Jul 7, 2010 03:15 |
|
In the past month or so since I have been running my new DIY "old parts" server I have managed to consume almost all its available space. I am going to be transitioning some stuff to a new setup shortly. Can I unplug my current RAID drives, stick them into another system, and copy the mdadm.conf file and have everything mount like normal with the proper fstab adjustments? DEVICE partitions ARRAY /dev/md1 level=raid1 num-devices=2 metadata=0.90 UUID=54a70d7b:e0a91f8f:b9f21045:e87bad95 ARRAY /dev/md0 level=raid1 num-devices=2 metadata=0.90 UUID=ba244485:c25e2ff9:c1811b64:f9cf9fcb Do UUIDs identify the same partition/device inside any system as long as the data on the drives is still intact?
|
# ? Jul 7, 2010 06:48 |
|
dietcokefiend posted:In the past month or so since I have been running my new DIY "old parts" server I have managed to consume almost all its available space. I am going to be transitioning some stuff to a new setup shortly. Yes they do if worse come to worse you can still assemble the raid manually (mdadm --assemble /dev/md0 /dev/sda1 /dev/sdb1 /dev/sdc1)
|
# ? Jul 7, 2010 10:06 |
|
dj_pain posted:Yes they do if worse come to worse you can still assemble the raid manually (mdadm --assemble /dev/md0 /dev/sda1 /dev/sdb1 /dev/sdc1) Can any improper mdadm.conf loading or assembly commands gently caress up a RAID array?
|
# ? Jul 7, 2010 16:31 |
|
dietcokefiend posted:Can any improper mdadm.conf loading or assembly commands gently caress up a RAID array? I can't guarantee for sure, but I've done both with my array and worse (created a logical volume on top of the raid volume and had to repair using xfs_repair). My raid was also automatically created using 2, 3 and 4 devices at some points. I had to remove the devices each time. Even when I had to re-synch due to some of these errors, I never lost more than 2 drives at once, so I would say you're good. Oh I just noticed you are using raid1. I still think you're good.
|
# ? Jul 7, 2010 16:39 |
|
It worked without any problems
|
# ? Jul 7, 2010 23:41 |
|
How much of a sucker would I be for buying either a Drobo S or Drobo FS for my home backups/media serving? It seems horrendously overpriced to me, but I really don't want to deal with setting up my own home server. The built-in Time Machine support for my Macs and ease of setup definitely seems attractive. Other similar 4-5 bay NAS/DAS devices all seem like enterprise-grade, unintuitive wind-tunnels. I've got 5 2TB WD RE drives sitting here begging to be used.
|
# ? Jul 7, 2010 23:52 |
|
Get a Synology unit, dont look back
|
# ? Jul 8, 2010 00:00 |
|
dietcokefiend posted:Get a Synology unit, dont look back edit: I suppose their 4-bay stuff is a lot more affordable. Star War Sex Parrot fucked around with this message at 02:02 on Jul 8, 2010 |
# ? Jul 8, 2010 01:58 |
|
dietcokefiend posted:Get a Synology unit, dont look back Quoting this because I'm very happy with my DS210J after spending months looking for an affordable NAS. Right now I'm using it as a UPNP server to stream video to a WDTV and Xbox 360, accessing shared volumes via AFP on our two Macs, using its Time Machine service for backups, and running the "DSAudio" service for remote streaming access to my music. It's small, quiet, low-power, stable, and pretty drat fast over gigabit LAN. I also love how much you can tweak and configure it. In the interest of full disclosure I've also had a few issues with it:
|
# ? Jul 8, 2010 03:07 |
|
Star War Sex Parrot posted:I'm in almost the exact same boat. Synology offers two 5-bay units, as far as I can tell. The DS509+ is 6 years old and discontinued, while its new replacement the DS1010+ is still $1000. I think I'll go with a Drobo. Technically you could get this: http://www.synology.com/us/products/ds410/spec.php And put the 5th drive in an external bay connected via eSATA and create a 5 disc RAID5.
|
# ? Jul 8, 2010 03:10 |
|
Ok, so I'm in the market for a network NAS/file server/etc and remembered/started looking at the drobo, trying to compare it vs freenas, etc. So I popped on here and saw at least one vocal critic against the drobo, and several recommendations for Synology, which I checked out but seems to have hard limits to the max space available (basically # of bays * 2GB, presumably no drive can be bigger than 2GB). Drobo, on the other hand, advertises "Easy Expansion to 10TB and Beyond" but doesn't really expand on that. I'd like to buy something that will hopefully last long enough to scale with ever-increasing storage needs, and so far the drobo seems to fit the bill. Yes, I realize that the idea of keeping a piece of modern hardware around for that long is a pipedream, but humor me. That aside, how is the throughput on the new Drobo FS?
|
# ? Jul 8, 2010 05:41 |
|
Zhentar posted:New problem: FreeNAS SMB is incredibly slow. When I'm copying one or two large files, I have no problem saturating my network connection. But many smaller files, like 100k sized, and a 32-thread robocopy only hits 1-2 mbit/s. Getting the folder size/file count for a directory with 71,000 files took over 10 minutes. Updates: -I disabled "Remote Differential Compression" on the advice of internet forums. I then found out Microsoft says this shouldn't matter at all. I'd swear it's avoided some long delays I'd been experiencing. I'll have to revisit it and test more thoroughly later. -Speaking of inaccurate internet advice, the oft-supported setting included in the FreeNAS system tuning, net.inet.tcp.delayed_ack=0. Eyeballing wireshark logs, setting that to 1 got me somewhere around 30% improvement for querying file details. I can still get a directory listing off of my old XP laptop on 100mbit well over three times faster than my FreeNAS box on gigabit.
|
# ? Jul 8, 2010 06:42 |
|
Zhentar posted:I can still get a directory listing off of my old XP laptop on 100mbit well over three times faster than my FreeNAS box on gigabit.
|
# ? Jul 8, 2010 13:02 |
|
adorai posted:Historically, FreeBSD has had poor CIFS performance when compared to solaris, linux, or windows. So I've been gathering. Wish I'd known that before I let you guys sell me on ZFS/FreeNAS.
|
# ? Jul 9, 2010 01:36 |
|
Zhentar posted:So I've been gathering. Wish I'd known that before I let you guys sell me on ZFS/FreeNAS.
|
# ? Jul 9, 2010 02:52 |
|
Oh yeah. You can do that. That would make migrating much easier...
|
# ? Jul 9, 2010 03:40 |
|
Found a quick and dirty method of dropping my server case temps. Moved my server from my first floor into my dark cold basement in a corner. CPU used to idle around 66C, now its around 60C. HDD temps are also down about 2-3C.
|
# ? Jul 9, 2010 03:58 |
|
Any opensolaris users out there give a quick bit of advice? In the process of moving from an old antecII case with a 4x1tb raidz1 to a new case with 6x1tb raidz, using a pci-e 1x card with two addition sataII controlled by a sil 3132 (thought it was opensolaris compatible...) on svn_134. (destroying 3+1 array and recreating as 5+1) Anyway, how do you install such a card? Very open-solaris newbie here, and plug-and-play (and reboot) don't seem to cut it... not seeing the two additional drives in the format utility, nor any updates appear in the package manager. Bonus: new case has a bit of... split personality, 30$ newegg special + coolermaster 4-in-3 adapter. Off: Click here for the full 1200x1600 image. ON Click here for the full 1200x1600 image. How I hate blue LEDs,.. I'll take a peek to see if I can cut them out later. Sorry for crappy iphone pics, real camera busy doing this
|
# ? Jul 9, 2010 07:28 |
|
Netgear announced their new ReadyNAS Ultras today and they've got me rethinking that Drobo, but ouch at the price: http://www.engadget.com/2010/07/08/netgears-readynas-ultra-4-and-ultra-6-stream-to-tivo-mobile-a/
|
# ? Jul 9, 2010 07:31 |
|
|
# ? May 22, 2024 17:57 |
|
What do you guys recommend for meeting these requirements: * Small/compact size (something like a enclosure form factor). Mid tower is too big. * Low power requirements. * Quiet * Samba support. * Treat all drives as one giant source but not in a raid setup. Meaning if one drive fails only the data on that drive is lost, not all drives. * 4 bays capable of hosting 2tb drives per bay * Gigabit connectivity with decent throughput. * As a bonus but not required ability to host apps such a newsgroup client and/or media server (Twonky). * SSH/SFTP support would be nice too
|
# ? Jul 9, 2010 23:36 |