|
Yeah. ZFS' design is based on a group of load balanced virtual devices. A vdev can be anything between a single disk, a mirror or a RAIDZ device. You can mix vdevs, altho the zpool command line tool will throw an error, requiring you to specify an override flag. I know I've read the justification for that, because it didn't always do that, but I forgot over the years. I ditched OpenSolaris shortly after Oracle got involved.
|
#
?
Dec 8, 2013 01:22
|
|
|
|
| # ? May 29, 2024 21:11 |
|
|
D. Ebdrup posted:EDIT: here is a look into how zpools do parity across disks from my bookmarks. This is an awesome link, I knew raidz was badass but I didn't know it was that badass.
|
|
#
?
Dec 8, 2013 16:56
|
|
|
You likely don't need a ZIL device for even a home lab use case. Maybe an L2ARC in which case I'd argue you should just put it on an SSD and expose that as an ISCSI target instead of bothering with ZFS BS when your primary goal is to learn VMware ESXi. And VCP is progressively getting tougher and your "hands on" experience in a lab won't matter as much as time spent failing in an expensive environment with really complicated stuff. Lots of fairly obscure errors that I honestly never saw popped up on the test because I set things up reasonably typically although making a ghetto lab t a Fortune 50 helped. Maybe a good mix of VMs with bad loads on them could be more useful than a ZFS zpool setup. I would almost recommend a cheap NetApp or something before bothering with ZFS if you're trying to learn VMware stuff given so much is about configuring storage for different scenarios.
|
|
#
?
Dec 8, 2013 17:01
|
|
|
brainwrinkle posted:Are there any decent cases for ITX/mATX custom NAS boxes? I've got an IBM ServeRAID M1015 controller laying around, so I figure I could go with an ITX board (or mATX failing that). I probably only need 4 drives, so something as small and slick as a Synology box would be nice. I've read the past couple of pages, but I haven't seen any recent posts on hardware choices. I have a Lian Li PC-Q08B that am looking to get rid of? I liked it but outgrew the m-itx mobo because I needed more memory for the ESXi box that I am running.
|
|
#
?
Dec 8, 2013 18:25
|
|
|
I guess this is a storage question. I'm looking for a way to automatically back up certain folders on one of my hard drives to a second drive, including files that have been added to those folders since the last backup. I guess that's not a question at all but oh well.
|
|
#
?
Dec 9, 2013 01:01
|
|
|
Yip Yips posted:I guess this is a storage question. I'm looking for a way to automatically back up certain folders on one of my hard drives to a second drive, including files that have been added to those folders since the last backup. You want a program that can do incremental backups - Robocopy on Windows or rsync on Linux But what you really want is backup software that can do all kinds of things like schedules etc.
|
|
#
?
Dec 9, 2013 01:05
|
|
|
Cool. Do you have any recommendations? It's a Windows system.
|
|
#
?
Dec 9, 2013 03:05
|
|
|
Yip Yips posted:Cool. Do you have any recommendations? It's a Windows system. SyncToy comes to my mind, but it might be too simplistic for your needs.
|
|
#
?
Dec 9, 2013 13:27
|
|
|
Robocopy and a scheduled task will keep two folders in sync, no need to make it more complicated than that.
|
|
#
?
Dec 9, 2013 13:39
|
|
|
Keep in mind, if you gently caress up your source files and robocopy syncs, you have no actual backup. Keep the folder in your user profile and use the built in Windows 7 backup or Windows 8 file history.
|
|
#
?
Dec 9, 2013 13:52
|
|
|
True, you could get creative with rotating the target folder based on the day of the week so you always have the previous days file but something like File History is a lot less hassle.
|
|
#
?
Dec 9, 2013 14:18
|
|
|
kiwid posted:Keep in mind, if you gently caress up your source files and robocopy syncs, you have no actual backup. Right - you want something that will let you go back and look at the previous X versions of a file.
|
|
#
?
Dec 9, 2013 14:30
|
|
|
I like to use Cobian Backup for Windows. It uses the volume shadow copy service to back stuff up and it's freeware (the guy's actually trying to sell the source now that he's on version 11). It can do full backups separated with timestamps or incremental backups and it has schedule settings for certain times/days/months or just a timer like every 180 minutes or whatever. I've found that once set up it's very reliable and I've got it running on about a dozen PCs, some with network backups, some with external HDs. The only thing it won't do is delete things from the backup location if you're doing incremental mode.
|
|
#
?
Dec 9, 2013 16:21
|
|
|
Bob Morales posted:Right - you want something that will let you go back and look at the previous X versions of a file. This isn't a big deal for me since what I'm backing up is project files, which I use incremental saves for. Thanks for the suggestions!
|
|
#
?
Dec 9, 2013 18:37
|
|
|
I've used the previous product to Genie Timeline Home and it worked wonterfully. Closest analogue to Time Machine now a days.
|
|
#
?
Dec 9, 2013 19:12
|
|
|
Crashplan. edit: Oops, missed the part where both hard drives are on the same system...I think?
|
|
#
?
Dec 9, 2013 19:53
|
|
|
Thermopyle posted:Crashplan. Crashplan can still handle that actually (backup destination as "a folder"), though it might tend towards overkill there.
|
|
#
?
Dec 9, 2013 19:59
|
|
|
This might sound stupid, but: how does FreeNAS 9 load and run from a USB thumb drive without choking? It seems as though the thumb drive is mounted read-only, so where are my settings stored when it's running? For that matter, how/when does it write those changes so that they're preserved between boots? Is there a way to set up Linux such that it boots from a USB thumb drive and the settings are preserved between boots?
|
|
#
?
Dec 9, 2013 20:37
|
|
|
stray posted:This might sound stupid, but: how does FreeNAS 9 load and run from a USB thumb drive without choking? It seems as though the thumb drive is mounted read-only, so where are my settings stored when it's running? For that matter, how/when does it write those changes so that they're preserved between boots? Is there a way to set up Linux such that it boots from a USB thumb drive and the settings are preserved between boots? Generally there's part of the drive allocated as a loopback device which is bind mounted over configuration files that need to be changed. Pretty much every Linux LiveCD or live distro does this to USB drives these days.
|
|
#
?
Dec 9, 2013 20:39
|
|
|
Combat Pretzel posted:Huh, what? 4000 cycles in over 8000 power on hours being horrendous? When it's rated 300000?! By that rate it'll get only to 13-15% of the rated count, if at all, before going tits up. (--edit: Where tits up would be around 80000 hours, which amounts to 9 years of power on time.) Cycling every 2 hours in a device which is probably always on and not changing power states is terrible. Most of my drives have over 20,000 power on hours and < 20 cycles. The M in MTBF is 'mean', not 'guarantee'. Just because it's rated for <some large number> doesn't mean you should cycle it needlessly.
|
|
#
?
Dec 9, 2013 20:41
|
|
|
stray posted:This might sound stupid, but: how does FreeNAS 9 load and run from a USB thumb drive without choking? It seems as though the thumb drive is mounted read-only, so where are my settings stored when it's running? FreeNAS / NAS4Free / pfSense are all derived from the original m0n0wall project (and the shorter-lived m0n0bsd distribution) - 100% of the bare-minimum required configuration changes are stored in a single file, config.xml. In the really old days when USB sticks were expensive, this was saved to a floppy disk while you booted the OS off of a CD-R. The only writable folder (at least on my NAS4Free Embedded install) is /cf. config.xml lives in /cf/conf/, the bootloader lives in /cf/boot, and the rest of the / filesystem is actually extracted from /cf/mfsroot.gz on boot.
|
|
#
?
Dec 9, 2013 21:12
|
|
|
evol262 posted:Generally there's part of the drive allocated as a loopback device which is bind mounted over configuration files that need to be changed.
|
|
#
?
Dec 9, 2013 21:31
|
|
|
Oookay. I've got a bit of an issue. I'm gearing up to setup my NAS4Free box, and as far as I can tell, the AMD E-350 APU doesn't appear to be supported. Not a huge deal as I have a spare motherboard and CPU that do appear to be supported (additionally, the other board has enough SATA ports that I won't need to use the add-in card that I picked up - which, also apparently isn't supported :P ). The issue is memory. Was reading that for best results, I should have a GB of memory for each TB of storage space. As I'm going to have 2x2TB in a RAID-1 array, and 4x3TB in a raidZ1 array, that would mean I would need a total of 14GB of memory. As 14GB would be difficult to do, we'll go ahead and round to 16GB. Here's the catch: the board I have uses DDR2 memory. 4 slots on the board. To use that board, I'm looking at $300+ for memory. For the same price, I could pick up a new board, more efficient CPU, and 16GB DDR3 memory. Was trying to do this relatively cheaply (the hard drive investment was pretty stiff as-is). Is there a way around this??
|
|
#
?
Dec 10, 2013 07:00
|
|
|
Here's an interesting one. I just stumbled upon an ancient ProZERVER IDE NAS, 12 bays, http://zerver.com/ <--- look at that web 1.0 website. Normally I would take it to the recycler and not even try as there is no chance of getting support, working firmware, a manual with basic setup, etc. What gives me a pause is that I started it right up and was able to get the thing running with stock IP's and passwords. Also that I have a large stack(20+) 500/750gb ide drives I pulled while decommissioning a stack of DVR's within the last week. Now the question I have, is there anyone here old enough to have seen this thing in action, somewhere around 2002? I'm looking for some hard IO numbers, whether I should attach this thing to the network as a data dump and risk my massive porn collection on 10year old IDE drives or blow this thing apart attempting to run VM's off it running suicide RAID. I'm being realistic on this and I know this is an ancient NAS that could blow apart at any moment. But I can't turn down the chance at an extra 5TB RAID for 0$. Am I being realistic or will it all end in tears?
|
|
#
?
Dec 10, 2013 07:36
|
|
|
Psimitry posted:Oookay. I've got a bit of an issue. I'm gearing up to setup my NAS4Free box, and as far as I can tell, the AMD E-350 APU doesn't appear to be supported. What are you basing this on? I can't say I've tried it myself (the only e350 I have is a net book and I haven't tried booting it with nas4free) but a quick Google seems to show people running both it and FreeNAS on it. As far as the RAM, gb-per-tb is nice to have but not required by any means as long as you never turn on deduplication. I have 10gb dedicated to my n4f vm which is up to 13tb usable and even then it still had plenty of free memory. Oh, never turn on deduplication. Ever.
|
|
#
?
Dec 10, 2013 10:08
|
|
|
IOwnCalculus posted:What are you basing this on? I can't say I've tried it myself (the only e350 I have is a net book and I haven't tried booting it with nas4free) but a quick Google seems to show people running both it and FreeNAS on it. If it uses DDR2 I would be surprised if it supported more than 8 anyway.
|
|
#
?
Dec 10, 2013 17:27
|
|
|
kiwid posted:This + 2x 2TB Reds + This. I was looking at the Synology DS214+, over the DS213j - I'd like to buy it before the week is over? Any comments/suggestions? 
|
|
#
?
Dec 10, 2013 18:38
|
|
|
Regarding ZFS chat, I manage three 32TB storage zpools for my work, holding some scientific databases. The pools are almost constantly being written to with new data, but only rarely read from. Each 32TB pool is comprised of 4 RAIDZ2 vdevs of 11 1TB disks. Our problem has become that scrubbing the three pools takes in excess of 30-35 hours (each). Scrubbing a pool while its active results in slowing down IO such that the pool falls behind on its allocated workload. I wasn't involved in the initial construction of the pools, but maybe I can pick your brains about this; Would I be right in thinking that, where regular scrubbing of a 96TB total storage capacity is concerned, many more smaller pools could have been a better approach to the three monolithic ones we have? Each pool corresponds to its physical housing (one pool on a Sun X4540, the other two on a Sun J4500 each), but there wasn't any actual need to do that that I can see. With smaller pools the scrubs would in general finish faster, and writes that were destined for a pool that's taken out of rotation to be scrubbed could instead be send to one of the others until it rejoins the pool of pools. Am I crazy?
|
|
#
?
Dec 10, 2013 19:00
|
|
|
eightysixed posted:I was looking at the Synology DS214+, over the DS213j - I'd like to buy it before the week is over? Any comments/suggestions? I missed this part on Synology's website, but after seeing this, link, I think I'dd definitely go for the DS214+ 
|
|
#
?
Dec 10, 2013 19:21
|
|
|
Except the ds214 is like $500.
|
|
#
?
Dec 10, 2013 19:58
|
|
|
Synology stuff goes j, nothing, + in terms of stuff like CPU, RAM etc. Last generation's + is roughly this generations no-suffix. They've started doing se models now to gently caress that scheme up though.
|
|
#
?
Dec 10, 2013 20:12
|
|
|
Jesse Iceberg posted:
No. I wish I would have made smaller pools than my single gargantuan one the takes 55 hours to scrub each month.
|
|
#
?
Dec 10, 2013 20:17
|
|
|
FISHMANPET posted:Except the ds214 is like $500.  Holy poo poo, you're right. I could have sworn I had seen it somewhere over the weekend for $299. So then, clearly the DS213j is the recommended box in this thread?
|
|
#
?
Dec 10, 2013 20:37
|
|
|
eightysixed posted:
Unless you want to build your own using an HP microserver. The DS213j is probably the best 2-bay home use NAS.
|
|
#
?
Dec 10, 2013 20:48
|
|
|
Thermopyle posted:No. I wish I would have made smaller pools than my single gargantuan one the takes 55 hours to scrub each month. drat it. I guess we're stuck with this set up for now, but doing a full scrub is a massive pain.
|
|
#
?
Dec 10, 2013 22:21
|
|
|
eightysixed posted:
I bought and set up one of these very recently and I’m thoroughly impressed. It performs much better than I expected and the whole user experience in combination with all the available services/packages make me want to replace my Mac Mini + DAS combo with one of the larger Synology models.
|
|
#
?
Dec 11, 2013 00:11
|
|
|
kiwid posted:Unless you want to build your own using an HP microserver. The DS213j is probably the best 2-bay home use NAS. They're very good. But the 4-bay models are far better if you ever think you'll want more storage. RAID-5 math favors using more disks.
|
|
#
?
Dec 11, 2013 00:43
|
|
|
Jesse Iceberg posted:Regarding ZFS chat, I manage three 32TB storage zpools for my work, holding some scientific databases. The pools are almost constantly being written to with new data, but only rarely read from. Have you done anything to speed up scrubbing? Not sure if it would help but if you haven't you could give more time to the scrub and get it over in a few hrs maybe instead of taking the hit for 1-2 days. Look at this http://broken.net/uncategorized/zfs-performance-tuning-for-scrubs-and-resilvers/. If the systems are 24x7 then this might not help but if there are a few hrs a day when they are not used then it might work.
|
|
#
?
Dec 11, 2013 01:11
|
|
|
It took a while but I got my USC-800 NAS setup and declared stable with the setup I've got. Pictures including unboxing are here: http://imgur.com/a/jXlPq In the middle picture I had a Noctua low profile HSF to show that I had maybe 2mm of room compared to the motherboard standoffs connected to the drive cage - that is the height you have to work with from the top of the motherboard PCB up. No point in trying to do a build there although some people reported they could do it, but I have my doubts that'll work long term. Trying to find a place to keep the board steady while working on it proved pretty hard. I'd recommend a good ESD mat but in a bid to save myself $40, I wound up blowing $240 of hardware given I really hadn't blown stuff out when using an ESD wrist strap. In this case it was really easy to accidentally make board contact with the case, which fried it fast. I switched the motherboards from the Gigabyte I had after I fried that and another one afterward because ASRock shipped their mini ITX Haswell C224/C226 boards. I opted for a C224 given I didn't care to pay $20+ more for features I won't use. Part list: CPU: Haswell i3-4130 Motherboard: ASRock E3C226D2I 2x8GB DDR3 UDIMMs (Samsung) LSI 1068E SAS controller (because I've spent too drat much on 2TB drives and won't buy more until enough die out) 4 WD 2TB Green Drives across all four generations (WD20EACS/DS/RS/RX!), 2 WD Red currently swapping to 4 Samsung Spinpoint F4 Software: FreeNas 9.1 The software was possibly a bigger pain than the hardware mostly because the chipset is so new but also because my network was really flakey for reasons I now root-caused as my new Apple Time Capsule firmware that I can't revert backwards to (yes, I'm going to have a large capacity NAS AND a Time Capsule). To get FreeNAS working with the USB ports, you'll have to disable USB 3.0 (OHCI) in the BIOS and go back down to USB 2.0. Network-wise, I might have to go back to my Asus RT-N56U for wired connectivity and the Time Capsule for wireless despite the whole thing putzing out. Plex for FreeBSD works surprisingly well... until you try to use soft subtitles, which will make Plex crash. I found a couple other cases that were just flakey and I've since gone with running Plex on a Mac Mini connected to the NAS and it's worked better (aside from the network dropping out repeatedly). The good news is that FreeNAS 9.2 is bringing forth Linux jails and I should be able to run Plex off of that instead of dealing with the FreeBSD port's bugs from lack of certain libraries. That and I use Dropbox as part of my workflow and the lack of a FreeBSD port of Dropbox kind of cramps the pipeline I made.
|
|
#
?
Dec 11, 2013 03:17
|
|
|
|
| # ? May 29, 2024 21:11 |
|
|
Thermopyle posted:No. I wish I would have made smaller pools than my single gargantuan one the takes 55 hours to scrub each month. What is this activity and why does one do it?
|
|
#
?
Dec 11, 2013 05:15
|
|