Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

roflsaurus posted:

do you have any links on how to recover from a software raid array on another machine? i'd like to see how easy / hard / problematic it is before i decide software or hardware raid.

My last server ran Windows Server 2003 with software raid 5 (8x160GB). To create it, I even used the XP hack to allow the ability to create raid 5 arrays. I then did the best I could to simulate it breaking. As long as I didn't lose more than a single disk, it recovered from all my attempts successfully. Even When I dropped 2 disks at the same time (these were pata drives - 4 channels with 2 drives on each channel), simply hooking one back up allowed me to access the array.

Once I was satisfied, I blew away the XP install and installed Server 2003 instead. Once I put the drivers for my disk controllers in, it automagically detected the array (I might have had to go into disk management and import a foreign disk, but I don't think I did). Later I moved it to a new motherboard with the same results.

All in all I was quite satisfied with that array - it survived 5 (I think?) disk failures over it's lifespan and I never once lost data. In fact I keep that whole box around and fire it up every now and then to back up important stuff on my current array. You can replace disks with a larger one and can create new partitions on the unused space (even adding the new partition into a different raid array if you wish). The only real issues were that you can't have the OS on the array and that I don't think there is any way to expand it if you replace everything with larger disks.

Adbot
ADBOT LOVES YOU

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
If you use both arrays at the same time, it kills performance. I ended up replacing 2 of the 160 drives with 250s (they just happened to be the cheapest >160 I could find at the time) and made a scratch space raid 1 array out of them to play with it. Copying from that space to the actual array was sloooooooooooow. Would be good for something low impact like porn overflow I guess :D

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

cypherks posted:

No, I'm totally not trolling. I was just thinking of my own home array, which will have 10 disks in it when done. I just don't see the need for backing it up. The odds of having 2 disks go bad at the same time, or two before I can fix one, I think are pretty darn low.

Now, something at work, of course, there are lots of reasons, such as what you mentioned above. I guess I should have asked "Why are you backing up your home R5 array". I'm just curious.

The more disks you have in an array, the greater the chance of multiple failures.

My old 8x160 array died 3 times over the course of the 4 years it was in service. Granted, 2 of those were because the RAID card was a POS, but if I didn't have backups (and I didn't for a majority of it) then the data was gone. The 3rd was just bad luck - a drive died and I slapped in a spare within 4 hours. A couple hours into the rebuild a second drive failed on me. In my case, the stuff that wasn't backed up was online DVD rips of my collection - all it took was the time to rerip them.

Nowadays I have 2 arrays - 4x1.5tb and 5x500gb. I had them both going in my server, but since I'm only using about 2.5tb of total space, I ended up putting the 5x500 in a spare case and set the auto power up on the mobo to once a week. Now it boots up, makes a copy of the folders I really care about as well as a chunk of stuff that isn't really a big deal and shuts back down. It is painless and it was equipment that I wasn't using so why not?

For really important documents I also use Windows Live Mesh to get a copy into the cloud (in Truecrypt volumes for anything sensitive) and from time to time I make a copy of the tc volumes on DVDR just in case of corruption.

I'm probably overkill, but I'd rather do too much than not enough.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

frunksock posted:

Yeah, this is going into a Antec P150, and I'd prefer not to have to Dremel anything, unless there are no products that fit without doing that. I'll comb the Solaris HCL if there's not a card the Solaris people here like.

I have no experiance with the P150, but on my Antec 1200 I had to Dremel the tabs off to get them to fit (I use two Icy Dock 5 in 3s, but at nearly the same price you get a bigger fan with the Supermicro. I just caught a deal at $75 a pop that I couldn't pass up). If you don't want to cut, you *might* be able to use a 4 in 3 similar to this. It really just depends on how big your tabs are.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
I've been out of the loop lately, but it is getting to the point where I'm going to need to do *something* with my (mostly media) fileserver at home in the next few months.

Right now it is running two 4 drive software RAID 5 arrays under Server 2008 R2, but I'm getting awful tired of having to buy hard drives in bundles of 4 matched sizes instead of just getting what is cheap when I need the extra space.

Looking at what is coming up in the near future, what is the skinny on Windows 8/Server 2012 Storage Spaces? My Google-Fu seems to be failing me... Is it looking like it might be a viable option if performance is a non-issue or should I be looking at something like unRAID or Drive Bender? I'd prefer to stick with Windows, but if it makes sense I'm willing to move to something *nix based.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Drizzt01 posted:

It is not out yet but consumer preview 2 is. You can download it on Microsoft's website and try Storage Spaces yourself. I do not know if there will be an upgrade path to RTM when it comes out.

I've done a little bit of playing with the Server 2012 Release Candidate on VMware Workstation and it looks like it will do what I want.

I haven't completely digested it, but it looks like by default the "Parity" setting splits data into 3 chunks - two striped data and one parity. Apparently you get more control if you create it via PowerShell. I'm going to play with it tonight, but since I'd rather have closer to the 25% parity hit I have today if I can make it 3 striped data and one parity I think I'll switch once it is RTM. More info

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
Is there a "go-to" card to just get a ton of SATA ports for a Windows system cheaply?

With Server 2012 going RTM early next month, I'm thinking about migrating my two w2k8r2 software RAIDs over to use Storage Spaces instead.

I've got 2 5 bay ICY Docks in the case right now with room for a 3rd and would like to all the drives on the same controller card if possible. So I'm looking for either 10 or 15 total ports as a minimum. I also want SMART capability in Windows (my current card doesn't seem to support it)

Cheap but not crappy is what I'm looking for here... :)

edit: Forgot to say I want PCI Express.

Fancy_Lad fucked around with this message at 17:38 on Jul 16, 2012

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
Thanks for the suggestion!

Sorry if I'm slow here, but I've been out of the controller hardware game for a loooong time.

I did a little bit of searching over my lunch break and it looks like since the card just has 2 SAS ports, my options would be a couple SAS to 4 port SATA cables (8 drives total) or I would need an expander to get 10-15 connections out of it?

The manual doesn't have much info about the expanders, but lists an "LSISASx12 Expander". The only thing I've found for sale with that search term is this and it looks like that is just the chip, not an actual board. I did find some forum posts pointing to a HP SAS Expander and this Intel Expander as being compatible, but at ~2-3 times the cost of the m1015 for one of the expanders I think I would compromise on doing a single card and just do 2 m1015s instead.

Am I on the right track here?

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

evol262 posted:

Sorry for jumping to conclusions, there. Yes, it's 2.0. You can happily put it in a x4 slot.

...And now I remember why I had a single card in mind. The mobo for my file server is an old Gigabyte 780G board that has some crazy PCIe slots. One of the PCIe x16 slots actually only runs at x4 and shares bandwidth 2 other slots. Guess I have some research to do to see if 2 m1015s will even work on it or not...

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
I had posted a few pages ago about what controller card to look at if I wanted SMART information in Windows and was recommended an IBM M1015. Someone finally posted a batch of them for ~$70 on eBay and I got it in the other day.

It looks like SMART data is kinda a pain to pull off the card (at least with stock and IT firmware). I can get it to pull by using smartmontools with the "-d sat" options and, by extension, GSmartControl so it is available. I just don't see myself manually pulling the info very often. Really what I was thinking was some sort of "set and forget" solution where it will just email me if it detects an issue. Like Arconis Drive Monitor.

I can't seem to find any software that can pull SMART data and email if it detect a potential issue. Any suggestions?

Random: Boy that M1015 is very picky about what boards you can use to flash it. Nothing in my house (all AMD stuff) would do more than freeze attempting to do the erase. I took it into work and dug up an old Optiplex that did it first go.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Longinus00 posted:

I have no idea what your last sentence means.

I'm pretty sure he means that he wants something with drobo-like functionality where you can have lets say a 1TB, 2TB, and a 3TB drive with parity protection. Once you start running low on space, you just pop in whatever you can pick up on sale and it adds it into the pool. This is exactly what I want as well.

I've been playing with Win8/Server2012 Storage Spaces thinking this would be the solution for this, but the more I play with it the more it just seems unfinished. The deal-breaker issue for me is as near as I can tell there is no way to gracefully evacuate a drive. You can "retire", but this just essentially puts the pool in a degraded state and starts the rebuild process as if the disk had died. This means if you have smart errors on a drive or run out of bays and want to upgrade a smaller drive you will need to cross your fingers that you don't lose a disk after you retire it - if so you may be hosed. Here's to hoping it is addressed in sp1 I guess *sigh*

Ruling out Storage Spaces it looks like the options are a drobo (and I've heard some scary stories about this), add-in stuff like flexRAID that is scary in its own "hacky" way, or unraid that I haven't played with yet.

I foresee more dropping $500+ every time I need more storage to get a new set of at least 4 drives to raid5/Z in my future. :(

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Longinus00 posted:

I believe synology has a very similar feature. Basically an automatic way of splitting raid volumes over heterogeneous disks to maximize redundant space with LVM on top. http://www.synology.com/dsm/highlight_synology_hybrid_raid.php?lang=us

Very nice... I suppose if you can get away with 4 bays and don't have anything currently this is a good solution. If you are looking at the whole picture for cost savings, the 8 bay units aren't quite such an easy sell if you are willing to roll your own... Especially if you have some old hardware sitting around that could be re-purposed to some sort of file server.

Longinus00 posted:

ZFS is pretty incomparable to those other raid solution. It offers checksumming among other things which have influenced its design enough to make it hard to add features such as "shrink a volume". If you are comparing it to solutions without such features maybe you could have just used a ext+mdraid solution which is way more open to things such as removing disks and shrinking. Maybe in a year once btrfs supports parity levels beyond mirroring you'll get the best of both worlds but until then the difference in how zfs and other raid solutions handles your data is pretty wide.

Oh, I'm not complaining that it isn't a feature of ZFS, I just put ZFS in there since it seems like the best solution if you have already resigned yourself to the idea that you are going to need to buy a bunch of like-sized disks for your next upgrade. Yeah, ext+mdraid is more comparable - I've got a few Windows-only things that my 24/7 server does so I'm currently using Windows Server RAID5 for my bulk media storage that is very similar.

I've been thinking about upgrading the server to an AIO ESXi based solution so I've been looking at what other options there are for everything I do right now. I'm just venting that heterogeneous disk pools aren't as simple as I figured they would be by this time.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
Just a heads up as it seems there are several folks in this thread that have been looking for IBM M1015 cards. There are a bunch on sale for ~$75 shipped on ebay right now:
http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&item=380492923084&ssPageName=ADME:B:SS:US:1123

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

FISHMANPET posted:

Anyone have a good source for brackets for those?

I have an M1015 right now (ordered a 2nd with that auction) and when I got it in, I went digging through my box of old pci cards for brackets. I found that a lot of them have screw holes in the same places, so if you have a stash of old stuff sitting around you may be able to find something that works for free.

Barring that, I would just use it without one but ebay tends to have several for sale for ~10 each at any given point if you are really concerned.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

FISHMANPET posted:

As much money as I've already thrown away on hot swap enclosures, my next NAS is getting built around this: http://www.newegg.com/Product/Product.aspx?Item=N82E16811219038

Yeah, I would have saved money and pain just starting there instead of my Antec 1200 plus 5 in 3 Icy Docks. Oh well, they have served me well...

Old pic as I now have 3 Icy Docks in it and have since got rid of the dumb blue led fan. Not pictured: using my Dremel to cut off the stupid tabs on each of those 5.25 bays so the Icy Docks would fit. Ugh.

Only registered members can see post attachments!

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Megaman posted:

These have backplanes and can failed the drives if they poo poo the bed, why would you want anything with backplanes?

2 have been running for 5 years and change through a couple different cases, 1 for about a year. In that time I have had 0 backplanes failures of any kind with the icy docks and somewhere around 5 drives fail and have flipped out multiple drives while upgrading capacities. Worth it to me for the ease of changing drives out. Biggest hardware failure during that time has been a controller card and when I put in a new one the array was fine (yay software raid). Anything important is backed up anyway so it is just for ease of use.

Why I went that route to begin with was a cheap way to add some 3.5 drive bays to rip some of my most watched dvd collection, but once I started ripping my media I went all out on it and shortly after needed more bays. Once I started down the path, it became harder and harder to justify anything from a cost perspective other than keeping on the path...

I am confused by this statement, though... Is that NORCO not using a backplane as well?

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Combat Pretzel posted:

With 9TB of usable diskspace, I'd suggest a hardware RAID with battery backup. The last thing you want to deal with is the array rebuilding after a stupid power outage. This'll be dragging your performance down for almost forever.

Windows' software-RAID does the same poo poo. At some point I got tired of the disks going on a semi-eternal grind every time the power grid gets a poo poo fit.

Ignoring the 3rd world power grid you appear to be dealing with, wouldn't one be able to buy like 3 quality UPS units for the price of a hardware RAID card with battery backup?

Just plug in the cable and set the OS to shutdown once the battery hits whatever threshold and you shouldn't really have to worry about this particular issue again...

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
Has anyone played around with Xpenology? It is the Synology OS based off of their GPL code, so should be kosher from a legal standpoint.

For the hell of it, I spun up a VM on my ESXi system and gave it some disks using this Idiot's guide:
http://xpenology.com/forum/viewtopic.php?f=2&t=558&start=40#p1632

Initially it was just to play with it as I had never messed with any of the Synology stuff before, but I must say that the Synology Hybrid RAID with 2 disk redundancy is a pretty darn slick looking feature. I'd much rather be able to just buy whatever disk I can find on sale at the time whenever I need to add more space to my fileserver rather than having to drop a few hundred bucks on a full array of like-sized disks when expansion time comes.

I want at least 2 disk redundancy (which rules out Unraid). I have concerns about support on Xpenology, but getting actual Synology hardware that would handle the amount of drives I'd like to run would nullify any price advantage that I might gain vs just full arrays and RAIDZ2.

Are there other options out there with similar functionality?

I have a Server 2012 R2 Preview VM I'm planning on playing with next to check out the dual parity option in Storage Spaces. Is btrfs a viable option yet? Been out of the loop for a bit...

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Krailor posted:

If you already have a N40L you should really consider giving XPEnology a try. All the benefits of the Synology software without any extra hardware to purchase.

I'm running it on my N54L and it's been seamless.

How long have you been running it? Have you had actual disk failures? I posted last page about trying out the VM version of it and I'm interested, but not sure I actually want to go all in on it...

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

parsleyc posted:

Does anyone have an opinion on the Toshiba PH3300U-1I72 3TB drive?

It's one of Shell Shockers at NewEgg today.

At $40 less than a 3TB WD Red with a similar 3-year warranty, it seems like a great deal. I'm thinking of purchasing getting a couple for my UnRaid setup.

They had combos this morning for the same drive plus a 16 or 32GB flash drive for 92/95 shipped. I nabbed 4 of them, so I guess I'll see :)

The slickdeals thread on it said they are Hitachi drives that are just rebadged. It is slickdeals, so take that for what it is. If true, I have had 4 Hitachi 2TB drives running fine in a software RAID5 array since March 2011 with no failures or SMART errors.

I was going to give a heads up to this thread about the deal, but they deleted the combos about 2 minutes after my order. I still think 99 is a reasonable price, especially with a 3 year warranty on it these days. Tigerdirect had these on sale for 90 after rebate a few days ago. Hopefully we'll see more deals at this price point in the future.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

ilkhan posted:

Its $5 less than a RED drive from amazon, and a 4TB RED from amazon is $202...

Unless you are seeing something I didn't/don't, the $105 RED on Amazon is 2TB...

http://www.amazon.com/WD-Red-NAS-Hard-Drive/dp/B008JJLW4M/ref=sr_1_1?ie=UTF8&qid=1379350497

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Hughlander posted:

I'm in the same boat reading up as much as I can on Xpenology, thinking of following Don Lapre's example machine with 16 gigs and ESXi as a Christmas break hack idea. Anyone have personal experience of Xpenology on ESXi?

I've spun up a couple test VMs and it seems to work. At least when I tried it, the VMware tools weren't part of the default install. I think there was a way to manually shoehorn them in, but I never really looked into it.

As mentioned above, you lose all kinds of SMART monitoring unless you are using direct passthrough to pass an entire card to the VM (and if you are unfamiliar with this technology, it is something you need hardware support for and most consumer level motherboards are iffy at best in this department). I did this with my spare IT flashed M1015 and it looked like it worked, but only kept it in for a couple days while playing.

Ultimately, I was concerned about supportability and wasn't as impressed with how it handled different sized disks as I thought it would be. I went with another option for my file server VM.I'm planning to go with another option (mostly likely FreeNAS) for my file server VM, but so far have been lazy and haven't actually done it :)

Fancy_Lad fucked around with this message at 16:40 on Dec 19, 2013

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

MMD3 posted:

I guess my question was just if the hybrid raid was the only way to use mixed drives and if there's any downside to using hybrid as opposed to another RAID type

It isn't the only way to use the drives, but it is the most effective use of the space when using mixed sizes. Without the hybrid raid, you will (often, not always) have more unused space. Also I'm not entirely sure with those synology units if they can increase space on the fly if you use traditional raid5/6 on them (I don't own one personally)

http://www.synology.com/en-us/support/RAID_calculator
Compare SHR and RAID5 (where you can lose a single drive before data loss)
Compare SHR2 and RAID6 (where you can lose two drives)

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
It has been a couple years since I setup my crashplan backup, but I recall having to turn encryption on manually... So if be surprised if 25 percent of their users actually do so.

I find it hard to believe that they wouldn't dedupe non-encrypted data.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Civil posted:

see what Toshiba has to say about how many errors must be found before they'll do anything.

On the retail box 3TB drives (http://www.newegg.com/Product/Product.aspx?Item=N82E16822149396), the only issue I have had with the return was finding how to actually submit the drat thing. The hard drive division said they just handle OEM drives and to talk to retail, retail said they just handle external drives and talk to hard drives. While on hold, the hold message gave a 3rd url (http://www.acclaim.toshiba.com) and that one actually took the serial numbers. Everything else was painless. I did have to do 2 separate RMAs - one for each drive.

They shipped new sealed retail boxes to me (not refurb!), I flipped them in and tested them to be good and sent the bad ones back. The only thing I said in the RMA request was that the "Drive is bad" and had no complaints. Actual problem on both of them was bad blocks (that I place the blame for squarely on newegg's lovely "throw these 4 drives in a giant box and let them bounce around half way across the country" shipping method).

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

All 4 of my 2TB Hitachi Deskstars have 1212 days power on and not a single issue... That said, factory reconditioned with a 60 day warranty are the reasons I'd recommend to avoid this one (no matter the brand)

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
Giving a mostly idle VM 4 cores is a bad idea in any case. Giving a mostly idle VM 4 cores on a system with 4 physical cores is a recipe for heartache.

If you give it another run, start with a single core and only move up if it is maxing that out consistently (in a home lab scenario I really doubt it will be needed).

The VM fighting the CPU scheduler might have been your whole issue...

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

TheParadigm posted:

I just need to replace the current one that's starting to go, and worst case scenario I just get a backup drive for the enclosure.

Don't lose sight of the fact that RAID 5/6/Z1/Z2/SHR/SHR2 is there for availability purposes. If you lose a drive (or 2 depending on your parity), you can still access your data. None of these are backups.

Always maintain (preferably offsite) backups of data you care about no matter is is on a parity setup or not. No number of parity drives is going to help if someone breaks into your place and steals your computer, it is caught in a fire, etc. I use Crashplan.


That being said I personally view Reds and HGST drives as about on par quality wise - I'd get whatever is cheaper if I were buying.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
Can you use external USB drives with it?

Of course if it isn't USB3, you probably won't be able to stream multiple streams off an external either. Perhaps if you can pick and choose where things go and try to isolate content to the USB drive that would only ever be streamed by a single person?

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

MMD3 posted:

ahhh, in my case we're talking about ~4TB across all of my media types. I can easily back that up to an external drive if I'd been diligent. My photography archive is probably only 1.5TB of that and it's the only thing that seems to have been deleted. I just have no idea how it was deleted.

Looking at your post history:

MMD3 posted:

The only thing I can figure might have happened is that I installed BitTorrent Sync on my laptop a few days ago and was playing around with figuring out the best way to sync the raw photos from my laptop to my Photo share folder. To the best of my knowledge I tried to add the Photos share folder as a destination but wasn't able to connect to my diskstation on my laptop.

http://help.getsync.com/customer/portal/articles/1901264-folder-preferences posted:

5. Store deleted files in folder archive.
If some peer with a Read & Write Key changes or deletes a file, it will be changed or deleted on the other peers' devices, too. However, before changing or deleting a file they will be copied to ".sync/Archive" subfolder. By default, these archived files will stay in the Archive for 30 days, just in case you need them, before being automatically cleaned up and removed by BitTorrent Sync. If you disable this option, files deleted by Sync (due to action on another peer) will no longer be copied to Archive.

I'm not trying to be an rear end, data loss sucks any way you look at it, but setting up a potentially destructive sync program right before a folder (not all folders, just the one you were attempting to sync) loses items is just waaaaaay too much of a coincidence to ignore and not suspect is the most likely culprit.


To try to actually be helpful here: https://www.synology.com/en-us/knowledgebase/faq/579

It looks like the Synology should be using EXT4 as the filesystem. As long as the files haven't been overwritten (so hopefully you haven't been using the thing since the data loss occurred), you may be able to recover the deleted files with something that can scan EXT4 formatted partitions.

Good luck...

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

canyoneer posted:

This is going to be a raid1 array for backing up mirroring pictures and crap on between two identical new 1tb hard drives

Fixed that for you. You aren't actually backing anything up in this scenario, you are simply mirroring the data between the two drives for availability. Sure, if a single drive in the mirror up and dies on you, you won't lose data. You won't necessarily be protected in other situations where actual backups will protect you like data corruption, fire, theft, etc.

Just pointing out the obvious here. If your pictures and crap are actually important you should be looking into real backup options for them (Crashplan for instance)

:)

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
I have 4 Toshiba DT01ACA300 drives (3TB models) in my server that I picked up really cheap at the time. 1036 days on them with no issues. *knocks on wood*

That said, I've seen a lot of horror stories come out of their RMA process since I bought them. Be aware of what you are getting yourself into. Example:
https://www.reddit.com/r/DataHoarder/comments/43bqrv/psa_toshiba_rmas_are_a_nightmare/

I'm currently picking these guys up as they go on sale since I don't really care about performance. The annoying thing is that they always limit 1 per household - although if you have one local you can get around that pretty easily. Sign up a spam account for the sales fliers to get the (unique) coupon codes. As luck would have it, they are running a reasonable sale right now (cheapest I've seen them is $89 shipped, currently $94 after coupon code)
http://www.frys.com/product/6943757?site=sa:adpages%20page:P7%20date:072416

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Boris Galerkin posted:

Backblaze likes the HGST drives but they're also using the enterprise drives in their reports so I don't think it's comparable like that.

FYI: I don't think this is right. For example, that HGST that Fry's keeps putting on sale for $89-$99 shipped that I posted last page is one of the drives that Backblaze uses - HGST HMS5C4040ALE640

Seems to do really well from a reliability standpoint per their stats, as well

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Matt Zerella posted:

Can I flash a H310 to support 6TB drives in IT mode? My boss told me to take what I wanted from a failed sub company and WELP there were 4 6TB reds in a NAS that they don't want anymore.

I'm using unraid, which I like a lot and paid for and currently it's loaded up with 4TB greens attached to the motherboard. It's in a node case but it's full and Id like to use all 8 drives so I'm going to upgrade the enclosure.

Looking at all the links online it gets confusing.

E: looks like the m1015 is still the way to go?

In the last month, a buddy and I have flashed 3 H200 cards to IT mode using the BIOS instructions here with no problems (instructions for the H310 included as well):

https://techmattr.wordpress.com/2016/04/11/updated-sas-hba-crossflashing-or-flashing-to-it-mode-dell-perc-h200-and-h310/

If you haven't bought the card yet, it seems that the H200 can be had pretty readily on ebay for ~30-35ish shipped in the US right now with best offers on the buy it now auctions with multiple cards listing for around 40.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?
I'm finishing up a migration of ~30TB of data from a Windows+DrivePool installation to UnRaid.

19 total spinner disks involved in the migration with ages varying from 1 year to 8.5 years. Average age is about 3. Mix of brands WD, HGST, Hitachi, Toshiba, Seagate. Since I didn't invest in new drives, I've been rewriting and shuffling data over and over again to move individual drives between the OSes. Bonus: I even decided to encrypt the UnRaid array after moving ~6TB of data over, so had an extra shuffle for that.

So far a ~7 year old 1.5TB Seagate refub drive (my last survivor out of 5 and also the last Seagate batch I purchased) has finally started throwing reallocated sectors. That's it.

I'd say make sure your backups are shored up, and stop sweating it. :)

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

redeyes posted:

I'm curious. What did you gain by moving to Unraid in terms of space? Also, does it do snapshots?

My case is kinda complicated, as I'm going from an ESXi setup with passthrough HBAs to the Windows VM and an Xpenology VM (was evaluating this at one point) and all sorts of inefficiencies plus adding/removing drives into the mix to get it done... I also used both 2x duplication and no duplication depending on the folder contents in DrivePool.

In a normal situation the math is pretty easy: A 2x duplication eats up 2x the space for each file. UnRaid with dual parity consumes your largest 2 drives for parity in the array.

I should end up gaining ballpark of 16TB usable after the migration on 66TB raw plus the ability to parity all data if I desire, but I"m most excited to be getting out of the computer janitor hell that the previous setup was.


As for the snapshots, I'm not aware of that with UnRaid... I'm still learning a *whole* lot very fast on it. I'm really digging the docker methodology for apps. Been an adventure!

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

eightysixed posted:

Question on this, and I've read opinions that oppose eachother. I should have all my new hardware on Saturday for an unRAID box, and am only moving over about 4TB worth of data. I've read to set up unRAID without the parity drive, copy all the files over, and then add the parity drive to get things copied over quickly. I don't really care about the speed of the transfer of the data, it's only backups. If I setup unRAID with the parity drive first,how long do you think we're talking about moving a mere 4TB? I can handle a day or two, and there's no way it should be longer than that.

Also, how crucial is a cache drive if I'm only looking at writing ~5GB per month to it? From everything I've said, that doesn't seem mission critical either.

Lastly, what's the best way to setup unRAID to be accessed outside of your LAN. This is basically an offsite backup for my office, plus a few personal things in its own container. :cheers:

Also following up with my fresh experience

1. I did all my data migration with parity enabled, but when I was shuffling data to encrypt the array I scrapped the parity until that process was finished and immediately rebuilt the parity when it wad done. There's two ways to configure how UnRaid writes parity. The default read/modify/write was about 1/3 the speed of reconstruct write for me, although understand the downside of keeping all your drives spinning (I do this anyway, so no downside for me). With reconstruct write, I get roughly 130MB/s write speed if the array is doing nothing else. Here's the kicker with UnRaid, if your array is doing any other writes, even to another drive, all writes are going to slow down because your parity has to write the changes and will bottleneck you. Also in reconstruct write mode heavy reads will impact your write speed as well since it is reading all drives in the array. The file shuffle for the encryption just tanked my speeds so instead of letting that take 4 days I had backups so I ran with it. All my copies were from a local VM with passthrough disks and 4TB with nothing else going on would ballpark half a day. Matt Zerella is correct that you will want to preclear your drives and that will take you probably that long or longer (depends on the size).

2) Agreed on the cache drive. I have 2 SSD cache drives but I'm using them just for docker/VM storage and not write cache to any share... From what I've read off the forums this isn't unusual. The ZFS folks will probably be laughing at those transfer numbers above, but for a backup or media server you generally aren't going to care about speeds much.

3) I haven't figured this out yet. My desire is less remote file transfers and more just remote management... I have a "todo" to try to setup the OpenVPN docker, but I expect that won't be available if the array is stopped so that isn't really ideal there. Would also like suggestions that aren't "open your web interface or SSH port to the interwebs" :)

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

Droo posted:

I dunno how useful it really since once you lose a random portion of your files it would be easier to restore everything from backups than try to figure out which individual files are gone, but if you really are up poo poo creek I guess a partial dataset is better than nothing.

UnRaid actually has a way to mitigate this to an extent, on a per share basis

https://imgur.com/mIihtpE

For example if your share "TV" is organized:
ShowName\Season\Episodes

You could choose to split it so that a single series or season for a series is self-contained on a single drive - whatever makes sense for your setup.

Or you could use the disk include/exclude options if you want something a bit more rigid.

...Not that any of this is an excuse to not have sufficient backups of anything that's important, of course.

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

necrobobsledder posted:

With the quad-LC NAND SSDs hitting the market we may start seeing prices for SSDs to work for bulk storage in another couple years. For home NASes, SSDs have a lot of characteristics that are great including lower power usage, better effective endurance, no noise, etc. I’ve hoped for a 8x2.5” array embedded in 2x5.25” external bays stuck in a small case and there’s really no commercial product like that besides arguably some rack mounts.

Something like these would let you convert any 5.25 bay into that, if that's what you mean?

I've been using the MB608SP-B in my system for about a year with no complaints.

Adbot
ADBOT LOVES YOU

Fancy_Lad
May 15, 2003
Would you like to buy a monkey?

priznat posted:

Question for Unraid folks, my Deluge docker seems to have flaked out and I can’t access the web interface anymore. Even uninstalling and reinstalling the docker has the same issue. I can access other web consoles for sonarr and plex but deluge is kaput. Any ideas? I will try moving the port next in case that is the issue otherwise I’m stumped. No idea why it flaked either, it was working then I added a couple torrents from a recent humble bundle purchase and kaboom. Cpu utilization went to 100% too.

A couple months ago, I had a similar problem with it - it would work fine on a Unraid fresh boot, but after awhile the web UI would lock up and restarting the docker wouldn't fix it. I ended up rolling back to version 145 (put "linuxserver/deluge:145" in the repository field) and that resolved the problem. I had kinda forgotten about it and haven't taken the version off to see if it was fixed in an update. I'll poke around and see I can't dig up where I found discussion around it.

Edit: Hey, last page of the support thread is a good place to start :)
https://forums.unraid.net/topic/41742-support-linuxserverio-deluge/?page=12&tab=comments#comment-694562

Dunno if this is your problem, but sure seems similar. Not a lot of movement there tho.

Fancy_Lad fucked around with this message at 05:41 on Jan 2, 2019

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply