Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
McGlockenshire
Dec 16, 2005

GOLLOCKS!

Combat Pretzel posted:

Crashplan's still using a Java client?

Not sure about the client, but the backend is totally Java.

Adbot
ADBOT LOVES YOU

Thermopyle
Jul 1, 2003

...the stupid are cocksure while the intelligent are full of doubt. —Bertrand Russell

Combat Pretzel posted:

Crashplan's still using a Java client?

yes

Lexicon
Jul 29, 2003

I had a beer with Stephen Harper once and now I like him.
I have a bunch of internal 3.5" drives that I use in conjunction with a MacBook Air for media storage, backup, and so on. I hooked them up with a a Thermaltake BlacX duet (the USB 2 version of that product) which has finally given in on me. I'm not keen to buy another as these things really don't work well with OS X in my experience, and there are threads in that vein on Apple Support and elsewhere. Basically, drives connected long enough become unresponsive and unwriteable and won't eject. Eject and remount works for 12 hours or so, then the cycle repeats. Not keen to get another, unless things have changed drastically.

The problem is, I have no idea what the hell to replace it with. I'd prefer something that'll connect in USB 3, but this product category is an absolute desolate wasteland, by the looks of things. Hell, I'll even buy a NAS at this point if there's a decent product out there (< $200 preferably).

Any recommendations? I just want to use my drat 3.5" internals with a MacBook Air. This seems surprisingly hard, in early 2013.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness
How often do you really need to swap drives around? It may be more sensible (and reliable) for you to just pick up a few actual external enclosures and put your drives in those, rather than using a device like you had there (which is really only intended for temporary use--that's why it's so easy to pop drives in/out: you're supposed to put them in, do what you need, and remove them, not leave them sitting for days).

You're not going to find a NAS that supports more than 2 drives for under $200. The N40L/54L is probably the cheapest 4-drive NAS out there, and it's $300+ most of the time.

Lexicon
Jul 29, 2003

I had a beer with Stephen Harper once and now I like him.

DrDork posted:

How often do you really need to swap drives around? It may be more sensible (and reliable) for you to just pick up a few actual external enclosures and put your drives in those, rather than using a device like you had there (which is really only intended for temporary use--that's why it's so easy to pop drives in/out: you're supposed to put them in, do what you need, and remove them, not leave them sitting for days).

You're not going to find a NAS that supports more than 2 drives for under $200. The N40L/54L is probably the cheapest 4-drive NAS out there, and it's $300+ most of the time.

Well, I have one media drive that I like to have fairly constant access to, and a backup drive that I use on occasion (and swap with a different one offsite). If I go the NAS route, I'm perfectly happy only having two hooked up at any one time, so a 2-bay NAS is fine. If I go the enclosure route, I'm happy to buy several so long as they are decent and are preferably USB 3. It's just hard to evaluate either choice, honestly.

Gozinbulx
Feb 19, 2004
So I think I'm starting to understand a little more this whole NAS thing. A low-spec computer with a mobo with huge sata port capability, running raid, with an OS fine tuned for this kind of application. More or less? Anyways, I have an old computer lying around with an AMD Sempron LE-1300 which apparently runs on socket AM2. My questions:

Is this CPU enough to run a decent NAS?
Is there a Socker AM2 mobo which is ideal for NAS application (ie has alot of Sata ports)?

Slowly but surely I think I'm getting it.

Longinus00
Dec 29, 2005
Ur-Quan

Gozinbulx posted:

So I think I'm starting to understand a little more this whole NAS thing. A low-spec computer with a mobo with huge sata port capability, running raid, with an OS fine tuned for this kind of application. More or less? Anyways, I have an old computer lying around with an AMD Sempron LE-1300 which apparently runs on socket AM2. My questions:

Is this CPU enough to run a decent NAS?
Is there a Socker AM2 mobo which is ideal for NAS application (ie has alot of Sata ports)?

Slowly but surely I think I'm getting it.

"Decent" will depend on three main factors, what kind of load you're going to put it through, how many disks you stick in it, and how you hook up all those disks. For home use that sempron should be more than sufficient. You don't necessarily need a motherboard with a lot of sata connections if you have free expansion slots for a pcie to sata/sas card or two.

Gozinbulx
Feb 19, 2004
I want to put a shitload of disks in it. Like 8.

Traxxus
Jul 13, 2003

WWJD - What Would Jack Do?

Gozinbulx posted:

So I think I'm starting to understand a little more this whole NAS thing. A low-spec computer with a mobo with huge sata port capability, running raid, with an OS fine tuned for this kind of application. More or less? Anyways, I have an old computer lying around with an AMD Sempron LE-1300 which apparently runs on socket AM2. My questions:

Is this CPU enough to run a decent NAS?
Is there a Socker AM2 mobo which is ideal for NAS application (ie has alot of Sata ports)?

Slowly but surely I think I'm getting it.

Sure, I've got Unraid (7 2TB hard drives + cache disk) running on a sempron 140 with just 2 GB of ram, runs great, even does my sabnzbd downloading and unpacking.

Gozinbulx
Feb 19, 2004
Mind posting a list of your parts? Case, mobo, drive bays.

Galler
Jan 28, 2008


Gozinbulx posted:

I want to put a shitload of disks in it. Like 8.

8 disks isn't really anywhere close to a shitload with regards to a file server. Your existing hardware should be fine with the addition of an IBM M1015.

Gozinbulx
Feb 19, 2004
Ok. One thing I don't seem to understand though, that RAID card has only 2 sata ports from what I can see. How would I go about installing 8 drives?

phongn
Oct 21, 2006

Gozinbulx posted:

Ok. One thing I don't seem to understand though, that RAID card has only 2 sata ports from what I can see. How would I go about installing 8 drives?
Two of these

Socialism
May 9, 2009
I'm thinking of adding some storage space, would a NAS be faster as a network drive than an USB 3 drive connected to a mac mini server?

I'm currently running a QNAP TS-212 with a single drive, and I have a mac mini as a dedicated media/etc. server as well as for personal use. My primary computer is a PC, which has both the NAS and the Mac's shared folder set up as network drives. I'd like to increase my storage space, and I guess I can either stick another drive in the NAS's spare bay or add an external USB 3.0 drive to the Mac and sharing that.

Adding internal to NAS would take up less physical space, but having an external drive might be handy for moving data later. My concern is if the external drive having to go through [USB -> mac -> ethernet to router -> PC] would have a material impact on speed or reliability. Is that something I should be concerned about? A very knowledgeable friend originally set up everything for me, but I'm not familiar with network storage in general.

Moey
Oct 22, 2010

I LIKE TO MOVE IT

Gozinbulx posted:

Ok. One thing I don't seem to understand though, that RAID card has only 2 sata ports from what I can see. How would I go about installing 8 drives?

To elaborate more, it's two SAS ports for breakout cables.

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!
Man, am I the only person using btrfs instead of ZFS? I feel like a filthy filthy snowflake.

Going 3 years strong so far and about to bump up the volume size 3x online.

Traxxus
Jul 13, 2003

WWJD - What Would Jack Do?

Gozinbulx posted:

Mind posting a list of your parts? Case, mobo, drive bays.

Cooler Master RC-590
BIOSTAR TA785G3HD w/ Sempron 140
2 GB Mushkin DDR3
CORSAIR Builder Series CX430
7x 2 TB HDD, 300 GB Cache Drive (for downloading/processing, also have ubuntu installed on there)
SASLP raid card
SS500 5 in 3
Unraid 4.7

Case has 9 bays so up to 15 hard drives. Unraid isn't perfect but I set it up like 3 years ago and had no issues so far (beyond what I break when I start tinkering to "fix" things).


Moey posted:

To elaborate more, it's two SAS ports for breakout cables.

Yes, each SAS port will accomodate 4 sata drives. So 8 off one card, +6 onboard.

Traxxus fucked around with this message at 23:40 on Mar 18, 2013

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer

deimos posted:

Going 3 years strong so far and about to bump up the volume size 3x online.
Even if it's not, the documentation makes it seem like a total pain in the rear end to set up for every distro.

Gozinbulx
Feb 19, 2004
Thanks so much. I know I'm asking annoyingly simple questions but I'm very new to RAID and NAS.

If I start with, say, 4 HDDs, and want to expand it later, how easy is that? Do I have to "redo" the array? Reformat? Will it erase everything already there?

Gozinbulx
Feb 19, 2004

Traxxus posted:

Cooler Master RC-590
BIOSTAR TA785G3HD w/ Sempron 140
2 GB Mushkin DDR3
CORSAIR Builder Series CX430
7x 2 TB HDD, 300 GB Cache Drive (for downloading/processing, also have ubuntu installed on there)
SASLP raid card
SS500 5 in 3
Unraid 4.7

Case has 9 bays so up to 15 hard drives. Unraid isn't perfect but I set it up like 3 years ago and had no issues so far (beyond what I break when I start tinkering to "fix" things).


Yes, each SAS port will accomodate 4 sata drives. So 8 off one card, +6 onboard.

Appreciate this very much.

Traxxus
Jul 13, 2003

WWJD - What Would Jack Do?

Gozinbulx posted:

Thanks so much. I know I'm asking annoyingly simple questions but I'm very new to RAID and NAS.

If I start with, say, 4 HDDs, and want to expand it later, how easy is that? Do I have to "redo" the array? Reformat? Will it erase everything already there?

Depends on what you are using, that's the reason I went with Unraid, unlike others you can mix and match hard drives, and can expand easily at any time. I just buy hard drives as I go and stick em in there. You can prepare the drive without messing with the array, and when you actually add the drive to the array it's only offline for a couple minutes.

You can check out the forums here (http://lime-technology.com/forum/index.php), there's a hardware section as well so you can see what others are using. There's also Freenas, Flexraid, and a couple others I'm forgetting about.

Traxxus fucked around with this message at 23:51 on Mar 18, 2013

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!

adorai posted:

Even if it's not, the documentation makes it seem like a total pain in the rear end to set up for every distro.

Yeah their documentation is fairly lovely, I went with howtoforge's docs when I first started which is somewhat simpler.

The gist:
- mkfs.btrfs <redundancy options here> /dev/sdb /dev/sdc /dev/etc...
- mount /dev/sdb /mnt/derp

But yeah, I understand how the documentation is overwhelming.

IOwnCalculus
Apr 2, 2003





Gozinbulx posted:

Thanks so much. I know I'm asking annoyingly simple questions but I'm very new to RAID and NAS.

If I start with, say, 4 HDDs, and want to expand it later, how easy is that? Do I have to "redo" the array? Reformat? Will it erase everything already there?

Yeah, it entirely depends on how you want to go about creating the array. Any option can destructively re-create the array, but you probably want to expand without having to re-copy all of your data. In that case:

Most hardware RAID controllers, especially low-end / built-in ones: Nope, or at least not a good idea
Linux software (mdadm) RAID: Yep, works pretty well actually
ZFS: Can only be expanded either by replacing every drive in the array with larger drives one-by-one and resilvering each time, or by adding another four-drive array to your pool

Once you get into the less-traditional ones like unraid, it gets pretty crazy.

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams
btrfs only has mirroring, which rules it out for plenty of us.

Longinus00
Dec 29, 2005
Ur-Quan

deimos posted:

Man, am I the only person using btrfs instead of ZFS? I feel like a filthy filthy snowflake.

Going 3 years strong so far and about to bump up the volume size 3x online.

deimos posted:

Yeah their documentation is fairly lovely, I went with howtoforge's docs when I first started which is somewhat simpler.

The gist:
- mkfs.btrfs <redundancy options here> /dev/sdb /dev/sdc /dev/etc...
- mount /dev/sdb /mnt/derp

But yeah, I understand how the documentation is overwhelming.

I am also running btrfs and it has served me pretty well. The only thing I recommend you do is that you mount via uuid rather than a disk name in /dev. Now that raid 5/6 code has officially landed hopefully in a year it will be stable enough to convert my "raid 1" volume into a proper raid 5/6 one, it'll be as if I expanded the array!

Ethereal
Mar 8, 2003
Any compact two drive DIY recommendations? I'm thinking of downsizing my N40L to something smaller.

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer

Ethereal posted:

Any compact two drive DIY recommendations? I'm thinking of downsizing my N40L to something smaller.
for power usage an AMD c-60 based solution is pretty nice. I am thinking about moving my existing NAS (openindiana on a athlon x2 1.9GHz) to the asus one with 6x sata. I don't need the extra CPU, but it's hard to justify the move on power utilization alone.

gabensraum
Sep 16, 2003


LOAD "NICE!",8,1
I finally got around to taking some photos of my N40L after putting a DuoSwap (hot-swap caddy) in it. Have some internal and external photos if anyone is interested:

http://ireckon.net/2013/03/the-n40l-nas-with-the-icy-dock-duoswap

Tornhelm
Jul 26, 2008

Ethereal posted:

Any compact two drive DIY recommendations? I'm thinking of downsizing my N40L to something smaller.

The easiest option would be to just yank out the guts of your N40L and put it in something smaller. If its just the power draw that you're worried about, it isn't too difficult to install a 120w PicoPSU (not sure if the 90w or lower work, but the 120w definitely does) instead of the standard one.

Tornhelm fucked around with this message at 06:09 on Mar 19, 2013

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Ethereal posted:

Any compact two drive DIY recommendations? I'm thinking of downsizing my N40L to something smaller.
Unless you have some other intended use for the N40L, downsizing is kinda pointless: by the time you sell the N40L, you'll likely barely have enough to cover the cost of a less-capable and slower 2-drive NAS setup. Not that such a thing even really makes sense in the DIY spectrum of things--you'll end up spending as much or more trying to roll your own as you would buying a pre-made, unless you're willing to accept some crappy case that's probably larger than the N40L, and/or a PSU that's less efficient than the one in the N40L.

All in all, unless you physically cannot find space for the N40L, there's really nothing to be gained by trying to replace it like that.

Master Stur
Jun 13, 2008

chasin' tail
I appear to have hit the final speed bump in my project. At least I would hope this is the final one.

I have a "master pool" that is deduped enabled and needs to replicate to a backup pool in another physical location over 1G ethernet. I set up the task in FreeNAS 8.3.1 and it has successfully kicked off the autorepl.py script and that's all working fine. The problem is this is undeduping the data, sending it, then rededuping. I only have around 3TB of unique data but ~15TB and growing of duplicate data so the initial zfs send is sending a stupid amount of data.

So questions:

Will future runs of of the replication task only send unique data or will it continue to undedup, send the 2-3tbs, then rededup? I'm assuming it's going to continue to do the latter.

Should I change the autorepl.py script to use zfs send -D instead? Basically, if I have 3TB of unique initially and every night afterwards I get 2.8TB of duplicate and 200G of unique I want to only send that 200G and the metadata associated with that 2.8TB.

Lexicon
Jul 29, 2003

I had a beer with Stephen Harper once and now I like him.
So, any recommendations for a USB3 enclosure for 3.5" drives?

Gozinbulx
Feb 19, 2004
I have one of these which I use for 2.5" and I really like it, nice and sturdy and easy to take out/swap (this feature is less common than you'd think).

Apparently they don't make a 3.5" one though.

I guess that didn't really help.

IT Guy
Jan 12, 2010

You people drink like you don't want to live!
I need to replicate our backups offsite. Since all our offsite locations get broken into regularly and poo poo gets stolen, I had to come to the decision to either colocate the server or enable encryption. I opted for colocating. My question is, what would be the best option for replicating data over the WAN (no VPN but we will be using SSH) when it comes to rsync vs ZFS replication (both machines have ZFS)?

Edit: Second question, how dumb would it be to have the freenas web interface (password protected of course) exposed to the WAN (my coworkers have never used a unix/linux shell in their life)?

Edit #2: Never mind about the web interface, I'm not going to take that chance.

IT Guy fucked around with this message at 16:02 on Mar 19, 2013

VictualSquid
Feb 29, 2012

Gently enveloping the target with indiscriminate love.

FISHMANPET posted:

btrfs only has mirroring, which rules it out for plenty of us.
Actually the alpha version of Raid5/6 for btrfs went public around 2 months ago.

Ziploc
Sep 19, 2006
MX-5

Lexicon posted:

So, any recommendations for a USB3 enclosure for 3.5" drives?

I've heard good things about this. Have yet to try it though.

http://www.amazon.com/exec/obidos/ASIN/B005JFU16E/thewire06-20

Also, not really an enclosure, guess I didn't help either!

Lexicon
Jul 29, 2003

I had a beer with Stephen Harper once and now I like him.

Ziploc posted:

I've heard good things about this. Have yet to try it though.

http://www.amazon.com/exec/obidos/ASIN/B005JFU16E/thewire06-20

Also, not really an enclosure, guess I didn't help either!

gently caress it, maybe I'll just buy this one then! Thanks

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!

Longinus00 posted:

I am also running btrfs and it has served me pretty well. The only thing I recommend you do is that you mount via uuid rather than a disk name in /dev. Now that raid 5/6 code has officially landed hopefully in a year it will be stable enough to convert my "raid 1" volume into a proper raid 5/6 one, it'll be as if I expanded the array!

Yeah I mount via UUID on fstab usually, but for manual mounts on the command line I do it the lazy /dev way. I made a small raid5 partition the other day to see how well it'd go, and am thinking of using it for scratch space for sabnzbd until it goes stable.

Ziploc
Sep 19, 2006
MX-5

Lexicon posted:

gently caress it, maybe I'll just buy this one then! Thanks

Note that it's not dual USB3.0 output. It has buttons on the front to select whether the disk is on in the front. It allows you to turn on both slots. But I don't know what happens if you turn on both.

Adbot
ADBOT LOVES YOU

TLG James
Jun 5, 2000

Questing ain't easy
Logged onto my Synology today. Noticed my Logs, I had over 10000 failed attempts at trying to ssh into my RAID in the last few days.

I quickly enabled autoblock after that....

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply