|
n0n0 posted:I'm seeing scattered reports on the internet indicating that certain SATA 3.0 drives don't like wdidle3, but they're scattered and inconsistent. Regardless, the drives I want to do this with are a couple of years old. Yeah, should work, just remember that "raid isn't backup" is especially important to remember with old drives not meant for this even if you do disable head parking.
|
#
?
Jun 17, 2015 07:17
|
|
|
|
| # ? May 26, 2024 13:06 |
|
|
H2SO4 posted:Does FreeNAS really do some weird ZFS voodoo that prevents pools from being recognized on other platforms? That's disappointing. Afaik it uses something called GEOM which is some from FreeBSD if I am not mistaken. Did you use ashift=12? You could try Napp It, or ZFS guru. Or you know, just use the command line  ZFS itself is two commands and the whole is pretty set and forget.
|
|
#
?
Jun 17, 2015 07:21
|
|
|
I don't think FreeNAS does anything active to try and prevent pools from moving around, it's just that there are differences between ZFS implementations so you have to make sure the implementation you're migrating to has a superset of the features you're moving from. I do not think it can hurt to try exporting the pool, booting to a live CD, and trying to mount it to see if it works. I haven't heard of any specific bug where mounting an incompatible zpool would damage it but you should have backups anyway. First thing you should do is just move files onto and off of it locally (dev/zero onto it and dev/null off of it, without compression, if you don't have other fast local storage) and see what kind of speeds you get. I'm betting it's something else, probably samba if you're using it because samba is flaky as hell and wants to be tweaked obsessively. e: Mr Shiny Pants posted:Afaik it uses something called GEOM which is some from FreeBSD if I am not mistaken. Did you use ashift=12? I'm not familiar with FreeNAS but even if FreeNAS forces geom use it should still write through cleanly to the drives. I used geom when I created my pool to force ashift=9 for better space efficiency; got me a full extra TB at some cost to throughput which can't be realized over the network anyway. After creating it I exported it, removed the virtual geom devices, and imported it normally and have had no issues. Desuwa fucked around with this message at 07:30 on Jun 17, 2015 |
|
#
?
Jun 17, 2015 07:25
|
|
|
H2SO4 posted:performance stuff (1) crappy NIC on the remote computer. Intel NICs for everyone! (2) I was using the pool to run uTorrent on. As in, downloading poo poo directly to the pool. Turns out this is not a great plan, and can substantially degrade performance. So now I download stuff to a small SSD I had laying around and sweep all the completed downloads to the larger pool every few days. Mr Shiny Pants posted:Afaik it uses something called GEOM which is some from FreeBSD if I am not mistaken. Did you use ashift=12? DrDork fucked around with this message at 07:34 on Jun 17, 2015 |
|
#
?
Jun 17, 2015 07:32
|
|
|
JacksAngryBiome posted:Sounds like your network card could be the bottleneck. Is it a marvel controller? It's an Intel PRO/1000 adapter so I don't think that would be the issue. You may be onto something with the controllers though, they're just Vantec add-on cards that Fry's had in stock. I do have the mirrors split between two controllers so if one blows up I'd still have a functioning set of disks from each vdev. I'm not above buying a decent controller card and testing. Mr Shiny Pants posted:Did you use ashift=12? Looks like FreeNAS did that automatically. The thing is, 3 of the four drives are actually not advanced format, could that be a contributing factor? I also just realized that one of the drives is a Seagate that does use 4k sectors, so I can't imagine that would be a good thing when used in a mirror with a device that's 512b. H2SO4 fucked around with this message at 08:00 on Jun 17, 2015 |
|
#
?
Jun 17, 2015 07:41
|
|
|
H2SO4 posted:It's an Intel PRO/1000 adapter so I don't think that would be the issue. You may be onto something with the controllers though, they're just Vantec add-on cards that Fry's had in stock. I think your drive setup is probably (but not absolutely) a red herring, since I have a freenas box with similar write speeds but far different hardware/pool setup: I see similar write speeds to you (65-70ish max), and from what I can tell it's just down to networking in FreeNAS, or rather some arcane setting in the networking stuff that I don't know about. I've tried both a windows client over SMB and a Synology DS1813+ over NFS, and neither could write to the synology box at anything over 65-70 MB/sec. In my case the FreeNAS (and windows) box has an Intel NIC, a haswell i3, 8 gigs of ram, and two controllers, an LSI-9211-8i and an IBM M1505 flashed to LSI 9211 IT firmware. The real LSI card has one pool with 8 3tb seagate SAS drives in raid-z2, the M1505 has 4 4tb WD Reds in Raid-Z, and both pools get the exact same write speed. FIO tests on the actual box write far faster, and closer to what you would expect for pools of disks that size, well over 100MB/sec ish range for a 16 gig write. (Also with no dedupe enabled.) I just ended up giving up on finding the root of it, since after I was done restoring my media library to the box the write speeds were not a huge terrible issue anyhow.
|
|
#
?
Jun 17, 2015 14:01
|
|
|
The GEOM stuff in any FreeBSD based NAS distros is loving bullshit. Defeats the point of OpenZFS. Also, if ZFS in FreeBSD still treats drives differently whether it's a partition or a whole disk, as ZFS always did in Solaris, then data integrity could be affected, because flushing outstanding writes is impaired.
|
|
#
?
Jun 17, 2015 16:26
|
|
|
I use my NAS mainly for DLNA at home and backup but it would be nice the odd time I want to access it at work or elsewhere if I could actually access it remotely. Its all set up, and once or twice it has worked for me but usually doesn't outside my home network. Buffalo Linkstation 421. Cloud is set up on the device, are there any common things in my router config I should look out for?
codo27 fucked around with this message at 17:26 on Jun 17, 2015 |
|
#
?
Jun 17, 2015 17:22
|
|
|
codo27 posted:I use my NAS mainly for DLNA at home and backup but it would be nice the odd time I want to access it at work or elsewhere if I could actually access it remotely. Its all set up, and once or twice it has worked for me but usually doesn't outside my home network. Buffalo Linkstation 421. Cloud is set up on the device, are there any common things in my router config I should look out for? Use a static IP on the NAS, port forward on the router to it for the services you want to use. Register a dynamic DNS name for easier reference.
|
|
#
?
Jun 17, 2015 17:55
|
|
|
H2SO4 posted:It's an Intel PRO/1000 adapter so I don't think that would be the issue. You may be onto something with the controllers though, they're just Vantec add-on cards that Fry's had in stock. Maybe you should try installing something like OpenIndiana or something. It gives you ZFS and Solaris which is pretty awesome. ZFS on Linux also works really good.
|
|
#
?
Jun 17, 2015 20:46
|
|
|
welp, I'm on 3 out of 4 of those seagate MD3000 drives taking a poo poo on me in one month. I don't even know if I want to RMA them.
|
|
#
?
Jun 17, 2015 21:02
|
|
|
RMA, then flip them on eBay to pay for some Reds.
|
|
#
?
Jun 17, 2015 21:35
|
|
|
IOwnCalculus posted:RMA, then flip them on eBay to pay for some Reds. Good plan! .... Out of Warranty This drive is out of warranty with Seagate. Probably just gonna buy another red and replace the 4th and final seagate drive I will ever buy. I guess these things only had a 1 or 2 year warranty and not 5 like I had imagined.
|
|
#
?
Jun 19, 2015 15:49
|
|
|
I found an insane person in SA-Mart http://forums.somethingawful.com/showthread.php?threadid=3726170
|
|
#
?
Jun 19, 2015 17:39
|
|
|
Should we tell him or let him find out the hard way?
|
|
#
?
Jun 21, 2015 21:23
|
|
|
yeah speaking of hard ways, I've hit a point where I'm not sure if I should try anything else or just cry about it and start over. I copied what I thought was a clean set of files over to a secondary nas as a backup. What I'm sorta kinda figuring out right now, is that in the act of replacing one of those goddamn seagate drives, I guess another drive that kept offlining, went and corrupted my files but nas4free cleared out the errors and I thought it had fixed the corrupt files. I guess maybe it didn't, and it just let me go ahead and rsync corrupt files over to my backup NAS. I went ahead and nuked the old lovely seagate nas today and started copying back the files that were on the backup to the primary and now i'm finding plenty of files that just don't open which leads me to figure hey, everything on the whole nas may just be totally hosed right? Is there any sort of thing I can do to find the corrupt files now? I assume it's a lot, I assume I've basically just ruined 7 years of stuff because of all this and it's a little depressing but a good lesson or some poo poo I suppose.
|
|
#
?
Jun 22, 2015 01:03
|
|
|
Telex posted:yeah speaking of hard ways, I've hit a point where I'm not sure if I should try anything else or just cry about it and start over. Were you never scrubbing your file system? If multiple drives have been failing without being detected and it's actually gotten as bad as it sounds there might be nothing you can do. I'd see what ZFS thinks (zfs status) and scrub your system now (zpool scrub) and see if that helps. ZFS should at least realize that it's reading corrupted files and they should actually get fixed upon reading, so you should never be seeing corrupt files unless it's already beyond repair. We need some more information. Though if you've already nuked the old NAS and only have the copies on the backup it may be too late for anything.
|
|
#
?
Jun 22, 2015 02:02
|
|
|
Desuwa posted:Were you never scrubbing your file system? If multiple drives have been failing without being detected and it's actually gotten as bad as it sounds there might be nothing you can do. I was running a weekly scrub, and it claimed things were fine. Things may still be fine, I may have just had some bad files in general, I'm copying the backup raid over right now to find out what's what. The problem was that three drives failed in short order. One at first, with a second while I was resilvering the first time. The third drive died a couple times before I could get the replacement drives for the second and third. Before I nuked the old nas, it was up to around 2 million data errors and claimed they were unrecoverable. It was writing new files fine, but accessing old stuff was not working out. I may be overreacting and I may have a clean backup, I'm just not sure how to find out short of literally opening every single file on the raid to find out. I tried a few and it didn't work and figured it was best to just wait and copy the whole raid over and sort it out later. There's always a chance something else horked a file on my desktop prior to copying it to the NAS (I do recording work on my laptop/desktop and throw it on the NAS for storage when it's done) but I don't know.
|
|
#
?
Jun 22, 2015 17:18
|
|
|
Looking for some advice on setting up a HP Gen8 Microserver. I currently have 2x4TB HDDs for it and would like the ability to expand with additional drives in the future. Its primarily purpose is to be a NAS, but I would also like to run a couple VMs on it. Mainly I can't decide how I want to set up my drives. Right now my vague plan is to install esxi (to boot from SD or USB flash drive), and having a VM with Xpenology to manage the drives (as I understand, synology's "SHR" is very flexible in terms of adding drives, my main reason for choosing that). But then if xpenology is managing the SHR, would it even be possible to be able to run other VMs from the same drives? Would all my VMs need to be installed on the SD/USBstick? Is there some other option that would make more sense? Also couple other esxi questions: The server comes with a celeron processor, and is upgradable to a xeon. Esxi hardware compatibility lists says it suppoerts the xeon version, but not celeron, would I run into any issues trying to do this? I don't have money to spend on upgrading the CPU at the moment. And should I be using "custom HP" esxi images? Is the advantage that they include the proper drivers? Any disadvantages to this?
|
|
#
?
Jun 24, 2015 04:06
|
|
|
ESXi is super picky about hardware, anything not approved is not likely to work.
|
|
#
?
Jun 24, 2015 04:30
|
|
|
DNova posted:I found an insane person in SA-Mart http://forums.somethingawful.com/showthread.php?threadid=3726170 This is the first time I've ever heard of the 3TB 7200.14 Barracudas being bad. I mean, cursory googling lets me know that this has been a well known issue for years I just somehow avoided all information about it up until now. I am lucky that I decided to read this thread. I have four of them in RAID0 with roughly 20k hours on them and I'm scared now. Granted I wouldn't use RAID0 if I cared about the data being stored on them but that backblaze report is pretty damning. I guess it is time to buy new drives and use these seagates for whatever, maybe cut that SA-Mart goon a sick deal? Thanks storage thread, I originally checked here for a link to that cool website that makes a graph of harddrive prices from various online retailers to show who has the best $/GB, does anyone remember what it is called? Or is it not really relevant anymore? (just buy wd reds?)
|
|
#
?
Jun 24, 2015 07:15
|
|
|
peepsalot posted:Also couple other esxi questions:
|
|
#
?
Jun 24, 2015 13:47
|
|
|
necrobobsledder posted:There's a lot of people using ESXi 5.x on their Microservers, but the generation might matter (the latest ones with the shiny faces on the cases are like Gen 3 I guess? Most guides are for before). I tried it on one before on a lark and didn't experience any obvious problems. The CPU on Microservers can be anemic and the space available in the chassis insufficient to cool a regular Xeon, but unless you're actually needing a fair bit of CPU for some applications like Plex server or serving lots of media the Celeron is probably fine for most home server needs.
|
|
#
?
Jun 24, 2015 17:35
|
|
|
peepsalot posted:From what I've read, the main thing about the celeron vs the xeon with regard to virtualization is that the celeron does not support VT-d, but I guess that's not necessarily a problem, just less performant? If you don't need to pass through PCIe cards to a VM you won't need it anyways.
|
|
#
?
Jun 24, 2015 17:52
|
|
|
Mr Shiny Pants posted:If you don't need to pass through PCIe cards to a VM you won't need it anyways. I would prefer to pass through a card to a FreeNAS/NAS4Free VM so the OS can read the smart data.
|
|
#
?
Jun 24, 2015 18:58
|
|
|
Moey posted:I would prefer to pass through a card to a FreeNAS/NAS4Free VM so the OS can read the smart data. Specifically if you're trying to use ZFS, not-passthrough is asking for trouble. Not sure how SHR would deal with it, though.
|
|
#
?
Jun 25, 2015 02:02
|
|
|
Ok, it sounds like I should just give up on the idea of running a hypervisor, maybe just put freenas on the bare metal and mirror my two drives in ZFS, and then I guess if I want to expand in the future I'll just add another mirrored set. Is it possible to transition from mirrored to striped and mirrored? Or would I just have to do two separate mirrored setups. And for some basic virtualization, it looks like I can just put vbox in a jail or something(i've never used bsd). Does that sound like a sensible plan?
|
|
#
?
Jun 25, 2015 04:32
|
|
|
peepsalot posted:Ok, it sounds like I should just give up on the idea of running a hypervisor, maybe just put freenas on the bare metal and mirror my two drives in ZFS, and then I guess if I want to expand in the future I'll just add another mirrored set. You could also run xpenology bare metal and use SHR for your drives. The 5.2 release supports docker.
|
|
#
?
Jun 25, 2015 05:04
|
|
|
peepsalot posted:Ok, it sounds like I should just give up on the idea of running a hypervisor, maybe just put freenas on the bare metal and mirror my two drives in ZFS, and then I guess if I want to expand in the future I'll just add another mirrored set. You could run SmartOS, so you get Solaris, KVM and ZFS.
|
|
#
?
Jun 25, 2015 08:53
|
|
|
You could also run plain FreeBSD with bhyve+iohyve (ESXi-like hypervisor on top of zfs) and jails+iocage (sandboxing on zfs with quotas, thin-provisioning, templates) and zfs on root with full-disk encryption. What we're getting at is that there are too many choices, and asking for recommendations will probably never get you a simple answer.
|
|
#
?
Jun 25, 2015 09:03
|
|
|
Interesting math. Seagate/Samsung 2TB 2.5" 9.5mm drive is 30.14GB/cm3 Seagate/Samsung 8TB 3.5" 25.4mm drive is only 21.23GB/cm3 So the 2.5" drive is by volume 42% more dense than its 3.5" cousin. So in the same unit volume as the 3.5" drive the 2.5" can achieve ~11.3TB. Of course density isn't everything but fun to know.
|
|
#
?
Jun 25, 2015 19:02
|
|
|
I'm setting up a Western Digital EX2100 and am having a hard time SSHing into it remotely. I can get into it fine from a local device and am prompted for my credentials/can ping the box remotely, but it won't take either the password nor a SSH key. As an aside, if anyone else has this box, would you be able to recommend how to prevent everything in ~/ from being deleted when the box is restarted?
|
|
#
?
Jun 25, 2015 20:23
|
|
|
I'm trying to get my head around Glacier. I have 300GB of photos on my Synology and want to put them in Glacier in case of fire. If I understand this right, I can setup the Synology App and it will upload them in the background to EU (Ireland) Costs are Storage: $0.011 per GB = $3.30 / month If I need to recover all 300GB, then I pay a retrieval fee of $0.011 per GB = $3.30 plus a data transfer fee of $0.090 per GB = $27.00 All plus taxes. Is that right, or am I missing something here?
|
|
#
?
Jun 25, 2015 21:39
|
|
|
gnrk posted:I'm setting up a Western Digital EX2100 and am having a hard time SSHing into it remotely. I can get into it fine from a local device and am prompted for my credentials/can ping the box remotely, but it won't take either the password nor a SSH key. As an aside, if anyone else has this box, would you be able to recommend how to prevent everything in ~/ from being deleted when the box is restarted? Get one for cheaps? Did you turn on SSH in the web panel? Did you set the password in the web panel? AFAIK, you can't prevent ~/ from being cleared so I don't keep anything there. Its lovely but I can live with it.
|
|
#
?
Jun 25, 2015 21:53
|
|
|
spog posted:I'm trying to get my head around Glacier. You'll pay some minimal fee to upload the files in the first place, and retrieval is all kinds of slow, but yes that's pretty much the gist of it. If you have Prime, Amazon has a free photo storage option as well.
|
|
#
?
Jun 25, 2015 22:04
|
|
|
Shaocaholica posted:Get one for cheaps? Did you turn on SSH in the web panel? Did you set the password in the web panel? AFAIK, you can't prevent ~/ from being cleared so I don't keep anything there. Its lovely but I can live with it. Like I said, I can SSH into it locally, but not remotely. I set the password. I've also noticed Transmission settings reset after a reboot, do you have any idea where Transmission's config file is?
|
|
#
?
Jun 25, 2015 22:11
|
|
|
spog posted:I'm trying to get my head around Glacier. Crashplan is like $5/m and you dont have any of that extra poo poo
|
|
#
?
Jun 25, 2015 22:47
|
|
|
Don Lapre posted:Crashplan is like $5/m and you dont have any of that extra poo poo With UK prices and VAT, it works out at £87 for Crashplan and £30 for Glacier per year I get what you are saying, but an extra $90 isn't worth it for me, if I just use this as an emergency back-up only since I prefer to keep things local. I apprecaite the advice though.
|
|
#
?
Jun 25, 2015 23:04
|
|
|
spog posted:With UK prices and VAT, it works out at £87 for Crashplan and £30 for Glacier per year Didn't realize it was moon currency we were talking.
|
|
#
?
Jun 25, 2015 23:09
|
|
|
|
| # ? May 26, 2024 13:06 |
|
|
Don Lapre posted:Didn't realize it was moon currency we were talking. I come from the land where $1=£1. Just ask Adobe, Sony, Canon, the games industry, etc,etc Excuse me, my bottom hurts.
|
|
#
?
Jun 25, 2015 23:20
|
|