fletcher posted:I didn't even need to mess with the firmware flash for my 5th drive that sits in the optical bay. Run some S.M.A.R.T tests on your drives, that's about the only good recommendation I can come up with if you want to figure out what happened. Also be aware that replacing the drives with 3TB ones won't grow the pool before you've replaced all five drives. BlankSystemDaemon fucked around with this message at 08:31 on Nov 5, 2012 |
|
# ? Nov 5, 2012 08:26 |
|
|
# ? May 29, 2024 05:45 |
fletcher posted:
Fixed my issue. From the nfs section: quote:The properties of one file system exported to a given host must all occur on one line. Lines without a client specified are treated as a single host. This limits how you can export file systems, but for most people this is not an issue. So rather than 3 separate shares, just create 1 share with 3 folders listed, separated by spaces: /etc/exports correctly lists it and all 3 are shown with a showmounts -e. Hooray!
|
|
# ? Nov 5, 2012 08:40 |
|
tonberrytoby posted:did you remember to write if and 'of=/dev/rdisk' instead of only '/dev/rdisk' ? The whole command I tried, as advised in the unRAID docs: code:
|
# ? Nov 5, 2012 09:50 |
|
Any thoughts on the HP vs this and this? Size/noise are a concern, effort less so as long as the end result works, but I'm not going rack a DL160 for this.
|
# ? Nov 5, 2012 09:53 |
|
Ninja Rope posted:Any thoughts on the HP vs this and this? Size/noise are a concern, effort less so as long as the end result works, but I'm not going rack a DL160 for this.
|
# ? Nov 5, 2012 18:50 |
|
necrobobsledder posted:File drag 'n drop is not the same thing as creating a brand new file because your permissions are transferred unless masked. With a new file, it inherits from both umask and the directory above it depending upon whether your OS can override whatever you attempt to set as a user (think it's enforceable on Solaris, not so on Linux). I did steps 1-6. When I used cp to copy the file, the permissions were set as intended with setfacl. When I drag & dropped the same file, the permissions were not set properly. So I suppose the problem is narrowed down to something to do with Finder. I did try quoting the arguments; no effect. So what's my next step in figuring this out?
|
# ? Nov 5, 2012 19:04 |
|
DrDork posted:For $300 ($350 w/RAM and NIC) it's real hard to beat the ease of setup and performance of the N40L. Good luck finding it for that price, though.
|
# ? Nov 5, 2012 19:14 |
|
necrobobsledder posted:File drag 'n drop is not the same thing as creating a brand new file because your permissions are transferred unless masked. With a new file, it inherits from both umask and the directory above it depending upon whether your OS can override whatever you attempt to set as a user (think it's enforceable on Solaris, not so on Linux). I don't think I'll have the time to do this the "proper" way and enforce this on the server side (FreeBSD). As a workaround I've decided to configure a umask on the client side (MacOS) to make dir/files 775/664 on creation, so when they're copied to the server they have the desired permissions. This is how I did it if anyone is interested: http://support.apple.com/kb/HT2202 Thanks so much to everyone that chipped in with feedback, I learned a hell of a lot about find, ACLs, and umasks over the last week.
|
# ? Nov 5, 2012 22:15 |
|
Longinus00 posted:I would recommend you backup the raid superblocks using dd before doing this so you can restore them if it doesn't work. Even better (and what should have happened originally since it seems like you are willing to pay a lot of money to get data off these drives, I googled and there are quotes of several hundred for raid recovery and that number gets really high if there are any hardware issues) is stopping all the drives and copying their contents into new ones and using those to restore your data. If you mess up recreating or a rebuilding, your disk images are a simple dd away. Once you fix up the array on your new drives successfully then you're free to do whatever you want with the old drives. How would you recommend I go about the backup in that case? The research I've done suggests that using the "dd if=/dev/sda of=/dev/sdb" method, but I don't want to do a 1:1 copy to a new disk. Rather, I'd like to copy everything over to my Synology NAS as a compressed file (if possible). Is this possible with a multidisk array? Would I end up with an img/bz file for each partition or a single file for all 4 partitions? I feel very ignorant about this high level multidisk backup stuff, but I have a feeling it should be as basic as a normal rsync. Thanks!
|
# ? Nov 5, 2012 22:22 |
|
[quote="Gism0" post="409248681"] Had my first scare today.. For some reason one of my drives disappeared, so I rebooted and it thankfully came back. Any reason why that might happen? Should I be worried? (I'm using ZFS on Ubuntu 12.04) code:
Rebooting is also the last thing you should do, not the first.
|
# ? Nov 5, 2012 23:01 |
|
titaniumone posted:Rebooting is also the last thing you should do, not the first. There should be a caveat associated with that goddamn nonsense article, that qualifies it with the complexity and redundancy of your machine being the major factor in anything you do up to and including reboots. In your case, it might be similar to mine where there are power issues from a bad PSU or a semi-loose cable and the only way to get the BIOS to give a poo poo again is to reboot. Once you lose a drive with that, you can't exactly go inside the case and plug it back in again and have it work.
|
# ? Nov 5, 2012 23:25 |
|
tehschulman posted:How would you recommend I go about the backup in that case? The research I've done suggests that using the "dd if=/dev/sda of=/dev/sdb" method, but I don't want to do a 1:1 copy to a new disk. Rather, I'd like to copy everything over to my Synology NAS as a compressed file (if possible). Is this possible with a multidisk array? Would I end up with an img/bz file for each partition or a single file for all 4 partitions? Are you asking how you can make an image of a disk rather than copy to a new disk? In that case just change the 'of' argument to point at a file rather than a block device. If you want to have it be compressed you can just do something like this cat /dev/sda | gzip > sda.img.gz, but you'll need to uncompress to do anything with them so it's not very useful except as a backup. You can then mount the disk images via a loop device but to do so with a partitioned disk image you'll need to use kpartx or mess around with losetup. If you're planning to do recovery it'll be easier to just backup compressed disk images and then uncompress them onto disks in a computer or backing up the partitions individually.
|
# ? Nov 5, 2012 23:50 |
|
Hmm, I'm trying to make my server boot off of a SiI3114-based SATA card. This works fine. The problem arises when I hook up all the other hard drives in the system. Two things happen then: 1. The cards BIOS info never appears during boot-up. To be clear, all the other ports BIOS screens appear (Intel, Gigabyte, LSI) along with the the SiI3114 until I have a bunch of drives hooked up to those ports...then the SiI3114 doesn't ever show up. 2. In my BIOS boot-order screen, only 8 of the 12 drives I have in the system appear. Any ideas on how to get this to work?
|
# ? Nov 6, 2012 00:56 |
|
Thermopyle posted:Hmm, I'm trying to make my server boot off of a SiI3114-based SATA card. This works fine. Hmm, might be some odd behaviour of the Si3114 Option ROM. Does it have a config menu at all you can enter? And in the boot screen under HDD BBS option / similar menu, only 8 appear? The 4 attached to the 3114 don't? Did the 3114 ever work properly?
|
# ? Nov 6, 2012 01:07 |
|
Got my UnRaid box all up and going... Took a little fight but it seems like its working well now. Out of laziness I ended up not using the Intel NIC right now, sticking with the Realtek for now. (Didn't have a keyboard or display hooked up and it was only readying eth0 and the card was eth1 (I think)) Got Sab/SickBeard/Couchpotato running and working as planned. Finally got Plex media server set up also. Finished it off by streaming a new election comedy movie at 720p to my Roku box over Wireless with no problem! While not the thread, Plex is loving awesome. I don't know why I ever considered setting this thing up and using PS3MediaServer as an option... Side Note: Any suggestions on a brand of a Sata PCI card? Need at least 3 internal SATA ports (figure 4 for good measure).
|
# ? Nov 6, 2012 01:14 |
|
movax posted:Hmm, might be some odd behaviour of the Si3114 Option ROM. Does it have a config menu at all you can enter? Yeah but I can only enter the config menu if I have the other drives disconnected. movax posted:And in the boot screen under HDD BBS option / similar menu, only 8 appear? The 4 attached to the 3114 don't? Did the 3114 ever work properly? 12 drives total. 2 attached to the 3114 4 to on-board Intel ports (965P-DS3 mobo from Gigabyte) 2 to on-board Gigabyte ports 4 to an LSI SAS card via a...crap I can't think of the word right now, but one of those cables that splits a port out to 4 SATA ports. Showing in BIOS boot-order screen 3 drives from the LSI 2 from the on-board Gigabyte ports 2 from the on-board Intel ports (I said 8 drives earlier, but actually one of them is "Bootable Add-in Cards", and setting that to boot order #1 doesn't help) The 3114 works great if I don't have drives plugged in to the other ports on-board or the LSI card. Prior to me tearing down this system to replace older, smaller drives with newer, bigger drives, all the ports worked fine. I think they worked fine because my boot drive at the time happened to be plugged in to one of the on-board ports. I'm trying to avoid that since the 3114 is lower performance and I'd like to save the higher-performance ports for my storage pool.
|
# ? Nov 6, 2012 01:21 |
|
Ahh, a 965 board. I'm beginning to wonder if that BIOS might have some odd limitations that you're running into. How much RAM is in the system, out of curiosity? e: And if you boot into a Live CD / OS, can you see all the controllers if you do lspci or similar?
|
# ? Nov 6, 2012 01:31 |
|
movax posted:Ahh, a 965 board. I'm beginning to wonder if that BIOS might have some odd limitations that you're running into. How much RAM is in the system, out of curiosity? code:
I haven't tested the storage pool which is a ZFS pool that I exported from another machine yet...
|
# ? Nov 6, 2012 01:43 |
|
Have you considered just getting a 2 port PCIE SATA card? That would erase any performance concerns.
|
# ? Nov 6, 2012 01:45 |
|
Longinus00 posted:Have you considered just getting a 2 port PCIE SATA card? That would erase any performance concerns. Yeah, I think I'm going to have to end up doing this.
|
# ? Nov 6, 2012 03:29 |
|
Sooo many problems. I would've sworn the LSI SAS1068E based controller cares support 3TB...I was wrong. What's a good replacement?
|
# ? Nov 6, 2012 04:23 |
|
Thermopyle posted:Sooo many problems. Yeah, I have 3 of those, thanks for the reminder. You can use their PCIe 2.0 6Gbps successors, the 2008s.
|
# ? Nov 6, 2012 04:29 |
|
Devian666 posted:This is a good start but somehow this picture made me think of the hoarder than had 10 tonnes of rubbish and 55 cats (15 of them dead) removed from his house. But the nice part about being a digital hoarder is that for the low low price of a day's pay, you get the digital equivalent of a brand new Costco to cram your new poo poo into. Additionally, having your data arranged in random heaps of crap doesn't pose a health and safety hazard when those cat macros and Linux iso's fall over and crush you to death. My personal packratting has gotten out of hand in a hilarious manner. I now have a SAS topology containing ~55 HHDs, totaling over 40.8 TB of usable space, post 10/2 conversion and raidz2 capacity losses. A Norco 4220 running OpenIndiana, a 4224 running as a Hyper-V lab box with an expander stealing all the drive bays for use as a halfassed jbod box, and a Supermicro 24 bay 2U rackmount case, running the 20 laptop drives I got from work because of some pricing bullshit that made it cheaper to replace them with SSDs than buy them new with SSDs. Also, Locate32 is literally the best thing ever. Set it to index the archive drives weekly and the recent download drives daily, and I can find anything reasonably quickly. If it would also somehow index metadata and tags, it would be perfect. movax posted:Yeah, I have 3 of those, thanks for the reminder. You can use their PCIe 2.0 6Gbps successors, the 2008s. I have an LSI 2008 chipset card, I think it's the 9016 2 internal port HBA. They're amazing in terms of playing nice with pretty much everything on the market as far as expanders, plus they have drivers for every OS you care to name.
|
# ? Nov 6, 2012 04:42 |
|
movax posted:Yeah, I have 3 of those, thanks for the reminder. You can use their PCIe 2.0 6Gbps successors, the 2008s. Well, geeze...those are quite expensive compared to the ~$100 I paid for the 1068E card.
|
# ? Nov 6, 2012 05:02 |
|
IBM makes a model called... I have no idea right now, but it's pretty reasonably priced.
|
# ? Nov 6, 2012 05:45 |
|
FISHMANPET posted:IBM makes a model called... I have no idea right now, but it's pretty reasonably priced. IBM m1015, which uses that LSI 2008 chipset. We use a shitload of those LSI 2008 cards at work, they really do work with just about everything you can throw at them.
|
# ? Nov 6, 2012 06:07 |
|
Still on ebay, $65 bucks plus shipping (missing the thing that holds the card, but any good nerd should have a few old PCI cards floating around that can mount these) http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&item=200841096206
|
# ? Nov 6, 2012 06:38 |
|
Fatal posted:Still on ebay, $65 bucks plus shipping (missing the thing that holds the card, but any good nerd should have a few old PCI cards floating around that can mount these) Yep that's the one you want. Also, I think all of the mods are digital hoarders.
|
# ? Nov 6, 2012 06:55 |
|
Perhaps it's all leftovers from waffleimages?
|
# ? Nov 6, 2012 14:58 |
|
movax posted:Also, I think all of the mods are digital hoarders.
|
# ? Nov 6, 2012 18:13 |
|
Fatal posted:Still on ebay, $65 bucks plus shipping (missing the thing that holds the card, but any good nerd should have a few old PCI cards floating around that can mount these) Do these do RAID 6? Or are you guys pretty much using them to just pass disks through? Edit: Nevermind looks like RAID 5 only.
|
# ? Nov 6, 2012 18:25 |
|
ClassH posted:Do these do RAID 6? Or are you guys pretty much using them to just pass disks through? The latter; they're well supported under Solaris/BSD which makes them great options for feeding ZFS massive number of disks. They can do hardware RAID as well if you want them too (might need a option key), but mostly they are HBAs. Star War Sex Parrot posted:For having access to as many drives as I could want, I'm surprisingly not. I have a single 2x3TB DAS (not even a NAS) that stores all of my poo poo since my computers all have 256GB SSDs, and a Time Capsule that keeps my backups. The rest is all in ~+~+~+~THE CLOUD~+~+~+~ But what about the foam hard-drive carriers
|
# ? Nov 6, 2012 18:26 |
|
Thanks for the heads up about the IBM card, guys.
|
# ? Nov 6, 2012 18:50 |
|
I'm going to be setting a client up with a new Synology NAS. Problem being they have about 4 copies of a lot of their files spread across their current "server" (secretary's P4 desktop) and the 2 other computers in their organization. Is there any good software/methods out there to go through and merge/de-duplicate all of that? We just want 1 copy on the NAS, and to sync that to the different computers.
|
# ? Nov 6, 2012 19:16 |
|
Just got a new storage device, 12 disks, running FreeBSD 9.1. Everything I've read says to keep every vdev in the single-digit range so performance doesn't get hurt. So, I did a two raidz2 setup for my pool.code:
I ran the "bonnie++" program, and it looked like it said this: Write Speed: 352.87 MB/sec Read Speed: 487.36 MB/sec That looks more than fine to me. In fact, that's faster than I need - would it be safe to just do a 12 disk raidz3 (and take a performance hit) to get some space back? Copying to it, I'm hitting up to 90MB/sec. Copying from it, I'm doing around 30MB/sec. Are there recommended Samba tweaks / tuning I should look into? There is, of course, a chance that the bottleneck is not the new system, but the old servers. Samba 3.6.9, FreeBSD 9.1 (RC3) Edit: No tweaks needed. The issue was the tool used, TeraCopy. Windows native file copying is getting 113MB/sec (to Samba) and 100MB/sec (from Samba). All's good. Xenomorph fucked around with this message at 18:26 on Nov 7, 2012 |
# ? Nov 6, 2012 23:05 |
|
Samba performance under FreeBSD has always been poo poo for some odd reason. Edit: http://www.mywushublog.com/2012/06/poor-samba-performance/
|
# ? Nov 6, 2012 23:22 |
|
Because no one uses it, so no one cares enough to fix it properly.
|
# ? Nov 6, 2012 23:48 |
|
is there a way with ZFS on Nas4Free to present my ZFS volume as an iscsi volume that doesn't need to be formatted/initialized? I tried messing around with it last night but I'm no expert on iscsi and the performance from SMB is just really, really bad. 15-20mb/s writing from my Windows machine while I'm trying to re-fill a raid from backup is taking me forever and ever.
|
# ? Nov 7, 2012 00:28 |
|
movax posted:Yep that's the one you want. You never notice that until you become both.
|
# ? Nov 7, 2012 00:35 |
|
|
# ? May 29, 2024 05:45 |
|
Xenomorph posted:Is this type of setup recommended? Yup, that seems to be the recommended method as opposed to a giant vdev. Gives you a much larger safety net.
|
# ? Nov 7, 2012 01:00 |