|
D. Ebdrup posted:Welp, gently caress. I had an issue with several 2008(LSI 9201 and 9211) cards in one machine with mismatching ROM loads. Since I wasn't booting off of any of them, I resolved this the easy(read: as little troubleshooting as possible) way by just doing a complete firmware wipe & flash and reloading P20 firmware on all of them, but not loading the mptbios onto them, so they just don't show up as bootable interface cards. Another option if your BIOS supports it, is to just disable OpRom loading altogether, if you don't need it. I know a lot of server AsRock and Supermicro boards support this.
|
#
?
May 11, 2020 20:00
|
|
|
|
| # ? May 26, 2024 04:29 |
|
|
zennik posted:Another option if your BIOS supports it, is to just disable OpRom loading altogether, if you don't need it. I know a lot of server AsRock and Supermicro boards support this. This would be my go-to. If you're not intending on booting off them, just disable it and save yourself the hassle (and few seconds of boot time).
|
|
#
?
May 11, 2020 20:44
|
|
|
Oh, thank you so much for bringing that up - at least that gives me something to try. Although I still have to find a flash disk, since the server doesn't have a UEFI shell. I'm pretty sure I already tried disabling the OpRom loading, but I guess it's possible I didn't because I was getting tired by that point.
|
|
#
?
May 11, 2020 22:31
|
|
|
Unless its been disabled by the manufacturer, OPROM disable has been a part of every Xeon BIOS since...like, forever.
|
|
#
?
May 11, 2020 22:50
|
|
|
Crunchy Black posted:Unless its been disabled by the manufacturer, OPROM disable has been a part of every Xeon BIOS since...like, forever. It's sometimes buried, though. I know on my older NAS I have an Asrock board, and theres two places you have to disable it. The first is in the boot settings... the second place you have to disable it is in the actually PCI Express bus settings, and you had to disable it on a per-slot basis.
|
|
#
?
May 12, 2020 01:24
|
|
|
zennik posted:It's sometimes buried, though. I know on my older NAS I have an Asrock board, and theres two places you have to disable it. The first is in the boot settings... the second place you have to disable it is in the actually PCI Express bus settings, and you had to disable it on a per-slot basis. BIOS consistenty is something that makes me laugh all the time. Wheres vt-d? Maybe its in chipset, maybe its in feature, maybe it two menus down under I/O. Maybe its pushing three freaking keys are the same time to make the option appear.
|
|
#
?
May 12, 2020 01:41
|
|
|
How can I tell if a Seagate that I have is impacted by the SMR affliction and isn't appropriate for my NAS? It's a 9TN158-578 2TB Barracuda LP. Thanks!
|
|
#
?
May 12, 2020 01:46
|
|
|
TraderStav posted:How can I tell if a Seagate that I have is impacted by the SMR affliction and isn't appropriate for my NAS? It's a 9TN158-578 2TB Barracuda LP. ironically that drive is so old and about to explode (assuming it was manufactured around 2010), that it's safe from SMR since SMR wasn't shipped until 2013 or so
|
|
#
?
May 12, 2020 02:13
|
|
|
Buff Hardback posted:ironically that drive is so old and about to explode (assuming it was manufactured around 2010), that it's safe from SMR since SMR wasn't shipped until 2013 or so Hah! Fair enough. Came in a workstation I just picked up to use as a Minecraft computer for my kid. I'll spare my NAS from it.
|
|
#
?
May 12, 2020 02:15
|
|
|
Well the 1tb drive that I thought I'd never fill for my Plex server is full. Guess its time to step into NAS territory. I dont need a NAS to run as a server just be a cheap drive, and I dont care about backing up anything on the drive since it'll just be regular old commodity media. If I want something stupid simple that I can just plug an ethernet jack into should I look at something like a single bay Synology or are there cheaper better options out there?
|
|
#
?
May 12, 2020 14:20
|
|
|
Finally decided to hell with it, and booted the server off a FreeBSD installation media exported as iSCSI via ctld - which resulted in dmesg.boot giving me a hint as to what's probably going wrong, so my current theory is this: Since the SAS2008-8i HBA is attached to pci7 (through a PCI bridge), and the SAS2308-8e HBA is attached to pci6, I think what's happening is that the UEFI firmware only sees the first HBA as a device to talk to, and completely ignores the second one? I forgot to grab the copy of the first dmesg, but it initially also showed that the firmware versions were out-of-sync, so I updated the firmware. So, I think the next step is to dig out some WinPE environment and get the UEFI (and IMM) firmware updated - because they're both marked as containing critical updates, and while I haven't looked through the changelog, it's possible this issue has been fixed. BaseballPCHiker posted:Well the 1tb drive that I thought I'd never fill for my Plex server is full. Whether the price also reflects their quality is for you to discover. 
|
|
#
?
May 12, 2020 14:28
|
|
|
BaseballPCHiker posted:Well the 1tb drive that I thought I'd never fill for my Plex server is full. Are you looking for just a simple network attached drive that you can access while you run PMS from elsewhere (desktop?), or are you looking for a mini-server that will run PMS itself?
|
|
#
?
May 12, 2020 17:37
|
|
|
D. Ebdrup posted:There's a pretty sizable collection of single-drive NAS enclures that just export disks as a SMB folder that can be mounted in Windows, and they're insanely cheap. DrDork posted:Are you looking for just a simple network attached drive that you can access while you run PMS from elsewhere (desktop?), or are you looking for a mini-server that will run PMS itself? Just a simple NAS that can be accessed from my Ubuntu server. Plex/Sonarr/etc run off of my current server that just has the single 1 TB ssd in it. Thinking I could get a cheap NAS and use that for bulk storage if I bought a single 4/8 TB drive to put in it. I figured a NAS would give me better performance if I can run it over ethernet as opposed to USB.
|
|
#
?
May 12, 2020 17:40
|
|
|
BaseballPCHiker posted:Just a simple NAS that can be accessed from my Ubuntu server. Plex/Sonarr/etc run off of my current server that just has the single 1 TB ssd in it. Thinking I could get a cheap NAS and use that for bulk storage if I bought a single 4/8 TB drive to put in it. I figured a NAS would give me better performance if I can run it over ethernet as opposed to USB. Assuming you're limited to 1GbE ethernet, USB-attached drives will likely be just as fast in many cases, as well as cheaper. Can you not use internal drives on the server?
|
|
#
?
May 12, 2020 18:14
|
|
|
An external USB drive will be faster and cheaper than a NAS. Just pick up an 8tb WD external and call it a day IMO.
|
|
#
?
May 12, 2020 18:16
|
|
|
Welp external 8tb drive enclosure it is! Thanks for saving me some money. I will be limited to 1gig ethernet, I just thought that would likely be faster than USB. But for my needs it probably doesnt really matter.
|
|
#
?
May 12, 2020 20:50
|
|
|
BaseballPCHiker posted:Welp external 8tb drive enclosure it is! Yeah, a USB 3.0 port will support at least 5Gbps, vs your 1Gbps ethernet. And most drives will max at around 115MBps ~= 920Mbps, so USB 3 has a ton of headroom vs a single drive.
|
|
#
?
May 12, 2020 20:53
|
|
|
Streaming I/O on disks can be as much as 160MBps, so you do absolutely want USB3 over RJ45 RJ45 as it maxes out at 116MBps, and even 9k jumboframes only get you 123MBps. Probably no point in bringing up 64k jumboframes since it basically only exists on cut-through switches and FreeBSDs netgraph, as far as I know. Speaking netgraph though, it can finally work as an interconnect to bhyve, and it seems to max out at a solid 22Gbps single-stream with virtio-net on a Broadwell-era Xeon using iperf3, according to the review. BlankSystemDaemon fucked around with this message at 21:36 on May 12, 2020 |
|
#
?
May 12, 2020 21:32
|
|
|
D. Ebdrup posted:Streaming I/O on disks can be as much as 160MBps, so you do absolutely want USB3 over RJ45 RJ45 as it maxes out at 116MBps, and even 9k jumboframes only get you 123MBps. Well, no video stream gets anywhere near 160MBps--hell, 160Mbps is still super hot and spicy for video. And transferring files to it is presumably going to be limited by the 1GbE network either way (or, more realistically, by whatever his internet connection speed is). But, yeah, there's really no reason to use a legit network drive over a USB 3 one unless the entire point is to de-couple it from the server (so you can shut the server down at night but want the filestore still accessible, for example).
|
|
#
?
May 12, 2020 22:21
|
|
|
DrDork posted:Well, no video stream gets anywhere near 160MBps--hell, 160Mbps is still super hot and spicy for video. And transferring files to it is presumably going to be limited by the 1GbE network either way (or, more realistically, by whatever his internet connection speed is). But, yeah, there's really no reason to use a legit network drive over a USB 3 one unless the entire point is to de-couple it from the server (so you can shut the server down at night but want the filestore still accessible, for example). If power efficiency is that important, a semi-modern (or any ARM SoC) processor with motherboard and a 80% AC->DC conversion PSU will save more power when idle than will the under-spec'd x86/MIPS on a board with an AC adapter that barely manages 20% efficiency. Especially if you don't buy drives with low load-unload cycle counts, and have them park their head and spin down when idle.
|
|
#
?
May 12, 2020 23:05
|
|
|
1 drive has 90 uncorrectable but no other issues, but it'll have to do until parity builds and I get a new drive in. Another drive outright failed while I was copying to it, but I got everything off it before it did. Otherwise things seem to be going okay. Crossing my fingers that the parity rebuild goes off without a hitch. Unraid is neat.
|
|
#
?
May 12, 2020 23:32
|
|
|
This USB3 talk is making me nostalgic for when I used Firewire to network my NAS to my desktop because I already had the dang cable and gigabit ethernet equipment was not what would have considered cheap at the time 
|
|
#
?
May 13, 2020 17:20
|
|
|
Welp, I fixed my issue, although I'm not completely fond of the solution. Basically I've disconnected one of the unused SFF-8087 connectors on the built-in SAS HBA on my server, and instead run a long SFF-8087 to SFF-8088 connector out through an otherwise-blank daughterboard slot on the back of the server. At least this means the disks as well as SES information are showing up in dmesg.boot, and everything is showing up correct in 'mpsutil show all': pre:Adapter:
mps0 Adapter:
Board Name: SAS9211-8i
Board Assembly: L3-25083-12K
Chip Name: LSISAS2008
Chip Revision: ALL
BIOS Revision: 7.27.01.01
Firmware Revision: 20.00.07.00
Integrated RAID: no
PhyNum CtlrHandle DevHandle Disabled Speed Min Max Device
0 0001 0009 N 6.0 1.5 6.0 SAS Initiator
1 0001 0009 N 6.0 1.5 6.0 SAS Initiator
2 0001 0009 N 6.0 1.5 6.0 SAS Initiator
3 0001 0009 N 6.0 1.5 6.0 SAS Initiator
4 N 1.5 6.0 SAS Initiator
5 N 1.5 6.0 SAS Initiator
6 0003 0019 N 3.0 1.5 6.0 SAS Initiator
7 0002 000a N 3.0 1.5 6.0 SAS Initiator
Devices:
B____T SAS Address Handle Parent Device Speed Enc Slot Wdt
5006048005f1ebbf 0009 0001 SMP Target 6.0 0002 00 4
00 46 4433221107000000 000a 0002 SATA Target 3.0 0001 04 1
00 57 5006048005f1eb89 000b 0009 SATA Target 3.0 0002 11 1
00 58 5006048005f1eb8a 000c 0009 SATA Target 3.0 0002 11 1
00 59 5006048005f1eb8b 000d 0009 SATA Target 3.0 0002 11 1
00 60 5006048005f1eb8c 000e 0009 SATA Target 3.0 0002 11 1
00 61 5006048005f1eb8d 000f 0009 SATA Target 3.0 0002 11 1
00 62 5006048005f1eb8e 0010 0009 SATA Target 3.0 0002 11 1
00 63 5006048005f1eb8f 0011 0009 SATA Target 6.0 0002 11 1
00 64 5006048005f1eb90 0012 0009 SATA Target 3.0 0002 10 1
00 65 5006048005f1eb91 0013 0009 SATA Target 3.0 0002 10 1
00 66 5006048005f1eb92 0014 0009 SATA Target 3.0 0002 10 1
00 53 5006048005f1eb94 0015 0009 SATA Target 6.0 0002 10 1
00 55 5006048005f1eb96 0016 0009 SATA Target 6.0 0002 10 1
00 56 5006048005f1eb97 0017 0009 SATA Target 6.0 0002 10 1
00 54 5006048005f1ebbe 0018 0009 SEP Target 6.0 0002 11 1
00 47 4433221106000000 0019 0003 SATA Target 3.0 0001 05 1
Enclosures:
Slots Logical ID SEPHandle EncHandle Type
08 500605b00b19b940 0001 Direct Attached SGPIO
16 5006048005f1ebbe 0018 0002 External SES-2
Expanders:
NumPhys SAS Address DevHandle Parent EncHandle SAS Level
25 5006048005f1ebbf 0009 0001 0002 1
Phy RemotePhy DevHandle Speed Min Max Device
00 03 0001 6.0 1.5 6.0 SAS Initiator
01 02 0001 6.0 1.5 6.0 SAS Initiator
02 01 0001 6.0 1.5 6.0 SAS Initiator
03 00 0001 6.0 1.5 6.0 SAS Initiator
04 1.5 6.0 No Device
05 1.5 6.0 No Device
06 1.5 6.0 No Device
07 1.5 6.0 No Device
08 1.5 6.0 No Device
09 00 000b 3.0 1.5 6.0 SATA Target
10 00 000c 3.0 1.5 6.0 SATA Target
11 00 000d 3.0 1.5 6.0 SATA Target
12 00 000e 3.0 1.5 6.0 SATA Target
13 00 000f 3.0 1.5 6.0 SATA Target
14 00 0010 3.0 1.5 6.0 SATA Target
15 00 0011 6.0 1.5 6.0 SATA Target
16 00 0012 3.0 1.5 6.0 SATA Target
17 00 0013 3.0 1.5 6.0 SATA Target
18 00 0014 3.0 1.5 6.0 SATA Target
19 1.5 6.0 No Device
20 00 0015 6.0 1.5 6.0 SATA Target
21 1.5 6.0 No Device
22 00 0016 6.0 1.5 6.0 SATA Target
23 00 0017 6.0 1.5 6.0 SATA Target
24 24 0018 6.0 6.0 6.0 SEP Target
|
|
#
?
May 13, 2020 20:57
|
|
|
Munkeymon posted:This USB3 talk is making me nostalgic for when I used Firewire to network my NAS to my desktop because I already had the dang cable and gigabit ethernet equipment was not what would have considered cheap at the time I would really like to see synology offer usb 3.1/3.2/usb4 support in their 2022 models so I could get 20gbps to my workstation using consumer hardware rather than access it via 2 x 1gbps. My NAS sits within 6' of my workstation and any other device on the network doesn't need more than 1gbps seems like a win-win
|
|
#
?
May 13, 2020 21:23
|
|
|
12TB WDs on sale at Best Buy for $199. I know they've been lower ($180 is the lowest?) but thinking I'll still drop on this later today. https://www.bestbuy.com/site/wd-easystore-12tb-external-usb-3-0-hard-drive-black/6364259.p?skuId=6364259
|
|
#
?
May 14, 2020 13:30
|
|
|
Hadlock posted:I would really like to see synology offer usb 3.1/3.2/usb4 support in their 2022 models so I could get 20gbps to my workstation using consumer hardware rather than access it via 2 x 1gbps. My NAS sits within 6' of my workstation and any other device on the network doesn't need more than 1gbps seems like a win-win That is why the QNAP TS-932x is looking quite tempting. I'm sitting below 4tb free currently.
|
|
#
?
May 14, 2020 15:17
|
|
|
So I've been doing some mental mathematics just to keep the old brain-cogs free of dustwebs, and I've reached this conclusion: With 11 disks consisting of 2x8TB, 3x6TB, 5x2TB and 1x1TB, I can go from 7TiB over 14TiB, 42TiB, and all the way to 56TiB of usable storage in one disk shelf, before I have to start replacing the 8TB disks. This assumes that raidz expansion won't have landed by then, because if it has I can just keep adding disks one at a time in a secondary SAS shelf. All of this using used server-grade equipment bought for pittance, because I'm poor. It's an order of magnitude more diskspace than the usable storage on my current storage server.
|
|
#
?
May 14, 2020 16:10
|
|
|
TraderStav posted:12TB WDs on sale at Best Buy for $199. Welp. Just bought 8 of these and a DS-1918+. Pray for me.
|
|
#
?
May 14, 2020 17:08
|
|
|
TraderStav posted:12TB WDs on sale at Best Buy for $199. Man, I've been waiting forever for the 14TBs to drop in price. I'm getting close to running out of space on my unraid. I may have to grab a pair.
|
|
#
?
May 14, 2020 17:12
|
|
|
12TB will last me quite a long while but I'm himming and hawing on the 14TB at $200 coming back sometime in the future. I hate when I try to optimize and miss the forest for the trees. If I get the 14TB I'll have to do another parity disk swap too and won't be able to use those extra 2TB so probably not worth waiting.
|
|
#
?
May 14, 2020 17:46
|
|
|
TraderStav posted:12TB will last me quite a long while but I'm himming and hawing on the 14TB at $200 coming back sometime in the future. I hate when I try to optimize and miss the forest for the trees. That's why you get 2!
|
|
#
?
May 14, 2020 17:58
|
|
|
Henrik Zetterberg posted:That's why you get 2! Hah! My inflow isn't high enough to justify that. I'll be better served to pop in 12TB now and probably in 6-12 months I MAY need to expand (or replace a dying one) which the $/TB may be lower than today. I've been holding steady around 3TB but want some more breathing room. I pulled the trigger on one.
|
|
#
?
May 14, 2020 18:15
|
|
|
I am at my wit's end. I am using a WD Red 10tb easystore for my main storage drive, via USB, and I can't get this fucker to stop sleeping. The official WD utility, which is supposed to do that, doesn't work. It ignores Mac OS's settings. The Keep Drive Spinning app lets the drive start to sleep and spins it back up again, which is infinitely worse for its longevity. I even went so far as to shuck the drive and stick it in an OWC Mercury Elite Pro to see if maybe the USB-SATA interface was what was letting the drive sleep, but that did nothing. I have the drive backed up, but I would really like for it to not die in the next year because it's too stupid to keep spinning.
|
|
#
?
May 15, 2020 02:00
|
|
|
Let it sleep
|
|
#
?
May 15, 2020 05:13
|
|
|
It's bad for longevity and it means I'm waiting 15-20 seconds to do anything with the drive.
|
|
#
?
May 15, 2020 06:01
|
|
|
I’ve been running an unraid for a decade with letting drives spin down after 15 mins and I’ve only had only one drive go bad.
|
|
#
?
May 15, 2020 06:29
|
|
|
Henrik Zetterberg posted:I’ve been running an unraid for a decade with letting drives spin down after 15 mins and I’ve only had only one drive go bad. KOTEX GOD OF BLOOD posted:I am at my wit's end. I am using a WD Red 10tb easystore for my main storage drive, via USB, and I can't get this fucker to stop sleeping. The official WD utility, which is supposed to do that, doesn't work. It ignores Mac OS's settings. The Keep Drive Spinning app lets the drive start to sleep and spins it back up again, which is infinitely worse for its longevity. I even went so far as to shuck the drive and stick it in an OWC Mercury Elite Pro to see if maybe the USB-SATA interface was what was letting the drive sleep, but that did nothing. I have the drive backed up, but I would really like for it to not die in the next year because it's too stupid to keep spinning.
|
|
#
?
May 15, 2020 09:42
|
|
|
D. Ebdrup posted:There were some drives, WD Greens among them, that had INCREDIBLY low load-unload cycle count (on the order of 10k) according to spec and design - meaning they would wear themselves out in months if you used them in a RAID array, especially ones that expects error recovery control over drives Wild. All my drives are greens. Maybe I’m sitting in a time bomb.
|
|
#
?
May 15, 2020 10:59
|
|
|
Henrik Zetterberg posted:Wild. All my drives are greens. Maybe I’m sitting in a time bomb. 
|
|
#
?
May 15, 2020 11:26
|
|
|
|
| # ? May 26, 2024 04:29 |
|
|
Newegg has the WD Elements 12 TB for $190 after a dumb code if you have an email signed up for their newsletter (or at least that's what it used to require): https://www.newegg.com/black-wd-elements-12tb/p/N82E16822234406
|
|
#
?
May 15, 2020 13:59
|
|
