|
Constellation I posted:Obligatory gently caress ipcamtalk and gently caress fenderman. Do NOT go to that website. Chill. He's an rear end in a top hat, but the site has plenty of solid info. Kinda like here and Lowtax until recently.
|
#
?
Dec 21, 2020 16:03
|
|
|
|
| # ? May 23, 2024 17:46 |
|
|
Nulldevice posted:First things first: RAID is NOT backup. It is redundancy for reducing downtime in the event a drive fails. If you delete a file in a RAID1 array that data is lost on both disks. You need a proper versioned backup schema in mind for true backups.
|
|
#
?
Dec 21, 2020 17:03
|
|
|
Axe-man posted:I saw some company that managed to get Synology Surveillance Station to work with Uquititi cameras and it was not pretty, it basically was just diverting the steam and almost going "gently caress you, i'm not using your environment just cause!"
|
|
#
?
Dec 21, 2020 21:23
|
|
|
wolrah posted:If they're not attached to a controller the Ubiquiti cameras have a standalone mode that'll give you a RTSP stream and a very basic config interface, so if they got janky with it they were probably overthinking the problem. You can get those URLs even if they're adopted, I know I've seen them in Protect before. I'm not sure why someone would pay for Unifi cameras without using their NVR/Protect, that's kind of missing the point.
|
|
#
?
Dec 22, 2020 04:08
|
|
|
8TB Red Plus for $149.99 after code on newegg. 3 year warranty Coupon: EMCGFFF25 WD Red Plus 8TB NAS Hard Disk Drive - 5400 RPM Class SATA 6Gb/s, CMR, 256MB Cache, 3.5 Inch - WD80EFAX https://www.newegg.com/red-wd80efax-8tb/p/1Z4-0002-00B89?sdtid=14720081&item=1Z4-0002-00B89
|
|
#
?
Dec 22, 2020 13:39
|
|
|
Are there any good articles/resources y’all would recommend on storage and backup best practices?
|
|
#
?
Dec 22, 2020 19:35
|
|
|
For synology that'd probably include "don't use write cache SSDs if you like your data." I didn't do much research before turning it on with a pair of SSDs, and when one died the other reverted to uninitialized instead of gracefully failing which corrupted some files on the volume. Luckily it didn't toast the entire volume like some other forum posts i've seen, maybe because I had file checksums enabled? At any rate, once I copy the rest of this data off and rebuild everything as a precaution i'm gonna have way more storage than I know what to do with so at least that's nice.
|
|
#
?
Dec 22, 2020 21:46
|
|
|
I’ve been thinking about using a pair of intel optane SSDs for write caching on my synology, with the theory being that they’re meant for caching and have much higher endurance (esp. when full) than regular SSDs. I’m also not really after any speed benefits, I’m hoping a 50GB read/write cache will stop my various media centre docker containers accessing a spinning disk every few minutes and maybe make the thing quieter, or even get to a point where it makes sense to spin the disks down if nobody is watching a movie or accessing files. I can’t find anything telling me that either of these will work, since all the information online is essentially “don’t use SSDs, they’ll fail quickly and you probably don’t need the speed”
|
|
#
?
Dec 22, 2020 22:18
|
|
|
Jamus posted:I’ve been thinking about using a pair of intel optane SSDs for write caching on my synology, with the theory being that they’re meant for caching and have much higher endurance (esp. when full) than regular SSDs. Don't do it. I don't care about quality of flash, I mostly wouldn't trust the synology itself.  I use an SSD for a read cache which I like to pretend helps. It has like a 50% hit rate for my workload.
|
|
#
?
Dec 22, 2020 22:24
|
|
|
Jamus posted:I can’t find anything telling me that either of these will work, since all the information online is essentially “don’t use SSDs, they’ll fail quickly and you probably don’t need the speed” Based on my experience in the preceding post there's a reason this is the prevailing wisdom. Maybe if you confine it to a second volume which has frequent and easily accessible backups you can minimize the blast radius, but it seems like an awful convoluted path just to spin down drives.
|
|
#
?
Dec 22, 2020 23:06
|
|
|
If the failures are coming from bad software, I guess there's no way to fix it with expensive hardware. I just figured people were installing consumer grade SSDs and they were being destroyed by lots of write cycles when they're full (a worst case scenario for wear leveling). A second volume just for (easily rebuildable) support files for containers/VMs is a pretty good idea, but you're right in that it's a lot of work to do given that the Synology is almost silent when idle. I guess I'll just comfort myself in the knowledge that spinning disks are generally more reliable when they're kept spun-up.
|
|
#
?
Dec 22, 2020 23:41
|
|
|
Holiday time means its finally, finally time to get back into the NAS game. My old one dates back to 2008 and runs some Solaris variant... and's been off for the past few years with inertia being a bitch and a half. I started rebuilding in 2017 (probably some posts from then here) but never actually finished bringing up the hardware, so it's just been... sitting. Since then however, I have ended up with a LOT of hardware from server surplus sales and some very lucky and generous friends at big tech co(s) with stupid R&D budgets. Plan is still to ESXi, and then run FreeNAS (or whatever it's become now) as a dedicated storage provider VM, and then separate Linux VM (or VMs) to actually run whatever software/servers I need, instead of depending on FreeBSD jails or pre-built packages. First question, where I've got the burden of old knowledge (I built my first one w/ 2 TB drives around the whole 512/4K transition time) and it's a bit unclear on the Internet.... is ashift / worrying about sectors still a thing? Or have we all moved on at this point? My drives are 8x Exos X16 16 TB drives (SATA, sadly not SAS, but not going to argue with cheap) that will run off the LSI SAS3008 controller on my Supermicro mobo. I'm thinking my only real choices are RAID-Z2, or striped mirrors. It's in a Fractal Node 304 and I'm not going to plan for further expansion in this chassis. Second question... ZIL, L2ARC, do people still care about these? This is mostly going to be slow file storage (media, etc., not a production environment in any means. I've got a 7.68 TB PM1725A NVMe drive (used) installed in my x8 slot on the mobo that I'm not sure what to do with yet, but I figure it's got IOPS for days. ZIL, L2ARC, maybe a small flash pool to expose as real fast storage? e: Actually, reading my own post history in this thread now...I already asked these and these were answered by some awesome goons. Sounds like: 1. 512/4K not a problem (thanks https://forums.somethingawful.com/showthread.php?goto=post&postid=471289841#post471289841), if drive reports itself, there's a database of models that is checked against. 2. Re: L2ARC/ZIL/etc (https://forums.somethingawful.com/showthread.php?goto=post&postid=471210712#post471210712)... don't even need to start with either one at the moment, I think. With 64 GB of system memory, putting 24-32 GB to FreeNAS is likely overkill for me. movax fucked around with this message at 08:39 on Dec 23, 2020 |
|
#
?
Dec 23, 2020 08:32
|
|
|
movax posted:e: Actually, reading my own post history in this thread now...I already asked these and these were answered by some awesome goons. Sounds like: Yup, this is still true: don't worry about 512/4k, and L2ARC/ZIL on a SSD aren't likely to help you if you're serving single-digit clients with 20+GB RAM. Also, yes, RAIDZ2 is probably the minimum you want for 8 drives. You could always run the SSD as a iSCSI target if you only have one "main" computer you'd want fast storage for, I suppose. But you'd also need 10Gb networking if you didn't want to waste most of the benefit of a drive that fast.
|
|
#
?
Dec 23, 2020 21:05
|
|
|
DrDork posted:Yup, this is still true: don't worry about 512/4k, and L2ARC/ZIL on a SSD aren't likely to help you if you're serving single-digit clients with 20+GB RAM. The one caveat to that I firmly believe is a metadata only l2arc on SSD if you use backup software that does an stat of all the files rather than an IO watcher. It cut hours off my backup time and brought the system io down.
|
|
#
?
Dec 24, 2020 00:18
|
|
|
Are there any serious contenders to Synology or QNAP for the “I don’t want to have to think about this NAS for the next five years” market? Bonus if they can run light Plex, and maybe a docker image or two. I’m guessing it’s down to the above two or rolling my own but if it’s down to just building a PC the value prop will have to be amazing to get me invested with time.. Right now I have an ancient Seagate blackarmor (lol) 4 bay from like the 1930s. It’s decrepit and old and I’ve been pretty sure it’s ready to die any day for the last four years now but somehow it just keeps ticking. Getting a sizeable bonus at work so I can finally justify spending a thousand+ on something to replace it though.
|
|
#
?
Dec 24, 2020 01:56
|
|
|
Will someone please think of the Hughlander posted:The one caveat to that I firmly believe is a metadata only l2arc on SSD if you use backup software that does an stat of all the files rather than an IO watcher. It cut hours off my backup time and brought the system io down. The only way to do it, and in such way that you can get additional benefit from streaming I/O of all the data stored on disk, is to use allocation classes - because they were made exactly for this reason, as part of draid. Which also means having to have a mirror of the disks, because if the metadata goes, the pool goes. Martytoof posted:Are there any serious contenders to Synology or QNAP for the “I don’t want to have to think about this NAS for the next five years” market? BlankSystemDaemon fucked around with this message at 02:02 on Dec 24, 2020 |
|
#
?
Dec 24, 2020 01:58
|
|
|
Eugh, I didn’t know it was that unpleasant down there. My last experience with Synology in like 2015 was fairly pleasant in the sense that it seemed to be stable for the year we deployed one before I left that particular company.
|
|
#
?
Dec 24, 2020 02:06
|
|
|
Not a whole lot of market in offering customers intangible concepts as actually protecting customer data, unless you charge exorbitant prices and call it an enterprise solution, despite using opensource software.
|
|
#
?
Dec 24, 2020 02:12
|
|
|
Martytoof posted:Are there any serious contenders to Synology or QNAP for the “I don’t want to have to think about this NAS for the next five years” market? Only thing you didn’t mention was a prebuilt TrueNAS (formerly FreeNAS) system. Similarly point and click to QNAP or Synology. I like my QNAP TVS-471 for what it’s worth. But at the time of purchase, that was $1600 outlay with drives.
|
|
#
?
Dec 24, 2020 05:13
|
|
|
rufius posted:Only thing you didn’t mention was a prebuilt TrueNAS (formerly FreeNAS) system. Similarly point and click to QNAP or Synology.
|
|
#
?
Dec 24, 2020 09:12
|
|
|
BlankSystemDaemon posted:TrueNAS Core is DIY though - not something you buy off the shelf, start up, set up, and forget about. I must be misremembering then. I was thinking these were pretty point and click: https://www.truenas.com/truenas-mini/
|
|
#
?
Dec 24, 2020 15:22
|
|
|
BlankSystemDaemon posted:TrueNAS Core is DIY though - not something you buy off the shelf, start up, set up, and forget about. TrueNAS Core is DIY. TrueNAS commercial has official appliances ranging from four drive SOHO boxes up to full racks of disks with NVDIMM caching and multiple 100G interfaces. https://www.truenas.com/systems-overview/ e:f;b
|
|
#
?
Dec 24, 2020 15:30
|
|
|
UnRAID is DIY but once you get it set up it's pretty smooth sailing and very good. You even get the flexibility to mix and match drive sizes (limited by the size of your parity drive).
|
|
#
?
Dec 24, 2020 18:16
|
|
|
Matt Zerella posted:UnRAID is DIY but once you get it set up it's pretty smooth sailing and very good.
|
|
#
?
Dec 24, 2020 19:10
|
|
|
BlankSystemDaemon posted:Will someone please think of the quote:zpool upgrade datastore
|
|
#
?
Dec 24, 2020 21:20
|
|
|
Ugh, I hosed up my build... My old N54L server died with a 6 drive ZFS pool. So I bought a Fractal Node 304 case, a mini itx mobo and ryzen 5 3600. Stupidly I assumed the CPU came with integrated graphics. So here is my problem, the motherboard has 4 sata ports and one PCI-E slot. I have a SATA card that will give me two additional sata ports but then I can't put a video card in. So my question is, can I boot to the BIOS and pre-OS environment with a USB video card? If not then it looks like my only option is to sell the 3600 and look for a ryzen 5 chip with integrated graphics. Is this correct?
|
|
#
?
Dec 25, 2020 03:24
|
|
|
kiwid posted:Ugh, I hosed up my build... You need one of the APU Ryzens for integrated graphics, the zen2 ones are not out yet and it’s fairly limited what you can get if you’re not an OEM. They’re also less beefy than the non APU CPUs iirc (max quad core etc) One option if you aren’t using the m.2 socket is this bad boy: https://www.asrockrack.com/general/productdetail.asp?Model=M2_VGA#Specifications
|
|
#
?
Dec 25, 2020 03:34
|
|
|
kiwid posted:Ugh, I hosed up my build... I think you can configure things such that you use the GPU for initial bring up and then leave it out, but I never actually tried it. Had a 3900X build that was similar and just ended up sucking it up and dremeling out a x1 slot.
|
|
#
?
Dec 25, 2020 03:35
|
|
|
priznat posted:You need one of the APU Ryzens for integrated graphics, the zen2 ones are not out yet and it’s fairly limited what you can get if you’re not an OEM. They’re also less beefy than the non APU CPUs iirc (max quad core etc) I'm not using the M.2 slot. That looks interesting. Where can I actually buy it? edit: is it possible to reduce the drives in a ZFS pool with FreeNas? Maybe considering going down to just 4 drives. movax posted:I think you can configure things such that you use the GPU for initial bring up and then leave it out, but I never actually tried it. Had a 3900X build that was similar and just ended up sucking it up and dremeling out a x1 slot. Yeah I might just set it up with the video card in it then swap it over to the SATA card. The SATA card has an external switch to put it in AHCI mode. kiwid fucked around with this message at 04:02 on Dec 25, 2020 |
|
#
?
Dec 25, 2020 03:41
|
|
|
Yeah that m.2 vga is probably going to be a bit niche to find, we deal with a direct sale vendor at work and they were offering them for $17ea. Setting up with a gpu then going headless after install is probably going to be the better option just due to it being a pain to find in non b2b.
|
|
#
?
Dec 25, 2020 04:08
|
|
|
kiwid posted:edit: is it possible to reduce the drives in a ZFS pool with FreeNas? Maybe considering going down to just 4 drives. You can, however, get a SATA port multipliers, because SATA3 runs at around 550MBps with all overhead accounted for, and spinning rust maxes out at ~160MBps for streaming I/O - so you can run more than one disk off one SATA port. Does the motherboard not have serial output? It might be easier to find a nullmodem cable and simply do things that way.
|
|
#
?
Dec 25, 2020 04:10
|
|
|
Sounds good. I'll go the headless route and work on figuring out a way to recreate the ZFS pool with 4 drives for the future.
|
|
#
?
Dec 25, 2020 04:13
|
|
|
priznat posted:Yeah that m.2 vga is probably going to be a bit niche to find, we deal with a direct sale vendor at work and they were offering them for $17ea. You could sell as many of those as you wanted on eBay for > $17, fwiw.
|
|
#
?
Dec 25, 2020 06:32
|
|
|
let's explore some dumbass solutions: 1) if your mobo supports pcie bifurcation, then you can bifurcate the lane into 2x8 and run both devices 2) sata expanders exist 3) I have seen at least one m.2 2280 to sata "card" out there 4) I have also seen m.2 to pci-e adaptors 5) that previously mentioned asrock m.2 display card 6) m.2 to u.2 adaptors are pretty common, then u.2 to sas.
|
|
#
?
Dec 25, 2020 06:33
|
|
|
Are there any good places to buy used custom NAS set ups? Just the rig, not the drives.
|
|
#
?
Dec 25, 2020 18:28
|
|
|
For people running FreeNAS in a VM, where do you store your FreeNAS VM? Right now I have it on another server on an nfs share but I don’t like having the dependencies. I also tried putting random usb flash drives in and I couldn’t get ESX to see it or I’m dumb and couldn’t figure out how to show it correctly.
|
|
#
?
Dec 25, 2020 18:51
|
|
|
I run ESXi off a SSD that also houses my FreeNAS VM file. The config gets backed up regularly, so I'm not terribly worried about losing that drive.
|
|
#
?
Dec 25, 2020 19:29
|
|
|
I'm booting ESXi off a thumb drive, then I have an NVMe SSD for a local VMware data store.
|
|
#
?
Dec 25, 2020 20:12
|
|
|
I am still wigged out by running ESXi off a USB stick because, USB, but earlier in the thread, I guess it’s still common in production, just gets run out of memory and as long as you back up config, it’s OK, I guess? Is there a setting on where to shove log files?
|
|
#
?
Dec 25, 2020 20:36
|
|
|
|
| # ? May 23, 2024 17:46 |
|
|
If the thumb drive fails everything keeps running, but will fail on a reboot. You can dump log files to a syslog server or a data store. Or just black hole them for home stuff. Edit, also ESXi config is super minimal, I don't bother backing that up.
|
|
#
?
Dec 25, 2020 20:41
|
|