|
Chimp_On_Stilts posted:Do y'all do cloud backups for large amounts of data from your NAS? (Like, 30TB+) Depends on your definition of 'cheap.' I've set up synology boxes at my parents house and my brother's house. The deal being that they get access to my Plex library on a NAS they can use and in return, the stuff I genuinely cannot afford to lose is backed up on the synos. Naturally that will probably be a big outlay for 30TB of data unless you're happy to use ex-datacentre drives, but the 'upside' of the big initial outlay is no monthly fees and, depending upon physical distance/internet speed you're assured of a swift data recovery if you need it.
|
# ? Dec 6, 2023 10:32 |
|
|
# ? May 25, 2024 22:08 |
|
Are they all on beefy fibre lines or did you do the initial sync with the box locally
|
# ? Dec 6, 2023 11:01 |
|
Anyone have experience with on-prem object storage? I'm thinking Dell ECS, Scality Artesca/Ring Ideally a hardware appliance I can just deploy and scale. Interested in hearing quotes people have had, just out of curiosity. It'll be for backup. Edit: oh, and I should include Cohesity here too
|
# ? Dec 6, 2023 11:14 |
|
Chimp_On_Stilts posted:Do y'all do cloud backups for large amounts of data from your NAS? (Like, 30TB+)
|
# ? Dec 6, 2023 11:16 |
|
HalloKitty posted:Anyone have experience with on-prem object storage? https://forums.somethingawful.com/showthread.php?threadid=2943669
|
# ? Dec 6, 2023 11:17 |
|
Whoops, I ended up in the wrong thread. Cheers.
|
# ? Dec 6, 2023 11:29 |
|
Thanks Ants posted:Are they all on beefy fibre lines or did you do the initial sync with the box locally The initial backup was all over LAN, but their internet connections are fine for the regular sync work. One is a 300/10Mbps Starlink and the other is garden variety copper at 50/5Mbps so they can fully saturate my gigabit line's upload speed on the odd occasion something big is added to my 'cannot lose these' files like importing a bunch of raw photographs.
|
# ? Dec 6, 2023 11:53 |
|
Is there some way to spin up a windows VM on my Synology and connect my TV to it (maybe using my Apple TV)? It would be nice to have a desktop environment to stream things from a regular browser (for instance YouTube with the SponsorBlock extension).
|
# ? Dec 6, 2023 19:42 |
Does anyone have experience with QuTS Hero? It's apparently a ZFS based appliance OS for QNAP systems with 8GB RAM or more.
|
|
# ? Dec 6, 2023 20:42 |
|
A linux VM may be easier just because they tend to have the right drivers out of the box and no license requirements. Beyond that, it looks like Synology has a VM manager, so give it a shot? The hard part is going to be the streaming - we solved it here by getting one of those mini-PCs and hooking it up instead of finding out how you'd do that.
|
# ? Dec 6, 2023 20:46 |
|
Yeah it seems like it’s mainly the streaming part that’s the issue. I’d love to not have to get another box to connect to the TV since I already have the Apple TV and the NAS right next to it though
|
# ? Dec 6, 2023 20:50 |
|
Nitrousoxide posted:I don't really see why anyone would use Unraid if you have even a modest level of technical acumen. TrueNAS is free, doesn't have any of that license bullshit, has a better file system, and if you really want to run containers on the same device you're using as a NAS you can use its built-in container engine (with scale) or spin up a vm (both core and scale) and use any server OS you want. I've worked with FreeBSD for a good chunk of my life and I just don't want to deal with it at home. ZFS is insane overkill for Linux ISOs, I don't care about data integrity for a media server. I just run a cron job that dumps a directory listing of my shares once a month and emails it. I work nutty hours and want minimal computer janitoring which unRAID is fantastic for. If I need the CLI it's there but most of the time I never need it, the GUI and community support is excellent. I have a bunch of mixed 10-14TB drives and parity calcs take hilariously long but they're fine. I think I paid like $80 for it several years ago, the cost is a handwave.
|
# ? Dec 6, 2023 21:45 |
|
Flyndre posted:Yeah it seems like it’s mainly the streaming part that’s the issue. I’d love to not have to get another box to connect to the TV since I already have the Apple TV and the NAS right next to it though Could you pass a USB DisplayLink device through to the VM? I don't know if a Synology device supports that.
|
# ? Dec 6, 2023 21:57 |
|
Flyndre posted:Is there some way to spin up a windows VM on my Synology and connect my TV to it (maybe using my Apple TV)? It would be nice to have a desktop environment to stream things from a regular browser (for instance YouTube with the SponsorBlock extension). For YouTube it might be better to get an android TV box and use SmartTube? I guess there might possibly be an equivalent app for the apple TV, but I have nearly no knowledge about that platform.
|
# ? Dec 6, 2023 23:10 |
My personal recommendation is to get an Amazon fire stick. They are super cheap. Grab the "Downloader" app off the appstore on it and then use that to side load SmartTube. SmartTube has its own built-in updater so you don't need to worry about it getting out of date or something.
|
|
# ? Dec 6, 2023 23:28 |
|
hogofwar posted:For YouTube it might be better to get an android TV box and use SmartTube? I guess there might possibly be an equivalent app for the apple TV, but I have nearly no knowledge about that platform. This. Apple TV if that is your ecosystem. Nvidia Shield TV if you need bitstreaming audio (Dolby TrueHD or DTS HD-MA), or prefer android. Roku for dead simple.
|
# ? Dec 7, 2023 04:35 |
|
Someone pointed out that you can sign up for a YouTube family plan at $4/month if you VPN to Ukraine if you want to save some money/hastle. I did it last week and it works perfectly.
|
# ? Dec 7, 2023 14:08 |
|
Paying for YouTube still doesn't get you SponsorBlock, and IMO using SmartTube/yt-dlp is honestly nicer and more ethical than abusing regional pricing.
|
# ? Dec 7, 2023 15:35 |
|
Keito posted:Paying for YouTube still doesn't get you SponsorBlock, and IMO using SmartTube/yt-dlp is honestly nicer and more ethical than abusing regional pricing. I don't know about smarttube as I'd not consider using smart tv functions, but sponsorblock is boss. Blocking all the ads is free and gets you a better experience than paying.
|
# ? Dec 7, 2023 17:13 |
|
I have been tasked with coming up with a strategy to back up ~ 50 tb from one server to another (on the same intranet).
we also want to prune the files kept on the server by access timestamp so we no longer have to keep 44 TiB in the directory. this might be a little separate from backing up, cause we don't want to remove these files from the backups, unless there is an append-only solution? also, for pruning little-used files, is there a way to keep around a "ghost" of the file (kind of like in the Dropbox selective sync ui) in the source filesystem that indicates it was there but is now backed up? the backup will be backed up regularly offsite by the admin of the windows server, so i am off the hook there. i need to find some software and write some scripts to get this going. i've used rsync, borg, and timeshift before, but never on such a scale. thank you for any pointers/symlinks/junctions.
|
# ? Dec 9, 2023 21:56 |
|
Chimp_On_Stilts posted:Do y'all do cloud backups for large amounts of data from your NAS? (Like, 30TB+) Surprised this didn't get an answer, but Amazon S3 Glacier is basically dirt cheap offsite storage, and is basically what I'm probably going to use. Their deep storage (which is hard to retrieve but for most personal backups that shouldn't be a regular concern) would be around 30 bucks a month for 30 TB, give or take. https://aws.amazon.com/s3/pricing/. I'm not sure if anyone else can match that price, but I'll look around myself. Whenever I finally get around to setting up my offsite setup I'll post in here with details. That being said, the answers you did get (don't bother backing up poo poo you can get again like movies/etc) are also good, because 30 bucks a month is still a few hundred a year and why bother backing something up you can either stream or download again. Alternatives to a cloud storage provider would be things like 'having a set of drives in a safety deposit box/etc' but honestly like...none of those are super great options.
|
# ? Dec 10, 2023 21:45 |
|
BlankSystemDaemon posted:Does anyone have experience with QuTS Hero? It's apparently a ZFS based appliance OS for QNAP systems with 8GB RAM or more.
|
# ? Dec 11, 2023 12:49 |
|
I just can't take A NAP seriously after seeing that their marketing made a Btrfs hate page: https://www.qnap.com/solution/qnap-ext4/en/
|
# ? Dec 11, 2023 15:48 |
|
Twerk from Home posted:I just can't take QNAP seriously after seeing that their marketing made a Btrfs hate page: https://www.qnap.com/solution/qnap-ext4/en/ Edit: gently caress, quote isn't edit. I'm leaving the original now. I guess I needed A NAP yesterday.
|
# ? Dec 11, 2023 15:48 |
|
Their file system speed comparison is an 8 core Ryzen vs. a Synology dual core Pentium. If the argument being made is "QNAP gives you more performance for the same budget" then maybe that's a fair comparison, otherwise lol.
|
# ? Dec 11, 2023 16:30 |
|
they're cowards and bullies for picking on poor little btrfs instead of going after zfs
|
# ? Dec 11, 2023 17:10 |
Clark Nova posted:they're cowards and bullies for picking on poor little btrfs instead of going after zfs
|
|
# ? Dec 11, 2023 22:11 |
|
I'm on Fedora and I know I'm going to want to reinstall the OS every few years. I have four 8tb platter drives and my plan right now is to build a RAID10 with md. I'm pausing to check though, because when I move to the next Fedora I want to be absolutely sure that I can rebuild the array afterwards. Is there anything I should know before I start?
|
# ? Dec 12, 2023 02:23 |
|
It's only been a couple weeks, but I am liking TrueNAS Scale, so far. I still need to learn how to create my own TrueChart via K8/Kubernetes or whatever, but I think I have a handle on most every other feature that I am likely to use.
|
# ? Dec 12, 2023 04:22 |
Salt Fish posted:I'm on Fedora and I know I'm going to want to reinstall the OS every few years. I have four 8tb platter drives and my plan right now is to build a RAID10 with md. I'm pausing to check though, because when I move to the next Fedora I want to be absolutely sure that I can rebuild the array afterwards. Is there anything I should know before I start? The installation on my laptop started out life as FreeBSD 6.0-RELEASE on a desktop with a Intel Pentium 4 Prescott E0, and it's been on at least two completely distinct systems in between then. I know it used to be a thing with Windows, where you'd need to reinstall every 6 months to avoid some slow-down, because that's the reason why I switched to FreeBSD in 2000 to begin with - but I find it hard to believe that it's true for anything not-Windows, and especially in the year 2023.
|
|
# ? Dec 12, 2023 10:59 |
|
My Synology 1515+ has recently started rebooting itself randomly, and after sending the logs to support they said "motherboard problem, you're out of warranty, soz." I'd rather not spend $900 on a new bay right now. With "automatically restart after power supply issue" turned off, it does not turn it self back on which indicates a power supply issue, so I'm going to attempt to replace it. Has anyone done this before and have any advise?
|
# ? Dec 12, 2023 18:18 |
|
Salt Fish posted:I'm on Fedora and I know I'm going to want to reinstall the OS every few years. I have four 8tb platter drives and my plan right now is to build a RAID10 with md. I'm pausing to check though, because when I move to the next Fedora I want to be absolutely sure that I can rebuild the array afterwards. Is there anything I should know before I start? On my personal computer I had fedora going for more than a decade, just upgrading from release to release until I tried out Arch to just come back to fedora in few months. The current installation has been going for 4 years now. Again, just upgrading. You shouldn't need to reinstall, pretty much never, baring any critical, OS-killing bugs, of which I haven't seen yet in Fedora at all.
|
# ? Dec 12, 2023 20:10 |
|
Yeah I'd say if you're going to bother reinstalling your OS regularly you should be looking at something like Ansible / Docker / etc to make sure you're forcing yourself to be ready, but I haven't actually done any hardware RAID support for something like that.
|
# ? Dec 12, 2023 20:20 |
|
With Synology's settings, if I want to prioritize the longevity of the drives, should I be trying to keep the drives active whenever possible, or spun down whenever possible? Also, the new 18TB Easystore I'm using to back up the array sounds like grinding gears when it spins up. I was pretty disturbed when I first set it up until I googled about it and found videos of other people asking on Reddit about identical noises, haha.
|
# ? Dec 12, 2023 20:29 |
Other the the initial distrohopping I did when I first picked up Linux I've stuck with Fedora Workstation since -- for the last 3ish years. If I were to need to reinstall now though it'd be to install silverblue.
|
|
# ? Dec 12, 2023 22:21 |
|
There's sure some BRT related fixes going into OpenZFS right now.
|
# ? Dec 13, 2023 19:36 |
|
Some of the 25TB seagate EXOS drives have been leaking out of the hyperscaler market to the secondary. They're host-managed SMR, not available for consumers and don't work with pretty much everything except some specific highend SAS chips. ... and if you use a normal filesystem on them they melt down instantly. 2 IOPS for random writes. Not a typo. 2. Then the storage stack crashes. Kinda tempted get some to throw logfs on. They have incredible random read IOPS for spinning rust - nearly 10x what a 20tb CMR drive can do. For something that gets laid down once and not edited (linux ISOs, pictures, blob-based backup systems, etc) they'd probably work pretty well.
|
# ? Dec 15, 2023 05:14 |
|
So on my synology I have 1 bay reserved for a SSD, which is where I run my apps and plex off of. That drive is starting to get full and I want to upgrade it, but because it's not a pool I'm going to have to copy everything to the new drive. Is there a good/straightforward way to do this? Right now I think my plan is to manually move the volume storage location of the app data to my HDD volume, do a backup, and then restore from backup to the new drive and re-point everything over to the new SSD.
|
# ? Dec 15, 2023 05:34 |
|
Harik posted:Some of the 25TB seagate EXOS drives have been leaking out of the hyperscaler market to the secondary. They're host-managed SMR, not available for consumers and don't work with pretty much everything except some specific highend SAS chips. Apparently if you want to play with these, btrfs supports them too: https://www.chia.net/2022/02/22/zoned-storage-using-smr-drives-for-chia-farming/
|
# ? Dec 15, 2023 05:35 |
|
|
# ? May 25, 2024 22:08 |
|
Twerk from Home posted:Apparently if you want to play with these, btrfs supports them too: https://www.chia.net/2022/02/22/zoned-storage-using-smr-drives-for-chia-farming/ I'd prefer to move away from btrfs, especially for multi-drive applications. But yes, COW filesystems are in a good place to take advantage of HM-SMR as long as their allocation rules are done correctly. chia, aside from being a shitcoin scam, is also a WORM system that recommends you mount your filesystem read-only. I wouldn't expect it to get great IOPS on HM-SMR because it's Q1 random reads - chia is an enormous game of pointer chasing, so every read depends on the result of the read before it. I suppose you could be chasing 32 pointer chains at a time to keep the queue depth up but I've already blown way past the amount of fucks I give for scams to turn money into wasted hardware and energy. That doesn't translate well into real-world use where you've got a lot of metadata that needs to be updated for every write. In a filesystem where I trust multi-drive redundancy (i.e. not btrfs) you could put the metadata on flash or optane and the data on hm-smr. e: interposing dm-zoned on host-managed or host-aware smr apparently solves a lot of the issues. Does nothing for stealth SMR drives but those are just ewaste. Harik fucked around with this message at 19:23 on Dec 15, 2023 |
# ? Dec 15, 2023 18:50 |