|
I would not be mixing ZFS into the Fuse based array. I'd stick with XFS.
|
# ? May 18, 2023 22:31 |
|
|
# ? May 31, 2024 08:35 |
|
Mr. Crow posted:Man look like google is finally cracking down on google workspace and they're gonna restrict my unlimited storage for $20/month to 5TB (for $20, 5 more for every $20 iirc) how quickly do you need access to it? backblaze is unlimited
|
# ? May 18, 2023 22:32 |
|
Matt Zerella posted:I would not be mixing ZFS into the Fuse based array. I'd stick with XFS.
|
# ? May 18, 2023 22:43 |
|
e.pilot posted:how quickly do you need access to it? backblaze is unlimited Its not super urgent cause it just goes read-only in two months, the unlimited is for windows only though right? Does it work if I e.g. have a windows guest with a read-only nfs share? Or does it have to be physically mapped drives on a windows host?
|
# ? May 18, 2023 22:58 |
|
Mr. Crow posted:Its not super urgent cause it just goes read-only in two months, the unlimited is for windows only though right? Does it work if I e.g. have a windows guest with a read-only nfs share? Or does it have to be physically mapped drives on a windows host? duplicati can back up to it https://www.backblaze.com/blog/duplicati-backups-cloud-storage/
|
# ? May 18, 2023 23:47 |
|
e.pilot posted:duplicati can back up to it That's using B2 to their object store, not the unlimited.
|
# ? May 18, 2023 23:51 |
|
Hughlander posted:That's using B2 to their object store, not the unlimited. ah poo poo I didn’t know that, I haven’t looked that deeply into it I’m just using googles annual 2tb plan, was planning on backblaze if that ever got full but welp
|
# ? May 18, 2023 23:52 |
|
withoutclass posted:Still not sure what a ZFS pool of 1disk does or why anyone would bother. Years ago I had a LVM JBOD volume across a bunch of drives running ext4 and I lost one drive. Some files were damaged, some files were destroyed, and a lot were fine. The catch was I had no idea which ones were which, so I spent a lot of time writing shell scripts to have ffmpeg check the media, opening other files manually, and eventually just saying "gently caress it" and deleting entire subdirectories. If I had for whatever nonsensical reason been running ZFS on that volume I'd still have lost files but I'd have known for sure which ones I lost within however much time it took a scrub to run, and realistically regular scrubs would have likely revealed the failing drive before it entirely gave up.
|
# ? May 19, 2023 02:24 |
|
Single-drive ZFS also lets you use compression - which is probably pointless but harmless if you're storing compressed video files, but can give you a decent space and performance boost if your data is compressible.
|
# ? May 19, 2023 11:20 |
|
ZFS compression saved a fair bit of space for me, on documents and misc crap that wasn't already compressed.
|
# ? May 19, 2023 11:37 |
|
Wibla posted:ZFS compression saved a fair bit of space for me, on documents and misc crap that wasn't already compressed. It's also hilariously effective on uncompressed DNA and RNA sequencing data, but I accept that this may be a niche use.
|
# ? May 19, 2023 11:44 |
|
Computer viking posted:It's also hilariously effective on uncompressed DNA and RNA sequencing data, but I accept that this may be a niche use. Considering the amount of junk data there's in DNA, that's not a surprise
|
# ? May 19, 2023 12:10 |
Computer viking posted:It's also hilariously effective on uncompressed DNA and RNA sequencing data, but I accept that this may be a niche use. Oh?? That changes things
|
|
# ? May 19, 2023 12:18 |
|
Wibla posted:Considering the amount of junk data there's in DNA, that's not a surprise Ha, you're not wrong. At least the RNAseq is like a sparknotes version.
|
# ? May 19, 2023 12:28 |
Yeah, I have a single drive pool on my OpenMediaVault server, and it saves a bit of space through the compression.code:
|
|
# ? May 19, 2023 13:13 |
That Works posted:Oh?? That changes things For real, I mean its basically text files so should easily compress. I do wonder what the compression values are like because that would be awesome to save a ton of space.
|
|
# ? May 19, 2023 14:54 |
|
Not just any kind of text files but ones that have a very darn small plaintext symbol space so encodings can be very, very efficient. In fact, I'm kind of surprised that people don't by default use a common format that lets researchers avoid using tons of data for no good reason but given these are likely academicians I'm somewhat not surprised that they're more interested in doing stuff that works for their own purposes than trying to use industry standards. NIH is such a big problem in academic spaces it was frustrating enough to keep me from ever bothering with continuing studies (on top of other factors, sure).
|
# ? May 19, 2023 16:06 |
|
necrobobsledder posted:Not just any kind of text files but ones that have a very darn small plaintext symbol space so encodings can be very, very efficient. In fact, I'm kind of surprised that people don't by default use a common format that lets researchers avoid using tons of data for no good reason but given these are likely academicians I'm somewhat not surprised that they're more interested in doing stuff that works for their own purposes than trying to use industry standards. NIH is such a big problem in academic spaces it was frustrating enough to keep me from ever bothering with continuing studies (on top of other factors, sure). These files are typically always handled in a compressed form though, which effectively takes advantage of the small symbol space. They get insanely good compression ratios with plain old gzip, and there's also a whole host of other better options including things like bgzip that allows reasonably performance random reads in compressed files. It's only a very rare tool that can't read/write these files in compressed form, and even if you get unlucky there you can probably just feed it stdin/stdout and not store anything uncompressed.
|
# ? May 19, 2023 16:54 |
|
Nitrousoxide posted:Yeah, I have a single drive pool on my OpenMediaVault server, and it saves a bit of space through the compression.
|
# ? May 19, 2023 17:16 |
|
Shucking easystores still the way to fill up a synology? Like this: https://www.bestbuy.com/site/wd-easystore-8tb-external-usb-3-0-hard-drive-black/6425302.p?skuId=6425302 $150 https://www.bestbuy.com/site/wd-easystore-12tb-external-usb-3-0-hard-drive-black/6425301.p?skuId=6425301 $205 Little annoying I have several 10TB ones and want to replace a 3TB to grab some extra space, and yet no 10TB. What's the current pricing situation look like?
|
# ? May 20, 2023 03:04 |
|
H110Hawk posted:Shucking easystores still the way to fill up a synology? Like this: I bought 2x 18 TB easystores at Best Buy for $285 each a couple months ago I dunno about synologies but I had to tape over a couple of the power pins to get my desktop to recognize them
|
# ? May 20, 2023 03:15 |
|
Mr. Crow posted:Man look like google is finally cracking down on google workspace and they're gonna restrict my unlimited storage for $20/month to 5TB (for $20, 5 more for every $20 iirc) Back of the envelope has Google cloud cold at about 30/mo for 24TB. I have a few TB up there with CloudBerry and I've been happy, but I only do files, not images.
|
# ? May 20, 2023 04:14 |
|
https://shucks.top/ keeps track of current/lowest/recent prices on the drives worth shucking. They're still a good way to get new, good drives for cheap but only when they're on sale. That happens quite frequently at least.
|
# ? May 20, 2023 04:23 |
|
FunOne posted:Back of the envelope has Google cloud cold at about 30/mo for 24TB. I have a few TB up there with CloudBerry and I've been happy, but I only do files, not images. Never looked into it but assume egress is insane? Glacier is like $130 a TB
|
# ? May 20, 2023 04:31 |
|
Mr. Crow posted:Never looked into it but assume egress is insane? Glacier is like $130 a TB Oh yeah, close to $50/TB in retrieval alone, before network.
|
# ? May 20, 2023 04:45 |
|
THF13 posted:https://shucks.top/ keeps track of current/lowest/recent prices on the drives worth shucking. They're still a good way to get new, good drives for cheap but only when they're on sale. That happens quite frequently at least. Awesome thanks.
|
# ? May 20, 2023 04:58 |
|
What is the absolute easiest way to backup photos with some redundancy? I don't want to spend a huge amount just to back up family photos, but my current system is very not good: Currently they are just on 1TB drive in the PC, with periodic manual backup to an external drive, which is then stored at a family member's house. Total storage demand currently is 1TB, but obviously likely to go up. First concern: drive failure during backup - this 1TB drive these photos are on is seriously long in the tooth and I now treat it with caution. Everything needs to come off the drive and onto new storage but I don't know how to do this in the most gentle manner. Second concern: what do I move to? My preference would be local redundancy to cover disk failure paired with a low cost online storage which would only be used if there was a fire or something managed to wipe all the local. My current thoughts: off the shelf 2 port PCI RAID card (£60) dropped into the PC with 2x 6TB (2x£150) with cloud cold storage (Glacier? I'm not clear on how to actually accomplish this). I don't use plex or store any other media to speak of, and I don't really want the upfront or ongoing expense of running a NAS (especially as there is no intention to access the photos remotely). Clearly anything is better than my current system, but working out what to actually do is very confusing!
|
# ? May 20, 2023 16:43 |
|
CancerCakes posted:What is the absolute easiest way to backup photos with some redundancy? I don't want to spend a huge amount just to back up family photos, but my current system is very not good: Currently they are just on 1TB drive in the PC, with periodic manual backup to an external drive, which is then stored at a family member's house. Total storage demand currently is 1TB, but obviously likely to go up. Honestly - first step I would recommend is pony up for a paid sub of OneDrive or GDrive and move the files there. If you want to get more extravagant later, great. As to “the most gentle way” - that’s hard to control so I’d probably start with just doing the upload to OneDrive/GDrive. If the drive fails, as long as the platters are in tact, you can find an expert that could recover the data. Think computer forensics person or even some photography shops may have a computer nerd that does it.
|
# ? May 20, 2023 17:17 |
|
The most gentle way is probably to get another 1+TB drive and then disk clone the drive with Macrium Reflect, Acronis or similar. It will read the drive from start to end linearly, that should minimize moving the read head. Unless there is a lot of free space, then a normal copy might be gentler overall.
|
# ? May 20, 2023 17:41 |
|
I got an old NAS from work, a Thecus N7710-G, and I'm trying to set it up as a time machine backup for our home stuff. I'm running OSX Monterey on my old laptop to try and get everything setup. As far as I can tell, I should simply be able to go to the network services, turn on AFP, and then set a folder as useable for time machine. I do this, but when I try and tell Time Machine to backup to that directory, I get a message (after an unusually long wait): "There was a problem connecting [...] The server may not exist or is not connected at this time, check the server name or ip address [yadda yadda]" I did some basic looking around, and suggestions of making sure the disk isn't mounted already, and also to disable SMB, which I have also done. However, these were tips from many years ago, so IDK if any of this is still relevant. Any further suggestions?
|
# ? May 20, 2023 18:11 |
|
Fanged Lawn Wormy posted:I got an old NAS from work, a Thecus N7710-G, and I'm trying to set it up as a time machine backup for our home stuff. Time machine expects smb3 on current macos, that thecus only does smb1. Try enabling AFP on that nas and see if monterey likes it, otherwise i would e-waste it.
|
# ? May 20, 2023 19:24 |
|
ahhh shucks. I've got AFP on, I figured it may be a this-poo poo-is-too-old problem.
|
# ? May 20, 2023 19:37 |
|
CancerCakes posted:What is the absolute easiest way to backup photos with some redundancy? I don't want to spend a huge amount just to back up family photos, but my current system is very not good: Currently they are just on 1TB drive in the PC, with periodic manual backup to an external drive, which is then stored at a family member's house. Total storage demand currently is 1TB, but obviously likely to go up. replace your external drive with two external drives and also throw everything into backblaze. I would love to use it for the same reason but uploading my photo collection is just unfeasible on my dogshit 25/3 cable internet
|
# ? May 20, 2023 19:45 |
|
Mr. Crow posted:Man look like google is finally cracking down on google workspace and they're gonna restrict my unlimited storage for $20/month to 5TB (for $20, 5 more for every $20 iirc) I haven't used it myself, but ArsTechnica recently mentioned https://www.idrive.com/ which seems to be quite cheap ($12.5 per month for 20TB or $31.25 for 50TB, if you pay for 2 years at once). https://arstechnica.com/information-technology/2023/02/ars-archivum-top-cloud-backup-services-worth-your-money/
|
# ? May 20, 2023 20:23 |
|
I use idrive and it works well for me. I've backed up 3+tb over 3 computers and have restored things from it multiple times in the past with no issue. As far as plug and play online backup solutions it works perfectly for me.
|
# ? May 20, 2023 23:19 |
|
I use idrive as well. Watch for sales, they often do like 90% off. Something around $10 for a year for 2tb of resold s3 storage I do consider it a risk due to price, but Ive used them for at least 3 years now without a problem.
|
# ? May 21, 2023 12:58 |
|
Anyone know for Unraid when a docker shows up like this: does that mean that the docker image is no longer being maintained and should switch to the other one (if there is one)?
|
# ? May 22, 2023 00:18 |
|
priznat posted:Anyone know for Unraid when a docker shows up like this: Find the docker patch plugin and install it. This is fixed in the new version apparently.
|
# ? May 22, 2023 00:36 |
|
Matt Zerella posted:Find the docker patch plugin and install it. This is fixed in the new version apparently. Nice, thanks that did it!
|
# ? May 22, 2023 04:32 |
|
|
# ? May 31, 2024 08:35 |
|
Also install the auto update plugin. It does your plugins and docker, very useful. And yes you can pick a d choose if you have some that you don't want auto updated.
|
# ? May 22, 2023 10:29 |