Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Keito
Jul 21, 2005

WHAT DO I CHOOSE ?

Nitrousoxide posted:

I do live backups for databases like Nextcloud too. Probably not ideal for that but it's not corrupted on me yet on a restore.

For databases you should use their dumping utilities, like pg_dump/pg_dumpall for PostgreSQL. Always (afaik) much smaller size than the data directory, and also ensures that the backup is consistent even if the database is being written to while you're dumping it.

~Coxy posted:

I miss XBMC. No "libraries", no debating whether something is a "TV show" or a "movie", no naming scheme or album art, just browse a SMB file share and see all the files and folders that are in it.

You can still use Kodi exactly like that if you want. I prefer having metadata loaded though.

Adbot
ADBOT LOVES YOU

Warbird
May 23, 2012

America's Favorite Dumbass

Got around to playing with Synology drive the other day after a year or two of not really caring/bothering and it’s pretty magical. Being able to have those files be local when I need them is a hoot on the laptop. A bit less so on the desktop as it’s hardwired in all the time and not hurting for storage, but still. I hope they get a Linux ARM build out soon so I can replace borg with it for my RasPi workstation backups.

Well Played Mauer
Jun 1, 2003

We'll always have Cabo

Warbird posted:

Got around to playing with Synology drive the other day after a year or two of not really caring/bothering and it’s pretty magical. Being able to have those files be local when I need them is a hoot on the laptop. A bit less so on the desktop as it’s hardwired in all the time and not hurting for storage, but still. I hope they get a Linux ARM build out soon so I can replace borg with it for my RasPi workstation backups.

I really like it, too. It's great for shuttling reference files around different machines. I've been using pCloud previously but have slowly been moving over to Paperless-ngx with files stored on the NAS, and Synology Drive for separate use cases.

FAT32 SHAMER
Aug 16, 2012



Are there any strong opinions on best ways to back up and sync iCloud Photos to a synology and reduce our storage subscriptions for iCloud?

I’d like to reduce our iCloud subscriptions down from the $10/user/mo for 2TB each, but I’m also a whiny baby about hands off syncing and like the native iOS/macOS Photos.app features. I downloaded Synology Photos last night to give it a whirl, and it looks like the companion mobile app allows you to backup while on the LAN (and I’m assuming if I put Tailscale on both of our phones, we can do it whenever we turn it on while on any wifi as well). Is SP’s photo management as good as apples native stuff?

Finally, I mentioned this in the NAS thread but may as well ask here as well: what is the best way to dump your iCloud Photos onto your nas and sync the latest to it? Is there a solution available to dump and sync iCloud, and then manage and organise using SP instead of having to deal with backing up using the SP backup feature? I’ve only skimmed the documentation for icloudpd, but it’s probably a better idea to ask the pros and go from there instead of striking out on my own :)

Dyscrasia
Jun 23, 2003
Give Me Hamms Premium Draft or Give Me DEATH!!!!
Does anyone deal with https on their internal networks? I know I could buy a domain name and use let's encrypt with a reverse proxy. While at work I would do this, it just seems like a lot of work for internal only service at home..

Warbird
May 23, 2012

America's Favorite Dumbass

I do, but only because I have a couple of internet exposed services and the red lock deal driving me insane. It’s pretty easy for me to add new domains now that I have things moved to DigitalOcean and use their CLI tool.

odiv
Jan 12, 2003

I use nginx proxy manager and letsencrypt and it was pretty easy. Less hassle than self-signed from what I've heard.

Tamba
Apr 5, 2010

Yes, I do exactly this. I have a domain that actually points to my servers local (192.168...) IP address and use NGP to handle all the certificate renewal stuff with letsencrypt without exposing the server to the internet.
That was the easiest way to stop all the "this site is not secure" warnings without having to mess with my own CA.

Tamba fucked around with this message at 01:48 on Feb 18, 2023

Dyscrasia
Jun 23, 2003
Give Me Hamms Premium Draft or Give Me DEATH!!!!
Thanks, I figured the best path was buying a real domain, everything falls into place after that.

Corb3t
Jun 7, 2003

FAT32 SHAMER posted:

Are there any strong opinions on best ways to back up and sync iCloud Photos to a synology and reduce our storage subscriptions for iCloud?

I’d like to reduce our iCloud subscriptions down from the $10/user/mo for 2TB each, but I’m also a whiny baby about hands off syncing and like the native iOS/macOS Photos.app features. I downloaded Synology Photos last night to give it a whirl, and it looks like the companion mobile app allows you to backup while on the LAN (and I’m assuming if I put Tailscale on both of our phones, we can do it whenever we turn it on while on any wifi as well). Is SP’s photo management as good as apples native stuff?

Finally, I mentioned this in the NAS thread but may as well ask here as well: what is the best way to dump your iCloud Photos onto your nas and sync the latest to it? Is there a solution available to dump and sync iCloud, and then manage and organise using SP instead of having to deal with backing up using the SP backup feature? I’ve only skimmed the documentation for icloudpd, but it’s probably a better idea to ask the pros and go from there instead of striking out on my own :)

There’s also something like PhotoPrism, which you’d use their mobile app to sync your photos with.

Syncing iCloud to other services like rclone is notoriously difficult, so I don’t think you’ll find many solutions that offer a hands off solution to that - you’ll need to rely on Synology or PhotoPrism’s mobile app to sync things. Hopefully they've adopted modern iOS APIs that allow for better background uploading.

I should stress that backing up important photos you can’t restore just to a NAS isn’t the best backup practice - I’d hate for a fire in your house destroying your backups. Cloud backups are certainly still recommended.

Corb3t fucked around with this message at 07:39 on Feb 18, 2023

SEKCobra
Feb 28, 2011

Hi
:saddowns: Don't look at my site :saddowns:

Tamba posted:

Yes, I do exactly this. I have a domain that actually points to my servers local (192.168...) IP address and use NGP to handle all the certificate renewal stuff with letsencrypt without exposing the server to the internet.
That was the easiest way to stop all the "this site is not secure" warnings without having to mess with my own CA.

What is NGP and how do you do that?

Tamba
Apr 5, 2010

https://nginxproxymanager.com/
e: once you have it set up, all you need to do is
- let it make a certificate for *.mydomain.com
- for each service add a proxy host like service1.mydonain.com that points at the server/port where the service is running, and select the certificate you made in step 1

Tamba fucked around with this message at 06:20 on Feb 18, 2023

Resdfru
Jun 4, 2004

I'm a freak on a leash.
I don't use nginx but I have the same thing set up with traefik, to give another option

Resdfru posted:

I did this on mine, it was pretty painless https://major.io/2021/08/16/wildcard-letsencrypt-certificates-traefik-cloudflare/

I have my domain pointed to an internal ip, so they only resolve internally but it's nice not having a bunch of cert errors

I briefly played with a cloudflare zero trust tunnel and it works nice and it's cool having sso in front of my stuff but I have a VPN and have no need for it so I turned it off

SEKCobra
Feb 28, 2011

Hi
:saddowns: Don't look at my site :saddowns:

Tamba posted:

https://nginxproxymanager.com/
e: once you have it set up, all you need to do is
- let it make a certificate for *.mydomain.com
- for each service add a proxy host like service1.mydonain.com that points at the server/port where the service is running, and select the certificate you made in step 1

Oh alright, I thought you were talking about something other than a reverse proxy and was interested to hear how that would work. Cheers for the explanation anyway.

spincube
Jan 31, 2006

I spent :10bux: so I could say that I finally figured out what this god damned cube is doing. Get well Lowtax.
Grimey Drawer

Dyscrasia posted:

Does anyone deal with https on their internal networks? I know I could buy a domain name and use let's encrypt with a reverse proxy. While at work I would do this, it just seems like a lot of work for internal only service at home..

If you're only accessing something from inside your home network, like your use case is 'getting Plex/Emby/Jellyfin/etc from NAS to TV' or 'occasionally checking the Pi you use as a torrent box', I wouldn't bother with https or even a domain; just add the 192.168.x.x to your bookmarks or something, or use a startpage like flame on a port you'll easily remember.

THF13
Sep 26, 2007

Keep an adversary in the dark about what you're capable of, and he has to assume the worst.
I use the SWAG docker container (formerly letsencrypt, name changes to avoid confusion) for an external facing reverse proxy.

I also separately have HA Proxy running on my pfsense router that is only listening on my trusted LAN interface that I can use to give anything internal a nice green padlock and avoid security warnings. You can definitely live without this, but it's nice.
A note mostly to homelabbers, I use a unique URL for the HA proxy address, one that doesn't match a machine or VM name since any non http/https connections to that FQDN will go to pfsense now and not to the HA proxy destination.

cruft
Oct 25, 2007

I've formerly used apache, then nginx, then traefik. These days I think caddy is the pro option for https reverse proxying.

Well Played Mauer
Jun 1, 2003

We'll always have Cabo
If I were interested in starting to host some services on a machine that isn't in my house, how would I go about searching for guides?

My thinking would be to use the domain I have for internal https certs and email, buy some hosting through dreamhost or whatever, and running some goofy poo poo like pastebins or an RSS reader that I don't have to Tailscale into. Just low risk stuff that if someone gets into the machine, they're not getting anything personal or valuable. Mostly I want to learn how to do it without exposing my home network.

I'm just not sure if that's called anything special, so trying to figure out where to start.

hogofwar
Jun 25, 2011

'We've strayed into a zone with a high magical index,' he said. 'Don't ask me how. Once upon a time a really powerful magic field must have been generated here, and we're feeling the after-effects.'
'Precisely,' said a passing bush.

Well Played Mauer posted:

If I were interested in starting to host some services on a machine that isn't in my house, how would I go about searching for guides?

My thinking would be to use the domain I have for internal https certs and email, buy some hosting through dreamhost or whatever, and running some goofy poo poo like pastebins or an RSS reader that I don't have to Tailscale into. Just low risk stuff that if someone gets into the machine, they're not getting anything personal or valuable. Mostly I want to learn how to do it without exposing my home network.

I'm just not sure if that's called anything special, so trying to figure out where to start.

I would recommend looking into VPS services, I use Hetzner for example. It will give you a small server you can SSH into and not really worry about. DigitalOcean is another option, and they have a decent amount of guides as well (which apply to most VPS services).

If you want to actually buy a physical machine and put it in some random house... make sure you have permission first.

cruft
Oct 25, 2007

hogofwar posted:

I would recommend looking into VPS services, I use Hetzner for example. It will give you a small server you can SSH into and not really worry about. DigitalOcean is another option, and they have a decent amount of guides as well (which apply to most VPS services).

If you want to actually buy a physical machine and put it in some random house... make sure you have permission first.

I'm a big fan of Linode, who just got acquired by Akamai.

Trapick
Apr 17, 2006

Digitalocean too - they've got some nice guides/tutorials and decent prices.

Fake edit: wow beaten, should have actually read previous replies fully, my bad.

Keito
Jul 21, 2005

WHAT DO I CHOOSE ?

cruft posted:

I've formerly used apache, then nginx, then traefik. These days I think caddy is the pro option for https reverse proxying.

Traefik is a lot more advanced as a reverse proxy, especially when working with containers. Caddy is simpler to use and also a web server.

Nitrousoxide
May 30, 2011

do not buy a oneplus phone



Traefik is cool too because you can just add labels to your Docker/Podman/Kubernetes containers and it'll pick it up and automatically generate the reverse proxy routing. If I were to start building my reverse proxy now I'd definitely use it. I'm already setup with NGINX Proxy Manager though so rather than reinvent the wheel I just keep adding any new services through that.

Well Played Mauer
Jun 1, 2003

We'll always have Cabo
I started poking around in Linode's documentation and it's fantastic. Just looking at some of the basic security stuff, it really simplified some things that took me a lot longer to learn by reading from other sources.

Corb3t
Jun 7, 2003

I know I recommended Photoprism for photo backups a few days ago, but I just came across this great Google photos ripoff called Immich.

It supports:
Google Photos-like WebUI
Live photos
Background Uploads (that are actually good and don't pause randomly like most other services)
Machine learning for recognizing subjects
iOS app (and Android, of course)

I can't stress how important it is to keep something like photos backed up in an offsite location using Amazon Photos, Google Photos, or iCloud, but this is a great way for NAS-based photo backups with minimal hand-holding once it's setup.

cruft
Oct 25, 2007

Immich seems to be the rising star of photo album software.

I'm currently writing a combination WebDAV server and image thumbnailer, to be used in conjunction with the CubilceSoft File Explorer because I'm tired of having to install some new thing and re-index all my photo albums every 2 years.

WebDAV winds up being a pretty badass way to make my files available on the Internet. It's a shame there aren't any really high-quality WebDAV phone clients right now. But I've been able to cobble together a working solution with PhotoSync and DAVx5.

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

Corb3t posted:

I know I recommended Photoprism for photo backups a few days ago, but I just came across this great Google photos ripoff called Immich.

It supports:
Google Photos-like WebUI
Live photos
Background Uploads (that are actually good and don't pause randomly like most other services)
Machine learning for recognizing subjects
iOS app (and Android, of course)

I can't stress how important it is to keep something like photos backed up in an offsite location using Amazon Photos, Google Photos, or iCloud, but this is a great way for NAS-based photo backups with minimal hand-holding once it's setup.

I was interested in trying this out after seeing it discussed recently on reddit but not being able to import an existing directory structure of photos was holding me back. Looks like they are working on it though:

PhotoPrism has been meeting my needs, I've been happy to support them. I just wish the ML was a little better at recognizing things!

Corb3t
Jun 7, 2003

fletcher posted:

I was interested in trying this out after seeing it discussed recently on reddit but not being able to import an existing directory structure of photos was holding me back. Looks like they are working on it though:

PhotoPrism has been meeting my needs, I've been happy to support them. I just wish the ML was a little better at recognizing things!

I've often loathed file/folder organization for file management, so this really isn't an issue for me (I'm too spoiled by tagging and smart filtering to ever go back to managing any files via folders), but nice to see that they're trying to add it.

Well Played Mauer
Jun 1, 2003

We'll always have Cabo
Yeah, I've been wanting try it out, but Synology Photos is covering me for my local backup. My latest project has been trying to make a switch over to desktop linux for my day to day poo poo.

Frankly it's been harder than setting up everything else I've done over the past couple months. I finally landed on a KDE Neon to get the latest version of Plasma. It actually doesn't suck with the Nvidia proprietary drivers! I spent some time in Gnome but didn't like how closed off it felt without finding/adding a zillion plugins. I'd previously used Cinnamon on Mint and it was very solid but boring. And like 20 years ago I ran Fluxbox on a Debian unstable install, which made me feel like a linux hipster.

Prior to this windmill, my last familial win was Tube Archivist. My kid now has "Plex Youtube" and it's not full of weird oversized families dressed as superheroes. (Why are all their kids blonde and why do they all look like the villains in Mighty Ducks movie?)

Blurb3947
Sep 30, 2022
I've got my photos on my Synology as well but Ente has been on my radar as a cloud backup solution. Created by someone who did work on Google Photos.

cruft
Oct 25, 2007

Well Played Mauer posted:

Yeah, I've been wanting try it out, but Synology Photos is covering me for my local backup. My latest project has been trying to make a switch over to desktop linux for my day to day poo poo.

Frankly it's been harder than setting up everything else I've done over the past couple months. I finally landed on a KDE Neon to get the latest version of Plasma. It actually doesn't suck with the Nvidia proprietary drivers! I spent some time in Gnome but didn't like how closed off it felt without finding/adding a zillion plugins. I'd previously used Cinnamon on Mint and it was very solid but boring. And like 20 years ago I ran Fluxbox on a Debian unstable install, which made me feel like a linux hipster.

Prior to this windmill, my last familial win was Tube Archivist. My kid now has "Plex Youtube" and it's not full of weird oversized families dressed as superheroes. (Why are all their kids blonde and why do they all look like the villains in Mighty Ducks movie?)

Gnome made some pretty polarizing UI desicions. I personally love Gnome 3, but it is definitely not for everyone.

Aware
Nov 18, 2003
Gnome3 for me feels far more natural on a laptop with a touchpad than a desktop, I absolutely prefer it to Windows, but on desktop for some reason it doesn't click for me.

THF13
Sep 26, 2007

Keep an adversary in the dark about what you're capable of, and he has to assume the worst.
It was brought up in the Plex thread in a slight derail, but thought it was better to talk about it here. Using code-server with Unraid's appdata folder mounted has been great. Especially using the dockermod for swag which autoreloads nginx when it detects valid changes. Thanks Matt Zerella

cruft
Oct 25, 2007

I don't suppose anybody in here knows whether btrfs mirroring (as opposed to btrfs on mdraid level 1) is something OpenMediaVault can handle?

If that isn't the nerdiest thing I've ever posted, I don't know what is.

Matt Zerella
Oct 7, 2002

Norris'es are back baby. It's good again. Awoouu (fox Howl)

THF13 posted:

It was brought up in the Plex thread in a slight derail, but thought it was better to talk about it here. Using code-server with Unraid's appdata folder mounted has been great. Especially using the dockermod for swag which autoreloads nginx when it detects valid changes. Thanks Matt Zerella

You're welcome but credit to Ibracorp for the idea. Also DO NOT expose that publicly.

Motronic
Nov 6, 2009

fletcher posted:

I was interested in trying this out after seeing it discussed recently on reddit but not being able to import an existing directory structure of photos was holding me back. Looks like they are working on it though:

PhotoPrism has been meeting my needs, I've been happy to support them. I just wish the ML was a little better at recognizing things!

Immich: search doesn't work. Well, it does for geo only on the app.

PhotoPrism: No user management at all. You need to run one instancer per person to have any sort of seperation.

NextCloud: Try any plugins you want, face/content detection still sucks, searching geotags is mediocre, the web photo broswer is just awful, and I've been entirely unsuccessful getting any supposedly compatible phone app to brows photos in nextcloud that aren't also stored on the phone.

Immich seems to be the best hope. It's really slick and fast. I hope they prioritize search and image/face rec as features.

CopperHound
Feb 14, 2012

cruft posted:

I don't suppose anybody in here knows whether btrfs mirroring (as opposed to btrfs on mdraid level 1) is something OpenMediaVault can handle?

If that isn't the nerdiest thing I've ever posted, I don't know what is.
Yes, in the sense that it is debian, but you might need to use the command line.

The web UI will see the file system once you have it setup

e.pilot
Nov 20, 2011

sometimes maybe good
sometimes maybe shit
anybody have a good docker container rec for an NTP server, have a USB GPS receiver ready to go, just need a container

Chilled Milk
Jun 22, 2003

No one here is alone,
satellites in every home

Motronic posted:

Immich: search doesn't work. Well, it does for geo only on the app.

PhotoPrism: No user management at all. You need to run one instancer per person to have any sort of seperation.

NextCloud: Try any plugins you want, face/content detection still sucks, searching geotags is mediocre, the web photo broswer is just awful, and I've been entirely unsuccessful getting any supposedly compatible phone app to brows photos in nextcloud that aren't also stored on the phone.

Immich seems to be the best hope. It's really slick and fast. I hope they prioritize search and image/face rec as features.

Yeah, I just have Nextcloud backup my Camera Roll, and then use Darktable or whatever to organize/browse them from there. The Nextcloud Photos is a last resort interface. Nextcloud apps in general are kind of on that level. It works but you don't love it (and sometimes it doesn't work). I hope one of these other apps takes off and I can just mount the existing folders into it.

Adbot
ADBOT LOVES YOU

BedBuglet
Jan 13, 2016

Snippet of poetry or some shit

e.pilot posted:

anybody have a good docker container rec for an NTP server, have a USB GPS receiver ready to go, just need a container

I assume you plan to map /dev/(bus|ttyUSB0) into the container? There's cturra but honestly, I would consider homecoming it. It is simple enough to make a ntp server container. Here's a guide if you want.
https://blog.oddbit.com/post/2015-10-09-running-ntp-in-a-container/

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply