Self Hosting: It's like being a prepper for the cloudpocalypse

The Something Awful Forums > Discussion > Serious Hardware/Software Crap > Self Hosting: It's like being a prepper for the cloudpocalypse

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Distro really depends on what you prefer. Probably gonna be CentOS or Debian or Ubuntu or Fedora or insert distro here. You're right in that going Linux to do docker is a much better idea than trying to make it do things on windows or mac but beyond that it's what you want to work with imo. I personally just use Ubuntu 22.04

Hardware wise, depends on what you'll be doing. But most of the poo poo people self host is not really hardware demanding and in fact a lot of people run Nucs and the like and are fine. I personally run a 4th generation i5 as my main server and some Intel Nucs.

Definitely keep the Mac if you want. As long as all your stuff can talk to each other you're good. You could also move it to docker (either migrate or fresh install) so you can install Linux on the Mac and have another Linux node to put poo poo on then that container can go back to being on the Mac if you want

I'm no expert though

# ¿ Jan 9, 2023 21:59

Adbot: ADBOT LOVES YOU

# ¿ May 15, 2024 00:39

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Nitrousoxide posted:

I run my setup on this at $150:

https://www.amazon.com/dp/B07WLLR43R?ref=nb_sb_ss_w_as-reorder-t1_ypp_rep_k0_1_7&amp=&crid=1CLP6Q7NRXAT3&amp=&sprefix=optiple

Its ram is already maxed out at 16 gigs, but I'm still okay while running quite a few applications.

I'll admit I'm getting reasonably close to redlining the RAM though. If you're not looking to run ~38 apps though you'll be fine.

44 containers. What are you running?

# ¿ Jan 10, 2023 01:03

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Nitrousoxide posted:

38 running. 6 of them are leftovers from the ci/cd pipelines running in my gitlab instance. They'll get cleaned up once a week on Saturday.

The ones running:
code:
dockers

nice, which homepage do you use? I've had Dashy, Homepage, homer, homarr, heimdall, and I'm sure I'm forgetting one. I just can't decide which one I like. I usually use Heimdall cause its actually set up as its the first one I ever tried.

Do you use gitlab just for managing the homelab stuff, or is it doing other stuff? I thought about self hosting but in the end I just decided to use Github. I just have github actions that uses my self hosted runner which in turn has full access to docker to run compose up on all my containers. This is probably breaking 100 different security rules but none of this is accessible publicly so if anyone is accessing any of it I'm screwed anyway. also portainer could literally do the same thing out of the box but I wanted to do it this way for no reason

my containers. I like seeing what other people are running to get ideas. but dont wanna spam: traefik, kanboard, syncthing, readarr, wud (whats up docker), prowlarr, lazylibrarian, homarr, github_runner, tautulli, bazarr, ubooquity, mylar3, plex, overseerr, radarr, sabnzbd, heimdall, duplicati, sonarr, portainer, adguard, unifi-controller

the next thing I'm doing is moving most of these to kubernetes across 3 nodes for fun and learning

# ¿ Jan 10, 2023 22:18

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Welcome! Take a look at my post above and Nitrousoxide for some more stuff you can run.

These guys have a lot of containers for various app they maintain that you can run: https://docs.linuxserver.io/

And this is a massive list of cool poo poo you can host

https://github.com/awesome-selfhosted/awesome-selfhosted

and I just looked at the first post in this thread, it has some pretty cool stuff too!

Nitrousoxide posted:

The second one, Homer, just links directly to their IP so I can still get to the sites if needed if my reverse proxy is down.

I have a task in my Kanboard to set up a second instance of Heimdall (or whatever I settle on) for the same reason. Just a way to get to stuff if Traefik goes down or my domain stops working or whatever. I'm sure I'll get around to doing it. Someday.

Homepage is nice, but I've been lazy about configuring it. I think one of the ones I mentioned has autodiscovery if given access to docker and thats probably the one I'll end up using if I didn't just imagine that.

Nitrousoxide posted:

I guess I could fork it on github but that's easy heh.

Resdfru fucked around with this message at 05:35 on Jan 11, 2023

# ¿ Jan 11, 2023 05:25

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I did this on mine, it was pretty painless https://major.io/2021/08/16/wildcard-letsencrypt-certificates-traefik-cloudflare/

I have my domain pointed to an internal ip, so they only resolve internally but it's nice not having a bunch of cert errors

I briefly played with a cloudflare zero trust tunnel and it works nice and it's cool having sso in front of my stuff but I have a VPN and have no need for it so I turned it off

# ¿ Jan 13, 2023 17:58

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Cloudflare free is pretty cool. Has an api, and other stuff like zero trust you can use

# ¿ Jan 24, 2023 05:37

Resdfru: Jun 4, 2004; I'm a freak on a leash.

corgski posted:

gonna be great when they go down and take 2/3 of the internet with them because nobody bothered to think about that.

This has already happened a few times since so many companies use their cdn. Unless you mean permanently

# ¿ Jan 24, 2023 21:18

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I probably should schedule the containers to stop but I just point Duplicati at /containers (where all my docker volumes are) and it just tars it all up and dumps it on Google drive. I've never tested to see if I can point a container at the volume and have it work but I'm more concerned with getting my config files off for the app if anything. In any case I have versioning and keep multiple backups so one of em will work.

Actually, I have tested before. I had a container that I somehow lost its configuration or something and I restored the volume from duplicati and it worked fine

# ¿ Feb 16, 2023 02:29

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I don't use nginx but I have the same thing set up with traefik, to give another option

Resdfru posted:

I did this on mine, it was pretty painless https://major.io/2021/08/16/wildcard-letsencrypt-certificates-traefik-cloudflare/

I have my domain pointed to an internal ip, so they only resolve internally but it's nice not having a bunch of cert errors

I briefly played with a cloudflare zero trust tunnel and it works nice and it's cool having sso in front of my stuff but I have a VPN and have no need for it so I turned it off

# ¿ Feb 18, 2023 06:01

Resdfru: Jun 4, 2004; I'm a freak on a leash.

A few jobs ago I worked as a sys admin at a place that hosted mail. It sucked. There a dozens of blacklists and you can find yourself on one simply by being ip neighbors with spammers or because someone looked at you wrong. And good luck getting off the blacklists. Half of them have no procedure for removal and the other half have a procedure and will take a year to look at your request and another year to take action.

Maybe it's better now or when you're not hosting a bunch of other users, but as far as I'm concerned I agree with never host your own email.

Plus email is something you usually want to work all the time.

# ¿ Mar 25, 2023 15:21

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I briefly considered self hosting my own 'Google photos' but then I realized I don't want to be responsible for that. I prefer to self host poo poo I don't care about and I'll pay Google to host my photos. Though I am considering exporting then from Google photos to s3 since Google can't be trusted to keep their products alive

To answer your question though your options are

https://github.com/immich-app/immich
Or
https://github.com/photoprism/photoprism

# ¿ Apr 1, 2023 16:52

Resdfru: Jun 4, 2004; I'm a freak on a leash.

just saw this, sounds like what you want

https://www.reddit.com/r/selfhosted/comments/136z5ed/i_created_a_selfhosted_imgur_clone_using/

# ¿ May 4, 2023 15:10

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Anybody run tailscale in docker? I don't have it in front of me but I do have the key or whatever in a volume I think. Something I found online when trying to fix this. Anyway, everytike the container starts up it can't auth to tailscale. Maybe someone here has a fix that isn't just run it on the OS.

# ¿ May 6, 2023 21:58

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Keito posted:

I do, yeah. I'm not sure I understood if you're having issues with maintaining authentication state, or trouble authenticating in the first place, but for the former it's important to persist /var/lib/tailscale. If you have an auth key you should be able to pass it via the TS_AUTHKEY environment variable.

Thanks Keito, I was about to reply to say "I'm doing both of those things!" I pulled up my docker compose to make sure and I have the authkey env var in there but I never actually put the authkey in the compose file or passed it in via docker env

:ughh:

# ¿ May 8, 2023 16:01

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Haven't used Wireguard but I assume since its all you you'll have to know what your public IP is at home, or have a dynamic dns address or something?

Tailscale recently updated their pricing so the free plan is pretty useful for most use cases. https://tailscale.com/blog/pricing-v3/

# ¿ May 9, 2023 22:30

Resdfru: Jun 4, 2004; I'm a freak on a leash.

If you're self hosting anything you should just get a domain and set up let's encrypt with traefik or whatever reverse proxy you like and save yourself a bunch of time and annoyance with cert issues.

https://major.io/2021/08/16/wildcard-letsencrypt-certificates-traefik-cloudflare/

# ¿ May 10, 2023 00:10

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Generic Monk posted:

I'm also having issues with the share not mounting reliably on boot despite working every time running mount -a manually, I imagine that's due to the network taking too long to come up.

Probably network related. I had the same issue with a giant usb drive not being ready in time.

I fixed it with a flag in fstab to ignore any issues with the mount and still boot and then a cronjob that runs on boot that just does mount -a.

Dunno if there's a more graceful solution but it works

# ¿ May 25, 2023 21:50

Resdfru: Jun 4, 2004; I'm a freak on a leash.

code:


PARTUUID="abcdef": /media/mount ntfs defaults,nofail 0 0

# ¿ May 26, 2023 12:00

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Self hosting photos is one thing I decided to never do cause I didn't wanna be responsible for it. So I pay Google for a couple terabytes and call it a day. But lately I've been worrying over Google killing photos or something so I've been considering self hosting a back up of Google photos

# ¿ Jun 28, 2023 16:52

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Yikes, I guess a good reason to start backing everything up locally too

# ¿ Jun 28, 2023 22:01

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I have a kanboard container, I use it to keep track of my self hosted projects. When I get an idea to do something or I have something I should probably do, I drop it on there.

# ¿ Jun 28, 2023 23:55

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Has anyone run Steam via docker or on a VM for remote gaming through a browser or ipad or something?

I was looking into building my kids their own computers but I realized a possible stopgap till I do that is just throwing a couple VMs up on my server and getting a good/ok NVidia card for it. The games they play aren't very demanding. Really at the moment its one game; Wobbly Life which I ran on a NUC to see if it worked and it did. (these containers/vms won't be on NUCs, just saying it ran on something with no gpu)

It looks like my options are entire VMs or a container like this: https://hub.docker.com/r/linuxserver/kasm or
https://github.com/Steam-Headless/docker-steam-headless

seems random people on the internet do this but was wondering if anyone here has ever done it and has any thoughts/suggestions.

edit: oh steam headless has support for AMD, I have an old rx 580 or something lying around. maybe I can test it myself

Resdfru fucked around with this message at 02:16 on Aug 8, 2023

# ¿ Aug 8, 2023 02:03

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I can't talk about nginx or swag or any of that but I use traefik and I set up automatic let's encrypt for all host names and I haven't had any issues with it. (I point my domain to a private address so nothing on my domain is publicly accessible, I use tailscale for that)

https://major.io/p/wildcard-letsencrypt-certificates-traefik-cloudflare/

# ¿ Nov 13, 2023 17:11

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Yea definitely try it and see. That's half the fun. Even if it can't do plex it can do loads of other things

# ¿ Jan 16, 2024 18:47

Resdfru: Jun 4, 2004; I'm a freak on a leash.

One potential benefit to plex in docker is portability. If you decide you want to run it elsewhere you can just move the container stuff over and add your volumes. Though to be fair if you have plex pass (and maybe if you don't?) if you log in it will have most/all of your config already

# ¿ Jan 17, 2024 02:31

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Does anyone use firefly iii? Does anyone use one of the plaid connectors with it?

I like firefly and I've been using it for almost a year but it's so drat tedious manually entering transactions. But setting up plaid just looks like such a pain in the rear end. I put all my stuff in rocket money and it's nice enough but I wanna self host this and also I like the reports in firefly a lot more

https://www.firefly-iii.org/
https://www.reddit.com/r/selfhosted/s/tWfWljLMLE

# ¿ Jan 25, 2024 22:40

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Me again with hopefully a better question. Unless this is the wrong thread.

Anyone self host a camera system nvr type thing? I have a bunch of Wyze cams but I don't like em cause of the whole sending all the video to their servers. I wanna install either their rtsp firmware or another custom firmware on em and then connect them to a something local and block their internet traffic

Seems doable, but not sure which firmware and which nvr app. Ideally I would have a functional web app and mobile app/site to view cams. There's also possibly other apps to add for object detection and the like that may or may not murder my cpu.

# ¿ Feb 1, 2024 17:49

Resdfru: Jun 4, 2004; I'm a freak on a leash.

All my network stuff is unifi and I would gladly do their camera but $$ and honestly I don't really neeeeed it. But messing around with some cheap Wyze cams sounds good.

csammis posted:

I use https://github.com/mrlt8/docker-wyze-bridge for my Wyze 3 camera, works fine and the developer was very responsive when I was working on adding Wyze pan/tilt controls to Home Assistant a year ago

Oh I never considered home assistant, always wanted to install it to see what it does. I read that docker bridge doesn't actually stop all the traffic from going to Wyze, is that true?

# ¿ Feb 1, 2024 20:01

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I run trillium for notes but I've never really loved it. I saw notion in the play store and just from the screenshots it looks awesome. After some digging it looks like the most similar things I can self host are

Appflowy
https://github.com/AppFlowy-IO/AppFlowy

Outline
https://github.com/outline/outline

Anytype
https://tech.anytype.io/how-to/self-hosting

Anyone got any experience with em?

# ¿ Feb 3, 2024 17:26

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Yea, same with notion. Looks cool but I don't wanna be locked into anyone else's thing. I just looked into those 3 things I posted and I'm too lazy for that. I'll try obsidian and see how it goes

# ¿ Feb 3, 2024 19:53

Resdfru: Jun 4, 2004; I'm a freak on a leash.

From what I've read (really quick Google search) this should work on ios https://github.com/vrtmrz/obsidian-livesync

I installed it earlier but haven't had a chance to try it out yet

# ¿ Feb 4, 2024 04:36

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Yea i use tailscale, nothing on my network is exposed.

I finally got live sync working last night. Spent like an hour troubleshooting my reverse proxy and couchdb thinking I did something wrong. But the problem was that I thought in the live sync config where it said to put database name and it said it will create it if it doesn't exist I misinterpreted that as leave it blank to get a random one. So yea I put a dB name and everything worked. Loloops

It's great though, does exactly what it says it will.

# ¿ Feb 4, 2024 16:17

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I haven't used portainer much but generally you would wrap the entire path in quotes or you can try escaping the spaces with backslashes

Yea split tunneling is how you would make it so only VPN specific traffic uses the VPN. I believe tailscale (and possibly wire guard?) work that way by default unless you enable the use of an exit node

Resdfru fucked around with this message at 17:04 on Feb 4, 2024

# ¿ Feb 4, 2024 17:02

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I have a hacky method. I have a git repo for my compose files and I had a self hosted runner container. When I pushed /merged to main it would kick off github actions which just ran compose up.

I keep all my compose files in 1 directory so I use a command to run compose up on all the files

My runner token expired and I never bothered to generate a new one though. It was useful when I was making a lot of changes but I rarely touch anything anymore so when I do I push to git and then ssh in and pull and run compose up on the container I edited.

I have a variety of tasks on my kanboard that I wanna do to do things better but finding time is always the issue

# ¿ Feb 19, 2024 19:09

Resdfru: Jun 4, 2004; I'm a freak on a leash.

I don't use unraid or portainer so I could be way off here but

1. If what you're looking at is a compose file it looks similar to this. Compose is a standardized yaml format. If it's not in this general format docker won't do what it should. But portainer or unraid could be wrapping this in something else i suppose.
https://docs.linuxserver.io/general/docker-compose/#v1x-compatibility

code:


version: "2.1"
services:
  heimdall:
    image: linuxserver/heimdall
    container_name: heimdall
    volumes:
      - /home/user/appdata/heimdall:/config
    environment:
      - PUID=1000
      - PGID=1000
      - TZ=Europe/London
    ports:
      - 80:80
      - 443:443
    restart: unless-stopped

2. Your container compose file will say which volumes it uses to store data. If those locations are backed up then whatever the container is doing is backed up for the most part. If there is no volume attached then the container is likely ephemeral

Now maybe unraid or portainer changes things and it stores that stuff in some sort of app data? I guess they could be keeping all your volumes in the same place.

# ¿ Feb 19, 2024 19:51

Resdfru: Jun 4, 2004; I'm a freak on a leash.

You can run APs without a controller but I lm not sure which if any features would be unavailable

You will probably have to reset them but it's possible they are using default creds

https://lazyadmin.nl/home-network/setup-unifi-ap-without-controller/

As this is the self hosting thread, you can easily self host the unifi controller in docker.

# ¿ Feb 21, 2024 13:54

Resdfru: Jun 4, 2004; I'm a freak on a leash.

Docker volumes sounds like a good assumption. I only ever do bind mounts if my containers need storage

My suggestion, traderstav, is to pick one of your containers and manage it manually. Use docker compose and set it up and if you don't know what one of the options does Google it. I think a better base understanding of what portainer is doing behind the scenes will be a good thing in general. That's just my opinion, I don't know if it's a good one

# ¿ Feb 27, 2024 21:15

Adbot: ADBOT LOVES YOU

# ¿ May 15, 2024 00:39

Resdfru: Jun 4, 2004; I'm a freak on a leash.

You're looking for this thread
https://forums.somethingawful.com/showthread.php?threadid=3409898&pagenumber=355&perpage=40

# ¿ Mar 4, 2024 02:38

The Something Awful Forums > Discussion > Serious Hardware/Software Crap > Self Hosting: It's like being a prepper for the cloudpocalypse