|
anyone have any recommendations for like, a self-hosted youtube? I have some copies of documentaries and stuff that are no longer available on youtube or anywhere, and I'd like to host them so students can still watch them at home. My upload and hardware should be adequate but the awesome-selfhosted page makes it hard to decide! https://github.com/awesome-selfhosted/awesome-selfhosted#media-streaming---video-streaming Thinking Objecto or Streama maybe... Oh and I don't want to manage a Plex server for my students or anything. tuyop fucked around with this message at 15:20 on Jun 29, 2023 |
#
?
Jun 29, 2023 15:16
|
|
|
|
| # ? May 28, 2024 10:32 |
|
|
Peertube?
|
|
#
?
Jun 29, 2023 16:50
|
|
|
cruft posted:Can MacOS read ext2 yet? You'll probably need to use a utility like this one with an ext2/ext3 module: https://osxfuse.github.io/ https://github.com/alperakcan/fuse-ext2
|
|
#
?
Jun 29, 2023 17:12
|
|
|
tuyop posted:anyone have any recommendations for like, a self-hosted youtube? Honestly, a directory listing of mp4 files may suffice here. I did look into some of the self-hosted youtube clones a while back and this one seemed pretty nice, I never actually tried it out though: https://github.com/mediacms-io/mediacms
|
|
#
?
Jun 29, 2023 17:37
|
|
|
I looked into ZFS and it appears OpenZFS has a port for mostly OS 10, one instance of 11, and nothing on 12. Is there another option? Google didn’t return much. I’m still on 11 on that machine so I may give it a go. I’m not super familiar with ZFS beyond setting up a proxmox drive to mirror. Can ZFS do a RAID5 equivalent and actually repair itself?
|
|
#
?
Jun 29, 2023 17:56
|
|
|
Well Played Mauer posted:I looked into ZFS and it appears OpenZFS has a port for mostly OS 10, one instance of 11, and nothing on 12. Is there another option? Google didn’t return much. In a word: yes https://openzfs.github.io/openzfs-docs/Basic%20Concepts/RAIDZ.html
|
|
#
?
Jun 29, 2023 18:23
|
|
|
corgski posted:You'll probably need to use a utility like this one with an ext2/ext3 module:
|
|
#
?
Jun 29, 2023 19:40
|
|
|
Whoops, quote is not edit. Anyway..Well Played Mauer posted:I looked into ZFS and it appears OpenZFS has a port for mostly OS 10, one instance of 11, and nothing on 12. Is there another option? Google didn’t return much. There's also a project to integrate macOS support into OpenZFS itself so that it's at parity with OpenZFS on Linux, FreeBSD, and eventually Windows. I also have a personal hope that NetBSD (which has a fork of FreeBSDs implementation from before FreeBSD switched to OpenZFS) as well as Illumos can be integrated - that way, every single implementation will be 100% compatible with each other, and ZFS will be the best filesystem for cross-platform support.
|
|
#
?
Jun 29, 2023 19:44
|
|
|
Oh boy these are not easy things to get running! Makes me really appreciate the *arrs and stuff.
|
|
#
?
Jun 30, 2023 00:44
|
|
|
BlankSystemDaemon posted:Whoops, quote is not edit. Anyway.. Is there a recommendation among these you'd make to get a ZFS drive up and running in MacOS? If it helps, I gave up on big system upgrades at OS 11/Big Sur. The variety is pretty daunting but I'm willing to do the legwork to get set up if I can make the right decision here so I'm not staring down another EXFAT fuckup in a year.
|
|
#
?
Jun 30, 2023 03:06
|
|
|
Well Played Mauer posted:Is there a recommendation among these you'd make to get a ZFS drive up and running in MacOS? If it helps, I gave up on big system upgrades at OS 11/Big Sur. The variety is pretty daunting but I'm willing to do the legwork to get set up if I can make the right decision here so I'm not staring down another EXFAT fuckup in a year.
|
|
#
?
Jun 30, 2023 10:01
|
|
|
Thank you!
|
|
#
?
Jun 30, 2023 13:08
|
|
|
Well Played Mauer posted:Is there a recommendation among these you'd make to get a ZFS drive up and running in MacOS? If it helps, I gave up on big system upgrades at OS 11/Big Sur. The variety is pretty daunting but I'm willing to do the legwork to get set up if I can make the right decision here so I'm not staring down another EXFAT fuckup in a year. i use this, version 2.1.6, on an M2 Mac Studio connected to two of these with 16 drives, 15 in ZFS pools and 1 APFS drive for network Time Machine backups. previously i had the same setup but connected to an Intel Mac Mini. it works great for me, and i can answer any particular questions you might have. i wouldn't personally try to use it as a boot drive or for my user folder (i think one or both of those are technically possibly but fiddly) but it's perfect for bulk storage and something to point a Plex server at..
|
|
#
?
Jun 30, 2023 15:31
|
|
|
tuyop posted:anyone have any recommendations for like, a self-hosted youtube?
|
|
#
?
Jun 30, 2023 15:45
|
|
|
Warbird posted:My dude has anyone told you about a little ol thing called ZFS likely at extreme length and very likely against your will? cruft posted:I use btrfs this way and I like it a lot. CopperHound posted:unRAID is not raid and doesn't have anywhere near the level of data integrity of something like ZFS, but I imagine it might still be exactly what you want. Any thread recommendations for hardware? I'm not entirely sure if I would be better off just getting some dumb interface I can plug lots of hard drives into and then connect it to the RPi I already have, or if some dedicated all-in-one box is a good idea?
|
|
#
?
Jun 30, 2023 17:06
|
|
|
Kivi posted:You could use Stash for that. It's for ur, adult content, but it allows you to point it to random folder of video files, have it generate thumbnails and have browseable front end. truly terrible idea to host video streaming for students on software for porno. if you don't want to run plex then i'm not sure why you want to run streama or whatever. just throw the video files on your file sharing software of choice (google drive, dropbox, whatever)
|
|
#
?
Jun 30, 2023 17:08
|
|
|
TACD posted:Thanks for the info! I somehow thought this would be a niche/unusual ask, but it seems like there's a lot of support for this already
|
|
#
?
Jun 30, 2023 17:25
|
|
|
jawbroken posted:truly terrible idea to host video streaming for students on software for porno. if you don't want to run plex then i'm not sure why you want to run streama or whatever. just throw the video files on your file sharing software of choice (google drive, dropbox, whatever) That’s currently what I do and the OneDrive “stream” interface is great. It’s just, this is the self-hosting thread and I like tinkering with this stuff and freeing myself from these big companies as much as possible
|
|
#
?
Jun 30, 2023 17:49
|
|
|
TACD posted:Thanks for the info! I somehow thought this would be a niche/unusual ask, but it seems like there's a lot of support for this already I run a DAS (direct attached storage) that makes the drives show up as individual USB mass storage devices, then run btrfs on top of that. I have been paid to spend weeks trying to recover failed hardware RAID arrays with a hex editor. I will never, ever, ever use hardware RAID. And especially not hardware RAID with some undocumented vendor-specific formatting, which I think is all of them.
|
|
#
?
Jun 30, 2023 19:23
|
|
|
Agreed, hardware RAID is a curse upon humanity. It's also just straight up a lie - because all hardware RAID means is that there's a ~500MHz MIPS/ARM/RISC-V processor sitting on a daughterboard, with a few hundred MB (maybe up to 1GB) of relatively slow RAM, and (hopefully) a battery. On that processor runs an realtime OS of some description, which offloads the actual XOR and Galois Field calculations needed for Reed-Solomon error correction to a small part of the processor. And all of this is proprietary, so that you have no way of knowing what it's doing, if it's doing the right thing, or indeed anything useful at all.
|
|
#
?
Jun 30, 2023 20:03
|
|
|
I really thought hardware raid was the way to go, interesting discussion!
|
|
#
?
Jun 30, 2023 20:50
|
|
|
tuyop posted:I really thought hardware raid was the way to go, interesting discussion! A number of smart people think my stance on this makes me the dumbest fucker on Earth. So I guess ask around. But BSD and I have Seen Some poo poo and wouldn't touch HW RAID with a 39½ foot pole.
|
|
#
?
Jun 30, 2023 21:04
|
|
|
Hardware raid is great if you can afford great hardware. Software raid is great when you can't.
|
|
#
?
Jun 30, 2023 21:06
|
|
|
Heck Yes! Loam! posted:Hardware raid is great if you can afford great hardware. Remember, these are government-backed research institutes - they have a basically-unlimited budget for getting the absolute best, and they all choose ZFS and have done so for at least a decade. BlankSystemDaemon fucked around with this message at 22:23 on Jun 30, 2023 |
|
#
?
Jun 30, 2023 22:20
|
|
|
BlankSystemDaemon posted:This is absofuckinglute bullshit. Both Sequoia and Sierra, which at one point held the #1 spot on the HPC TOP500 list, used/use ZFS (and Lustre), and the same is true for Frontier which is currently #1. That doesn't really negate what I said? Software raid is absolutely the standard, but a good hardware raid is quite expensive.
|
|
#
?
Jun 30, 2023 23:02
|
|
|
Heck Yes! Loam! posted:That doesn't really negate what I said?
|
|
#
?
Jun 30, 2023 23:06
|
|
|
tuyop posted:anyone have any recommendations for like, a self-hosted youtube? I've gone down this rabbit-hole before. tubearchivist is kinda the most comprehensive I've found, but I found it to be a bit too much. Much better, I found, was to use something like tubesync to make automatic downloading from playlists work well. From there you can use any sort of media distribution options you like (shared storage, plex, website, etc,)
|
|
#
?
Jul 5, 2023 04:50
|
|
|
El Mero Mero posted:I've gone down this rabbit-hole before. These two things solve a different but related problem I’ve been having, thank you!
|
|
#
?
Jul 5, 2023 12:03
|
|
|
I would like to understand something about ActivityPub / Fediverse, in the context of self-hosting. I've self-hosted Pleroma for a while a few years back, but the fediverse has grown a fair bit since. There's a bunch of different AP-speaking apps with radically different purposes: Mastodon/Pleroma/Misskey ~= Twitter PixelFed ≃ Insta PeerTube ≃ Youtube Bookwyrm ≃ Goodreads Lemmy/Kbin ≃ Reddit WriteFreely ≃ Wordpress But the idea is that since they all speak ActivityPub, they can all follow and publish to each other. Alice has a Bookwyrm blog where she reviews books, Bob makes vlogs for his PeerTube channel, Carol shares dumb links on her Lemmy. If they all follow each other, each other's media will appear on their "feed" in a limited form - Alice logs in to her Bookwyrm instance and she will see that Bob published a new vlog, without needing a PeerTube account. (Though, on Bookwyrm she'll probably just see a short description and a link to the Peertube page, rather than a full embed.) Correct so far? Assuming so, let's say I have my own domain & server, and I want to run my own social presence. But I may want to put multiple different types of media out there. Sometimes I'll tweet dumb poo poo, sometimes I'll review a book, sometimes I'll upload a video. So I install Mastodon, Bookwyrm, and Peertube on my server. They're all single-user instances. Can I arrange them so that, to the outside world, I appear as a single person who just happens to publish on different media platforms? That is, some dude using e.g. Pixelfed sees one of my comments, decides to follow me, and he should be able to see all of my content regardless of where it was originally created, without having to hunt down and individually click on the three different pages. Is this possible?
|
|
#
?
Jul 5, 2023 15:51
|
|
|
Does anyone use Ansible to easily set up their proxmox VMs? I'm wondering how I could do it to replicate what I currently have, do I need to make VM templates?
|
|
#
?
Jul 14, 2023 15:59
|
|
|
I do on occasion, there are plenty of ways to skin that cat but the "simplest" there may be to set up a VM template either manually or via packer/cloudinit that has the user/ssh key for your ansible runners and go from there. If you're looking for something a bit more dynamic or complicated automating the deployment entirely via Terraform may be more attractive and just have the ansible element serve as an external provider after the actual provisioning is complete.
|
|
#
?
Jul 14, 2023 16:07
|
|
|
hogofwar posted:Does anyone use Ansible to easily set up their proxmox VMs? I'm wondering how I could do it to replicate what I currently have, do I need to make VM templates? Yup! I don't make any changes to the VMs manually. I commit things to git and my CI/CD pipeline runs Ansible on my VMs to apply the changes.
|
|
#
?
Jul 14, 2023 17:56
|
|
|
I should look into that. Everything I'm doing right now is a hodge podge of like 3-4 different approaches. Which is probably par for the course for a homelab, but it wouldn't hurt to try to standardize things.
|
|
#
?
Jul 14, 2023 18:02
|
|
|
Yeah, my end goal is to somewhat replace setup documentation with ansible (and maybe terraform)? I should probably learn Terraform for my job anyway, so I think I will go that route. I am still not entirely sure where one tools area of use ends and the other begins (When to use ansible vs when to use terraform?)
|
|
#
?
Jul 14, 2023 19:44
|
|
|
Remember that your infrastructure as code is only as good as your ability to start everything from a cold-boot. Don't be Amazon/Google/Twitter/Facebook/whatever other Fortune 500 has done this (but especially not the ones listed, who've all done it to varying degrees).
|
|
#
?
Jul 14, 2023 19:50
|
|
|
hogofwar posted:Yeah, my end goal is to somewhat replace setup documentation with ansible (and maybe terraform)? I should probably learn Terraform for my job anyway, so I think I will go that route. I am still not entirely sure where one tools area of use ends and the other begins (When to use ansible vs when to use terraform?) Terraform for infrastructure, Ansible for configuration of said infrastructure. This applies mostly to VMs. So with Proxmox it's terraform. For the VMs inside of proxmox it's Ansible. I'd back out one step further and build VMtemplates with packer that are preconfigured for your Ansible code and are deployed with TF.
|
|
#
?
Jul 14, 2023 19:59
|
|
|
While we’re on the subject, has anyone here dealt with Packer on Proxmox? I’ve finally got it more or less doing what I want but it stalls out waiting on a ssh connection. The VM is getting created and configured and can even ping/curl the Packer endpoint when accessed via the Proxmox console but I haven’t been able to sort out what the issue is so far. The VM is running Ubuntu Jellyfish if that’s any help.
|
|
#
?
Jul 14, 2023 20:14
|
|
|
Also on the subject, what are the options for IaC to configure Proxmox itself - not what VMs or containers it is running, but things like users, groups, clusters, storage, etc? The Terraform provider looks like it only does VMs and containers. I'm just starting to use it but I'm needing to click around in the UI way too much.
|
|
#
?
Jul 14, 2023 21:17
|
|
|
Warbird posted:While we’re on the subject, has anyone here dealt with Packer on Proxmox? I’ve finally got it more or less doing what I want but it stalls out waiting on a ssh connection. The VM is getting created and configured and can even ping/curl the Packer endpoint when accessed via the Proxmox console but I haven’t been able to sort out what the issue is so far. Reverse lookup during the SSH connection setup?
|
|
#
?
Jul 15, 2023 07:54
|
|
|
|
| # ? May 28, 2024 10:32 |
|
|
Matt Zerella posted:Terraform for infrastructure, Ansible for configuration of said infrastructure. This applies mostly to VMs. So a rough overview would be this? Packer would create the base VM templates, setup with the basic stuff you would want in each VM. Terraform would set these up in Proxmox when needed, specifying the different cpu/memory/network config for each VM that is spun up Ansible would do final config/set up each VM for their own unique usage. (A VM that runs docker, a VM that runs backup, etc)
|
|
#
?
Jul 15, 2023 18:34
|
|