Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
SlowBloke
Aug 14, 2017

Aware posted:

Not crazy no, though I think you can run unifi controller software in the Pi if that helps.

The aps are a/b/g/n/ac so I'm not that vested in keeping them but yeah, that's a correct observation.

Adbot
ADBOT LOVES YOU

BlankSystemDaemon
Mar 13, 2009



The unifi controller is java and mongodb - it can run basically anywhere.

The biggest problem seem to be that ubiquiti occationally introduces breaking changes that the various distributions then have to try to work around (sometimess less successfully than others).

Aware
Nov 18, 2003
I mean you kinda get what you pay for with them. It's great for the price until it's not.

Motronic
Nov 6, 2009

Aware posted:

I mean you kinda get what you pay for with them. It's great for the price until it's not.

I've had their APs for over a decade and had to re-roll the controller on a VM once.....maybe twice? I get this may be burdensome for someone who doesn't have compute resources locally for other reasons but like.....yeah, certain things work or certain people. Also don't they have little plug in controllers you can buy also?

They've been 100% of the utility I've wanted out of enterprise gear in my home without having to deal with all of the stupidity of the enterprise gear I dealt with at work. I think it's a pretty good balance.

Aware
Nov 18, 2003
Yeah I don't really have an opinion on them for home either way but I do lol at people paying hundreds of dollars for their dreammachine routers or whatever.

Motronic
Nov 6, 2009

Aware posted:

Yeah I don't really have an opinion on them for home either way but I do lol at people paying hundreds of dollars for their dreammachine routers or whatever.

Oh then we're nearly on the same page. Because lol paying for any of their other garbage for.....much of anything home or otherwise. I almost see the SMB use case but it's still not great.

Hughlander
May 11, 2005

I'm kinda interested in Switch Flex XG. I got 3 machines with dual 10g NICs daisy chained and Linux IP forwarding on the middle one. Just pumping it into a regular switch would make my life easier.

I don't know of any other prosumer 10G copper switches.

Aware
Nov 18, 2003
TpLink and Netgear seem to make 5 and 10 port 10G copper switches. Seem to be in the 300-500USD range. Unmanaged which sounds fine for you.

Presumably the ubiquiti one will also work fine unmanaged out of the box too.

e.pilot
Nov 20, 2011

sometimes maybe good
sometimes maybe shit

Hughlander posted:

I'm kinda interested in Switch Flex XG. I got 3 machines with dual 10g NICs daisy chained and Linux IP forwarding on the middle one. Just pumping it into a regular switch would make my life easier.

I don't know of any other prosumer 10G copper switches.

I’ve got a couple, they were kind of a mess from September or so up until the last firmware update, there was some bug in the firmware that was causing weird ping spike/lag issues if it was connected to another flex xg, so you had to run the pre September firmware. All good since the last update in march though.

can read about it here if you’re interested:
https://community.ui.com/questions/...63-1e409dd5f949

SlowBloke
Aug 14, 2017
Power cycling the unit has magically made all disks operational (after some tinkering since it didn't like going from four to zero disks) with no visible data loss. I'll keep it running as is until it melts. Hopefully it will last long enough for wifi7 to be available so i can replace everything to remove the dependencies on the nas(maybe i'll search for a router with vpn packages so i can skip the raspi).

SlowBloke fucked around with this message at 14:17 on Apr 19, 2023

BlankSystemDaemon
Mar 13, 2009



Motronic posted:

I've had their APs for over a decade and had to re-roll the controller on a VM once.....maybe twice? I get this may be burdensome for someone who doesn't have compute resources locally for other reasons but like.....yeah, certain things work or certain people. Also don't they have little plug in controllers you can buy also?

They've been 100% of the utility I've wanted out of enterprise gear in my home without having to deal with all of the stupidity of the enterprise gear I dealt with at work. I think it's a pretty good balance.
You also don't need to keep the controller running at all times - unless you're using features like AAA via FreeRADIUS (for WPA2 Enterprise), captive portal or OTP-based password authentication (both of the latter for wireless guest networks).

shame on an IGA
Apr 8, 2005

good morning storage havers, we've got three weeks to scrape Imgur

https://forums.somethingawful.com/showthread.php?threadid=4030290&perpage=40&noseen=1

SpartanIvy
May 18, 2007
Hair Elf

I'm a moron but if someone can put together an idiots guide I'd be willing to grab whatever I can.

Less Fat Luke
May 23, 2003

Exciting Lemon
Presumably these folks will organize a project to do some distributed archiving:
https://wiki.archiveteam.org/

Wizard of the Deep
Sep 25, 2005

Another productive workday

Haha, that's impressively dumb. Like "I saw what happened when Tumblr hosed that wasp nest, but I'm sure I'll be fine!"

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!
What's happening these days? More or less the same time as Reddit decides to implicitly block porn/NSFW posts, by nature of blocking it on their data APIs, when like 80-85% of users browse on third party mobile apps (nevermind making said APIs also commercial now).

BlankSystemDaemon
Mar 13, 2009



Combat Pretzel posted:

What's happening these days? More or less the same time as Reddit decides to implicitly block porn/NSFW posts, by nature of blocking it on their data APIs, when like 80-85% of users browse on third party mobile apps (nevermind making said APIs also commercial now).
Company accepts VC money to get started, then eventually run out of suckers who think they can make billions thanks to a good bet, so they have to do an IPO and this involves getting rid of all the things that could cause issues.
This includes but is not limited to: Adult material, any part of the service that was previously free, and a general attitude towards not loving over the users.

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

I swear I posted a reply in a thread or reddit post when imgur launched predicting it would inevitably come to this. I just don't think it's possible to have a sustainable image hosting business that is suitable for how people actually want to use it. SA's own built in image hosting is the only thing that will survive long term for the forums, assuming we all continue to support the forums!

Theophany
Jul 22, 2014

SUCCHIAMI IL MIO CAZZO DA DIETRO, RANA RAGAZZO



2022 FIA Formula 1 WDC

fletcher posted:

I swear I posted a reply in a thread or reddit post when imgur launched predicting it would inevitably come to this. I just don't think it's possible to have a sustainable image hosting business that is suitable for how people actually want to use it. SA's own built in image hosting is the only thing that will survive long term for the forums, assuming we all continue to support the forums!

I just got hit with a price hike on my Usenet fees for the year and they have over 10 years of retention. For all the dross uploaded to Imgur, it's hard to imagine how the business model is sustainable as a free service whilst retaining a load of data that has effectively been orphaned.

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!
Is there a tool or app that runs in Docker, where I can just drop random links and have it do its stuff in background? So far I've been collecting links to content in a text file and am always like "meh, imma wget/yt-dlp this later".

BlankSystemDaemon
Mar 13, 2009



fletcher posted:

I swear I posted a reply in a thread or reddit post when imgur launched predicting it would inevitably come to this. I just don't think it's possible to have a sustainable image hosting business that is suitable for how people actually want to use it. SA's own built in image hosting is the only thing that will survive long term for the forums, assuming we all continue to support the forums!
I actually thought of you when reading the other thread, because I was sure that you made the same prediction that I did.

If you still do python stuff for archiving, it might be useful to have you on hand in the thread if it turns out some help is needed.

Combat Pretzel posted:

Is there a tool or app that runs in Docker, where I can just drop random links and have it do its stuff in background? So far I've been collecting links to content in a text file and am always like "meh, imma wget/yt-dlp this later".
FlexGet is what I use, though there are alternatives.

Hughlander
May 11, 2005

Combat Pretzel posted:

Is there a tool or app that runs in Docker, where I can just drop random links and have it do its stuff in background? So far I've been collecting links to content in a text file and am always like "meh, imma wget/yt-dlp this later".

I solve the second by running a cron job that starts a docker container of yt-dlp once a day that downloads anything in a file using the settings:

--download-archive youtube-dl-archive.txt
-a playlist-dl-channels.txt

first saves the IDs so it doesn't pick it up again next time, second is the file to take the list of URLs from.

TransatlanticFoe
Mar 1, 2003

Hell Gem

Combat Pretzel posted:

Is there a tool or app that runs in Docker, where I can just drop random links and have it do its stuff in background? So far I've been collecting links to content in a text file and am always like "meh, imma wget/yt-dlp this later".

I use Metube, which has a bookmarklet and a REST API you can add stuff with.

e.pilot
Nov 20, 2011

sometimes maybe good
sometimes maybe shit

TransatlanticFoe posted:

I use Metube, which has a bookmarklet and a REST API you can add stuff with.

I use this as well it’s pretty great, works on just about anything I’ve thrown at it too, youtube, soundcloud, instagram, etc

Dicty Bojangles
Apr 14, 2001

For those of you using metube, have you been able to get subtitles to download? Adding the example environment: variable to my docker-compose.yml suggested on the metube Readme.md crashes docker-compose with “ERROR: yaml.scanner.ScannerError: mapping values are not allowed here”

Namely, this one:
code:
{"writesubtitles": true, "subtitleslangs": ["en", "-live_chat"], "postprocessors": [{"key": "Exec", "exec_cmd": "chmod 0664", "when": "after_move"}, {"key": "FFmpegEmbedSubtitle", "already_have_subtitle": false}, {"key": "FFmpegMetadata", "add_chapters": true}]}

KVeezy3
Aug 18, 2005

Airport Music for Black Folk
Looking for a storage solution in the ~50TB range. Is going Synology a bad idea? I'm specifically curious about the DS1522+. I'm not too concerned about budget, but value.

Trapick
Apr 17, 2006

Hey if anybody else has a NAS with some free space and decent download speeds, check out https://forums.somethingawful.com/showthread.php?threadid=4030517 - imgur is dying, we don't want a million threads with dead links, download and help out.

Thanks Ants
May 21, 2004

#essereFerrari


I can but I can't get the bash scripts to run in WSL, will have a play

Edit: It's working but WSL seems to be way too slow for this.

Thanks Ants fucked around with this message at 20:06 on Apr 24, 2023

Beve Stuscemi
Jun 6, 2001




I'm still chasing a high performance NAS setup for editing video from. I think I have the hardware figured out, my problem is that I have a mixture of 1TB and 500GB SSD SATA disks. RAIDZ seems to want to use all similarly sized disks, and most JBOD solutions seem to not split data over different drives, which results in read speeds limited by the speed of a single drive.

I have recently come into a decent used gaming PC (i7-6700K, 32GB RAM) that can accept M.2 drives, so I have the option to do that if I want to as well, along with throwing a SATA card in it to take the disks. I also have a 10Gigabit link that can go between the NAS and my editing PC, so I'm thinking of connecting the two over iSCSI?

Is truenas the solution for all that? If so, what is the best way to set it up to use differently sized disks?

I also have an option to throw all of that out and put the drives in a Synology DS2419+ that has a 10Gbit SFP+ card in it, but no NVME capability unless I buy their adapter card for it.

So do I build my own thing with Truenas, or just pres the easy button with the Synology?

Beve Stuscemi fucked around with this message at 21:14 on Apr 24, 2023

A Bag of Milk
Jul 3, 2007

I don't see any American dream; I see an American nightmare.

KVeezy3 posted:

Looking for a storage solution in the ~50TB range. Is going Synology a bad idea? I'm specifically curious about the DS1522+. I'm not too concerned about budget, but value.

Synology is analogous to Apple in certain ways. They want to lock you into their proprietary ecosystem in favor of a hands-off "it just works" experience. That's good for people who don't want to tinker at all, but you're getting less computing power for your money. Whether that makes Snyology a good value is in the eye of the beholder.

The other route would be to get a used tower and/or some used parts and put together your own machine running TrueNAS, Unraid, or Ubuntu. That setup would be more flexible, and much more powerful, at the same price point. It would require more learning, but the stuff you'd learn would be much more valuable and transferable than learning how to use a Synology box. After it's all set up, there is very little computer janitoring required to maintain things regardless of OS.

Also Synology isn't compatible with ZFS, aka god's file system, which is the best for storage and backup. But BTRFS, which is supported by Synology, has a lot of the same features.

In essence, Synology = a little easier, and almost as good. But not that much easier, and not quite as good.

Beve Stuscemi posted:

So do I build my own thing with Truenas, or just pres the easy button with the Synology?

Unraid is the OS that best handles a mess of drives of different sizes. But if you're talking about 1tb or 500gb drives I would seriously question the effort and complexity of this operation. You could buy two medium sized drives like 4-8tb and mirror them for something that is much simpler and a lot less of a pain in the rear end. See my other response in this post for my general thoughts on Synology vs other options. But since you already own a tower that's plenty good enough for a server, I would lean against Synology in your particular case.

Computer viking
May 30, 2011
Now with less breakage.

A Bag of Milk posted:

Unraid is the OS that best handles a mess of drives of different sizes. But if you're talking about 1tb or 500gb drives I would seriously question the effort and complexity of this operation. You could buy two medium sized drives like 4-8tb and mirror them for something that is much simpler and a lot less of a pain in the rear end.

I generally agree, but 4TB SSDs are not really "medium size" yet, and going from even SATA SSDs to spinning drives would be a huge performance downgrade.

Beve Stucemi: How many drives of each size do you have?

Computer viking fucked around with this message at 00:19 on Apr 25, 2023

Beve Stuscemi
Jun 6, 2001




I want to say 4x 1tb drives and 10x 500gb drives? Between the sata on the motherboard and the sata card I have, I can cover the 14 drives.

Computer viking
May 30, 2011
Now with less breakage.

Beve Stuscemi posted:

I want to say 4x 1tb drives and 10x 500gb drives? Between the sata on the motherboard and the sata card I have, I can cover the 14 drives.

You could see how a 4x1TB + 5x500GB + 5x500GB (each a raidz1) pool performs?

I believe it will balance usage to keep them at roughly equal fill levels, so vdevs with more free space see more writes - but they're not wildly mismatched so maybe it'll be good enough?

Beve Stuscemi
Jun 6, 2001




I’ll give that a shot. Normally I’d feel like it’s a bad idea to use this many disks, but they all probably draw less power than one spinning disk anyway

Beve Stuscemi fucked around with this message at 12:46 on Apr 25, 2023

KVeezy3
Aug 18, 2005

Airport Music for Black Folk

A Bag of Milk posted:

Synology is analogous to Apple in certain ways. They want to lock you into their proprietary ecosystem in favor of a hands-off "it just works" experience. That's good for people who don't want to tinker at all, but you're getting less computing power for your money. Whether that makes Snyology a good value is in the eye of the beholder.

The other route would be to get a used tower and/or some used parts and put together your own machine running TrueNAS, Unraid, or Ubuntu. That setup would be more flexible, and much more powerful, at the same price point. It would require more learning, but the stuff you'd learn would be much more valuable and transferable than learning how to use a Synology box. After it's all set up, there is very little computer janitoring required to maintain things regardless of OS.

Also Synology isn't compatible with ZFS, aka god's file system, which is the best for storage and backup. But BTRFS, which is supported by Synology, has a lot of the same features.

In essence, Synology = a little easier, and almost as good. But not that much easier, and not quite as good.

Appreciate this response, thank you. I'm a dummy, but this will help me narrow down the research.

Beve Stuscemi
Jun 6, 2001




I've been running Unraid for I think 3 years now and the amount of janitoring is basically "log in and see if there are updates"

Unless you have wonky hardware its pretty hands off after initial setup

That Works
Jul 22, 2006

Every revolution evaporates and leaves behind only the slime of a new bureaucracy


Beve Stuscemi posted:

I've been running Unraid for I think 3 years now and the amount of janitoring is basically "log in and see if there are updates"

Unless you have wonky hardware its pretty hands off after initial setup

Same and for about the same time. Ive been quite happy with the effort:outcome ratio for it.

Tiny Timbs
Sep 6, 2008

Beve Stuscemi posted:

I've been running Unraid for I think 3 years now and the amount of janitoring is basically "log in and see if there are updates"

Unless you have wonky hardware its pretty hands off after initial setup

Coincidentally you posted this as I was coming back to this thread to post how great Unraid has been for over a month of uptime with zero janitoring. It's night-and-day compared to when I was fussing around with OpenMediaVault and Portainer.

I had an issue with setup where my NVME kept failing but it wasn't Unraid's fault that the motherboard put its NVME slot on the back right up against the bottom of the case.

e.pilot
Nov 20, 2011

sometimes maybe good
sometimes maybe shit

Beve Stuscemi posted:

I've been running Unraid for I think 3 years now and the amount of janitoring is basically "log in and see if there are updates"

Unless you have wonky hardware its pretty hands off after initial setup

I installed the docker auto update plugin and don’t even have to do that anymore.

Have it set up to send me a daily email on any updates it does to make sure there aren’t any issues, and in the 3mo I’ve been running the plug-in it’s been flawless.

e.pilot fucked around with this message at 14:13 on Apr 25, 2023

Adbot
ADBOT LOVES YOU

Matt Zerella
Oct 7, 2002

Norris'es are back baby. It's good again. Awoouu (fox Howl)
I took the auto update one step further and have the appdata backup running daily and then it upgrades the docker for me after the backup. Kills two birds with one stone.

UnRAID has its problems and if speed is your big concern then it's probably a no go but goddamn do I love it for what it does.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply