|
After posting build potential and learning about the glory of Xeon and whatnot, I ended up ordering this. What's SOP for cramming it full of hard drives nowadays? Is there a go-to shucking option? (I'm probably going to use unRaid after the conversation on the last few pages, or maybe just Ubuntu + ZFS because I'm already blowing money on hardware and disks.  )
QuantumNinja fucked around with this message at 02:01 on Oct 7, 2018 |
#
?
Oct 7, 2018 01:51
|
|
|
|
| # ? May 16, 2024 14:29 |
|
|
Atomizer posted:Part of the issue with shucking is that you're not 100% certain what drive is inside (which is even more of an issue when ordering online because even though you may get a good price with a deal, you can't even look at the info on the box to take a guess what's inside before opening it,) and those 8 TB Easystores can have like 3-4 different drives last time I checked. Then you may run into that obnoxious 3.3v issue on top of that. Meh, the drives in Easystores are either reds or white label versions of reds that work the same after the tape mod. Enos Cabell posted:I found this site that someone posted upthread https://www.serverbuilds.net/anniversary I put together a 1366-based build put together by the same guy, and I wish I had jumped in on this one instead. I don't actually have a vital use case, but I figure there is nothing bad about having extra compute at my disposal.
|
|
#
?
Oct 7, 2018 05:56
|
|
|
Hey everyone, so I’m a home user with a NAS. My primary focus is my photo directory but I also store my documents and some movies there. Besides backblaze off site backup, what would be best practices to protect my photos and backup? 1. A mini 1 Bay NAS just for photos and documents? Double points if it’s mirrors into another physical location. 2. USB attachment backup for photos nightly? I just dread dealing with a baclblaze or restore which takes forever
|
|
#
?
Oct 7, 2018 07:00
|
|
|
caberham posted:Hey everyone, so I’m a home user with a NAS. My primary focus is my photo directory but I also store my documents and some movies there. The more important/irreplaceable a given file is, the better the backup solution needs to be, in terms of number of copies and geographic isolation. In your case, you'd probably be fine with two steps: - an external drive (or as many as are necessary) for a 2nd copy on-site. - a 3rd party provider like Backblaze for a 3rd copy, just in case. The external drives contain your primary backups, and if something catastrophic like a fire occurs then that's when you would rely on the Backblaze restoration.
|
|
#
?
Oct 7, 2018 10:43
|
|
|
My home videos, movies and teevee shows currently sit on my big, power-thirsty PC, which is directly plugged into my TV. I'm currently using Emby as a sort of fancy wrapper for watching the videos, rather than for its media server capabilities. However, this is something of a waste. So, I'd like to invest in a NAS to serve up my videos to my TV, by throwing them straight to a Chromecast over my network. I'd like something that doesn't use a lot of power, first and foremost - naturally I'm not going to be watching all day and all night, so something that sits on standby and spins up as needed is fine. My second point probably contradicts the first: some of these videos, home videos in particular, are ancient DVD rips (remember when camcorders briefly recorded straight to DVD?), so the codecs, containers etc. are all over the place. So, there's probably going to be some transcoding needed, which I understand needs horsepower and, thus, power usage. I don't have any issue with spending a few weekends with Handbrake - it's probably overdue at this point anyway - so I'd prioritise power usage over horsepower, but naturally if I can have my cake and eat it that'd be great. Right now I'm looking at a bog-standard Synology DS218play, as it's apparently built for media streaming/transcoding and there's an Emby package available for the Synology platform - but if the thread has any advice I'm all ears.
|
|
#
?
Oct 7, 2018 11:22
|
|
so I could say that I finally figured out what this god damned cube is doing. Get well Lowtax.
|
Depending upon storage amount needs using AWS Glacier or Google Cloud Storage with cold tier storage are decent options for backups (their intended use cases). It should amount to maybe a couple dollars / month and if you need much more and trust that they can restore your data (there’s some folks reporting issues) Backblaze is basically the only game left for consumer backups that are economical. I’m generally against transcoding compressed media to other compressed media and would instead recommend keeping copies of software that you know plays it and to occasionally check for software incompatibility down the road (notorious on Macs, somewhat less of an issue on Windows). Like the old codec packs from CCCP, old VLC versions, etc. are a bigger problem for preserving stuff than the actual media. Although I guess if you’re a weirdo and don’t care too much about video quality you can upload it to YouTube for free and make it private.
|
|
#
?
Oct 7, 2018 15:29
|
|
|
spincube posted:I don't have any issue with spending a few weekends with Handbrake - it's probably overdue at this point anyway - so I'd prioritise power usage over horsepower, but naturally if I can have my cake and eat it that'd be great. Right now I'm looking at a bog-standard Synology DS218play, as it's apparently built for media streaming/transcoding and there's an Emby package available for the Synology platform - but if the thread has any advice I'm all ears. As for caberham: A 1-bay Synology NAS can automatically backup to Google Cloud, which is very nice, and winds up costing only a couple of dollars per month.
|
|
#
?
Oct 7, 2018 15:54
|
|
|
caberham posted:Hey everyone, so I’m a home user with a NAS. My primary focus is my photo directory but I also store my documents and some movies there. Make your important stuff be a different B2 target. Set up versioning in B2 to keep 30-90 days of it. This way if a virus deletes them all B2 doesn't dutifully delete them all as well. In general this won't cause much extra cost but should provide a lot of extra protection.
|
|
#
?
Oct 7, 2018 16:17
|
|
|
 Everything is up and running on the bench now, pretty amazing how smooth everything went. Flashed the on board LSI SAS controller, taped and blanked drives, and booted up to UnRAID. Now I get to sit and wait 11 hours for parity drive to finish up before I can start copying my data over.
|
|
#
?
Oct 7, 2018 21:14
|
|
|
Thanks a lot guys for the help, guess I will have a one bay synology set up in my moms house and load to google cloud as off site. And on site would a spare USB HDD. I’m a little confused by the virus time delay thingy, sorry. H110Hawk posted:Make your important stuff be a different B2 target. Set up versioning in B2 to keep 30-90 days of it. This way if a virus deletes them all B2 doesn't dutifully delete them all as well. Sorry I have trouble understanding this post
|
|
#
?
Oct 7, 2018 23:32
|
|
|
caberham posted:Sorry I have trouble understanding this post How are you going Synology -> Backblaze? Is it via a desktop backblaze desktop backup client or via Synology's integration with Backblaze B2? If it's the latter log in to B2, find your bucket, click "Lifecycle Rules", set "Keep Versions: Last 30 days." (or whatever) If it's their main client backup system I forget exactly how it does that, it might be automatic: https://help.backblaze.com/hc/en-us/articles/217665868-Restoring-Deleted-or-Previous-Versions-of-Files
|
|
#
?
Oct 7, 2018 23:42
|
|
|
Enos Cabell posted:
Thats hot. 
|
|
#
?
Oct 8, 2018 03:52
|
|
|
 I love double CPU computers.
|
|
#
?
Oct 8, 2018 04:45
|
|
|
spincube posted:My home videos, movies and teevee shows currently sit on my big, power-thirsty PC, which is directly plugged into my TV. I'm currently using Emby as a sort of fancy wrapper for watching the videos, rather than for its media server capabilities. However, this is something of a waste. I use Plex instead of Emby, but for exactly what you want to do. You can set up a PMS on literally any spare PC or laptop; I have mine currently on a SFF HP EliteDesk. However, you can also get a dedicated NAS box to do the same thing; I just got an WD MyCloud Pro PR4100 (the 2-bay version is the PR2100) and it uses hardware transcoding (Intel QuickSync) to handle those needs for PMS (there's a dedicated branch for this NAS.) It works beautifully (exactly like a PC-based PMS implementation although I'm still only just starting to around with it.) It uses a 90 W adapter (you can actually plug in a 2nd one for redundancy) although I'm sure it uses far less power than that most of the time, and the PR2100 IIRC has a 48 W supply. I transcoded all of my DVD rips to HEVC (although AVC would also suffice) using Handbrake which chops down the file size to about half, and I strongly recommend doing this as the default MPEG-1/2 is very inefficient compared to modern codecs. necrobobsledder posted:I’m generally against transcoding compressed media to other compressed media and would instead recommend keeping copies of software that you know plays it and to occasionally check for software incompatibility down the road (notorious on Macs, somewhat less of an issue on Windows). Like the old codec packs from CCCP, old VLC versions, etc. are a bigger problem for preserving stuff than the actual media. Your point about lossy transcoding is well taken, however as long as you're not going back and forth between codecs for no reason it's a good idea to do a one-time transcode to a more universal format, as above. Using Youtube for non-commercial stuff (i.e. DVD rips, torrented TV shows, etc.) is a good idea, because you're accomplishing the same thing (streaming video over the Internet from somewhere, be it your own home or not) and then it become's Youtube's problem to manage the storage and backup. caberham posted:I’m a little confused by the virus time delay thingy, sorry. The idea is, if you have a backup setup to keep a copy of drive A on drive B, it will reflect any deletions or hostile encryptions (i.e. from hijacking malware) on drive A so you can lose everything on both drives. This is why you don't immediately want your backup to delete or change files on drive B so you have time to rectify any errors on drive A. (This is kind of why the Recycle Bin is useful instead of all deletions being permanent immediately.) dexefiend posted:
Now that's loving gorgeous! 
|
|
#
?
Oct 8, 2018 05:09
|
|
|
Atomizer posted:Using Youtube for non-commercial stuff (i.e. DVD rips, torrented TV shows, etc.) is a good idea, because you're accomplishing the same thing (streaming video over the Internet from somewhere, be it your own home or not) and then it become's Youtube's problem to manage the storage and backup. I would never trust Youtube as the only copy of data, nor with any data I wouldn't want literally anyone to access in case someone found and distributed the link, but that's not a bad idea for videos that fall into that category.
|
|
#
?
Oct 8, 2018 05:12
|
|
|
Yeah I mean as I've said the more important something is the more copies you should have, but if it's not particularly vital or sensitive then having someone else host it is the way to go.
|
|
#
?
Oct 8, 2018 06:53
|
|
|
Does anyone have a recommendation for a cheap PCIe 1x SATA card that is known to work in OpenIndiana or other Illumos distros? I need at least 2 ports, but 4 would be even better. Performance isn't really a concern. I have been through the HCL but it is primarily SAS RAID HBAs. I was looking at this, but can't seem to find anyone who has it working on Illumos or Solaris, but plenty of people using it on linux / BSD. Any thoughts on this card, or a similar suggestion? https://www.amazon.com/IO-Crest-Con...GPMK3F4KANX56P4
|
|
#
?
Oct 8, 2018 14:10
|
|
|
drat, if I'd have known how powerful and easy to setup an UnRAID / Plex Server combo was I'd have done this years ago! Pretty awesome to be able to serve up multiple concurrent 10mbit 1080p streams out over the internet, my close friends and family are about to get a whole lot happier. e: granted, years ago I didn't have the gigabit fiber connection that makes that sharing possible
|
|
#
?
Oct 8, 2018 18:54
|
|
|
adorai posted:Does anyone have a recommendation for a cheap PCIe 1x SATA card that is known to work in OpenIndiana or other Illumos distros? I need at least 2 ports, but 4 would be even better. Performance isn't really a concern. I have been through the HCL but it is primarily SAS RAID HBAs. I was looking at this, but can't seem to find anyone who has it working on Illumos or Solaris, but plenty of people using it on linux / BSD. Any thoughts on this card, or a similar suggestion? I don't have a specific suggestion but you can fit a larger than 1x card into a 1x slot one of two ways. 1) use an extender cable that goes from 1x to whatever size the card you want has 2) if your slot doesn't have a back then the larger one will just fit in; you can always remove the material yourself but you do risk destroying the board. I know you said that performance isn't a factor, but do consider that PCIE 1x is 250MB/s in each direction. With even 2 hard drives attached you're going to be pushing up against that, so depending on your needs it might be better to juggle around elsewhere (eg if you have a vid card occupying a 8x or 16x slot, use the HBA on one of those and throw the graphics card on the 1x).
|
|
#
?
Oct 8, 2018 22:29
|
|
|
Raldikuk posted:I don't have a specific suggestion but you can fit a larger than 1x card into a 1x slot one of two ways. 1) use an extender cable that goes from 1x to whatever size the card you want has 2) if your slot doesn't have a back then the larger one will just fit in; you can always remove the material yourself but you do risk destroying the board.
|
|
#
?
Oct 8, 2018 23:46
|
|
|
Then yeah if you're concerned about guaranteed support, your best bet is to just run a known-good card on the 1x slot anyway. Either dremel it or stick it on a 1x-16x riser and figure out a way for it to not be a total clusterfuck. I did the latter at one point.
|
|
#
?
Oct 8, 2018 23:52
|
|
|
drat, I need a static IP and it looks like that's going to be a bigger hassle to get from my ISP than I thought.
|
|
#
?
Oct 9, 2018 03:27
|
|
|
Enos Cabell posted:drat, I need a static IP and it looks like that's going to be a bigger hassle to get from my ISP than I thought. You probably actually want Dynamic DNS. https://freedns.afraid.org/
|
|
#
?
Oct 9, 2018 03:29
|
|
|
The Milkman posted:You probably actually want Dynamic DNS. https://freedns.afraid.org/ I'm behind a carrier grade NAT so not sure that will work.
|
|
#
?
Oct 9, 2018 03:45
|
|
|
Yeah that won't work. What's your ISP?
|
|
#
?
Oct 9, 2018 09:30
|
|
|
Get a $5/mo VPS and forward traffic to its public IP back to your gear through a VPN tunnel.
|
|
#
?
Oct 9, 2018 12:26
|
|
|
SamDabbers posted:Get a $5/mo VPS and forward traffic to its public IP back to your gear through a VPN tunnel. People have tried that and say it slows Plex down to unacceptable levels. This is primarily for Plex app access to the server, which limits my options a lot sadly. From what I've been reading I'm really at the mercy of the ISP (Allo) for now. I've got a friend that works for them, so he's gonna see what he can do.
|
|
#
?
Oct 9, 2018 13:09
|
|
|
Enos Cabell posted:People have tried that and say it slows Plex down to unacceptable levels. This is primarily for Plex app access to the server, which limits my options a lot sadly. From what I've been reading I'm really at the mercy of the ISP (Allo) for now. I've got a friend that works for them, so he's gonna see what he can do. Plex does all this for you, basically runs its own dns for you. I dont have a static ip and everyone linked to my account can access it at any time.
|
|
#
?
Oct 9, 2018 13:17
|
|
|
derk posted:Plex does all this for you, basically runs its own dns for you. I dont have a static ip and everyone linked to my account can access it at any time. You aren't behind carrier grade nat then. e: Here is the relevant bit from the Plex support docs. I haven't found anything yet that contradicts this: quote:If you are behind Carrier Grade NAT service, then you would need to check if your ISP has an option for you to use (or purchase) a static Public IP address which would bypass CGNAT.
|
|
#
?
Oct 9, 2018 13:29
|
|
|
If your ISP doesn't give you a "real" IP address, perhaps change ISPs? It sounds like they are just giving you a local IP to their network, right? I mean, doesn't that mess up all kinds of poo poo?
|
|
#
?
Oct 9, 2018 14:07
|
|
|
Yes. Normally though unless you are using an LTE network you would have access to IPv6 if they're forcing CGNAT on you.
|
|
#
?
Oct 9, 2018 14:12
|
|
|
Enos Cabell posted:You aren't behind carrier grade nat then. what a lovely ISP
|
|
#
?
Oct 9, 2018 14:33
|
|
|
Just got off the phone with them, supposedly they are getting a new bucket of IPv4 addresses in the next few days, and will set me up with a static at that point. With the global IPv4 shortages, I think more and more ISPs are going to be moving to cgnat.
|
|
#
?
Oct 9, 2018 14:40
|
|
|
derk posted:what a lovely ISP Blame people for sticking their head in the sand around implementing ip6. While I am the first to pile onto the mega-isp-is-poo poo bandwagon this is one thing that nerds/many companies in general have brought upon themselves. Thankfully mobile carriers have added it in the USA, and Google works on it as well.
|
|
#
?
Oct 9, 2018 14:42
|
|
|
H110Hawk posted:Blame people for sticking their head in the sand around implementing ip6. While I am the first to pile onto the mega-isp-is-poo poo bandwagon this is one thing that nerds/many companies in general have brought upon themselves. Yeah, I just wanna say too that my ISP Allo is pretty badass and no complaints with them. I can't really blame them for IPv4 shortages.
|
|
#
?
Oct 9, 2018 14:50
|
|
|
There are 2 things carrier grade NAT affects for most normal people. First is you can't open/forward any ports. Means torrents go slow and you get low uploads. The other problem is your public IP addresss is shared by however many hundreds of people, so if one of them fucks up and gets bannded from a website, everyone gets banned with that IP. On the other hand IPv6 utterly rocks and if more websites were v6 enabled this wouldn't be an issue at all.
|
|
#
?
Oct 9, 2018 17:16
|
|
|
I experimented with a $5 droplet to pass through traffic to a local VM, it worked pretty well. Connected a local Ubuntu VM and the droplet with OpenVPN, setup the droplet to passthrough traffic from the WAN over the VPN to my UbuntuVM. I tested it a bit with Emby, site was just as responsive and could do about 70mbps of bandwidth, plenty for several streams. I had pretty ideal conditions though, gigabit FIOS to a nearby DO Datacenter, with my test user also nearby on gigabit FIOS. Also probably simpler to terminate the SSL connection at the droplet, then reverse proxy over the VPN to whatever internal devices/applications you wanted.
|
|
#
?
Oct 9, 2018 19:18
|
|
|
Enos Cabell posted:People have tried that and say it slows Plex down to unacceptable levels. This is primarily for Plex app access to the server, which limits my options a lot sadly. From what I've been reading I'm really at the mercy of the ISP (Allo) for now. I've got a friend that works for them, so he's gonna see what he can do. It is pretty important to make sure that both the VPS and the VPN-terminating equipment on your end can both handle the throughput you want. In particular, this means using a VPN mechanism that takes advantage of hardware crypto and uses a kernel data plane, which means OpenVPN is probably not the best choice. IPsec is the most likely to be able to take advantage of hardware crypto on just about every platform, though not the simplest to configure. Also, redeyes posted:IPv6 utterly rocks
|
|
#
?
Oct 9, 2018 19:27
|
|
|
CGNAT fucks with people games and so I'm convinced that marketing the benefits of playing Xbox or Playstation on one ISP over the other is going to be what finally tips the world into IPv6 territory. From what I understand, Xbox Live will already flag a lack of IPv6 when doing a network check, and there's going to be a point where it's cheaper to just roll it out than to field tech support calls from angry gamers.
|
|
#
?
Oct 9, 2018 19:38
|
|
|
|
| # ? May 16, 2024 14:29 |
|
|
THF13 posted:I experimented with a $5 droplet to pass through traffic to a local VM, it worked pretty well. I understood some of these words.
|
|
#
?
Oct 9, 2018 19:58
|
|
