|
gradenko_2000 posted:I feel like someone in the threadpredicted that this is exactly what would happen at the time lmao It's what everyone expected but hoped wouldn't happen.
|
#
?
Oct 21, 2022 06:45
|
|
|
|
| # ? Jun 1, 2024 19:31 |
|
|
Are LTT just using all of this storage to archive their old videos? Is there something I’m missing
|
|
#
?
Oct 21, 2022 12:12
|
|
|
8 Ball posted:Are LTT just using all of this storage to archive their old videos? Is there something I’m missing Yes, all Youtubers with any sense will back up all their video files in case they need to re-edit them or grab old footage. Tom Scott’s said in the past he has petabytes of backups of everything he’s done since 2002 including the original Iron Chefs video.
|
|
#
?
Oct 21, 2022 12:39
|
|
|
It's not just for backups but real-time video editing too. All camera footage gets ingested into a central server that everyone's supposed to work off of instead of using local storage, I think.
|
|
#
?
Oct 21, 2022 13:33
|
|
|
Dr. Video Games 0031 posted:It's not just for backups but real-time video editing too. All camera footage gets ingested into a central server that everyone's supposed to work off of instead of using local storage, I think. Storage for edited content, for raw footage, and for editing scratch disks. Scratch disks take quite a bit of room. People who have never worked in video also don't realize how much raw footage it takes to make a video. You're generally looking at 2 hours of raw footage per 20-30 minutes of edited video, on average. For project videos, there would be raw footage of the whole project. So if it's a 3 day project, you're talking maybe 24 hours of raw video. Any b-roll (shots of products, projects, locations by themselves) is also usually 2 hours of footage per minute. Now, if you're running multi-cam like some places do, multiply that by the number of cameras running. TL:DR Video production takes way way more storage than people understand.
|
|
#
?
Oct 21, 2022 16:08
|
|
|
Thread sweetheart CRD did a recent video going over how much work it is wrangling the data produced
|
|
#
?
Oct 21, 2022 16:20
|
|
|
Also people just shooting RED in the highest possible quality raw formats possible. I love the braw compression, and I'm surprised for talking heads they need more than braw 1/4. Even for segments a BMPCC 6k would be enough, but they went big for something that it doesn't feel like they needed too. Still if I could tell my boss "yeah we uh, need red cameras" and he said yeah I'm not going to convince him it's actually overkill e - they could be off red and I wouldn't know. Hopefully they moved to something more practical. I would be using one of the sonys with face tracking for segments, it seems like they have autofocus for thejrs but I'm too lazy to verify forest spirit fucked around with this message at 16:26 on Oct 21, 2022 |
|
#
?
Oct 21, 2022 16:24
|
|
|
iirc, ltt used to shoot in 8k or something like that so they can crop the shots to frame them better in 4k. probably not for all shoots, unless ...
|
|
#
?
Oct 21, 2022 17:06
|
|
|
CRT dude had a video about storage where he goes over video bitrate/storage https://www.youtube.com/watch?v=MQRpIUu3dMw&t=895s
|
|
#
?
Oct 21, 2022 17:09
|
|
|
I did a podcast that went for like ~80 episodes and I saved all the audacity projects (at least until like a loving moron I formatted that hard drive on accident) and I feel like by the time I was done it was 700 gigs or so.
|
|
#
?
Oct 21, 2022 17:58
|
|
|
njsykora posted:Yes, all Youtubers with any sense will back up all their video files in case they need to re-edit them or grab old footage. Tom Scott’s said in the past he has petabytes of backups of everything he’s done since 2002 including the original Iron Chefs video. i do think it’s probably a bit overkill considering how ephemeral the medium is; they could probably get away with compressing it a ton and no one would notice. granted overkill is the point of the channel
|
|
#
?
Oct 21, 2022 19:11
|
|
|
Honestly surprised Linus hasn't wiped out all of their back catalog of footage at some point with some hairbrained scheme. Or did he and they had to employ some data recovery company? I recall something like that. He should be really kept away from the backend stuff that keeps the channel going.
|
|
#
?
Oct 21, 2022 19:18
|
|
|
Generic Monk posted:i do think it’s probably a bit overkill considering how ephemeral the medium is; they could probably get away with compressing it a ton and no one would notice. granted overkill is the point of the channel With video you always shoot at high as you can. You can always push quality down but never up. At least when you have money to do so anyway.
|
|
#
?
Oct 21, 2022 19:21
|
|
|
priznat posted:Or did he and they had to employ some data recovery company? I recall something like that. Yes, their first big homebrew NAS project was a raid0 of raid5s. Fast, resilient to drive failure, insanely vulnerable to a controller failure. And when one of the controllers did fail, that cockamamie scheme was so obtuse that they needed specialists to reconstruct it. I think archiving all your footage in full quality is pretty superfluous for a youtube channel -- it's not like in 20 years people are going to want "The Complete LTT Box Set, now in 8k!" like a TV series. But they can, and the project to make a petabyte NAS is more content. And when said NAS catches on fire, it's yet more content.
|
|
#
?
Oct 21, 2022 19:42
|
|
|
I think GN has a system where they have all their more recent stuff saved on their server at full quality, but past a certain time they automatically get compressed and saved to a separate storage server.
|
|
#
?
Oct 21, 2022 19:46
|
|
|
Handling scratch disks and archival for professional video production isn't exactly the top of the range of what's possible, despite how much youtubers like to go on about how difficult it supposedly is. HPC clusters doing scientific calculations like that done at Lawrence Livermore National Laboratory need storage at exabyte scales with bandwidth enough that a single 100Gbps fiber interface isn't going to be enough. Their current solution is Lustre on top a ZFS pool using a truly massive set of disks. The point being, if something is the thing what make you money, you should budget to do it properly because you probably can't afford to gently caress it up. And if you can afford it, you're probably not paying your employees enough.
|
|
#
?
Oct 22, 2022 13:48
|
|
|
Kramjacks posted:I think GN has a system where they have all their more recent stuff saved on their server at full quality, but past a certain time they automatically get compressed and saved to a separate storage server. yeah this is what i was saying is the logical choice - save compressed versions of the archived footage by all means if you want, it does beat just keeping the rendered projects or downloading it from youtube every time you want to clip something, but keeping the raw uncompressed originals is excessive; they're a tech youtube channel, not the criterion collection. i'm not gonna judge them too much for it tho since the 'we hosed up our server' or 'we got this new enterprise tech that we barely know how to use' stuff is my favourite content from them. the scripted content, benchmarks, reviews etc i am less of a fan of. nobody watched top gear for an intimate understanding of tyre grip coefficients, power-to-weight ratios or emissions testing. Klyith posted:Yes, their first big homebrew NAS project was a raid0 of raid5s. Fast, resilient to drive failure, insanely vulnerable to a controller failure. this happened again very recently where they had moved all the archival to zfs which is meant to ensure data integrity, but no one had remembered to set up the scrubs that actually do the work of checking for data errors. a bunch of drives had silently failed out of the array over the years and they ended up having to call wendell from l1t for help https://www.youtube.com/watch?v=Npu7jkJk5nM Generic Monk fucked around with this message at 14:20 on Oct 22, 2022 |
|
#
?
Oct 22, 2022 14:17
|
|
|
They’re doing that poo poo on purpose When I had built a NAS that didn’t go anywhere like 10 years ago, even I knew to set up a scrub cron job
|
|
#
?
Oct 22, 2022 18:20
|
|
|
Generic Monk posted:this happened again very recently where they had moved all the archival to zfs which is meant to ensure data integrity, but no one had remembered to set up the scrubs that actually do the work of checking for data errors. a bunch of drives had silently failed out of the array over the years and they ended up having to call wendell from l1t for help  edit: you know what, i don't care - they're 100% willfully ignorant and actively lie to get clicks
|
|
#
?
Oct 22, 2022 19:25
|
|
|
Linus has made a really good career out of knowing just enough about technology to be dangerous and frankly I’m kind of jealous.
|
|
#
?
Oct 22, 2022 19:28
|
|
|
Has GN actually made any fan reviews using their fancy fan testing machine? Since I'll probably be building a new pc I thought I'd check it out an the last test is a giant novelty fan from Corsair lol.
|
|
#
?
Oct 22, 2022 19:41
|
|
|
Phone posted:They’re doing that poo poo on purpose yeah same, it’s one of the first things the truenas setup guide implores you to set up iirc. though i think they were using some frankensteined linux version it doesn’t surprise me tbh; one of them probably blocked out a morning to do it then got called to pitch in with something else. this is why you have a full time IT person lmao
|
|
#
?
Oct 22, 2022 19:59
|
|
|
TrueNAS Scale? That's natively Linux from the get-go.
|
|
#
?
Oct 22, 2022 20:13
|
|
|
mobby_6kl posted:Has GN actually made any fan reviews using their fancy fan testing machine? Since I'll probably be building a new pc I thought I'd check it out an the last test is a giant novelty fan from Corsair lol. Not yet. I think they’re still deciding methodology. It took them many months to start doing actual PSU reviews. Close to a year IIRC.
|
|
#
?
Oct 22, 2022 20:34
|
|
|
BlankSystemDaemon posted:HPC clusters doing scientific calculations like that done at Lawrence Livermore National Laboratory need storage at exabyte scales with bandwidth enough that a single 100Gbps fiber interface isn't going to be enough. When I worked on developing Lustre and the first deployment at LLNL in ~2004 (on top of extN), we broke Linux’s df and some other utilities because they couldn’t handle exabyte-sizes filesystems. Livermore took something like 15 years to promote Lustre to full production use from its initial “scratch” deployment; they’re serious about their hard-to-reproduce data being safe. (In terms of unclassified stuff, at least. I don’t know if they were more aggressive with Q and friends.)
|
|
#
?
Oct 22, 2022 21:04
|
|
|
gently caress yes. Sad for the guy who got them but this is going to be tremendous content. https://twitter.com/GamersNexus/status/1583906098033356800
|
|
#
?
Oct 22, 2022 21:31
|
|
|
priznat posted:Linus has made a really good career out of knowing just enough about technology to be dangerous and frankly I’m kind of jealous. Linus seems like a nice enough guy. I think he is proof of the Peter principle and how little that matters in the age of the Internet. As long as his staff continue to get paid, I don't care that much.
|
|
#
?
Oct 22, 2022 23:41
|
|
|
Pilfered Pallbearers posted:Not yet. I think they’re still deciding methodology. It took them many months to start doing actual PSU reviews. Close to a year IIRC. Thanks! I'm a huge nerd so I certainly appreciate measuring everything but on the other hand it seems like "put the fan in a case and measure temperature" would've been much easier and probably more useful in practice than whatever that contraption measures. Anyway, they did just buy a $5000 PC and it immediately throttles itself lol: https://www.youtube.com/watch?v=ICMKUSff_6I
|
|
#
?
Oct 22, 2022 23:46
|
|
|
mobby_6kl posted:Anyway, they did just buy a $5000 PC and it immediately throttles itself lol: https://www.youtube.com/watch?v=ICMKUSff_6I lol skimming thru the video and the main thing that stood out to me outside of how lovely the build was, was his hair occasionally dangling into the case while he was digging around
|
|
#
?
Oct 23, 2022 00:22
|
|
|
Charles Leclerc posted:Linus seems like a nice enough guy. I think he is proof of the Peter principle and how little that matters in the age of the Internet. Companies responded to it as if it was real by adopting a process where people are fired if they refuse promotion.
|
|
#
?
Oct 23, 2022 00:39
|
|
|
mobby_6kl posted:Anyway, they did just buy a $5000 PC and it immediately throttles itself lol: https://www.youtube.com/watch?v=ICMKUSff_6I Oof, Skytech were meant to be one of the good ones too.
|
|
#
?
Oct 23, 2022 00:57
|
|
|
Lmfao the userbenchmark page for the i5-13600K is so drat smug
|
|
#
?
Oct 23, 2022 10:40
|
|
|
Scientists need to study the userbenchmark guy. We could achieve immortality if we studied his ability to never age one bit.
|
|
#
?
Oct 23, 2022 15:07
|
|
|
At this point, he's probably suffering some TempleOS type of mental illness. Because that amount of fanboyism and mental gymnastics is just ridiculous.
|
|
#
?
Oct 23, 2022 16:12
|
|
|
some fun gn overclocking of the 4090 happening rn https://www.youtube.com/watch?v=zkQ9ihrSJ_0
|
|
#
?
Oct 23, 2022 18:35
|
|
|
kliras posted:some fun gn overclocking of the 4090 happening rn hmmmm I have family in Raleigh... I should call them & say to expect local power grid brownouts.
|
|
#
?
Oct 23, 2022 19:05
|
|
|
LTTStore.com shoelaces. Trying to milk the audience pretty hard, eh?
|
|
#
?
Oct 23, 2022 20:23
|
|
|
Combat Pretzel posted:LTTStore.com shoelaces. Trying to milk the audience pretty hard, eh? They're copying Tumblr's recently launched merch store lol. Except Tumblr's shoelaces were at least referencing an old Tumblr meme.
|
|
#
?
Oct 23, 2022 20:39
|
|
|
Combat Pretzel posted:LTTStore.com shoelaces. Trying to milk the audience pretty hard, eh? they're free
|
|
#
?
Oct 24, 2022 00:15
|
|
|
|
| # ? Jun 1, 2024 19:31 |
|
|
well why not posted:they're free it’s free foot estate
|
|
#
?
Oct 24, 2022 00:25
|
|