How do social media companies like twitter or youtube not run out of space for posts?

skomposzczet@vlemmy.net to No Stupid Questions@lemmy.world – 141 points –

I know memory is fairly cheap but e.g. there are millions of new videos on youtube everyday, each probably few hundred MBs to few GBs. It all has to take enormous amount of space. Not to mention backups.

86

You are viewing a single comment

Yeah this seems false. SD cards are unreliable, hard to keep track of, and don’t actually store that much data for the price. I do think they use tapes though to store long term, low traffic data.

Used to work there but it’s been a few years so maybe things changed but that was how we originally got super cheap and durable s3.

We use LTO tapes in Hollywood to back up raw footage; it wouldn't surprise me if AWS uses tapes for glacier.

I got a tour of Iron Mountain once (where we sent tapes for long term archival). They had a giant room with racks and racks of LTOs, and a robot on rails that would make copies of each tape at regular intervals to keep the data from corrupting. It looked kinda like the archive room in Rogue One. Wouldn't surprise me if Iron Mountain was an inspiration for the design. Super interesting.