Reddit signs $60M contract allowing AI company to train its models on the social media platform's content

minnix@lemux.minnix.dev to Technology@beehaw.org – 260 points –
reuters.com
106

Remember the whole "if you aren't paying for the product, you are the product"?

It wasn't enough to turn you into a product. Now they also want to turn you into a resource. Farming your comments and posts to feed to an AI model.

What an economy we've built.

I wonder why I don't pay for Lemmy.

The kind of frightening thing is that anyone could start an instance on the Fediverse, collect all the posts and comments coming in as all instances usually do and then use it to do the same thing, and I'm not sure there's currently anything (legally or otherwise) stopping them.

But at least we have the option to defederate such an instance. If we can find out which ones do it...

I totally understand your perspective, but I approach this from the opposite direction.

From my perspective, there's no "at least" here. My Lemmy posts are public. I have no control over what is done with them after I post them. I am comfortable with that.

The difference between Reddit and Lemmy is not that one protects privacy and they other doesn't. NEITHER is a platform for private discussion.

The difference is that with Lemmy, public means PUBLIC. Reddit, Twitter, and Facebook are also "public" in the sense that there can be no expectation of privacy. But they're "private" in the corporate sense — a single corporate entity retains control of the data. They can, at will, restrict access to that data, without the consent of the users who created it.

And that's not just theoretical; all of those companies have literally restricted access to content that users meant to be public. People can't read the Twitter posts that I made with the intention of them being public, because Twitter now requires an account to read posts and comments. Reddit has restricted access to posts I made with the intention of them being public and readily accessible, because they killed apps and integrations, and implemented onerous access control in an attempt to hoard my data.

They altered the terms, and I, for one, got sick of praying that they would not alter them further.

Lemmy is public. You cannot control who can read it, and you cannot control what they do with it. The difference is that with a truly public platform like Lemmy, my data can benefit the whole world, instead of just some corporation.

If you are looking for a platform for private discussion, Matrix is probably it. But even then, the concept of data privacy only makes sense if you trust all the people that ever have access to the data. If I'm in a Matrix room with hundreds of strangers, I wouldn't consider that "private" either, regardless of the protocol's encryption.

Bad actors will always have access to the posts I make public. On Lemmy, good actors do, too, and nobody can take that away from us. THAT'S the difference.

This is the right way to think of it. Reddit feels dirty because they were a private company and we trusted them in the walled garden. That trust was naiive at least on my part, but it was 14ish years ago I had joined and they never did wrong, until recently.

Lemmy, however, is a public protocol. From the ground up everything is public. There is no illusion of privacy here, and anyone who thinks there is should forget about it. The protocol is by definition public, and will launch any comment/post across the globe to anyone listening. It's nailing the paper to the door for everyone to see. To me this is okay though, because I know that going in. The tradeoff is less privacy, but it's an open platform that no one can take away.

I really like that perspective, thank you for easing my fear.

W take. I have no problem with my public comments being used as training data for AI as long as they're public. I just don't want some shitty private company to hoard them like they fucking own them when they don't.

An instance isn't required. It's not like the current generation of generative AI wasn't trained from web scrapings

The instance would likely just act as a regular instance and allow normal users on, you couldn't even tell they were using it to scrape data at that point.

Free and open information, like Wikipedia, used to be an ideal. I have used Reddit since 2008 or earlier because it got on search engines and shared information consistently on precise topics. Twitter used to also be this way, but now mostly only puts paid subscribers on search engines.

If you are to organize information around topics, such as a Commodore 64 community, and the protocol openly allows copies to be made via federation, I encourage people to have the attitude that information be treated like Wikipedia content. It sucks now that so much information from 10 years ago has been just entirely lost now that so many deliberately purged their Reddit comments, etc. Tragedy of the commons. And it drags down the entire planet that people squirrel away discussions on topics that are generally public. It's like now everyone wants to monetize even their discussions on Commodore 64 or automotive repair / have behind absolute control or paywalls /etc.

I wouldn't consider this a tragedy of the commons situation. People entrusted reddit to remain a somewhat acceptable company, and reddit betrayed that trust.

People didn't purge their comments to remove this information from the public, but they purged it from reddit making money off limiting the access to this information.

People didn’t purge their comments to remove this information from the public, but they purged it from reddit making money off limiting the access to this information.

Reddit was always making money off their content. The tragedy is that the common knowledge is destroyed. They didn't bother to copy it to a public place, they just nuked information and context. The loss is for newcomers on any topics. The result is the same old questions being asked over and over, which all social media sites (including Lemmy thrive on FRESH content).

People can already do that without an instance, the same way google indexes the site.

Legally, in EU, you probably cannot scrape an instance of someone else because of the database copyright law. But I have no idea if that applies to being part of the network. Since the other instances send you their content willingly.

Maybe someone should make a license extension to ActivityPub, where instances can communicate what can and what can't be done with the information they publish. Then at least there would be legal clarity. If it can be enforced is another question.

The thing is, the license probably doesn't mean a whole lot in that case because of the way content is shared on the Fediverse.

As you say, you actively send your content to other websites, and licenses need at least some degree of active acceptance. Including a license field in the metadata almost certainly does not meet any kind of legal threshold. It's significantly weaker than the EULAs they everyone knows that nobody reads.

The content posted here has no obvious license. I wonder if an administrator could just put any license of his choice on your posts.

people joined basically with no terms of service on a lot of Lemmy instances.

I would think that subscribing to a community could be coupled to a license. Servers do not randomly send data, they only send it to other servers that are subscribed. And a server could technically decline a subscription.

But anyways, by default, copyright is with the creator. No idea what that looks like in legislations around the world, but if I remember correctly, in EU, just because you give a copy of a e.g. song you wrote to someone, does not actually mean they can do with it what they want. By default, you have all the rights, and the someone else needs to grant them to you. So if you give that someone also a contract where it states that he can play it in front of an audience, then they can, otherwise they cannot.

However, I am not sure how much implied consent can play a role here. By posting something on a fediverse instance, since the purpose of the fediverse is to share these posts with other servers, then by posting you may implicitly agree to this data being shared, and the next server can share it with another server again, and so on. This is the basic "boost" functionality of mastodon.

I believe though that because the purpose of the fediverse is not explicitly to train AI models or to sell the posts to someone else, it may be illegal to scrape all posts off to feed e.g. an AI model. But may also not be. We will never know until someone starts doing it and someone else sues them.

The thing is, servers don't subscribe to anything, users do. If the end user is provided with a license, the server is not obligated to honour it, because the server didn't agree to shit.

If an instance is defederated, the owners can just spin up a new instance.

I've always thought about what you've said about Lemmy when people start talking about how Lemmy is more privacy focused than Reddit.

As one of your replies have said many people in the hundreds/thousandths have a copy of your data on Lemmy - the instance owners. If you decide you've shared too much information then you end up asking every owner to delete that nugget of information. And realistically there is nothing to enforce it. This is one benefit of the walled garden of places like Reddit because they are legally obligated to delete the information especially in places like the EU.

This is one benefit of the walled garden of places like Reddit because they are legally obligated to delete the information especially in places like the EU.

In theory yes, but anyone can also scrape reddit for all its posts and comments (and someone likely is). And nobody is making them delete the data. And then there's stuff like the Internet archive complicating stuff further.

Whilst true about anyone can scrape data off Reddit, I think it's more of a pain since before the API updates the rate limit was 2 API calls per second. You also have to find or create a scraper. With Lemmy, you follow the instructions (copy and paste) on join-lemmy.org to create your instance and you're done. Both methods you have to configure it to subscribe to communities, so they're about the same.

In the EU at least there is a right to be forgotten, so yeah, Reddit and other platforms are forced to delete the data on request. I'm not sure how the same can be applied to a distributed network like Lemmy.

There were publicly available archives of Reddit. The last time I checked, you couldn't find the latest submissions and comments. Maybe things have changed, maybe newer alternatives have appeared.

For the right to be forgotten, this only applies to personal information. E.g. information that can be associated with information, that could be used to identify you.

Since you usually have an email for signup, that would make the data fall under personal information. But reddit could just delete the email adress and your user name and show something like:

[deleted]
When does the Narwhal bacon?

And well, it is pretty difficult to find out if, when and where there is backups that still contain your information and could be given to the AI model trainers too. To find these things out, we'd need a precedence case that makes a data protection agency investigate reddit throughouly.

It's all of the data or just the data that associates content with you, the latter if the company has a genuine reason to keep the content, which a forum generally does.

If the content cannot be associated with you then does it matter if the content is present on the website?

Creating a new instance only gets you access to content that users of your instance have subscribed to, and then mostly only content that comes in after subscription (I believe Lemmy primes the pump a bit on community subs, pulling in a handful of posts at the time of discovery, but discovery is done by users). So, there's a limit on what you can scrape with your own private instance, and you're taking a bit of a bet on which communities will yield what you're looking for in the future.

It'd be easier and more reliable to just crawl the network and scrape it the old fashion way.

"If you search for a community first time, 20 posts are fetched initially. Only if a least one user on your instance subscribes to the remote community, will the community send updates to your instance. Updates include:

New posts, comments
Votes
Post, comment edits and deletions
Mod actions"

So you create a single user and subscribe to all communities of interest.

I probably downplayed the difficulty of setting up a Lemmy instance that will come if you do something out of order or don't quite have the host set up correctly or something. Although I do think it's easier than pigging about with web crawlers.

1 more...
1 more...
1 more...
1 more...

You don't have to, but the owners of your instance are probably paying out of pocket to keep it online. I'm sure they're taking donations

1 more...
1 more...

That AI is going to get really racist, really fast, judging by the muck we all saw daily on Reddit.

Although it's going to be really good at anime porn too. So there's that.

Damn just 60 mil??

Like seriously, this must be fake. Add a zero and I'd still find it suspiciously cheap.

Yeah, the diarrhea of my shitposts over there alone is worth more, it's what will make the future AI kinda smart & very depressed.

And that's why I deleted all my posts and comments before deleting my account. Sure, they could probably go back and restore it if they wanted but, so far, they haven't.

Glad I landed here on Lemmy.

I deleted all my comments last year. Recently I got a notification for a response in one of such comments. When I clicked the notification link, my comment and the response were visible. The comment doesn't show up in my profile.

Interesting. I've specifically searched for some fairly unique content (Python scripts, etc) I posted in my time over there, and it hasn't shown up at all.

So you left your Reddit account intact?

Edit: Fucking. Cunts. I just searched (had been a few months) and at least some of my data is back. I reckon they've done it ahead of the planned AI move and IPO.

Edit 2: joke's on them - my posts were linked to an alt account I setup on Pastebin years ago. Still had the creds, so have deleted the pastes. Fuck Reddit. 🤘

Reddit was aggressively rate limiting tools used to delete and edit content in a funny way when the API pricing was announced. The API wouldn’t return an error, the rate limiting was silent, and the tools would report successful deletion or edits even when the edit or deletion wasn’t made.

I had to modify an existing script to handle the 5-second rate limit and, lieu of deleting, I just rewrote each comment with a farewell.

Even then I did 3 passes (minor additional edits) in cases Reddit was saving previous edits.

My content has stayed edited.

Do you still have the Python script available?

I was fine with keeping my comments up before for the future searchers, but I'm not fine with that shithole making profit off of it.

I recently used shreddit with the --gdpr-export-dir flag and it worked perfectly.

I've had the same experience. Most scripts just erase the comments available directly through your reddit profile, which is limited to the most recent ~2000 posts that you've made. To fully erase anything and everything, you need to request all your data from reddit, download the .zip and feed it into an application like shreddit.

Yep used 'power delete suite' to delete everything before I left.

Well, I just discovered a bunch of my stuff had been restored. Says deleted account, but it's there.

Deleting your account doesnt delete your content AFAIK.

I was saying elsewhere I deleted all my content before deleting my account, but now some of my content is back.

Supposedly, if you deleted it during the blackouts... any sub that was down at the time of deletion, didn't delete comments.

I don't think I ever actually bothered deleting my content because I suspected that they would just do something like that anyway.

I suspect Reddit holds a perfect copy of every edit, including the first, you’ve ever done. For legal reasons if nothing else. Now also to prevent against perfectly good AI training content to be deleted.

1 more...
1 more...

Yeah! Here, no one gets paid when someone else wants to profit off of all the free user generated content. Wait, what was our goal again?

3 more...

Just in time to make new AI generated shitposts with AI generated replies & pump up those numbers for the IPO.

Can't wait to read a post about how a novice AI finds it hard to animate human hands and some other AI suggest studying hentai porn to get the finger/tentacles movements just right. And ofc lots of ads. From AIs, to AIs, by AIs, for AIs.

r/TotallyNotRobots is spreading everywhere.

Reddit is run by pigeons and other birds/drones confined. Actually we always knew that.

Trained on 99% reposts

And the outputs of bots. There has been a shocking increase in auto-generated comments on reddit in the past years and it's turning the training data into a minefield.

Haven't touched reddit socially in 8 months, but every now and then I'll use it to search for opinions or instructions on things. Searched "reddit best domain registrar" recently and landed on a thread where top to bottom, every comment recommending a registrar was from a bot and/or banned account. No real person testimonials, all ads. And as AI implementations improve, that's going to get harder to spot. In the meantime, I'm formatting searches like "best domain registrar lemmy" because reddit is legit that bad rn.

We all knew it was coming, but it's still disappointing

Funny, I don't see anyone saying the AI companies have free right to Reddit's content.

Can users opt out? Because the content belong to the users

my layman understanding would be, that they include it in the TOS and your only option would be to leave the platform and demand them to delete all your content, which they may or may not do. E.g. they could just train the AI on an older backup. Good luck getting your rights recognized and abided by.

Good point. People are only loud about something if it directly effects them

$60m doesn't seem like that much in an era where twitter could (have been) sold for $40b.

60 million a year for access to the relatively public data... That seems pretty good to me tbh.

Maybe, but with people are saying reddit's main value proposition is access to AI training data, and that reddit is worth n billion dollars, $60m seems like a pittance.

Its just an API, right?

No, it's really not.

Firstly, while the data may be public, it's not "free". Scraping reddit and using it to train an AI would likely contravene their terms of use, you'd end up facing similar copyright issues that the current generation of bots has.

Secondly, scraped data would be incomplete, you wouldn't get anything edited or "deleted", which would surely be available if you paid them. The edits and deletes would be very valuable for AI training.

Thirdly, you would get the meta that reddit has. Geolocation, user agent, alt accounts, browsing habits, et cetera.

Fourthly, you wouldn't get exclusivity. Locking out a competitor is worth something.

Idk why you are talking about scraping when I said API?

And is all that information in the training contract?

I assumed that when you said "it's just an API" you were saying you're paying $60m for an API as opposed to scraping for free.

Is all what information in the training contract?

so the API thing was over nothing? brilliant

No, it was just preemptive to enforce control over who can programmatically read the site

We did it reddit, we trained an AI to be the pure embodiment of cringe.

Add the bot problem to it and you'll get garbage in, garbage out

Hell even the users didn't exactly contribute good quality content.

Lol, so they're going to be training their AI on... AI generated content? The uptick in that shit on reddit has made it more annoying than usual.

That and all the confidently incorrect shit on the site... Not to mention the constant in-jokes. I'm just imagining a chatbot responding to something about how to deal with grief with "I also choose this man's dead wife!"

Can't see how this could possibly go wrong.

Got to get my data deleted quick.

It is just fooling yourself, we were all robbed by the time Spez setup the paywall.

Quit Reddit.

Sounds like it's time for me to actually log back in and delete all my old posts. I've been putting that off for too long.

Be sure to edit them before deletion in case it gets restored. There's been reports of that happening.

Yeah true. Is power delete suite still the preferred method?

I actually don't know since I ran it before the API changes. It may be limited now that API usage is limited, depending on how it works.

Dumb question for the Lemmy lawyers, if enough redditors joined could a class action lawsuit be filed to be paid for their content... Or is that so outside of the TOS that it's not worth considering?

TOS dictates that Reddit owns all content on their platform, you’d have no case

Reddit doesn't "own" the content, TOS only have users agree to give Reddit a license to do as it pleases.

Ah, right they don’t own it! It’s just stored on their servers, and they have exclusive rights to do whatever they’d like with it. But they don’t own it.

Read the TOS, they don't have "exclusive" rights.

However It gets interesting because under EU law TOS that violate GDPR are not enforceable. So at least EU citizens could probably have some recourse.

There’s a lot of “at least EU citizens” going around lol

Americans find it odd that other people have legal protections.

California has something similar too (CCPA), as do a few other non-EU countries and US states.

I just spent a while today deleting all my posts and comments. At this point they'll probably have plenty of copies of it, but at least the content is not up for them anymore.

Just trying to see if I can survive without an account there (the "forum fediverse", if that makes sense, is getting better and better) and then it'll go to the same place my Twitter and Facebook handles went a while ago.

Yeah, several months ago I used some service to go through and wipe all of my comments and replace them with garbage, and then I deleted my account. Goddamned shame. I was a Reddit user since 2008 or so, though I haven't been active there since the rise of /r/t_d. They really took so much goodwill and popularity and made a point to flush it down the fucking toilet.

Would users licensing their comments and posts help?

CC BY-NC-SA 4.0

No. Just claiming your own rules over existing rules is the same crap that those sovereign citizens are trying to pull. As much as I hate reddit (being an now ex 13year redditor) this is not something you fix plby putting your own license in your post, it makes you look ... Well, like those sovereign citizen types. Dumb.

"own rules". I didn't invent copyright.

CC BY-NC-SA 4.0

Yeah you really don't seem to understand how any of that works.

If you use a platform and that platform specifically states that they have rights to use your "work" if you post there, then they can. For one, if they couldn't, then they wouldn't be able to display your comment to begin with.

They can add in their terms of usage that they are allowed to do more with your work, like analyze it for personalized ads, for example.

You adding your license thingie in your message is a cute way to try to say "no you can't!" But yeeaaaahhh, that's not how anything works. You can't simply make a license that invalidates the terms of service of a website. It's literally the same nonsense that those sovereign citizen idiots try to pull with police and government (and always fail in hilarious ways)

It would not. Because when you signed up to Reddit, you accepted their user agreement, which you can read here in full: https://www.redditinc.com/policies/user-agreement-september-25-2023

As you can see in Section 5: Your Content, you have already consented to following:

You retain any ownership rights you have in Your Content, but you grant Reddit the following license to use that Content:

When Your Content is created with or submitted to the Services, you grant us a worldwide, royalty-free, perpetual, irrevocable, non-exclusive, transferable, and sublicensable license to use, copy, modify, adapt, prepare derivative works of, distribute, store, perform, and display Your Content and any name, username, voice, or likeness provided in connection with Your Content in all media formats and channels now known or later developed anywhere in the world. This license includes the right for us to make Your Content available for syndication, broadcast, distribution, or publication by other companies, organizations, or individuals who partner with Reddit.

Thank you for the response. That really is an all encompassing license reddit has on users' content...

Best thing users could do is leave reddit if they did care.

CC BY-NC-SA 4.0