Technology

37705 readers

123 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]

Could the reddit API changes have to do with ChatGPT rather than third party apps? (old.reddit.com)

submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]

65 comments fedilink hide all child comments

One of Spez's answers in the infamous Reddit AMA struck me

Two things happened at the same time: the LLM explosion put all Reddit data use at the forefront, and our continuing efforts to reign in costs...

I am beginning to think all they wanted to do was getting their share of the AI pie, since we know Reddit's data is one of the major datasets for training conversetional models. But they are such a bunch of bumbling fools, as well as being chronically understaffed, the whole thing exploded in their face. At this stage their only chance if survival may well be to be bought out by OpenAI...

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 11 points 1 year ago (1 children)

I'm very sure that this is the case. Reddit is pissed they gave away all the content as training data for free while struggling to monetize their platform adequately.

But I suspect the damage is already done. There are projects like "Orca" from Microsoft that skip the learning process from source data for a big part by using chatGPT and GPT4.

They missed the timing but are too stubborn and double down on it

[–] [email protected] 1 points 1 year ago

What's more, chat-gpt 4 is near the upper bound of what you can collect on the web in that way. They basically took everywhere you'd look to for information and grabbed it along with as much structure as they could... There's plenty more information on the Internet, but the structure and quality are much lower. It's very data poor and unstructured interactions between humans

Moving forward, everyone is talking about synthetic data sets - you can't go bigger without some system to generate (or refine) training data - and if you have to generate the data anyways, you're not going to pay much for a dataset that is just decent

So yeah, Reddit most definitely missed the timing.

I think Elon's claims that he's made Twitter profitable (despite a lot of evidence to the contrary) is also creating pressure for the other social networks to chase overly aggressive monetization schemes