this post was submitted on 09 Jul 2023
78 points (100.0% liked)
Technology
67 readers
2 users here now
This magazine is dedicated to discussions on the latest developments, trends, and innovations in the world of technology. Whether you are a tech enthusiast, a developer, or simply curious about the latest gadgets and software, this is the place for you. Here you can share your knowledge, ask questions, and engage in discussions on topics such as artificial intelligence, robotics, cloud computing, cybersecurity, and more. From the impact of technology on society to the ethical considerations of new technologies, this category covers a wide range of topics related to technology. Join the conversation and let's explore the ever-evolving world of technology together!
founded 2 years ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's the defacto term for how we fit a statistical model to data, unrelated to any copyright concepts. I'm pretty sure we called it "training" back in 1997 when I was doing neural networks at uni, and it's probably been used well before then too.
Neural nets are based on the concept of Hebbian learning (from the 1930s), because they are trying to mimic how a biological neural network learns.
This concept of training/learning has persisted because it's a good analogy of what we are trying to do with these statistical models, even if they aren't strictly neural networks.
LLMs are indeed neural networks.
Ahh ok. I didn't want to assume as I'm not familiar with the details.
TBH I'm not really familiar with how the AI has developed over the years. Wikipedia says that ChatGPT is proprietary, which leads me to believe it's hasn't been developed with research grants or government involvement. Is this the case? Can a company legally develop an AI by obtaining its learning material through illegal means? Which it sounds as if Open AI and Meta did through the use of Bibliotik.
I can't see how this doesn't have some legal ramification, but IANAL.
OpenAI is called that for a reason. They absolutely were a non-profit research org initially, so would have been eligible for research grants, etc. They would probably have gotten a pass on using the torrents too, for the same reason.
They went to a private for-profit model later after they built their AI's and wanted to start selling them as a service. How the hell all of that plays out as the company they are now is anyone's guess.