Finally Apple is ready to use all that training data they say they don't collect.
Article says it’s likely an OpenAI partnership.
Then is this even a race?
Depends. If they get access to the code OpenAI is using, they could absolutely try to leapfrog them. They could also just be looking at ways to get near ChatGPT4 performance locally, on an iPhone. They’d need a lot of tricks, but succeeding there would be a pretty big win for Apple.
People are really racing to destroy the planet so their phone can make a crappy summary of what's on wikipedia.
Not even a summary of what’s on Wikipedia, usually a summary of the top 5 SEO crap webpages for any given query.
Well yeah, but to be fair we now know exactly how much glue to put into our zesty pizza sauce.
near ChatGPT4 performance locally, on an iPhone
Last I checked, iPhones don't have terabytes of RAM. Nothing that runs on a small battery powered device is ever going to be in the ballpark of ChatGPT. At least not in the foreseeable future.
They don’t, but with quantization and distillation, as well as fancy use of fast ssd storage (they published a paper on this exact topic last year), you can get a really decent model to work on device. People are already doing this with things like OpenHermes and Mistral (given, 7B models, but I could easily see Apple doubling ram and optimizing models with the research paper I mentioned above, and getting 40B models running entirely locally). If the start of the network is good, a 40B model could take care of a vast majority of user Siri queries without ever reaching out to the server.
For what it’s worth, according to their wwdc note, they’re basically trying to do this.
But every apple user has assured me that iPhones are so much more secure and that apple isn't like mean ol Google and toooootally doesn't collect all the same data from you.
They will also assure you that Apple totally doesn't not collaborate with the CCP and allows them full access to all Chinese users data.
Apple users like to assure people of many things. :)
Apple user here. I can assure you, Apple sucks just as bad as MS and Google.
Wowee, yet another LLM. I bet this one's going to be super different somehow.
Apple: “It’s the best LLM we’ve ever shipped. We think you’re gonna love it.”
It's just ChatGPT. Nothing is new here. Apple hasn't innovated anything truly new in over a decade. The closest you can get is their processors, and none of those are anything like the innovations they brought us 15-20 years ago.
Can't wait for the Apple in a world first we present to you press event for AI.
StartUp: innovates
Big corpo: throws money
Somehow it always ends in centralization.
Buncha wet blankets on Lemmy. JFC.
I know there is a ton of hype around AI, but at least there is actually something there (unlike crypto).
This is the most exciting thing to happen with computing in a while and if you read Lemmy you'd think everything is bleak and hopeless.
There is so much opportunity to change the way we interact with computers and innovate.
It's exciting, but in the hands of morons (executives).
I'm actually worried about the next few years.
All it takes is for a deep learning algorithm to learn and perform menial tasks better than humans and that is it. Suddenly whole industries of workers could be made redundant, which would spike unemployment rates. We are not ready for that.
And before you say Universal Basic Income will save us, UBI is little more than a leftist pipe dream that would bankrupt any nation that tries to pursue it as an actual policy.
AI peeps so insecure that they gotta attack crypto (vaguely). Despite its many problems. crypto is a viable alternative to the legacy system of stat currency that's literally creating war and destroying the planet. It's the only truly international currency. AI solves no such problem nearly as important.
Lol?
You think the current currency system is the cause of war?
Finally Apple is ready to use all that training data they say they don't collect.
Article says it’s likely an OpenAI partnership.
Then is this even a race?
Depends. If they get access to the code OpenAI is using, they could absolutely try to leapfrog them. They could also just be looking at ways to get near ChatGPT4 performance locally, on an iPhone. They’d need a lot of tricks, but succeeding there would be a pretty big win for Apple.
People are really racing to destroy the planet so their phone can make a crappy summary of what's on wikipedia.
Not even a summary of what’s on Wikipedia, usually a summary of the top 5 SEO crap webpages for any given query.
Well yeah, but to be fair we now know exactly how much glue to put into our zesty pizza sauce.
Last I checked, iPhones don't have terabytes of RAM. Nothing that runs on a small battery powered device is ever going to be in the ballpark of ChatGPT. At least not in the foreseeable future.
They don’t, but with quantization and distillation, as well as fancy use of fast ssd storage (they published a paper on this exact topic last year), you can get a really decent model to work on device. People are already doing this with things like OpenHermes and Mistral (given, 7B models, but I could easily see Apple doubling ram and optimizing models with the research paper I mentioned above, and getting 40B models running entirely locally). If the start of the network is good, a 40B model could take care of a vast majority of user Siri queries without ever reaching out to the server.
For what it’s worth, according to their wwdc note, they’re basically trying to do this.
But every apple user has assured me that iPhones are so much more secure and that apple isn't like mean ol Google and toooootally doesn't collect all the same data from you.
They will also assure you that Apple totally doesn't not collaborate with the CCP and allows them full access to all Chinese users data.
Apple users like to assure people of many things. :)
Apple user here. I can assure you, Apple sucks just as bad as MS and Google.
Wowee, yet another LLM. I bet this one's going to be super different somehow.
Apple: “It’s the best LLM we’ve ever shipped. We think you’re gonna love it.”
It's just ChatGPT. Nothing is new here. Apple hasn't innovated anything truly new in over a decade. The closest you can get is their processors, and none of those are anything like the innovations they brought us 15-20 years ago.
Can't wait for the Apple in a world first we present to you press event for AI.
StartUp: innovates
Big corpo: throws money
Somehow it always ends in centralization.
Buncha wet blankets on Lemmy. JFC.
I know there is a ton of hype around AI, but at least there is actually something there (unlike crypto).
This is the most exciting thing to happen with computing in a while and if you read Lemmy you'd think everything is bleak and hopeless.
There is so much opportunity to change the way we interact with computers and innovate.
It's exciting, but in the hands of morons (executives).
I'm actually worried about the next few years.
All it takes is for a deep learning algorithm to learn and perform menial tasks better than humans and that is it. Suddenly whole industries of workers could be made redundant, which would spike unemployment rates. We are not ready for that.
And before you say Universal Basic Income will save us, UBI is little more than a leftist pipe dream that would bankrupt any nation that tries to pursue it as an actual policy.
AI peeps so insecure that they gotta attack crypto (vaguely). Despite its many problems. crypto is a viable alternative to the legacy system of stat currency that's literally creating war and destroying the planet. It's the only truly international currency. AI solves no such problem nearly as important.
Lol?
You think the current currency system is the cause of war?