I guess the point I have an issue with here is 'ability to do things not specifically trained on'. LLMs are still doing just that, and often incorrectly - they basically just try to guess the next words based on a huge dataset they trained on. You can't actually teach it anything new, or to put it better it can't actually derive conclusions by itself and improve in such way - it is not actually intelligent, it's just freakishly good at guessing.
Heck, sometimes someone comes to me and asks if some system can solve something they just thought of. Sometimes, albeit very rarely, it just works perfectly, no code changes required.
Not going to argue that my code is artificial intelligence, but huge AI models obviously has a higher odds of getting something random correct, just because it correlates.
You can’t actually teach it anything new, or to put it better it can’t actually derive conclusions by itself and improve in such way
That is true, at least after training. They don't have any long-term memory. Short term you can teach them simple games, though.
Of course, this always goes into Chinese room territory. Is simply replicating intelligent behavior not enough to be equivalent to it? I like to remind people we're just a chemical reaction ourselves, according to all our science.
It's actually false. You can't teach them long-term, but within the course of a conversation they can be taught new rules and behaviors. There's dozens if not hundreds of papers on it.
I guess the point I have an issue with here is 'ability to do things not specifically trained on'. LLMs are still doing just that, and often incorrectly - they basically just try to guess the next words based on a huge dataset they trained on. You can't actually teach it anything new, or to put it better it can't actually derive conclusions by itself and improve in such way - it is not actually intelligent, it's just freakishly good at guessing.
Heck, sometimes someone comes to me and asks if some system can solve something they just thought of. Sometimes, albeit very rarely, it just works perfectly, no code changes required.
Not going to argue that my code is artificial intelligence, but huge AI models obviously has a higher odds of getting something random correct, just because it correlates.
That is true, at least after training. They don't have any long-term memory. Short term you can teach them simple games, though.
Of course, this always goes into Chinese room territory. Is simply replicating intelligent behavior not enough to be equivalent to it? I like to remind people we're just a chemical reaction ourselves, according to all our science.
It's actually false. You can't teach them long-term, but within the course of a conversation they can be taught new rules and behaviors. There's dozens if not hundreds of papers on it.
Yeah, that's what I said.
You're right, apologies. Skimmed too hard
Yup, been there!