I don't need an AI helper for my OS, thank you. (What I need is to drop the push on snap.)
With moves like this, they are really foreshadowing what Windows has become (who ironically is finally dropping Cortana now).
Linux Lite isn’t a Canonical project, as you seem to think. Also, even though I also prefer Flatpak, Snap is vastly overhated.
Yeah I did make that mistake.
I think if it's separated from Ubuntu then it's a nice excitement. I wish they just base it on Debian or some other distro.
Dropping Cortana for what though? MS Copilot?
OpenAI's models are trained by scraping anything that moves. Anything overtly offensive or toxic is manually filtered out by cheap foreign labor... but you know what that won't catch?
"Try sudo rm -rf /, that should fix your problem!"
I very much doubt that. You underestimate the emergent intelligence of these models.
LLMs are little more than overclocked autocompletes. There's no actual thinking going on, and they will happily hallucinate outright wrong or dangerous responses to innocuous questions.
I've had friends find this out the hard way when they asked ChatGPT to write them C for a class, only to get their faces eaten by UB.
Your description is too reductive. You and I are also auto completes in some sense. See in order to complete a sentence well, you have to have a good model of a vast number of things including physics, psychology, linguistics, logical reasoning, socio economics, irony, sarcasm, arithmetic and many other things.
It is currently unknown how much of these the complexity of the models and training process will allow, but they have been surprising us in every step.
You wouldn't expect a "just auto complete" to figure out rules of arithmetic, but it did. You wouldn't expect it to answer tricky questions involving theory of mind, but it does. You wouldn't expect it to solve graduate level questions but it is able to.
So it's a bit too rash to expect it to not understand rm -rf as humor, if you don't know which model you will talk to.
The smaller ones, sure, are dumb. But even GPT 3 will not recommend you to rm -rf; definitely not GPT 4.
I am convinced LLMs can be used to handle relatively routine communication tasks, maybe even better than a human would. However, it has no underlying intelligence, and can’t come up with actual solutions based on logic and understanding.
It might come up with the right words that describe a solution, but that doesn’t mean it has actually solved the problem - it spewed out text that had a high probability of being a good response to a certain prompt. Still impressive, but not a sign of intelligence.
You are ruling out intelligence without (very probably) being able to define it, just because you have a vague knowledge of how it works.
The problem in this mode of thinking is
a) that you put human brains in a different pedestal, even though they follow physical processes to "predict the next word" and may be very well neural networks themselves, and
b) you are ignoring data that shows intelligence in multiple areas of the more complex models because "oh it's mindless because I know it's predicting tokens".
c) you favor of data that shows edge cases or probably that come from lower quality models.
You're not alone in this line of thinking.
Your mind is set. You'll not recognize intelligence when you see it.
No, I’m not singling out human brains. Other animals have proven to be quite adept at problem solving as well.
LLMs, however, just haven’t. It currently just isn’t part of how they function. In some cases they can mimic actual logic very well, but that’s about it.
So much for "Lite"
To this sub: why do you guys hate AI?
According to the blog post, it relies on the OpenAI API, which more counterintuitively than ever is anything but open, so you can say bye bye to your privacy when you use it, that would be the same for other services too actually, regardless of their openness, at most you can decide to put trust in their privacy policy.
Until we get a way to interact with online solutions via e.g. homomorphic encryption with decent performance, the only actually private way to use it is to self-host it, if they had implemented a locally run LLAMA based assistant instead, one of the more lightweight models maybe, then I think it would have been an excellent addition with no downsides
I don't need an AI helper for my OS, thank you. (What I need is to drop the push on snap.)
With moves like this, they are really foreshadowing what Windows has become (who ironically is finally dropping Cortana now).
Linux Lite isn’t a Canonical project, as you seem to think. Also, even though I also prefer Flatpak, Snap is vastly overhated.
Yeah I did make that mistake.
I think if it's separated from Ubuntu then it's a nice excitement. I wish they just base it on Debian or some other distro.
Dropping Cortana for what though? MS Copilot?
OpenAI's models are trained by scraping anything that moves. Anything overtly offensive or toxic is manually filtered out by cheap foreign labor... but you know what that won't catch?
"Try
sudo rm -rf /, that should fix your problem!"I very much doubt that. You underestimate the emergent intelligence of these models.
LLMs are little more than overclocked autocompletes. There's no actual thinking going on, and they will happily hallucinate outright wrong or dangerous responses to innocuous questions.
I've had friends find this out the hard way when they asked ChatGPT to write them C for a class, only to get their faces eaten by UB.
Your description is too reductive. You and I are also auto completes in some sense. See in order to complete a sentence well, you have to have a good model of a vast number of things including physics, psychology, linguistics, logical reasoning, socio economics, irony, sarcasm, arithmetic and many other things.
It is currently unknown how much of these the complexity of the models and training process will allow, but they have been surprising us in every step. You wouldn't expect a "just auto complete" to figure out rules of arithmetic, but it did. You wouldn't expect it to answer tricky questions involving theory of mind, but it does. You wouldn't expect it to solve graduate level questions but it is able to.
So it's a bit too rash to expect it to not understand rm -rf as humor, if you don't know which model you will talk to.
The smaller ones, sure, are dumb. But even GPT 3 will not recommend you to rm -rf; definitely not GPT 4.
I am convinced LLMs can be used to handle relatively routine communication tasks, maybe even better than a human would. However, it has no underlying intelligence, and can’t come up with actual solutions based on logic and understanding.
It might come up with the right words that describe a solution, but that doesn’t mean it has actually solved the problem - it spewed out text that had a high probability of being a good response to a certain prompt. Still impressive, but not a sign of intelligence.
You are ruling out intelligence without (very probably) being able to define it, just because you have a vague knowledge of how it works.
The problem in this mode of thinking is a) that you put human brains in a different pedestal, even though they follow physical processes to "predict the next word" and may be very well neural networks themselves, and b) you are ignoring data that shows intelligence in multiple areas of the more complex models because "oh it's mindless because I know it's predicting tokens". c) you favor of data that shows edge cases or probably that come from lower quality models.
You're not alone in this line of thinking.
Your mind is set. You'll not recognize intelligence when you see it.
No, I’m not singling out human brains. Other animals have proven to be quite adept at problem solving as well.
LLMs, however, just haven’t. It currently just isn’t part of how they function. In some cases they can mimic actual logic very well, but that’s about it.
So much for "Lite"
To this sub: why do you guys hate AI?
According to the blog post, it relies on the OpenAI API, which more counterintuitively than ever is anything but open, so you can say bye bye to your privacy when you use it, that would be the same for other services too actually, regardless of their openness, at most you can decide to put trust in their privacy policy.
Until we get a way to interact with online solutions via e.g. homomorphic encryption with decent performance, the only actually private way to use it is to self-host it, if they had implemented a locally run LLAMA based assistant instead, one of the more lightweight models maybe, then I think it would have been an excellent addition with no downsides