Meta "programmed it to simply not answer questions," but it did anyway.
Hallucinating is a fancy term for BEING WRONG.
Unreliable bullshit generator is still unreliable. Imagine that!
AI doesn't know what's wrong or correct. It hallucinates every answer. It's up to the supervisor to determine whether it's wrong or correct.
Mathematically verifying the correctness of these algorithms is a hard problem. It's intentional and the trade-off for the incredible efficiency.
Besides, it can only "know" what it has been trained on. It shouldn't be suprising that it cannot answer about the Trump shooting. Anyone who thinks otherwise simply doesn't know how to use these models.
It is impossible to mathematically determine if something is correct. Literally impossible.
At best the most popular answer, even if it is narrowed down to reliable sources, is what it can spit out. Even that isn't the same thing is consensus, because AI is not intelligent.
If the 'supervisor' has to determine if it is right and wrong, what is the point of AI as a source of knowledge?
It is impossible to mathematically determine if something is correct. Literally impossible.
For example a very simple proof: with the conjecture that an even number is 2k of a number k, then you can prove that the addition of two even numbers is again an even number (and that prove is definite): 2a+2b=2(a+b), since a+b=k for some k.
Obviously, proving more complex mathematical problems like AI is more involved. But that's why we have scientists that work on that.
At best the most popular answer, even if it is narrowed down to reliable sources, is what it can spit out. Even that isn't the same thing is consensus, because AI is not intelligent.
That is correct. But it's not a limitation. It's by design. It's the tradeoff for the efficiency of the models. It's like lossy JPG compression. You accept some artifacts but in return you get much smaller images and much faster loading times.
But there are indeed "AI"s and neural networks that have been proven correct. This is mostly applied to safety critical applications like airplane collision avoidance systems or DAS. But a language model is not safety critical; so we take full advantage.
If the 'supervisor' has to determine if it is right and wrong, what is the point of AI as a source of knowledge?
You're completely misunderstanding the whole thing. The only reason why it's so incredibly good in many applications is because it's bad in others. It's intentionally designed that way. There are exact algorithms and there approximation algorithms. The latter tend to be much more efficient and usable in practice.
You can prove some things are correct, like math problems (assuming the axioms they are based on are also correct).
You can't prove that things like events having happened are correct. That's even a philosophical issue with human memory. We can't prove anything in the past actually happened. We can hope that our memory of events is accurate and reliable and work from there, but it can't actually be proven. In theory everything before could have just been implanted into our minds. This is incredibly unlikely (as well as not useful at best), but it can't be ruled out.
If we could prove events in the past are true we wouldn't have so many pseudo-historians making up crazy things about the pyramids, or whatever else. We can collect evidence and make inferences, but we can't prove it because it is no longer happening. There's a chance that we miss something or some information can't be recovered.
LLMs are algorithms that use large amounts of data to identify correlations. You can tune them to give more unique answers or more consistent answers (and other conditions) but they aren't intelligent. They are, at best, correlation finders. If you give it bad data (internet conversations) or incomplete data then it at best will (usually confidently) give back bad information. People who don't understand how they work assume they're actually intelligent and can do more than this. This is dangerous and should be dispelled quickly, or they believe any garbage it spits out, like the example from this post.
You can’t prove that things like events having happened are correct.
You can't so solidly that this shouldn't even be discussed.
What should be is whether you can make a machine capable of reasoning.
There's symbolic logic, so you can maybe some day make a machine that makes correct syllogisms, detects incorrect syllogisms and such.
People who don’t understand how they work assume they’re actually intelligent and can do more than this. This is dangerous and should be dispelled quickly, or they believe any garbage it spits out, like the example from this post.
Sadly there's that archetype of "the narrow-minded not cool scientist against the cool brave inventor" which means that actively dispelling that may do harm. People who don't understand will match the situation with that archetype and it will reinforce their belief.
Well but this kind of correctness applies to everything. By thag logic, you can't believe anything. I'm talking about an entirely different correctness. Like resistance against certain adversarial attacks. Of course, proving that the model is always correct, is as complicated as modelling the entire reality. That's infeasible. But it's also infeasible for every other software.
This sounds like an overly pedantic view of "prove"
It's not pedantic. You can mathematically prove math.
You can't mathematically/algorithmically prove an event happened or did not happen.
Adding "mathematically/algorithmically" in front of the word "prove" as if it were always implicitly there, and suggesting that it's the only way we should be using the word "prove" seems pretty darned pedantic to me.
We're describing the behavior of software. It must be implicitly included. Software cannot do anything that isn't algorithmic.
You can prove mathematical logic and you can (not 1-to-1) tie that to symbolic logic, but since it's not 1-to-1, because of ambiguity of symbols, there will be much more complexity. I personally think that the future of various machine assistants lies there, and what LLM's now do is going to be used in auxiliary roles for that.
The problem is that mathematical proofs rely on the basic premise that the underlying assumptions are rock solid, and that the rules of the math are rock solid. It's rigorous logic rules, applied mathematically.
The real world is Bayesian. Even our hard sciences like physics are only "mostly" true, which is why stuff like relativity could throw a wrench in it. There's inherent uncertainty for everything, because it's all measurement based, with errors, and more importantly, the relationships all have uncertainty. There is no "we know a^2 and b^2, so c^2 must be this". It's "we think this news source is generally reliable and we think the sentiment of the article is that this crime was committed, so our logical assumption is that the crime was probably committed". But no link in the chain is 100%. "Rock solid" sources get corrupted, generally with a time lag before it's recognizable. Your interpretation of a simple article may be damn near 100%, but someone is still going to misread it, and a computer definitely can.
Uncertainty is central to reality, down to the fact that even quantum phenomena have to be talked about probabilistically because uncertainty is built in all the way down.
This is why many philosophers came to criticize metaphysical logic in the 1800s, viewing it as dealing with absolutes when reality does not actually exist in absolutes, stating that we need some other logical system which could deal with the "fuzziness" of reality more accurately. That was the origin of the notion of dialectical logic from philosophers like Hegel and Engels, which caught on with some popularity in the east but then was mostly forgotten in the west outside of some fringe sections of academia. Even long prior to Bell's theorem, the physicist Dmitry Blokhintsev, who adhered to this dialectical materialist mode of thought, wrote a whole book on quantum mechanics where the first part he discusses the need to abandon the false illusion of the rigidity and concreteness of reality and shows how this is an illusion even in the classical sciences where everything has uncertainty, all predictions eventually break down, nothing is never possible to actually fully separate something from its environment. These kinds of views heavily influenced the contemporary physicist Carlo Rovelli as well.
You are describing LLMs, yes. But not what I'm describing.
I'm talking about machine finding syllogisms and checking their correctness. This can't be rock solid because of interpretation of the statement in natural language with its fuzzy semantics, but everything after that can be made rock solid. While in LLMs even it isn't.
That's what I'm talking about.
Humans make mistakes, but not such as LLM-generated texts contain.
I mean that one can build a reasoning machine which an LLM isn't.
I'm not describing LLMs. LLMs are completely irrelevant, and my examples had nothing to do with LLMs.
Formal logic requires propositions be Boolean in nature. They're true, or they're false.
That's not the real world. There are no booleans in the real world. In the real world, everything, down to the fundamental particles, is inherently probabilistic.
Our "certainty" is at most 99. a lot of 9s. It's never 100%. You can't say "the New York Times said X", and "the New York Times is perfectly reliable", so "X must be true". It's "given that the NYT said X and the NYT has a history of reporting facts with reasonably high accuracy, the probability X is true is...". If they get caught being shady, the estimates of previous information learned from them is retroactively changed. But there is no "proof", because there is no certainty anywhere in the chain. The world and human understanding of it has to be Bayesian. Again, down to the Uncertainty Principle about low level particles. Uncertainty is fundamental to reality. There is no certainty.
Why are you writing this to me?
Do you know what a syllogism is?
It doesn't require being certain of the information we're building it on. Only of existence of such categories.
Naturally people in Antiquity and Middle Ages who used symbolic logic were even less certain of the actual truths and lies in the world than we are.
It allows the truth to be subjective, but not the logical constructions. This is a very important trait both then and now.
The difference between the filter and the data going through it.
Of course you can't just feed all the data of all the PoVs and similar cases on something, integrate it into a model and expect your PoV to not clash with its output.
It's philosophically the same as why using dialectics is bad for science.
No. It's just pure math and logic. And LLMs are nothing more than billions of additions and multiplications. Literally. You can prove certain things on it just like you can prove theorems in mathematics. It's an ongoing ressearch field.
It's just pure math and logic. And LLMs are nothing more than billions of additions and multiplications.
Okay: using additions and multiplications prove the assassination attempt on Donald Trump happened
How would you even prove something like that outside of LLMs? What is your point? That you cannot prove anything except "I think therefore I am"?
Either you haven't read my comments or you're intentionally trying to be provocative.
My point is what OPs point was (which you veered away from in order to try to show off that You Are Very Smart): it is literally impossible for a computer system to prove a historical event has happened.
I'm having a hard time keeping track of all of the threads and replies evolving here. Forgive me. But I assume you mean the followong one?
It is impossible to mathematically determine if something is correct. Literally impossible.
This is simply a wrong statement. You can indeed prove certain properties on these models. That implies of course that you're able to formulate that property fully.
I don't know why the discussion went this far off track. The main point though is that everyone including OP is trying to discredit AI by bringing up things it was never supposed to be good at. By design, it's not good at knowledge retrieval. But everyone is hating it because it's hallucinating fake news. It's beyond me why people argue like that.
You can indeed prove certain properties on these models.
Okay, how does the model prove the assassination attempt happened? Because that is what OP was talking about.
It was clear from the context that OP was saying "It is impossible to mathematically determine if something [historical] is correct." They omitted one word and instead of using context clues you went into a long unnecessary post on how we prove even numbers are divisible by 2. If you tried Iron Manning their post instead of trying to show off with an "Um Actually...." You wouldn't be getting lost in the replies as we'd be staying on the original topic.
The main point though is that everyone including OP is trying to discredit AI by bringing up things it was never supposed to be good at.
We're missing the context again. It's not people trying to discredit AI. People are trying to discredit companies insisting on using AI for things it is bad at.
It sounds like you actually agree with OP: AI should not be used for this purpose. Instead of saying "I agree, this is a bad use of AI, it should only be used for X, Y, and Z" you felt the need to White Knight for AI. The problem right now isn't AI being attacked, it's companies treating AI like a miracle that can do everything.
Your proof example is a proof from your discrete structures class. That’s very different than “proving” something like “the Trump assassination attempt was a conspiracy.”
Otherwise we could have gotten rid of courts a long time ago.
Well obviously. But that was not at all what I said or claimed. I just said that you can prove certain properties of neural networks because others said that you can't. And others also misunderstood LLMs in general. They believe it's an information retrival service, which is wrong.
Besides, your argument, as you've written it, applies to everything. Literally. From Wikipedia, to News, even up to your eyesight. What can you actually prove? I don't understand the point you're making and how that is related to LLMs.
Just like us. Sometimes it's better to have bullshit predictions than none.
The only reason why it’s so incredibly good in many applications is because it’s bad in others. It’s intentionally designed that way.
lolwut
It's designed in a ways that'll make it inherently incorrect. Even on a physical basis (due to numeric issues). It's not a problem of the algorithm because it has been designed that way. The problem is that you don't know how to correctly use it.
I can't explain it any differently without getting overly technical. You wouldn't understand it anyways, judging by your comment "lolwut". If you want to learn how LLMs work specifically, there are plenty of ressources on the internet.
It’s designed in a ways that’ll make it inherently incorrect. Even on a physical basis (due to numeric issues). It’s not a problem of the algorithm because it has been designed that way. The problem is that you don’t know how to correctly use it.
"It doesn't make a good source of knowledge."
"Yeah, but it is designed to be inherently wrong"
How does that make any sense when trying to use something for knowledge? Being inherently wrong is the opposite of helpful for knowledge.
AI is great at pattern recognition, but knowledge isn't pattern recognition. Needing to know when it gives false information requires the "supervisor" to already have that knowledge. That makes the AI less useful than a simple reference because at least the reference can come from a trusted source.
If people stopped trying to jam AI into situations where being correct is important it wouldn't be a problem. But excusing that because it is designed to be inherently wrong deserves another LOLWUT.
How does that make any sense when trying to use something for knowledge? Being inherently wrong is the opposite of helpful for knowledge.
It was never designed to reproduce knowledge. It was designed to do reasoning and natural language processing and generation. You're using it wrong.
LULWUT
If you don't know what you're talking about and don't have any capacity to learn something new, it's sometimes best to stop talking. Especially when you're starting to get rude to knowlegable people that try to explain it to you.
It's designed in a ways that'll make it inherently incorrect. Even on a physical basis (due to numeric issues). It's not a problem of the algorithm because it has been designed that way. The problem is that you don't know how to correctly use it.
So it is bad at things like giving or finding factual information. I agree, companies need to stop cramming it into everything (like search engines) for tasks that it is specifically bad at because it is not designed for it.
Can you recommend any for resource to start with? (If I can be picky, then something I can consume after a whole day of being a patent because there is no energy for much else.)
That is, unless you define correct in mathematical terms. Which no one has done yet.
It also wouldn't be a source of knowledge. It would be a shitty calculator.
We should understand that 99.9% of what wee say and think and believe is what feels good to us and we then rationalize using very faulty reasoning, and that's only when really challenged! You know how I came up with these words? I hallucinated them. It's just a guided hallucination. People with certain mental illnesses are less guided by their senses. We aren't magic and I don't get why it is so hard for humans to accept how any individual is nearly useless for figuring anything out. We have to work as agents too, so why do we expect an early days LLM to be perfect? It's so odd to me. Computer is trying to understand our made up bullshit. A logic machine trying to comprehend bullshit. It is amazing it even appears to understand anything at all.
You know how I came up with these words? I hallucinated them. It’s just a guided hallucination.
The the word hallucination means literally anything you want it to. Cool, cool. Very valiant of you.
That's like saying car crash is just a fancy word for accident, or cat is just a fancy term for animal.
Hallucination is a technical term for this type of AI, and it's inherent to how it works at it's core.
And now I'll let you get back to your hating.
Hallucination is also wildly misleading. The AI does not believe something that isn't real, it was incorrect in the words it guessed would be appropriate.
The funny thing is we hallucinate all our answers too. I don't know where these words are coming from and I am not reasoning about them other than construction of a grammatically correct sentence. Why did I type this? I don't have a fucking clue. 😂
We map our meanings onto whatever words we see fit. If I had a dollar for every time I've heard a Republican call Obama a Marxist still blows my mind.
Thank you for saying something too. Better than I could do. I've been thinking about AI since I was a little kid. I've watched it go from at best some heuristic pathfinding in video games all the way to what we have now. Most people just weren't ever paying attention. It's been incredible to see that any of this was even possible.
I watched Two Minute Papers from back when he was mostly doing light transport simulation (raytracing). It's incredible where we are, but baffling people can't see the tech as separate from good old capitalism and the owner class. It just so happens it takes a fuckton of money to build stuff like this, especially at first. This is super early.
Kaplan noted that AI chatbots "are not always reliable when it comes to breaking news or returning information in real time," because "the responses generated by large language models that power these chatbots are based on the data on which they were trained, which can at times understandably create some issues when AI is asked about rapidly developing real-time topics that occur after they were trained."
If you're expecting a glorified autocomplete to know about things it doesn't have in its training data, you're an idiot.
There are definitely idiots, but these idiots don’t get their ideas of how the world works out of thin air. These AI chatbot companies push the cartoon reality that this is a smart robot that knows things hard in their advertisements, and to learn otherwise you have to either listen to smart people or read a lot of text.
I just assumed that its bs at first, but I also once nearly went unga bunga caveman against a computer from 1978. So I probably have a deeper understanding of how dumb computers can be.
Some services will use glorified RAG to put more current info in the context.
But yeah, if it's just the raw model, I'm not sure what they were expecting.
Yeah, the average person is the idiot here, for something they never asked for, and for something they see no value in. Companies threw billions of dollars at this emerging technology. Many things like Google Search have hallucinating, error-prone AI forced into the main product that is impossible to opt-out or use the (working) legacy version now...
Nobody is forcing you to use it.
I'm using it and I see great value in it. And if there are people that see value in a product then it's worth the investment.
Yes, people are being forced to use it if they want to, for instance, search using Google or Bing.
As the parent comment suggested, or there's no way to opt out, currently.
I'm glad you see value in it; I think the injection of LLM queries into search results I want to contain accurate results (and nothing more) a useless waste of power.
Injecting that into search result is a bad thing, I'm with you on that. Try DuckDuckGo. They use Bing but don't insert all of that AI crap. The results are much more vanilla. It's actually easier to find stuff because it's not that cluttered.
I always ask all people defending AI, or rather LLMs, what's the great value they all mention in their comments. So far the "best" answer I got was one dude using LLMs to extract info from decades old reports that no one has checked in 20 years hahaha. So glad we are allowing LLMs to deetroy the environment and plagiarize all creative work for that lol.
So, what is the great value you see man?
It was never made for information retrieval. It's made for high-level reasoning and language understanding. That is where it shines. You completely misunderstand what this is all about. You're trying to use a car to paint a wall.
There is really no argument against LLMs if they are used correctly. Just relax a bit and embrace it with a bit more curiosity. It won't kill mankind, just like fire, agriculture, or the steam engine has.
Me? I'm not using LLMs at all hahaha. I'm asking you, who says they have great value, to provide examples of their uses. I just provided pretty much the only one I have heard, which some random dude told me in a different thread. Everyone else, like you, just keeps it abstract and just bullshits and bullshits hahaha.
Great use is subjective. But I use them to better understand university lectures. I can have a real discussion, ask questions, ask for examples and so on. I had countless situations where web searches would not have helped me because the ressources cannot do reasoning to explain intuitions. I'm also using it for coding. It's awesome for boilerplate code. I also sometimes ask it to improve my existing code, so I can learn new coding practicesand tricks from that.
None of these applications require the LLM to be correct 100% of the time. It's still great value for me. And when I suspect that it's wrong about something or it's hallucinating or bad at explaining something, I'll just do some web searches for validation.
You might not find it useful because you're using it wrong, or simply because you have no application for the value it can provide. But that doesn't mean it's all bad. OP certainly doesn't know how to use it. I would never even think about asking it about historical events.
So literally you use it for information retrieval hahahaha. I did use copilot, codium, and the jetbrains one for a bit. But I had to disable each one, the amount fo wrong code simply doesn't justify the little boilerplate it generates.
That's not information retrieval. There is a difference between asking it about historical events and asking it to come up with their own stuff based on reasoning. I know that it can be wrong about factual questions and I embrace that. OP and many others don't understand that and think it's a problem when the AI gives a wrong answer about a specific question. You're simply using it wrong.
It's been a while since ChatGPT4 has spit out non-working bullshit code for me. And if it does, I immediately notice it and it'll still be a time-saver because there is at least something I can take from every response even if it's a wrong response. I'm using it as intended. And I see value in it. So keep convincing yourself it's terrible, but stop being annoying about it if others disagree.
Jesus man, chill. Why are all AI people so sensitive? Hahahaha. My man, during this conversation I have only asked about what are the great apps that LLMs have provided. You answered with the usual ones, chatgpt and copilot. It's nice that you find them useful, no need to insult me just because I don't think they are useful. I was honestly hoping for something else, but that's it. Seriously, chill dude.
Sir, are you telling me AI isn't a panacea for conveying facts? /s
The shooting happened after the end of the training date. Like asking windows 95 clippy about 9/11 and it saying it didn't happen.
Clippy being a 9/11 conspiracy theorist is now canon
maybe Meta AI is into something
Is it wrong to root this on simply because I hate that shitbag?
Hatred is a path to the dark side.
As evidenced by you now rooting for misinformation.
Oh I'm far to pragmatic to believe that. If truth isn't working, then what choice do you really have?
Does this AI work with real time info?
Well, if the chatbot learned anything from Dementia Don the racist rapist with 34 felonies that can't complete a coherent sentence, it learned that you never tell the truth.
Does the AI consistently say that, no matter who asks?
Hallucinating is a fancy term for BEING WRONG.
Unreliable bullshit generator is still unreliable. Imagine that!
AI doesn't know what's wrong or correct. It hallucinates every answer. It's up to the supervisor to determine whether it's wrong or correct.
Mathematically verifying the correctness of these algorithms is a hard problem. It's intentional and the trade-off for the incredible efficiency.
Besides, it can only "know" what it has been trained on. It shouldn't be suprising that it cannot answer about the Trump shooting. Anyone who thinks otherwise simply doesn't know how to use these models.
It is impossible to mathematically determine if something is correct. Literally impossible.
At best the most popular answer, even if it is narrowed down to reliable sources, is what it can spit out. Even that isn't the same thing is consensus, because AI is not intelligent.
If the 'supervisor' has to determine if it is right and wrong, what is the point of AI as a source of knowledge?
No, you're wrong. You can indeed prove the correctness of a neural network. You can also prove the correctness of many things. It's the most integral part of mathematics and computer-science.
For example a very simple proof: with the conjecture that an even number is 2k of a number k, then you can prove that the addition of two even numbers is again an even number (and that prove is definite): 2a+2b=2(a+b), since a+b=k for some k.
Obviously, proving more complex mathematical problems like AI is more involved. But that's why we have scientists that work on that.
That is correct. But it's not a limitation. It's by design. It's the tradeoff for the efficiency of the models. It's like lossy JPG compression. You accept some artifacts but in return you get much smaller images and much faster loading times.
But there are indeed "AI"s and neural networks that have been proven correct. This is mostly applied to safety critical applications like airplane collision avoidance systems or DAS. But a language model is not safety critical; so we take full advantage.
You're completely misunderstanding the whole thing. The only reason why it's so incredibly good in many applications is because it's bad in others. It's intentionally designed that way. There are exact algorithms and there approximation algorithms. The latter tend to be much more efficient and usable in practice.
You can prove some things are correct, like math problems (assuming the axioms they are based on are also correct).
You can't prove that things like events having happened are correct. That's even a philosophical issue with human memory. We can't prove anything in the past actually happened. We can hope that our memory of events is accurate and reliable and work from there, but it can't actually be proven. In theory everything before could have just been implanted into our minds. This is incredibly unlikely (as well as not useful at best), but it can't be ruled out.
If we could prove events in the past are true we wouldn't have so many pseudo-historians making up crazy things about the pyramids, or whatever else. We can collect evidence and make inferences, but we can't prove it because it is no longer happening. There's a chance that we miss something or some information can't be recovered.
LLMs are algorithms that use large amounts of data to identify correlations. You can tune them to give more unique answers or more consistent answers (and other conditions) but they aren't intelligent. They are, at best, correlation finders. If you give it bad data (internet conversations) or incomplete data then it at best will (usually confidently) give back bad information. People who don't understand how they work assume they're actually intelligent and can do more than this. This is dangerous and should be dispelled quickly, or they believe any garbage it spits out, like the example from this post.
You can't so solidly that this shouldn't even be discussed.
What should be is whether you can make a machine capable of reasoning.
There's symbolic logic, so you can maybe some day make a machine that makes correct syllogisms, detects incorrect syllogisms and such.
Sadly there's that archetype of "the narrow-minded not cool scientist against the cool brave inventor" which means that actively dispelling that may do harm. People who don't understand will match the situation with that archetype and it will reinforce their belief.
Well but this kind of correctness applies to everything. By thag logic, you can't believe anything. I'm talking about an entirely different correctness. Like resistance against certain adversarial attacks. Of course, proving that the model is always correct, is as complicated as modelling the entire reality. That's infeasible. But it's also infeasible for every other software.
This sounds like an overly pedantic view of "prove"
It's not pedantic. You can mathematically prove math.
You can't mathematically/algorithmically prove an event happened or did not happen.
Adding "mathematically/algorithmically" in front of the word "prove" as if it were always implicitly there, and suggesting that it's the only way we should be using the word "prove" seems pretty darned pedantic to me.
We're describing the behavior of software. It must be implicitly included. Software cannot do anything that isn't algorithmic.
You can prove mathematical logic and you can (not 1-to-1) tie that to symbolic logic, but since it's not 1-to-1, because of ambiguity of symbols, there will be much more complexity. I personally think that the future of various machine assistants lies there, and what LLM's now do is going to be used in auxiliary roles for that.
The problem is that mathematical proofs rely on the basic premise that the underlying assumptions are rock solid, and that the rules of the math are rock solid. It's rigorous logic rules, applied mathematically.
The real world is Bayesian. Even our hard sciences like physics are only "mostly" true, which is why stuff like relativity could throw a wrench in it. There's inherent uncertainty for everything, because it's all measurement based, with errors, and more importantly, the relationships all have uncertainty. There is no "we know a^2 and b^2, so c^2 must be this". It's "we think this news source is generally reliable and we think the sentiment of the article is that this crime was committed, so our logical assumption is that the crime was probably committed". But no link in the chain is 100%. "Rock solid" sources get corrupted, generally with a time lag before it's recognizable. Your interpretation of a simple article may be damn near 100%, but someone is still going to misread it, and a computer definitely can.
Uncertainty is central to reality, down to the fact that even quantum phenomena have to be talked about probabilistically because uncertainty is built in all the way down.
This is why many philosophers came to criticize metaphysical logic in the 1800s, viewing it as dealing with absolutes when reality does not actually exist in absolutes, stating that we need some other logical system which could deal with the "fuzziness" of reality more accurately. That was the origin of the notion of dialectical logic from philosophers like Hegel and Engels, which caught on with some popularity in the east but then was mostly forgotten in the west outside of some fringe sections of academia. Even long prior to Bell's theorem, the physicist Dmitry Blokhintsev, who adhered to this dialectical materialist mode of thought, wrote a whole book on quantum mechanics where the first part he discusses the need to abandon the false illusion of the rigidity and concreteness of reality and shows how this is an illusion even in the classical sciences where everything has uncertainty, all predictions eventually break down, nothing is never possible to actually fully separate something from its environment. These kinds of views heavily influenced the contemporary physicist Carlo Rovelli as well.
You are describing LLMs, yes. But not what I'm describing.
I'm talking about machine finding syllogisms and checking their correctness. This can't be rock solid because of interpretation of the statement in natural language with its fuzzy semantics, but everything after that can be made rock solid. While in LLMs even it isn't.
That's what I'm talking about.
Humans make mistakes, but not such as LLM-generated texts contain.
I mean that one can build a reasoning machine which an LLM isn't.
I'm not describing LLMs. LLMs are completely irrelevant, and my examples had nothing to do with LLMs.
Formal logic requires propositions be Boolean in nature. They're true, or they're false.
That's not the real world. There are no booleans in the real world. In the real world, everything, down to the fundamental particles, is inherently probabilistic.
Our "certainty" is at most 99. a lot of 9s. It's never 100%. You can't say "the New York Times said X", and "the New York Times is perfectly reliable", so "X must be true". It's "given that the NYT said X and the NYT has a history of reporting facts with reasonably high accuracy, the probability X is true is...". If they get caught being shady, the estimates of previous information learned from them is retroactively changed. But there is no "proof", because there is no certainty anywhere in the chain. The world and human understanding of it has to be Bayesian. Again, down to the Uncertainty Principle about low level particles. Uncertainty is fundamental to reality. There is no certainty.
Why are you writing this to me?
Do you know what a syllogism is?
It doesn't require being certain of the information we're building it on. Only of existence of such categories.
Naturally people in Antiquity and Middle Ages who used symbolic logic were even less certain of the actual truths and lies in the world than we are.
It allows the truth to be subjective, but not the logical constructions. This is a very important trait both then and now.
The difference between the filter and the data going through it.
Of course you can't just feed all the data of all the PoVs and similar cases on something, integrate it into a model and expect your PoV to not clash with its output.
It's philosophically the same as why using dialectics is bad for science.
No. It's just pure math and logic. And LLMs are nothing more than billions of additions and multiplications. Literally. You can prove certain things on it just like you can prove theorems in mathematics. It's an ongoing ressearch field.
Okay: using additions and multiplications prove the assassination attempt on Donald Trump happened
How would you even prove something like that outside of LLMs? What is your point? That you cannot prove anything except "I think therefore I am"?
Either you haven't read my comments or you're intentionally trying to be provocative.
My point is what OPs point was (which you veered away from in order to try to show off that You Are Very Smart): it is literally impossible for a computer system to prove a historical event has happened.
I'm having a hard time keeping track of all of the threads and replies evolving here. Forgive me. But I assume you mean the followong one?
This is simply a wrong statement. You can indeed prove certain properties on these models. That implies of course that you're able to formulate that property fully.
I don't know why the discussion went this far off track. The main point though is that everyone including OP is trying to discredit AI by bringing up things it was never supposed to be good at. By design, it's not good at knowledge retrieval. But everyone is hating it because it's hallucinating fake news. It's beyond me why people argue like that.
Okay, how does the model prove the assassination attempt happened? Because that is what OP was talking about.
It was clear from the context that OP was saying "It is impossible to mathematically determine if something [historical] is correct." They omitted one word and instead of using context clues you went into a long unnecessary post on how we prove even numbers are divisible by 2. If you tried Iron Manning their post instead of trying to show off with an "Um Actually...." You wouldn't be getting lost in the replies as we'd be staying on the original topic.
We're missing the context again. It's not people trying to discredit AI. People are trying to discredit companies insisting on using AI for things it is bad at.
It sounds like you actually agree with OP: AI should not be used for this purpose. Instead of saying "I agree, this is a bad use of AI, it should only be used for X, Y, and Z" you felt the need to White Knight for AI. The problem right now isn't AI being attacked, it's companies treating AI like a miracle that can do everything.
Your proof example is a proof from your discrete structures class. That’s very different than “proving” something like “the Trump assassination attempt was a conspiracy.”
Otherwise we could have gotten rid of courts a long time ago.
Well obviously. But that was not at all what I said or claimed. I just said that you can prove certain properties of neural networks because others said that you can't. And others also misunderstood LLMs in general. They believe it's an information retrival service, which is wrong.
Besides, your argument, as you've written it, applies to everything. Literally. From Wikipedia, to News, even up to your eyesight. What can you actually prove? I don't understand the point you're making and how that is related to LLMs.
Just like us. Sometimes it's better to have bullshit predictions than none.
lolwut
It's designed in a ways that'll make it inherently incorrect. Even on a physical basis (due to numeric issues). It's not a problem of the algorithm because it has been designed that way. The problem is that you don't know how to correctly use it.
I can't explain it any differently without getting overly technical. You wouldn't understand it anyways, judging by your comment "lolwut". If you want to learn how LLMs work specifically, there are plenty of ressources on the internet.
"It doesn't make a good source of knowledge."
"Yeah, but it is designed to be inherently wrong"
How does that make any sense when trying to use something for knowledge? Being inherently wrong is the opposite of helpful for knowledge.
AI is great at pattern recognition, but knowledge isn't pattern recognition. Needing to know when it gives false information requires the "supervisor" to already have that knowledge. That makes the AI less useful than a simple reference because at least the reference can come from a trusted source.
If people stopped trying to jam AI into situations where being correct is important it wouldn't be a problem. But excusing that because it is designed to be inherently wrong deserves another LOLWUT.
It was never designed to reproduce knowledge. It was designed to do reasoning and natural language processing and generation. You're using it wrong.
If you don't know what you're talking about and don't have any capacity to learn something new, it's sometimes best to stop talking. Especially when you're starting to get rude to knowlegable people that try to explain it to you.
So it is bad at things like giving or finding factual information. I agree, companies need to stop cramming it into everything (like search engines) for tasks that it is specifically bad at because it is not designed for it.
Can you recommend any for resource to start with? (If I can be picky, then something I can consume after a whole day of being a patent because there is no energy for much else.)
https://www.youtube.com/watch?v=Ma2rKDu-714
That is, unless you define correct in mathematical terms. Which no one has done yet.
It also wouldn't be a source of knowledge. It would be a shitty calculator.
We should understand that 99.9% of what wee say and think and believe is what feels good to us and we then rationalize using very faulty reasoning, and that's only when really challenged! You know how I came up with these words? I hallucinated them. It's just a guided hallucination. People with certain mental illnesses are less guided by their senses. We aren't magic and I don't get why it is so hard for humans to accept how any individual is nearly useless for figuring anything out. We have to work as agents too, so why do we expect an early days LLM to be perfect? It's so odd to me. Computer is trying to understand our made up bullshit. A logic machine trying to comprehend bullshit. It is amazing it even appears to understand anything at all.
The the word hallucination means literally anything you want it to. Cool, cool. Very valiant of you.
Uhm. Have you ever talked to a human being.
Human beings are not infallible either.
That's like saying car crash is just a fancy word for accident, or cat is just a fancy term for animal.
Hallucination is a technical term for this type of AI, and it's inherent to how it works at it's core.
And now I'll let you get back to your hating.
Hallucination is also wildly misleading. The AI does not believe something that isn't real, it was incorrect in the words it guessed would be appropriate.
The funny thing is we hallucinate all our answers too. I don't know where these words are coming from and I am not reasoning about them other than construction of a grammatically correct sentence. Why did I type this? I don't have a fucking clue. 😂
We map our meanings onto whatever words we see fit. If I had a dollar for every time I've heard a Republican call Obama a Marxist still blows my mind.
Thank you for saying something too. Better than I could do. I've been thinking about AI since I was a little kid. I've watched it go from at best some heuristic pathfinding in video games all the way to what we have now. Most people just weren't ever paying attention. It's been incredible to see that any of this was even possible.
I watched Two Minute Papers from back when he was mostly doing light transport simulation (raytracing). It's incredible where we are, but baffling people can't see the tech as separate from good old capitalism and the owner class. It just so happens it takes a fuckton of money to build stuff like this, especially at first. This is super early.
If you're expecting a glorified autocomplete to know about things it doesn't have in its training data, you're an idiot.
There are definitely idiots, but these idiots don’t get their ideas of how the world works out of thin air. These AI chatbot companies push the cartoon reality that this is a smart robot that knows things hard in their advertisements, and to learn otherwise you have to either listen to smart people or read a lot of text.
I just assumed that its bs at first, but I also once nearly went unga bunga caveman against a computer from 1978. So I probably have a deeper understanding of how dumb computers can be.
Some services will use glorified RAG to put more current info in the context.
But yeah, if it's just the raw model, I'm not sure what they were expecting.
Yeah, the average person is the idiot here, for something they never asked for, and for something they see no value in. Companies threw billions of dollars at this emerging technology. Many things like Google Search have hallucinating, error-prone AI forced into the main product that is impossible to opt-out or use the (working) legacy version now...
Nobody is forcing you to use it.
I'm using it and I see great value in it. And if there are people that see value in a product then it's worth the investment.
Yes, people are being forced to use it if they want to, for instance, search using Google or Bing.
As the parent comment suggested, or there's no way to opt out, currently.
I'm glad you see value in it; I think the injection of LLM queries into search results I want to contain accurate results (and nothing more) a useless waste of power.
Injecting that into search result is a bad thing, I'm with you on that. Try DuckDuckGo. They use Bing but don't insert all of that AI crap. The results are much more vanilla. It's actually easier to find stuff because it's not that cluttered.
I always ask all people defending AI, or rather LLMs, what's the great value they all mention in their comments. So far the "best" answer I got was one dude using LLMs to extract info from decades old reports that no one has checked in 20 years hahaha. So glad we are allowing LLMs to deetroy the environment and plagiarize all creative work for that lol.
So, what is the great value you see man?
It was never made for information retrieval. It's made for high-level reasoning and language understanding. That is where it shines. You completely misunderstand what this is all about. You're trying to use a car to paint a wall.
There is really no argument against LLMs if they are used correctly. Just relax a bit and embrace it with a bit more curiosity. It won't kill mankind, just like fire, agriculture, or the steam engine has.
Me? I'm not using LLMs at all hahaha. I'm asking you, who says they have great value, to provide examples of their uses. I just provided pretty much the only one I have heard, which some random dude told me in a different thread. Everyone else, like you, just keeps it abstract and just bullshits and bullshits hahaha.
Great use is subjective. But I use them to better understand university lectures. I can have a real discussion, ask questions, ask for examples and so on. I had countless situations where web searches would not have helped me because the ressources cannot do reasoning to explain intuitions. I'm also using it for coding. It's awesome for boilerplate code. I also sometimes ask it to improve my existing code, so I can learn new coding practicesand tricks from that.
None of these applications require the LLM to be correct 100% of the time. It's still great value for me. And when I suspect that it's wrong about something or it's hallucinating or bad at explaining something, I'll just do some web searches for validation.
You might not find it useful because you're using it wrong, or simply because you have no application for the value it can provide. But that doesn't mean it's all bad. OP certainly doesn't know how to use it. I would never even think about asking it about historical events.
So literally you use it for information retrieval hahahaha. I did use copilot, codium, and the jetbrains one for a bit. But I had to disable each one, the amount fo wrong code simply doesn't justify the little boilerplate it generates.
That's not information retrieval. There is a difference between asking it about historical events and asking it to come up with their own stuff based on reasoning. I know that it can be wrong about factual questions and I embrace that. OP and many others don't understand that and think it's a problem when the AI gives a wrong answer about a specific question. You're simply using it wrong.
It's been a while since ChatGPT4 has spit out non-working bullshit code for me. And if it does, I immediately notice it and it'll still be a time-saver because there is at least something I can take from every response even if it's a wrong response. I'm using it as intended. And I see value in it. So keep convincing yourself it's terrible, but stop being annoying about it if others disagree.
Jesus man, chill. Why are all AI people so sensitive? Hahahaha. My man, during this conversation I have only asked about what are the great apps that LLMs have provided. You answered with the usual ones, chatgpt and copilot. It's nice that you find them useful, no need to insult me just because I don't think they are useful. I was honestly hoping for something else, but that's it. Seriously, chill dude.
Sir, are you telling me AI isn't a panacea for conveying facts? /s
The shooting happened after the end of the training date. Like asking windows 95 clippy about 9/11 and it saying it didn't happen.
Clippy being a 9/11 conspiracy theorist is now canon
maybe Meta AI is into something
Is it wrong to root this on simply because I hate that shitbag?
Hatred is a path to the dark side.
As evidenced by you now rooting for misinformation.
Oh I'm far to pragmatic to believe that. If truth isn't working, then what choice do you really have?
Does this AI work with real time info?
Well, if the chatbot learned anything from Dementia Don the racist rapist with 34 felonies that can't complete a coherent sentence, it learned that you never tell the truth.
Does the AI consistently say that, no matter who asks?
Because if so, that’s not a hallucination.