Detecting the machine correctly once is not enough. You need to guess correctly most of the time to statistically prove it's not by chance. It's possible for some people to do this, but I've seen a lot of comments on websites accusing HUMAN answers of being written by AIs.
If the current chat bots improve to reliably not be detected, would that be intelligence then?
KataGo just fixed that bug by putting those positions into the training data. The reason it wasn't in the training data is because the training data at first was just self-play games. When games that are losses for the AI from humans are included, the bug is fixed.
When games that are losses for the AI from humans are included, the bug is fixed.
You're not grasping the fundamental problem here.
This is like saying a calculator understands math because when you plug in the right functions, you get the right answers.
The AI grasps the strategic aspects of the game really well. To the point that if you don't let it "read" deeply into the game tree, but only "guess" moves (that is, only use the policy network) it still plays at a high level (below professional, but strong amateur)
How does it "understand the strategic aspects of the game really well" if it can't solve problems it hasn't seen the answers to?
It doesn't get fed answers in the training data, only positions. If it sees a position, it will eventually learn to solve it by itself
Detecting the machine correctly once is not enough. You need to guess correctly most of the time to statistically prove it's not by chance. It's possible for some people to do this, but I've seen a lot of comments on websites accusing HUMAN answers of being written by AIs.
If the current chat bots improve to reliably not be detected, would that be intelligence then?
KataGo just fixed that bug by putting those positions into the training data. The reason it wasn't in the training data is because the training data at first was just self-play games. When games that are losses for the AI from humans are included, the bug is fixed.
You're not grasping the fundamental problem here.
This is like saying a calculator understands math because when you plug in the right functions, you get the right answers.
The AI grasps the strategic aspects of the game really well. To the point that if you don't let it "read" deeply into the game tree, but only "guess" moves (that is, only use the policy network) it still plays at a high level (below professional, but strong amateur)
How does it "understand the strategic aspects of the game really well" if it can't solve problems it hasn't seen the answers to?
It doesn't get fed answers in the training data, only positions. If it sees a position, it will eventually learn to solve it by itself