We know remarkably little about how AI systems work, so how will we know if AI becomes conscious?
Many people in AI will be familiar with the story of the Mechanical Turk. It was a chess-playing machine built in 1770, and it was so good its opponents were tricked into believing it was supernaturally powerful. In reality, the machine had space for a human to hide in it and control it. The hoax went on for 84 years. That’s three generations!