“Any sufficiently advanced technology is indistinguishable from magic,” the writer Arthur C Clarke memorably said. And, yes, when they’re not hallucinating or telling you to eat rocks for dinner, AI chatbots can feel like magic. They can feel very human. But let’s go back to that idea of “stochastic parrots” from Gebru’s paper. “To parrot something is to repeat it without understanding,” says Gebru. This is essentially what LLMs are doing. “They have been taught to calculate how likely sequences of text are based on the data they were trained on.” Because they’ve been fed enormous quantities of data, these models are very sophisticated but that “doesn’t mean consciousness or understanding or anything like that”.

"Magic". Great analogy. A magician saws a person in half on stage--in front of our eyes. We saw it happen. But what didn't we see?

Good opinion piece: No, Richard Dawkins. AI is not conscious