"Chain of Thought" is not a thought process, but rather an approximate retrieval procedure: the tokens shape the context in such a way that plausible response patterns become more likely (Kambhampati, ASU). 1/2 www.quantamagazine.org/is-ai-reason...
Is AI Reasoning Right for the Wrong Reasons? | Quanta MagazineThe idea that artificial intelligence can “reason” is more intuitive than ever. But intuitions can be wrong, and the science is far from settled.www.quantamagazine.org