We are exposed to a much narrower range of knowledge through AI chatbots than through a basic web search. This is documented by a new study led by the University of Copenhagen. As more and more of us turn to AI chatbots for information, researchers warn that the risk of ‘knowledge collapse’ increases.
Not really an issue if the knowledge they expose you to is still more than you can absorb. Classic web search can show you 10x more info but you will just skim it anyway and absorb only tiny portion of it.
This isn’t about individuals. We safeguard knowledge institutionally. For instance, everyone should read this open letter from the top mathematicians on the planet, describing how we are about to undermine our mathematical understanding IDIOCRACY style. (I’m paraphrasing.)
Essentially, mathematical proofs are worthless without the communities that discover them. We care about math proofs because they create these communities (safeguarding knowledge for the next generation), not vice versa.
Having ChatGPT assert a proof we lack the expertise to check defeats the purpose. Not to mention, we already know it will get things wrong because of Gödel incompleteness so this whole situation is peak irony.