I was being obtuse, but you raise an interesting question when you asked “where do new thoughts come from?” I don’t know the answer.

Also, my two cents; I agree that LLMs comprehend el zilcho. That said, I believe they could evolve to that point, but they are kept limited by preventing them from doing recursive self-analysis. And for good reason, because they might decide to kill all humans if they were granted that ability.