While he may not have used these exact words in a published work, the quote reflects a core principle of his theories about language. Chomsky argues that language, like fossils, provides us with clues to understand the past. He sees the structures and patterns of language as evidence of a deeper, innate "universal grammar" that is shared by all humans.
This view of language as a historical artifact, revealing fundamental human capabilities, aligns with the notion of "fossil poetry." Just as fossils tell us about extinct life forms, language, according to Chomsky, reveals the deep structures of human cognition and its evolution.