Information events in language have predictable arrival times: new-word intensity decays, and LLMs introduce new words faster than humans
Treating natural language as a temporal point process of information-bearing events lets a neural model predict when the next new word or high-surprisal token will arrive, and shows LLMs introducing new words at consistently higher rates than humans.