N-grams: the language model before language models

Before transformers, before word embeddings, before anyone said "attention is all you need", autocomplete worked. Your phone guessed the next word. Search engines finished your query. Spell checkers knew that "definately" was wrong and "definitely" was right. All of that ran on counting.