N-grams: the language model before language models
Before transformers, before word embeddings, before anyone said "attention is all you need", autocomplete worked. Your phone guessed the next word. Search engines finished your query. Spell checkers knew that "definately" was wrong and "definitely" was right. All of that ran on counting.
Dev.to AI10 min read