GoKawiilDeveloper shows gzip's DEFLATE algorithm can crudely generate text like a language model
A blogger demonstrated that gzip, primed with a corpus of Shakespeare text, can 'continue' a prompt by finding byte sequences that compress most efficiently against its sliding window, producing text that is semi-coherent but clearly reflects patterns from the source material. The experiment was inspired by a paper arguing that prediction and compression are mathematically equivalent, since both rely on assigning probabilities to what comes next.