Hmm, wow. A small language model that fits in an 8-bit Atari! But browsing through the training data (a single 13KB text file) I'm getting serious ELIZA vibes - seeing such a stripped-down language description is a good reminder just how non-intelligent these language models really are.
JAM (Just Atari Model), small language models that runs on 1979 #Atari8bit computers https://github.com/marspa73/atarijam #atari #lm #ai
πΉοΈ Is this the smallest language model in the world? I just managed to squeeze real artificial intelligence into 30 kilobytes, running on a 1979 Atari 800. A fully generative, deterministic langu...
GitHub