Andrej Karpathy's implementation, including back-propagation/training, of a gpt2-like LLM in 100 lines of elegant python

This 2024 IOCC entry by Adrian Cable "implements an LLM inference engine in an impossibly minimal quantity of maximally incomprehensible C code". It can run llama2-7b in only 1750 bytes of C. That's basically a paragraph of C code to run an LLM 🤯

I was able to eventually convince ChatGPT that it actually works by asking it to de-obfuscate and explain the code.

I tried it on my 8-year-old Thinkpad (X1 Carbon 5th gen) with 16GB of RAM and got surprisingly good output at about 1 token/second!

A free tech magazine. I don't know how practical the one page per article constraint is, but it is fun and I'm enjoying Issue 8 so far.

ants as enemies in science fiction

:h quickref is worth the occasional review