Hi, I'm Afeef. I like breaking hard ideas down and teaching them.
The past doesn't change, so stop recomputing it — caching keys and values through a generate loop.
A GPT from scratch, one line at a time — tokens to generated text.