nanoGPT is awesome (and I highly recommend his videos on it), but it’s closer to... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		benreesman on Jan 29, 2025 \| parent \| context \| favorite \| on: SmolGPT: A minimal PyTorch implementation for trai... nanoGPT is awesome (and I highly recommend his videos on it), but it’s closer to a direct reproduction of GPT-2, so it’s cool to have a really clean implementation of some newer ideas.

Nimitz14 on Jan 29, 2025 [–]

nanoGPT contains some new ideas. https://github.com/karpathy/minGPT is more plain

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact