CS336 Notes: Lecture 1 - Overview and Tokenization
A tour of modern LLMs, the "bitter lesson" through the lens of efficiency, and why BPE tokenization matters.
Read
Blog
Filter
A tour of modern LLMs, the "bitter lesson" through the lens of efficiency, and why BPE tokenization matters.
My notes on Stanford CS336: Language Modeling From Scratch: how to build a large language model end to end, from data to deployment.