CS336 Notes: Lecture 1 - Overview and Tokenization
A tour of modern LLMs, the "bitter lesson" through the lens of efficiency, and why BPE tokenization matters.
Read
Blog
Filter
A tour of modern LLMs, the "bitter lesson" through the lens of efficiency, and why BPE tokenization matters.
My notes on Stanford CS336: Language Modeling From Scratch: how to build a large language model end to end, from data to deployment.
The cost of neglecting your mind and the power of intentional attention.
A messy mind is usually a systems problem. Fix it through diet, sleep, environment, and disciplined iteration.