Chapter 4: Language Modeling Basics

Chapter 4: Language Modeling Basics of my upcoming The Hundred-Page Language Models Book is now online

Hey!

Chapter 4: Language Modeling Basics of my upcoming The Hundred-Page Language Models Book is now online! The link to the chapter and the book's website with the previous three chapters are in the first comment of this post.

I also released the Colab notebooks for the third and fourth chapters. Do tinker with the code to really feel how this all works.

Enjoy the reading, and leave your comments in the chapter if anything isn't clear or if you see any way to improve the text. I still have time to make fixes before the planned official release in January.

Andriy