This is an (almost) complete picture of LLMs, highlighting the underlying math for probability calculations. It’s a great companion for the 64-picture visual summary I curated for a talk earlier this year.
Good reminder that “Life’s most important questions are, for the most part, nothing but probability problems.” Pierre-Simon Laplace in Théorie Analytique Des Probabilités