Appears On
Episode Appearances
Dwarkesh Podcast · Apr 29, 2026
Reiner Pope – The math behind how LLMs are trained and served
“Gave lecture on large-scale training systems and hierarchical collectives; discussed pipeline parallelism”
Roofline analysis for transformer inferenceBatch size optimization and latency-cost tradeoffsMemory bandwidth as binding constraint on inference
View Analysis