Speculative Sampling - Intuitively and Exhaustively Explained | Towards Data Science

A drop-in strategy for making language models 3x faster