#parallel-decoding - Tags - ML Learning Lab

2 posts · Transformer Series

Tag: #parallel-decoding

← All tags Home

Exploring the Transformer Series (30) --- Decoding Speculation

🗓 2026-04-11 • Transformer Series • ⏱ 63 min read

Speculative decoding, speculative sampling, blockwise parallel decoding, token tree verification, and Hugging Face implementation details.

#transformer #speculative-decoding #speculative-sampling #parallel-decoding #inference #sampling

Exploring the Transformer Series (32) --- Lookahead Decoding

🗓 2026-04-11 • Transformer Series • ⏱ 29 min read

Lookahead decoding: Jacobi decoding, n-gram pool, 2D window, parallel verification, and llama.cpp implementation details.

#transformer #lookahead-decoding #jacobi-decoding #speculative-decoding #parallel-decoding #inference