#sampling - Tags - ML Learning Lab

2 posts · Transformer Series

Tag: #sampling

← All tags Home

Exploring the Transformer Series (30) --- Decoding Speculation

🗓 2026-04-11 • Transformer Series • ⏱ 63 min read

Speculative decoding, speculative sampling, blockwise parallel decoding, token tree verification, and Hugging Face implementation details.

#transformer #speculative-decoding #speculative-sampling #parallel-decoding #inference #sampling

Exploring the Transformer Series (15) --- Sampling and Output

🗓 2026-04-05 • Transformer Series • ⏱ 66 min read

Transformer generator heads, softmax, decoding strategies, sampling parameters, logits analysis, and weight sharing.

#transformer #sampling #generator #softmax #beam-search #top-k