#training - Tags - ML Learning Lab

2 posts · Transformer Series

Tag: #training

🗓 2026-04-05 • Transformer Series • ⏱ 35 min read

Transformer parameter counts, memory usage, activations, FLOPs, KV cache, and optimization directions.

🗓 2026-04-01 • Transformer Series • ⏱ 38 min read

Transformer training and inference in practice: teacher forcing, masks, dropout, label smoothing, learning rate scheduling, and parallelism.