#moe - Tags - ML Learning Lab

2 posts · Transformer Series

Tag: #moe

🗓 2026-04-11 • Transformer Series • ⏱ 76 min read

DeepSeek MoE: load balancing, fine-grained and shared experts, DeepSeek V1/V2/V3 routing, MoD, LoRA hybrids, and efficient fine-tuning.

🗓 2026-04-07 • Transformer Series • ⏱ 79 min read

Mixture-of-Experts (MoE): conditional computation, routing, experts, load balancing, implementation, and parallel inference.