#llm-compression - Tags - ML Learning Lab

2 posts · Transformer Series

Tag: #llm-compression

Exploring the Transformer Series (36) --- Large Model Quantization Scheme

🗓 2026-04-11 • Transformer Series • ⏱ 106 min read

Large model quantization schemes across 8-bit, 4-bit, and low-bit settings, including LLM.int8(), ZeroQuant, SmoothQuant, GPTQ, AWQ, LLM-QAT, QLoRA, FlatQuant, SqueezeLLM, SpQR, BitNet, and OneBit.

#transformer #quantization #llm-compression #ptq #qat #low-bit-quantization

Read →

Exploring the Transformer Series (34) --- Quantitative Fundamentals

🗓 2026-04-11 • Transformer Series • ⏱ 48 min read

Quantization fundamentals for Transformer LLMs: compression background, numerical representations, PTQ/QAT workflows, calibration, granularity, and acceleration.

#transformer #quantization #llm-compression #ptq #qat #model-quantization

Read →

| #llm-compression

Tag: #llm-compression

Exploring the Transformer Series (36) --- Large Model Quantization Scheme

Exploring the Transformer Series (34) --- Quantitative Fundamentals