Yihua Zhang
EN 中

Post-training

All13 Post-training6 Systems5 Music2 Archive20

Series

3

Anatomy of DeepSeek

 3

The GRPO lineage

6 articles

From GRPO to DAPO and GSPO: What, Why and How
Post-training · en / zh ·18 equations The GRPO lineage 2 GRPO
Re-understanding KL Approximation from an RL-for-LLM Lens: Notes on “Approximating KL Divergence
Post-training · en / zh ·18 equations The GRPO lineage 3 GRPO
Navigating the RLHF Landscape: From Policy Gradients to PPO, GAE, and DPO for LLM Alignment
Post-training · en / zh ·88 equations RLHF
DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge
Post-training · en / zh ·16 equations The GRPO lineage 1 GRPORLHF
From Zero to Reasoning Hero: How DeepSeek-R1 Leverages Reinforcement Learning to Master Complex Reasoning
Post-training · en / zh ·2 equations Anatomy of DeepSeek 1 GRPO
Patching the Foundation Models: Pitfalls and Pains in Machine Unlearning
Post-training · en / zh ·14 equations Unlearning