#synthetic-data

2 pages search “synthetic-data” ↳ all tags

Wiki 2

Frontiers in synthetic data Lambert's 2024 notes on synthetic data in post-training, from SFT on GPT-4 outputs to Gemini Flash being distilled from Pro
Synthetic Data & Distillation | RLHF and Post-Training Book by Nathan Lambert Chapter of Lambert's RLHF book on synthetic data, from SFT distillation and on-policy KD to AI feedback, Constitutional AI and rubrics