RLHF Safety

Run RLHF (and DPO, IPO, and related preference-optimization techniques) as a safety-aware process. Learn the pipeline-level safety controls, refusal-behaviour design, sycophancy mitigation, the RLHF evaluation battery (harmfulness, honesty, helpfulness trade-offs), and the telemetry you want during a live RLHF training run.