openrlhf-training

High-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2× faster than DeepSpeedChat with distributed architecture and GPU resource sharing.

By orchestra-research · 768 installs

npx skills add orchestra-research/ai-research-skills --skill openrlhf-training

Source repository · Upstream listing