grpo-rl-training

仓库创建 2025年11月3日最近提交 1 个月前SkillHot 收录 21 天前
▸ 精选理由

为自定义奖励与高质量策略优化提供实用示例与经验。

▸ 风险提示

需大量GPU与实验性代码,复现成本和调参负担较高。

这个 Skill 做什么

使用TRL实现GRPO策略优化的实战级训练与调参指南。

提供用 TRL 做 GRPO/RL 微调的实战级方案,包含 reward 设计、训练流水线和调参技巧,适合想用强化学习提升模型推理或完成特定任务的团队。需要把语言模型用自定义奖励做专业化训练时用,强调可复现、可生产化的训练流程和实战经验。

▸ 展开 SKILL.md 英文原文

Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training

研究检索RL训练GRPOTRL通用
1.1w
Stars
817
Forks
40
仓库内 Skill
+704
7 日增星
安装 / 使用
给你的 Agent 一句话(通用)
帮我安装这个 skill:https://raw.githubusercontent.com/Orchestra-Research/AI-Research-SKILLs/main/06-post-training/grpo-rl-training/SKILL.md
或 curl 直取 SKILL.md
curl -fsSL "https://raw.githubusercontent.com/Orchestra-Research/AI-Research-SKILLs/main/06-post-training/grpo-rl-training/SKILL.md"
SKILL.MD 节选查看完整文件 ↗
# GRPO/RL Training with TRL

Expert-level guidance for implementing Group Relative Policy Optimization (GRPO) using the Transformer Reinforcement Learning (TRL) library. This skill provides battle-tested patterns, critical insights, and production-ready workflows for fine-tuning language models with custom reward functions.

## When to Use This Skill

Use GRPO training when you need to:
- **Enforce specific output formats** (e.g., XML tags, JSON, structured reasoning)
- **Teach verifiable tasks** with objective correctness metrics (math, coding, fact-checking)
- **Improve reasoning capabilities** by rewarding chain-of-thought patterns
- **Align models to domain-specific behaviors** without l
via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有