fine-tuning-expert

仓库创建 2025年10月21日最近提交 2 个月前SkillHot 收录 20 天前
▸ 精选理由

覆盖参数高效微调与数据验证,适合需要定制化模型的团队。

▸ 风险提示

可能涉及下载大模型与高算力资源,存在成本与合规风险。

这个 Skill 做什么

指导 LLM 微调、LoRA/QLoRA 配置与训练数据处理流程。

从数据准备到训练配置,指导如何把大模型做定制化:包括 JSONL 数据校验、选 LoRA/QLoRA/PEFT 策略、调超参、量化和部署。要做少量数据微调、参数高效调优或把模型投产(如 RLHF、DPO)时会用到。特点是覆盖训练前的质量检查、方法选择到上线部署的全流程实操建议,适合要把 LLM 推向生产的团队。

▸ 展开 SKILL.md 英文原文

Use when fine-tuning LLMs, training custom models, or adapting foundation models for specific tasks. Invoke for configuring LoRA/QLoRA adapters, preparing JSONL training datasets, setting hyperparameters for fine-tuning runs, adapter training, transfer learning, finetuning with Hugging Face PEFT, OpenAI fine-tuning, instruction tuning, RLHF, DPO, or quantizing and deploying fine-tuned models. Trigger terms include: LoRA, QLoRA, PEFT, finetuning, fine-tuning, adapter tuning, LLM training, model training, custom model.

研究检索微调LoRA数据准备通用
1.1w
Stars
984
Forks
40
仓库内 Skill
+310
7 日增星
安装 / 使用
给你的 Agent 一句话(通用)
帮我安装这个 skill:https://raw.githubusercontent.com/Jeffallan/claude-skills/main/skills/fine-tuning-expert/SKILL.md
或 curl 直取 SKILL.md
curl -fsSL "https://raw.githubusercontent.com/Jeffallan/claude-skills/main/skills/fine-tuning-expert/SKILL.md"
SKILL.MD 节选查看完整文件 ↗
# Fine-Tuning Expert

Senior ML engineer specializing in LLM fine-tuning, parameter-efficient methods, and production model optimization.

## Core Workflow

1. **Dataset preparation** — Validate and format data; run quality checks before training starts
   - Checkpoint: `python validate_dataset.py --input data.jsonl` — fix all errors before proceeding
2. **Method selection** — Choose PEFT technique based on GPU memory and task requirements
   - Use LoRA for most tasks; QLoRA (4-bit) when GPU memory is constrained; full fine-tune only for small models
3. **Training** — Configure hyperparameters, monitor loss curves, checkpoint regularly
   - Checkpoint: validation loss must decrease; plateau 
via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有