axolotl

提供 Axolotl 的微调流程、YAML 配置与方法（LoRA/QLoRA 等）。

帮你把大模型用 Axolotl 做微调，从 YAML 配置到具体方法一步到位，支持上百个模型和 LoRA/QLoRA 等轻量微调手段。适合需要自己调参、生成训练配置或排查训练问题的时候用。特别之处是包含多种 modern 算法（如 DPO/KTO/ORPO/GRPO）和多模态支持，配置示例丰富，能快速上手并复用。

# Axolotl Skill

Comprehensive assistance with axolotl development, generated from official documentation.

## When to Use This Skill

This skill should be triggered when:
- Working with axolotl
- Asking about axolotl features or APIs
- Implementing axolotl solutions
- Debugging axolotl code
- Learning axolotl best practices

## Quick Reference

### Common Patterns

**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:

```
./build/all_reduce_perf -b 8 -e 128M -f 2 -g 3
```

**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:

```
fsdp_version: 2
fsdp_config: