ai-eval-plan

为模型或提示设计可执行的评测计划、指标与基线

把模糊的“看起来不错”变成可复现的评测计划：定义任务、数据集、指标与基线，设计自动化＋人工评测、pass bar 和回归闸门。在要评估 prompt、model 或 agent 性能、设置信号线或把改动纳入 CI/CD 前使用。特点是把定性目标量化，防止改动悄悄把质量拉下去。

# AI Eval Plan Skill

You can't improve an AI feature you can't measure, and "it looks good in the demo" is not measurement.
This skill produces an evaluation plan that turns a fuzzy quality goal into a repeatable, gated test —
so a prompt change that quietly makes outputs worse can't ship.

## Required Inputs

Ask for these only if they aren't already provided:

- **The feature & task** — what the model does and what "good output" means to a user.
- **Failure modes that matter** — what bad looks like (hallucination, wrong format, unsafe, off-tone, too slow).
- **Available data** — any real examples, logs, or labelled cases; or note there are none yet.
- **Who judges quality** — automated ch