advanced-evaluation

仓库创建 2026年1月15日最近提交 21 天前SkillHot 收录 20 天前
▸ 精选理由

系统化解决评估偏差与自动化评分,适合模型研发与 QA 团队。

这个 Skill 做什么

提供构建生产级 LLM 输出评估与判定的策略、模板与实践。

帮你搭建能把大模型当裁判来评估输出的工程化方案:什么时候用来比对模型输出、做自动化打分、或消除评估偏差都很合适。会把常见做法(如 rubrics、pairwise 比较、位置偏差校正)和流水线实践搬到生产环境,提供模板和落地策略,省去从零摸索的反复试验。

▸ 展开 SKILL.md 英文原文

This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.

研究检索评估LLM判定偏差缓解通用
4.2w
Stars
6.8k
Forks
40
仓库内 Skill
+0
7 日增星
安装 / 使用
给你的 Agent 一句话(通用)
帮我安装这个 skill:https://raw.githubusercontent.com/sickn33/antigravity-awesome-skills/main/skills/advanced-evaluation/SKILL.md
或 curl 直取 SKILL.md
curl -fsSL "https://raw.githubusercontent.com/sickn33/antigravity-awesome-skills/main/skills/advanced-evaluation/SKILL.md"
SKILL.MD 节选查看完整文件 ↗
# Advanced Evaluation

This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems.

**Key insight**: LLM-as-a-Judge is not a single technique but a family of approaches, each suited to different evaluation contexts. Choosing the right approach and mitigating known biases is the core competency this skill develops.

## When to Use
Activate this skill when:

- Building automated evaluation pipelines for LLM outputs
- Comparing multiple model responses to select the best one
- Establishing 
via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有