advanced-evaluation
仓库创建 2026年1月15日最近提交 21 天前SkillHot 收录 20 天前
▸ 精选理由
系统化解决评估偏差与自动化评分,适合模型研发与 QA 团队。
这个 Skill 做什么
提供构建生产级 LLM 输出评估与判定的策略、模板与实践。
帮你搭建能把大模型当裁判来评估输出的工程化方案:什么时候用来比对模型输出、做自动化打分、或消除评估偏差都很合适。会把常见做法(如 rubrics、pairwise 比较、位置偏差校正)和流水线实践搬到生产环境,提供模板和落地策略,省去从零摸索的反复试验。
▸ 展开 SKILL.md 英文原文
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
4.2w
Stars
6.8k
Forks
40
仓库内 Skill
+0
7 日增星
安装 / 使用
给你的 Agent 一句话(通用)
帮我安装这个 skill:https://raw.githubusercontent.com/sickn33/antigravity-awesome-skills/main/skills/advanced-evaluation/SKILL.md或 curl 直取 SKILL.md
curl -fsSL "https://raw.githubusercontent.com/sickn33/antigravity-awesome-skills/main/skills/advanced-evaluation/SKILL.md"SKILL.MD 节选查看完整文件 ↗
# Advanced Evaluation This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems. **Key insight**: LLM-as-a-Judge is not a single technique but a family of approaches, each suited to different evaluation contexts. Choosing the right approach and mitigating known biases is the core competency this skill develops. ## When to Use Activate this skill when: - Building automated evaluation pipelines for LLM outputs - Comparing multiple model responses to select the best one - Establishing
via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有