building-gold-corpus

仓库创建 2025年10月4日最近提交 3 小时前SkillHot 收录 3 小时前
▸ 精选理由

从项目初期提供可复现的评估夹具与注释配置,降低数据合规风险。

▸ 风险提示

切勿提交真实受限临床数据到仓库,需严格合规与合成化。

这个 Skill 做什么

搭建临床 NER/去标识化的合成金标语料、标注规范与分割用于评估。

搭建一套可直接用于 OpenMed 评估的金标注工程:定好标签集、写标注规范、生成 BRAT 或 Label Studio 的配置,并切分出训练/验证/测试集。强调能提交到仓库的金标必须是合成数据,受限真实语料(如 i2b2、MIMIC)只能本地用于评估。适合要组织标注、产出可复现 eval fixtures 或搭建评测基线时使用。

▸ 展开 SKILL.md 英文原文

Scaffold a synthetic gold-standard annotation project for evaluating OpenMed NER and de-identification models — label schema, annotation guidelines, BRAT or Label Studio config, and disjoint train/dev/test splits. Use when the user wants to create eval fixtures, set up annotation, define a label set, write guidelines, configure an annotation tool, or build a held-out gold set for the OpenMed eval harness. Trigger on "gold corpus", "annotation project", "label schema", "annotation guidelines", "BRAT", "Label Studio", "train dev test split", or "build eval fixtures" for OpenMed. Committed gold must be synthetic; licensed (i2b2/n2c2/MIMIC) data is eval-only and never committed.

数据与抓取金标语料注释规范评估用例通用
4.7k
Stars
581
Forks
40
仓库内 Skill
积累中
7 日增星
安装 / 使用
给你的 Agent 一句话(通用)
帮我安装这个 skill:https://raw.githubusercontent.com/maziyarpanahi/openmed/master/skills/building-gold-corpus/SKILL.md
或 curl 直取 SKILL.md
curl -fsSL "https://raw.githubusercontent.com/maziyarpanahi/openmed/master/skills/building-gold-corpus/SKILL.md"
SKILL.MD 节选查看完整文件 ↗
# Building a Gold Corpus

You can't evaluate what you can't measure against. This skill scaffolds a
gold-standard annotation project whose output drops straight into the OpenMed
eval harness as fixtures. The hard rule: **anything committed to the repo is
synthetic**. Licensed clinical corpora (i2b2, n2c2, MIMIC) are DUA-gated — use
them at eval time from the user's own copy, never check them in.

## When to use this skill

- You need eval fixtures for `benchmarking-clinical-ner` or
  `evaluating-with-leakage-gates` and have none.
- You're standing up an annotation effort: schema, guidelines, tool config.
- You need disciplined train/dev/test splits with no leakage between them.
- You want a 
via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有