agent-observability-spec

仓库创建 2026年1月29日最近提交 14 小时前SkillHot 收录 20 天前
▸ 精选理由

把行为打包为可追踪的 trace,方便检测与告警

▸ 风险提示

规范可能要求收集敏感输入或用户数据,需合规处理

这个 Skill 做什么

为代理/LLM功能制定追踪、指标与告警的可观测性规范

为 AI agent 或 LLM 功能定义需要记录的 trace、span、指标和告警规则,告诉你该记录什么、怎么采样、谁负责以及何时报警。用在设计可观测的 LLM 服务、排查行为问题或量化质量与成本时最合适。特别之处是把行为可观测(not 只是可用性)当核心,包含隐私说明和存储保留策略,便于生产环境落地监控。

▸ 展开 SKILL.md 英文原文

Specify the tracing, metrics, and alerting for an AI agent or LLM feature in production. Use when asked what to log for an LLM app, design agent tracing or spans, define quality and cost monitors, or answer 'how do we know if the agent is misbehaving?'. Produces an observability spec with a trace schema, metric definitions with owners and alert thresholds, sampling and retention policy, and a privacy note for logged content.

开发编程可观测性追踪规范监控告警通用
1.2k
Stars
220
Forks
40
仓库内 Skill
+74
7 日增星
安装 / 使用
给你的 Agent 一句话(通用)
帮我安装这个 skill:https://raw.githubusercontent.com/mohitagw15856/pm-claude-skills/main/skills/agent-observability-spec/SKILL.md
或 curl 直取 SKILL.md
curl -fsSL "https://raw.githubusercontent.com/mohitagw15856/pm-claude-skills/main/skills/agent-observability-spec/SKILL.md"
SKILL.MD 节选查看完整文件 ↗
# Agent Observability Spec Skill

You can't fix what you didn't record. For LLM systems the unit of observability is the *trace* — everything the model saw and did — because behaviour, not uptime, is what fails. This skill specifies what to capture, what to compute from it, and when to page someone.

## What This Skill Produces

- A **trace schema**: per-request spans and the fields each must carry
- **Metric definitions** across health, quality, cost, and behaviour — each with a threshold and owner
- A **sampling and retention policy** that keeps cost sane and debugging possible
- A **privacy note**: what logged content contains, who can see it, and how long it lives

## Required Inputs

As
via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有