crawlability-audit

仓库创建 2026年7月28日最近提交 7 小时前SkillHot 收录 1 小时前

▸ 精选理由

定位影响收录的配置与页面问题，适合上线或流量异常时使用。

这个 Skill 做什么

检查 robots、sitemap、状态码与元数据，定位不可抓取问题。

检查搜索引擎爬不进去或不信任的技术问题：robots.txt、sitemap、状态码、错误页当200、缺失canonical、重复meta等都能定位。上线前、流量停滞、改了路由或被问“为啥页面不被收录”时用，直接找出机械性抓取故障。核心是侧重技术可抓取性，不给内容优化那套泛泛建议。

▸ 展开 SKILL.md 英文原文

Find pages search engines cannot reach or will not trust — robots.txt rules that block real content, sitemaps contradicting robots, error pages served as HTTP 200, missing canonicals, and duplicate metadata. Use before a launch, when organic traffic is flat, after changing robots or routing, or when the user asks why a page is not indexed.

开发编程SEO审计抓取可达性网站检测通用

Stars

Forks

仓库内 Skill

积累中

7 日增星

安装 / 使用

给你的 Agent 一句话（通用）

帮我安装这个 skill：https://raw.githubusercontent.com/sriptcollector/toolbay-skills/main/skills/crawlability-audit/SKILL.md

或 curl 直取 SKILL.md

curl -fsSL "https://raw.githubusercontent.com/sriptcollector/toolbay-skills/main/skills/crawlability-audit/SKILL.md"

SKILL.MD 节选查看完整文件 ↗

# Crawlability Audit

## Install

Save this file as `~/.claude/skills/crawlability-audit/SKILL.md`, or
`.claude/skills/crawlability-audit/SKILL.md` to scope it to one repo. Claude Code
auto-discovers it. Invoke with `/crawlability-audit` or by asking "why isn't this
page getting indexed?".

## Why this exists

SEO advice is mostly about content. The failures that actually cost the most are
mechanical, silent, and take minutes to fix once seen: a prefix rule that blocks
more than anyone intended, a sitemap advertising URLs that robots forbids, an
error page returning 200 so crawlers file it as thin content instead of retrying.

None of these announce themselves. Traffic is simply flat, and ev

via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有