code-yeongyu/oh-my-openagent✦ 精选0°

ultimate-browsing

仓库创建 2025年12月3日最近提交 3 小时前SkillHot 收录 20 天前

⬈ GitHub 仓库 ⬈ SKILL.md 原文件 ⬇ Raw 原始文件

▸ 精选理由

解决常见被屏蔽/需渲染页面的数据获取难题，适合复杂爬取场景。

▸ 风险提示

包含绕过 WAF/登录保护的技术，可能涉及法律或平台政策风险。

这个 Skill 做什么

在普通抓取失败时分层升级的网页访问与提取工具，支持 JS 渲染、登录与 WAF 场景。

当普通抓取被 WAF、403、Cloudflare、JS 渲染或登录挡住时，用它按层级升级去拿页面。先尝试 headless 抽取、TLS 伪装与 yt-dlp 等手段，必要时切到 Playwright 的真 Chrome 或平台专用阅读器（如小红书、微博、B站）。能处理复杂反爬、登录态和动态渲染场景，减少抓取失败和手动调试成本。

▸ 展开 SKILL.md 英文原文

Escalation skill for blocked or hard-to-reach web access — load it when a normal browse/fetch is blocked (WAF, 403, Cloudflare, JS-only render, login-gated, or a platform a generic fetcher cannot read). Tiered router: TIER 1 insane-search (headless extraction + WAF bypass via curl_cffi TLS impersonation, yt-dlp, Jina Reader, public APIs, Playwright real-Chrome fallback); TIER 1.5 agent-reach (platform-native readers for Chinese and social platforms: Xiaohongshu, Douyin, Weibo, Bilibili, V2EX, WeChat, plus Twitter/Reddit/LinkedIn/GitHub); TIER 2 Chrome stealth (CloakBrowser stealth Chromium + agent-browser CDP for clicks, forms, screenshots, video, cookie login). Triggers: blocked site, bypass bot detection, cloudflare/WAF bypass, scrape, stealth browser, import cookies, fill form, screenshot, play youtube, xiaohongshu, douyin, weibo, bilibili, v2ex, wechat article, podcast transcript. NOT for simple searches (use web-search) or plain fetches (use webfetch).

开发编程网页抓取WAF 绕过JS 渲染通用

6.7w

Stars

5.4k

Forks

仓库内 Skill

+1.6k

7 日增星

安装 / 使用

给你的 Agent 一句话（通用）

帮我安装这个 skill：https://raw.githubusercontent.com/code-yeongyu/oh-my-openagent/dev/packages/shared-skills/skills/ultimate-browsing/SKILL.md

或 curl 直取 SKILL.md

curl -fsSL "https://raw.githubusercontent.com/code-yeongyu/oh-my-openagent/dev/packages/shared-skills/skills/ultimate-browsing/SKILL.md"

SKILL.MD 节选查看完整文件 ↗

# Ultimate Browsing

Escalation web access for tasks a normal browse or fetch cannot complete. Reach for this skill the moment a page is blocked (WAF / 403 / Cloudflare), needs JS rendering, hides behind a login, or lives on a platform a generic fetcher cannot read. Escalate only when the cheaper tier cannot do the job:

**Tier 1 — insane-search** (headless extraction + WAF bypass) -> **Tier 1.5 — agent-reach** (platform-native APIs, esp. Chinese platforms) -> **Tier 2 — Chrome stealth** (real interaction via CloakBrowser + agent-browser).

## PHASE 0 — ROUTE FIRST (MANDATORY)

```
User request
  |
  +- extract text/data from a URL --------------------- TIER 1  insane-search
  +- URL blocked

via SKILL·HOT · 数据来自 GitHub 公开信息 · 原文版权归作者所有