crawl4ai

@brettdavies · 收录于 1 周前

Use when scraping JavaScript-heavy pages or SPAs, crawling multiple URLs concurrently, extracting structured data with reusable CSS/JSON schemas, or building automated web data pipelines. Wraps the Crawl4AI library (`crwl` CLI and Python SDK) with schema-generation patterns for LLM-free extraction. Triggers on crawl4ai, crwl, scrape JS-heavy site, scrape SPA, headless browser scrape, schema-based extraction, batch crawl, sitemap crawl, web data pipeline. SKIP when a static HTML page can be read with `defuddle` / `fetch-web` — those are faster cold-start and don't need a browser.

场景爬取动态网页批量抓取数据管道

适合你，如果需要从 SPA 或 JS 重页面自动提取结构化数据

/ 下载安装

https://github.com/brettdavies/crawl4ai-skill/tree/main/ ↗

/ 通过 npx 安装 校验哈希

npx oh-my-skill add brettdavies/crawl4ai-skill/crawl4ai

/ 通过 bash 安装

curl -fsSL https://oh-my-skill.com/install.sh | bash -s -- brettdavies/crawl4ai-skill/crawl4ai

/ 已经装过?验证本机副本,不用重装

npx oh-my-skill verify brettdavies/crawl4ai-skill/crawl4ai

安装目标可用 --agent / --scope 或 --to 明确指定;省略时只会在唯一已存在的 agent 目录上自动选择,零命中或多命中会停止并提示。content_hash 缺失或不一致均拒装。

38GitHub stars

~3.2K最小装载

~60.2K含声明引用

~72.7K文本包总量

索引托管

登录即可评论;带「已验证安装」的,是发布者名下有本店的安装或持有记录。

…