aidotnet/web-scraper
skills/tools/web-scraper/SKILL.md
使用CSS选择器从网页提取数据，支持分页、限速和多种输出格式。
$ install --global
skillsauthnpx skillsauth add aidotnet/moyucode web-scraperInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Mar 28, 2026, 1:38 PM36.0s2 files scanned
SKILL.md
- name:
- web-scraper
- description:
- 使用CSS选择器从网页提取数据，支持分页、限速和多种输出格式。
- short-description:
- 从网站爬取数据
- repository:
- https://github.com/cheeriojs/cheerio
- license:
- MIT
Web Scraper Tool
Description
Extract structured data from web pages using CSS selectors with rate limiting and pagination support.
Trigger
/scrapecommand- User requests web data extraction
- User needs to parse HTML
Usage
# Scrape single page
python scripts/web_scraper.py --url "https://example.com" --selector ".item" --output data.json
# Scrape with multiple selectors
python scripts/web_scraper.py --url "https://example.com" --selectors "title:.title,price:.price,link:a@href"
# Scrape multiple pages
python scripts/web_scraper.py --urls urls.txt --selector ".product" --output products.json --delay 2
Tags
scraping, web, html, data-extraction, automation
Compatibility
- Codex: ✅
- Claude Code: ✅
Related Skills
aidotnet/x-report-generator
development
VerifiedTrustedCommunity
使用Playwright浏览器爬取X(Twitter)真实数据，分析统计信息，生成精美的HTML报告面板并导出为高清图片。
75SKILL.mdUpdated Mar 27, 2026
aidotnet/uuid-generator
tools
VerifiedTrustedCommunity
生成UUID（v1、v4、v5）和其他唯一标识符，如ULID、nanoid。
75SKILL.mdUpdated Mar 27, 2026
aidotnet/url-shortener
tools
VerifiedTrustedCommunity
使用各种服务缩短URL，并为短链接生成二维码。
75SKILL.mdUpdated Mar 27, 2026
aidotnet/text-translator
development
VerifiedTrustedCommunity
使用免费翻译API在语言之间翻译文本，支持批量处理和文件翻译。
75SKILL.mdUpdated Mar 27, 2026