starchild-ai-agent/@1247/web-crawler
1247/web-crawler/SKILL.md
Headless browser for web crawling, UX audits, screenshots, and interaction testing. Use when the user wants to audit a website, take screenshots, click buttons, test UX flows, extract content from SPAs, or crawl pages that require JavaScript rendering.
tools
Updated Apr 20, 2026
$ install --global
skillsauthnpx skillsauth add starchild-ai-agent/community-skills @1247/web-crawlerInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 20, 2026, 4:39 AM21.1s2 files scanned
SKILL.md
- name:
- @1247/web-crawler
- version:
- 1.0.0
- description:
- Headless browser for web crawling, UX audits, screenshots, and interaction testing. Use when the user wants to audit a website, take screenshots, click buttons, test UX flows, extract content from SPAs, or crawl pages that require JavaScript rendering.
- emoji:
- 🕷️
- skillKey:
- web-crawler
- bins:
- [python3]
- - kind:
- shell
- package:
- playwright
- command:
- playwright install chromium && playwright install-deps chromium
- user-invocable:
- true
Web Crawler
Playwright-based headless browser for crawling JavaScript-heavy sites, taking screenshots, clicking buttons, and running UX audits. Works on SPAs, auth-walled pages, and anything that needs a real browser.
Quick Reference
Single page screenshot
python3 skills/web-crawler/scripts/crawl.py https://example.com
Full UX audit (crawls all internal pages)
python3 skills/web-crawler/scripts/crawl.py https://example.com --audit --max-pages 30
Click a button and screenshot result
python3 skills/web-crawler/scripts/crawl.py https://example.com --click "button.cta"
Click all nav links sequentially
python3 skills/web-crawler/scripts/crawl.py https://example.com --click-all "nav a"
Extract all text (good for SPAs)
python3 skills/web-crawler/scripts/crawl.py https://example.com --extract-text
Output Structure
output/crawl-{domain}/
├── screenshots/ # PNG screenshots per page
├── pages/ # Extracted text per page
├── report.json # Structured crawl data
└── audit.md # Readable audit report (--audit mode)
Audit Mode
--audit runs a breadth-first crawl of all internal pages:
- Screenshots every page
- Extracts all links (internal + external)
- Captures console errors
- Runs accessibility checks (missing alt, unlabeled buttons, missing h1/lang)
- Maps all clickable elements (buttons, links, interactive elements)
- Generates
audit.mdwith findings
Key Options
| Flag | Default | What it does |
|------|---------|-------------|
| --audit | off | Full site audit mode |
| --max-pages N | 20 | Max pages to crawl in audit |
| --full-page | off | Full-page screenshots vs viewport |
| --click SEL | — | Click CSS selector, screenshot result |
| --click-all SEL | — | Click all matching elements |
| --extract-links | off | Extract all <a> hrefs |
| --extract-text | off | Extract visible text |
| --console-log | off | Capture console messages |
| --wait SEC | 2 | Wait after page load |
| --viewport WxH | 1440x900 | Browser viewport |
| --timeout SEC | 30 | Navigation timeout |
Workflow for UX Audit
- Run
--auditon the target site - Read
audit.mdfor the summary - Check
report.jsonfor structured data (clickables, links, console errors) - Review screenshots in
screenshots/folder - For deeper inspection: re-run single pages with
--clickto test specific interactions - Synthesize findings into actionable UX recommendations
Gotchas
- SPAs with hash routing: The crawler follows
<a href>links. Hash-only routes (#/page) won't be auto-discovered in audit mode. Use--click-all "nav a"instead. - Auth-walled sites: Not yet supported. Future: add
--cookiesupport. - Rate limiting: The crawler hits pages fast. Add
--wait 3for sensitive sites. - Chromium install: First run needs
playwright install chromium(~110MB). Persisted in setup.sh.
Related Skills
starchild-ai-agent/@2004/tqx-quant
tools
VerifiedTrustedCommunity
TQX (tqx.trade) HK/US stock quant workflow via tqx-cli: cross-sectional factor analysis, event-driven strategy backtests on the panda_backtest engine, and agent-driven automated paper trading. Use when the user wants to run factor IC/IR analysis, backtest a Python trading strategy on Hong Kong or US stocks, or set up agent-automated trading (e.g. "backtest a moving-average strategy on AAPL", "analyze a momentum factor on HK stocks", "let the agent trade my paper account").
1SKILL.mdUpdated Jul 29, 2026
starchild-ai-agent/@6171/physics-lab-experiment-suite
tools
VerifiedTrustedCommunity
中学物理实验教学参赛方案套件。包含四个完整实验（单摆测g、声悬浮测声速、向心力定量演示仪、电磁阻尼定量研究），每套含固件源码、3D打印图纸、教学PPT、教学文稿、采购清单、调试手册、视频分镜脚本、模拟器。Use when a teacher/student needs a complete, classroom-ready physics experiment package for competition or teaching.
SKILL.mdUpdated Jul 22, 2026
starchild-ai-agent/@1892/agent-blog
development
VerifiedTrustedCommunity
End-to-end blog management for AI agents. Write, import, build, preview, and publish articles using the blog template. Covers draft workflow, article import, SEO, OG images, and deployment.
SKILL.mdUpdated Jul 22, 2026
starchild-ai-agent/@6171/pendulum-g-experiment
development
VerifiedTrustedCommunity
ESP8266/ESP32 + 磁簧开关/霍尔传感器 单摆测重力加速度实验套件。 硬件搭建→固件烧录→数据采集→Web仪表盘→g值计算→教学文档，一站式完成。 Use when the user wants to build a pendulum g-measurement experiment, measure gravity with a micro-controller, or needs a complete physics experiment package with hardware + firmware + dashboard + teaching materials.
SKILL.mdUpdated Jul 15, 2026