mofa-org/web_scraping
examples/skills/web_scraping/SKILL.md
Extract data from web pages, including HTML parsing, API interaction, and data export
$ install --global
skillsauthnpx skillsauth add mofa-org/mofa web_scrapingInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 7, 2026, 8:28 AM48.8s2 files scanned
SKILL.md
- name:
- web_scraping
- description:
- Extract data from web pages, including HTML parsing, API interaction, and data export
- category:
- web
- tags:
- [scraping, http, api, data]
- version:
- 1.0.0
Web Scraping Skill
This skill enables web scraping and data extraction capabilities.
When to Use
Use this skill when you need to:
- Scrape data from websites
- Interact with REST APIs
- Parse HTML content
- Export scraped data to various formats
Scraping Methods
Static HTML Scraping
For static websites, use CSS selectors to extract data.
Dynamic Content
For JavaScript-heavy sites, use browser automation.
API Access
For structured data access, prefer REST or GraphQL APIs.
Code Tools
This skill includes:
- @code: python scraper.py --input {input} - Generic web scraper
- @code: bash fetch.sh {url} - Simple HTTP fetcher
Best Practices
- Check robots.txt: Always respect site scraping policies
- Rate limiting: Add delays between requests to avoid overwhelming servers
- User-Agent: Identify your bot properly
- Error handling: Gracefully handle network errors and timeouts
Example
To scrape a webpage:
Use the web_scraping skill to extract product information from https://example.com/products
Related Skills
mofa-org/text_analysis
research
VerifiedTrustedCommunity
Analyze text for sentiment, entities, keywords, and linguistic patterns
221SKILL.mdUpdated Apr 7, 2026
mofa-org/pdf_processing
documentation
VerifiedTrustedCommunity
Process and manipulate PDF documents, including text extraction, form filling, and metadata editing
221SKILL.mdUpdated Apr 7, 2026
openclaw/openclaw-secret-scanning-maintainer
development
VerifiedTrustedCommunity
Maintainer-only workflow for handling GitHub Secret Scanning alerts on OpenClaw. Use when Codex needs to triage, redact, clean up, and resolve secret leakage found in issue comments, issue bodies, PR comments, or other GitHub content.
357,764SKILL.mdUpdated Apr 15, 2026
openclaw/openclaw-release-maintainer
development
VerifiedTrustedCommunity
Maintainer workflow for OpenClaw releases, prereleases, changelog release notes, and publish validation. Use when Codex needs to prepare or verify stable or beta release steps, align version naming, assemble release notes, check release auth requirements, or validate publish-time commands and artifacts.
357,764SKILL.mdUpdated Apr 10, 2026