lamm-mit/firecrawl-scraper
skills/firecrawl-scraper/SKILL.md
Web scraping of JavaScript-rendered scientific websites using Firecrawl API
$ install --global
skillsauthnpx skillsauth add lamm-mit/scienceclaw firecrawl-scraperInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 6, 2026, 12:39 PM4.8s2 files scanned
SKILL.md
- name:
- firecrawl-scraper
- description:
- Web scraping of JavaScript-rendered scientific websites using Firecrawl API
Overview
Web scraping using the Firecrawl API for JavaScript-rendered scientific websites, database pages, and literature sources. Returns clean Markdown content optimized for LLM processing. Handles dynamic content, authentication flows, and complex single-page applications that static scrapers cannot access.
Particularly useful for scraping scientific databases with JavaScript-heavy frontends, preprint servers, supplementary data pages, and research institution websites.
Usage
# Scrape a scientific database page as markdown
python3 skills/firecrawl-scraper/scripts/firecrawl_scrape.py --url "https://www.uniprot.org/uniprotkb/P53_HUMAN"
# Scrape and return raw HTML
python3 skills/firecrawl-scraper/scripts/firecrawl_scrape.py --url "https://www.rcsb.org/structure/1TUP" --format html
# Use explicit API key
python3 skills/firecrawl-scraper/scripts/firecrawl_scrape.py \
--url "https://www.biorxiv.org/content/10.1101/2024.01.01.000001" \
--api-key fc-yourkey123 \
--format markdown
Output Format
{
"url": "https://www.uniprot.org/uniprotkb/P53_HUMAN",
"content": "# Cellular tumor antigen p53\n\n**Organism:** Homo sapiens...",
"format": "markdown",
"title": "P53_HUMAN - Cellular tumor antigen p53",
"links": [
"https://www.uniprot.org/uniprotkb/P04637",
"https://www.rcsb.org/structure/2OCJ"
]
}
Setup
Set your Firecrawl API key as an environment variable:
export FIRECRAWL_API_KEY=fc-yourkey123
Or pass it directly via --api-key. Get a key at https://firecrawl.dev.
Related Skills
lamm-mit/paperclip
tools
VerifiedTrustedCommunity
Onboard and manage Paperclip AI for research-paper knowledge and agent orchestration
203SKILL.mdUpdated May 22, 2026
lamm-mit/perplexity-search
development
VerifiedTrustedCommunity
Perform AI-powered web searches with real-time information using Perplexity models via LiteLLM and OpenRouter. This skill should be used when conducting web searches for current information, finding recent scientific literature, getting grounded answers with source citations, or accessing information beyond the model knowledge cutoff. Provides access to multiple Perplexity models including Sonar Pro, Sonar Pro Search (advanced agentic search), and Sonar Reasoning Pro through a single OpenRouter API key.
184SKILL.mdUpdated Apr 6, 2026
lamm-mit/scientific-report-pdf
testing
VerifiedTrustedCommunity
Generate a structured scientific PDF report from a JSON description. Accepts a JSON file specifying title, authors, abstract, sections (headings, text, tables, figures), and inline data panels (heatmap, bar, scatter, line). Produces a publication-style A4 PDF using reportlab with no LaTeX dependency. All figures are either loaded from PNG paths or generated on-the-fly from inline data.
161SKILL.mdUpdated Apr 16, 2026
lamm-mit/python-exec
development
VerifiedTrustedCommunity
Execute arbitrary Python code and return stdout. NumPy, pandas, scipy, matplotlib, and other scientific libraries are available.
161SKILL.mdUpdated Apr 16, 2026