gooseworks-ai/review-site-scraper

Review Site Scraper

Scrape product reviews from G2, Capterra, and Trustpilot using platform-specific Apify actors.

Quick Start

Requires APIFY_API_TOKEN env var (or --token flag). No external dependencies needed (uses stdlib urllib).

# Trustpilot reviews
python3 skills/capabilities/review-site-scraper/scripts/scrape_reviews.py \
  --platform trustpilot \
  --url "https://www.trustpilot.com/review/example.com" \
  --max-reviews 10 --output summary

# G2 reviews with keyword filter
python3 skills/capabilities/review-site-scraper/scripts/scrape_reviews.py \
  --platform g2 \
  --url "https://www.g2.com/products/example/reviews" \
  --keywords "pricing,support"

# Capterra reviews (uses company name, not URL)
python3 skills/capabilities/review-site-scraper/scripts/scrape_reviews.py \
  --platform capterra \
  --company-name "HubSpot CRM" \
  --max-reviews 20

Supported Platforms

| Platform | Actor | Input | Cost | |----------|-------|-------|------| | G2 | focused_vanguard/g2-reviews-scraper | --url (G2 product page URL) | Free tier available | | Capterra | getdataforme/capterra-reviews-scraper-bulk | --company-name (company name, not a URL) | Pay-per-result | | Trustpilot | agents/trustpilot-reviews | --url (Trustpilot review page URL) | ~$0.20/1k reviews |

CLI Reference

| Flag | Default | Description | |------|---------|-------------| | --platform | required | g2, capterra, or trustpilot | | --url | none | Product review page URL (required for G2 and Trustpilot) | | --company-name | none | Company name to search (Capterra only) | | --max-reviews | 50 | Max reviews to scrape | | --keywords | none | Keywords to filter (comma-separated, OR logic) | | --days | none | Only include reviews from last N days | | --output | json | Output format: json or summary | | --token | env var | Apify token (prefer APIFY_API_TOKEN env var) | | --timeout | 300 | Max seconds for Apify run |

Normalized Output Schema

All platforms are normalized but each has platform-specific fields.

G2 output fields:

{
  "platform": "g2",
  "id": "review-id",
  "product_name": "Product Name",
  "title": null,
  "text": "Review body text",
  "rating": 4,
  "author": "Reviewer Name",
  "author_title": "Job Title",
  "author_company": "Company Name",
  "author_company_size": "51-200",
  "author_industry": "Software",
  "date": "2026-02-18",
  "source": "organic",
  "url": "https://..."
}

Capterra output fields:

{
  "platform": "capterra",
  "title": "Review title",
  "text": "Review body text",
  "overall_rating": 4,
  "ease_of_use": 5,
  "customer_service": 3,
  "features": 4,
  "author": "Reviewer Name",
  "job_title": "Marketing Manager",
  "industry": "Marketing and Advertising",
  "usage_duration": "1-2 years",
  "date": "2026-02-18",
  "url": "https://..."
}

Trustpilot output fields:

{
  "platform": "trustpilot",
  "id": "review-id",
  "title": "Review title",
  "text": "Review body text",
  "rating": 4,
  "author": "Reviewer Name",
  "date": "2026-02-18T12:00:00.000Z",
  "experienced_date": "2026-02-15T00:00:00.000Z",
  "likes": 2,
  "input_source": "organic",
  "url": "https://..."
}