harryvik990/twitter-scraping
skills/twitter-scraping/SKILL.md
Scrapes X/Twitter data without API access using Puppeteer stealth and browser console scripts. Extracts profiles, followers, following lists, tweets, search results, hashtags, threads, media, bookmarks, notifications, DMs, likes, and viral tweets. Exports to JSON/CSV. Use when collecting, exporting, or analyzing Twitter data.
development
Updated Apr 23, 2026
$ install --global
skillsauthnpx skillsauth add harryvik990/X-auto twitter-scrapingInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 10, 2026, 2:12 AM67.7s2 files scanned
SKILL.md
- name:
- twitter-scraping
- description:
- Scrapes X/Twitter data without API access using Puppeteer stealth and browser console scripts. Extracts profiles, followers, following lists, tweets, search results, hashtags, threads, media, bookmarks, notifications, DMs, likes, and viral tweets. Exports to JSON/CSV. Use when collecting, exporting, or analyzing Twitter data.
- license:
- MIT
- author:
- nichxbt
- version:
- 4.0
Twitter Scraping
Auth Setup
All scrapers require an auth_token cookie from x.com (DevTools -> Application -> Cookies -> copy auth_token value).
Node.js Scraper API
npm install xactions -- all functions from src/scrapers/index.js.
import { createBrowser, createPage, loginWithCookie, scrapeProfile } from 'xactions';
const browser = await createBrowser();
const page = await createPage(browser);
await loginWithCookie(page, AUTH_TOKEN);
const profile = await scrapeProfile(page, 'nichxbt');
await browser.close();
| Function | Purpose |
|----------|---------|
| scrapeProfile(page, username) | Profile data (bio, followers, following) |
| scrapeFollowers(page, username, {limit}) | Follower list |
| scrapeFollowing(page, username, {limit}) | Following list |
| scrapeTweets(page, username, {limit}) | User's tweets |
| searchTweets(page, query, {limit}) | Search results |
| scrapeHashtag(page, tag, {limit}) | Hashtag tweets |
| scrapeThread(page, tweetUrl) | Thread tweets |
| scrapeMedia(page, username, {limit}) | Media URLs |
| exportToJSON(data, path) / exportToCSV(data, path) | File export |
Browser Console Scripts
Standalone IIFEs -- paste into DevTools console on x.com. No dependencies.
| Script | File | Navigate to |
|--------|------|-------------|
| Download video | src/scrapers/videoDownloader.js | Tweet with video |
| Export bookmarks | src/scrapers/bookmarkExporter.js | x.com/i/bookmarks |
| Unroll thread | src/scrapers/threadUnroller.js | Any thread |
| Find viral tweets | src/scrapers/viralTweets.js | User profile |
| Scrape followers | scripts/scrapeFollowers.js | x.com/USER/followers |
| Scrape following | scripts/scrapeFollowing.js | x.com/USER/following |
| Scrape profile | scripts/scrapeProfile.js | User profile |
| Scrape search | scripts/scrapeSearch.js | Search results |
| Scrape hashtag | scripts/scrapeHashtag.js | x.com/hashtag/TAG |
| Scrape likes | scripts/scrapeLikes.js | x.com/USER/likes |
| Scrape likers | scripts/scrapeLikers.js | Any tweet |
| Scrape replies | scripts/scrapeReplies.js | Any tweet |
| Scrape media | scripts/scrapeMedia.js | User media tab |
| Scrape DMs | scripts/scrapeDMs.js | x.com/messages |
| Scrape notifications | scripts/scrapeNotifications.js | x.com/notifications |
| Scrape list | scripts/scrapeList.js | Any X List |
| Scrape bookmarks | scripts/scrapeBookmarks.js | x.com/i/bookmarks |
| Export to CSV | scripts/exportToCSV.js | After any scrape |
| Link scraper | scripts/linkScraper.js | Any timeline |
| Quote retweets | scripts/scrapeQuoteRetweets.js | Any tweet |
MCP Scraping Tools
All scrapers available via the MCP server for AI agents:
| Tool | Description |
|------|-------------|
| x_get_profile | Scrape user profile |
| x_get_followers | Get follower list |
| x_get_following | Get following list |
| x_get_tweets | Get user tweets |
| x_search_tweets | Search tweets |
| x_get_thread | Unroll thread |
| x_download_video | Extract video URL |
Notes
- Always call
browser.close()when done with Node.js scrapers - Browser scripts stop on page navigation -- stay on the page while running
- All scripts support JSON and CSV export
- Increase
limitparameter for deeper scraping (default varies by function) - Rate limiting is built in -- avoid reducing delays below defaults
Related Skills
harryvik990/xactions-mcp-server
tools
VerifiedTrustedCommunity
Free MCP server providing 68+ tools for AI agents to automate X/Twitter. Scrapes profiles, followers, tweets. Posts, follows, likes, retweets, downloads videos, analyzes sentiment, monitors brands, manages DMs, runs workflows, and more. Uses local Puppeteer -- no API keys or payments required. Compatible with Claude Desktop, Cursor, Windsurf, VS Code. Use when setting up or using AI agent Twitter automation via MCP.
SKILL.mdUpdated Apr 23, 2026
harryvik990/xactions-cli
tools
VerifiedTrustedCommunity
Command-line interface for scraping X/Twitter data, managing MCP server config, and running automation. Scrapes profiles, followers, tweets, search results, and more from terminal. Outputs text, JSON, or CSV. Uses Puppeteer stealth. Use when running Twitter operations from command line or automated pipelines.
SKILL.mdUpdated Apr 23, 2026
harryvik990/viral-thread-generation
content-media
VerifiedTrustedCommunity
Researches trending topics and competitor threads to generate high-engagement thread content with optimized hooks, value ladders, and calls to action. Use when creating threads or planning viral content.
SKILL.mdUpdated Apr 23, 2026
harryvik990/unfollow-management
tools
VerifiedTrustedCommunity
Mass unfollow on X/Twitter via browser console scripts. Unfollows everyone, only non-followers, non-followers with username logging, smart time-based unfollow with whitelists, and follow/following ratio management. Use when cleaning up a following list, removing non-followers, bulk unfollowing accounts, or optimizing your follow ratio.
SKILL.mdUpdated Apr 23, 2026