RonanCodes/ingest-reddit
.claude/skills/ingest-reddit/SKILL.md
Extract post and comments from Reddit threads for wiki ingestion. Appends .json to any Reddit URL, no auth required for public subreddits.
$ install --global
skillsauthnpx skillsauth add RonanCodes/llm-wiki ingest-redditInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 24, 2026, 9:03 PM1.8s1 file scanned
SKILL.md
- name:
- ingest-reddit
- description:
- Extract post and comments from Reddit threads for wiki ingestion. Appends .json to any Reddit URL, no auth required for public subreddits.
- user-invocable:
- false
- allowed-tools:
- Bash(curl *)
Ingest Reddit Thread
Extract the full post content and comment tree from a Reddit thread.
Extraction Method
-
Parse the URL to extract the thread path:
- Pattern:
https://www.reddit.com/r/{subreddit}/comments/{id}/{slug}/ - Also handles:
https://old.reddit.com/...,https://reddit.com/... - Strip trailing query parameters
- Pattern:
-
Fetch via JSON endpoint (no auth needed for public subreddits):
curl -sL -H "User-Agent: llm-wiki-bot/1.0" \
"https://www.reddit.com/r/{subreddit}/comments/{id}/{slug}.json?sort=top&limit=500"
-
Parse JSON response:
- Element
[0]— the post:[0].data.children[0].data.title— post title[0].data.children[0].data.selftext— post body (markdown)[0].data.children[0].data.author— poster username[0].data.children[0].data.subreddit— subreddit name[0].data.children[0].data.score— upvotes[0].data.children[0].data.created_utc— timestamp[0].data.children[0].data.url— link URL (for link posts)[0].data.children[0].data.is_self— true if text post, false if link post[0].data.children[0].data.num_comments— comment count
- Element
[1]— the comment tree:[1].data.children[]— top-level comments- Each comment:
.data.author,.data.body,.data.score,.data.created_utc - Each comment may have
.data.replies— a nested object with the same structure - Recursively traverse
.data.replies.data.children[]to build nested markdown
- Element
-
Build the comment tree as nested markdown:
- Traverse comments recursively
- For each comment, render as a blockquote with author and score
- Use indentation (nested blockquotes) for reply depth
- Skip "more" stubs — comments where
kind === "more"(these are placeholders for additional comments in large threads; acceptable to skip for v1)
Comment Rendering Format
## Comments
> **u/username** (42 points)
> Comment text here, which may span
> multiple lines.
> > **u/replier** (15 points)
> > This is a reply to the above comment.
> > > **u/deep-replier** (8 points)
> > > And this is a nested reply.
> **u/another-top-level** (30 points)
> Another top-level comment.
Cap rendering at 4 levels of nesting depth to keep output readable. For deeper replies, flatten them at the 4th level.
Post-Extraction
- Save to vault's
raw/<subreddit>-<slug>.mdwith YAML header:
---
source-url: <reddit-thread-url>
title: "<post-title>"
author: "u/<username>"
subreddit: "r/<subreddit>"
date-fetched: <today>
source-type: discussion
score: <post-score>
num-comments: <comment-count>
---
- Include the full post body followed by the rendered comment tree
- For link posts (not self posts), include the linked URL prominently at the top of the raw file
Fallback
If the .json endpoint returns a 429 (rate limit) or error:
- Wait briefly and retry once
- If still failing, try
old.reddit.comas the domain:
curl -sL -H "User-Agent: llm-wiki-bot/1.0" \
"https://old.reddit.com/r/{subreddit}/comments/{id}/{slug}.json?sort=top&limit=500"
- If all attempts fail, report the error and suggest the user try again later or paste the content manually
Dependencies
None — uses only curl.
Related Skills
RonanCodes/yt-transcript
data-ai
VerifiedTrustedCommunity
Extract transcript from a YouTube video as clean readable text. Use when user shares a youtube.com or youtu.be link and wants the transcript, content summary, or to read what was said.
1SKILL.mdUpdated Apr 17, 2026
RonanCodes/wiki-templates
development
VerifiedTrustedCommunity
Page type templates and frontmatter conventions for LLM Wiki pages. Reference skill loaded by ingest, query, and lint skills to ensure consistent wiki structure.
1SKILL.mdUpdated Apr 17, 2026
RonanCodes/vault-status
testing
VerifiedTrustedCommunity
Show status of all LLM Wiki vaults — page counts, source counts, last activity, and git status. Use when user wants to see vault status, list vaults, or check wiki health.
1SKILL.mdUpdated Apr 17, 2026
RonanCodes/vault-import
documentation
VerifiedTrustedCommunity
Import an existing Obsidian vault, markdown folder, or git repo as an llm-wiki vault. Moves content into vaults/, adds missing structure (index, log, CLAUDE.md, frontmatter). Use when user wants to import, adopt, migrate, or bring in an existing knowledge base.
1SKILL.mdUpdated Apr 17, 2026