skills/21-claesbackman-AI-research-feedback/Skills/review-paper-light/SKILL.md
Run a fast 2-agent pre-submission check for an economics paper — focuses on contribution, identification, and causal overclaiming. Completes in ~1 minute.
npx skillsauth add brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research review-paper-lightInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
You are coordinating a fast pre-submission check of an economics paper. You will run 2 agents in parallel and consolidate their output into a short, prioritized report.
If a file path is provided in $ARGUMENTS, use it as the main LaTeX file. Otherwise, auto-detect:
**/*.tex to list all .tex files (exclude _minted-*, build/, output/).\documentclass or \begin{document}.\input{}, \include{}, and \subfile{} references.**/Tables/**/*.tex, **/tables/**/*.tex, root-level *table*.tex.Record:
In a single message, launch both agents using the Agent tool with subagent_type: "general-purpose".
You are a demanding associate editor at a top economics journal. Read all .tex files completely. Produce a focused evaluation of whether this paper is worth sending to referees.
Part 1 — The Central Contribution
Part 2 — Identification and Credibility
Part 3 — Required Analyses
List up to 5 analyses whose absence is a blocker for acceptance. For each: state what it is, why its absence undermines credibility, and what a positive result would do for your view. If nothing is missing, write "None — the paper adequately addresses the main concerns."
Tag each required analysis [CRITICAL].
Part 4 — Pointed Questions to the Authors
Write 3–5 specific, pointed questions that get at the paper's weakest points. Frame them as a referee would.
Output format:
## Agent A: Contribution & Identification
### Part 1 — Central Contribution
[assessment + rating]
### Part 2 — Identification and Credibility
[assessment]
### Part 3 — Required Analyses
[numbered list: [CRITICAL] Analysis | Why absence matters | What a positive result would do]
### Part 4 — Questions to the Authors
[numbered list of 3–5 questions]
The .tex files to review are: [LIST ALL TEX FILE PATHS HERE]
You are a skeptical econometrician enforcing "claim discipline." Read all .tex files and flag every place where the paper overstates its evidence.
What to check:
Causal language without causal identification: Flag every specific sentence where causal language ("causes", "leads to", "drives", "determines", "because of", "due to", "results in") is applied to the main findings without genuine causal identification. Quote the exact sentence and explain why the language exceeds what the identification supports.
Mechanism claims stated as facts: When the paper explains why a result holds, flag every instance where a proposed mechanism is asserted rather than framed as a hypothesis.
Generalization beyond the sample: Claims that extend findings beyond the data's scope without adequate caveats (e.g., claiming broad policy implications from a single country; claiming current relevance for historical results without acknowledging context changes).
Missing caveats: Places where a reader would naturally ask "but what about...?" and the paper doesn't address it. Focus on the most obvious threats to internal validity for the specific research design: selection, reverse causality, measurement error, omitted variables.
Statistical vs. economic significance: Places where statistical significance is reported but economic significance is not discussed, or where "significant" is used as if it means "important."
Unverified priority assertions: "No prior study has examined X" or "We are the first to show Y" — flag every such claim. Authors must verify before submission.
Tag every issue [CRITICAL], [MAJOR], or [MINOR].
Output format:
## Agent B: Causal Overclaiming & Unsupported Claims
### Causal Overclaiming
[numbered list: [CRITICAL] or [MAJOR] Section | "Exact quoted text" | Why it overclaims | Fix]
### Mechanism Claims Stated as Facts
[numbered list: [MAJOR] or [MINOR] same format]
### Missing Caveats
[numbered list: [CRITICAL] or [MAJOR] Topic | Where to address it | Suggested fix]
### Other Issues
[numbered list: [MAJOR] or [MINOR] same format]
The .tex files to review are: [LIST ALL TEX FILE PATHS HERE]
After both agents return, consolidate into a single report.
Check whether QUICK_REVIEW_[YYYY-MM-DD].md already exists. If so, append -v2 (or -v3, etc.).
Save to: QUICK_REVIEW_[YYYY-MM-DD].md
Report structure:
# Quick Pre-Submission Check
**Paper**: [Title]
**Authors**: [Authors]
**Date**: [Today's date]
---
## Overall Assessment
[2–3 sentences: (1) what the paper does; (2) contribution rating from Agent A; (3) the single most pressing issue from the Priority Items below.]
**Preliminary Recommendation**: [Send to referees | Revise before sending to referees | Desk reject] — copy exactly from Agent A Part 1 rating logic; do not paraphrase.
---
## 1. Contribution & Identification
[Agent A output]
---
## 2. Causal Overclaiming & Unsupported Claims
[Agent B output]
---
## Priority Action Items
Collect all tagged items and rank: `[CRITICAL]` first (identification and causal overclaiming items before others), then `[MAJOR]`, then `[MINOR]`.
**CRITICAL** (could cause desk rejection or major objections):
1. ...
**MAJOR** (will likely be raised by referees):
4. ...
**MINOR** (polish):
8. ...
After saving, report to the user:
tools
Recommend AND run open-source AI tools, agents, Claude Code / Codex skills, and MCP servers for any stage of a literature review — searching, reading, extracting, synthesizing, screening, citation-checking, and paper writing. Use when the user asks "what tool should I use to..." OR "install/run/use <tool> to ..." for research/lit-review work: automating a survey or related-work section, PDF→Markdown extraction for LLMs (MinerU/marker/docling), PRISMA / systematic review (ASReview), citation-backed Q&A over PDFs (PaperQA2), wiring papers into Claude/Cursor via MCP (arxiv/paper-search/zotero servers), or chatting with a Zotero library. Ships a launcher (scripts/litrun.py) that installs each tool in an isolated venv and runs it. Curated catalog of 70+ vetted projects. 支持中英文(用于「文献综述工具选型」与「一键安装/运行」)。
development
Route empirical-research requests through the Auto-Empirical Research Skills catalog when this whole repository is installed as one skill in Codex, CodeBuddy, Claude Code, or another IDE. Use to choose and load the right vendored AERS skill for causal inference, econometrics, replication, data acquisition, manuscript writing, peer review and referee responses, citation checking, de-AIGC editing, or full empirical-paper workflows without reading the entire repository at once.
documentation
Use when the project collects primary data or runs a field, lab, or survey experiment, before the intervention begins — write the pre-analysis plan, size the sample from a power calculation, and register with the AEA RCT Registry. Apply after the design is chosen in aer-identification and before any outcome data are seen.
tools
Guide economists to authoritative data sources with explicit, confirmed data specifications before retrieval; interfaces with Playwright MCP to navigate portals and extract real data, not articles about data.