self-review

Automatically review an academic paper using the NeurIPS review form with three reviewer personas, ensemble scoring, and reflection refinement. Extracts text from PDF, runs structured review, and outputs actionable feedback. Use when the user wants to review a paper before submission or get feedback

By lingzhi227 · 1,435 installs

npx skills add lingzhi227/agent-research-skills --skill self-review

Source repository · Upstream listing

Self Review Review an academic paper using a structured review form with multiple reviewer personas. Input $ARGUMENTS — Path to PDF file or .tex file Scripts Extract text from PDF Tries pymupdf4llm (best) → pymupdf → pypdf. Install: pip install pymupdf4llm pymupdf pypdf Parse PDF into structured sections Extracts title (via font size), section headings, and section text. Requires: pip install pymupdf Key flags: format text , verbose Workflow Step 1: Load Paper If PDF: use extract pdf text.py to extract text If .tex : read the LaTeX source directly Step 2: Three Persona Review Run three independent reviews using different personas (from references/review form.md ): 1. Harsh but fair reviewer : Expects good experiments that lead to insights 2. Harsh and critical reviewer : Looking for impactful ideas in the field 3. Open minded reviewer : Looking for novel ideas not proposed before For each persona, generate a review following the NeurIPS review JSON format in references/review form.md . Step 3: Reflection Refinement (up to 3 rounds per reviewer) After each review, apply the reflection prompt: re evaluate accuracy and soundness, refine if needed. Stop when "I am done". Step 4: Aggregate Combine all three reviews Average numerical scores (round to nearest integer) Synthesize a meta review finding consensus Weight scores using AgentLaboratory weights: Overall (1.0), Contribution (0.4), Presentation (0.2), others (0.1 each) Step 5: Actionable Report Output format: References NeurIPS review form, scoring weights, personas, reflection prompts: ~/.claude/skills/self review/references/review form.md PDF text extraction: ~/.claude/skills/self review/scripts/extract pdf text.py Missing Sections Check You MUST verify that all required sections are present: Abstract, Introduction, Methods/Approach, Experiments/Results, Discussion/Conclusion. Reduce scores if any are missing. Related Skills Upstream: [paper compilation](../paper compilation/) Downstream: [paper revision](../paper revision/), [rebuttal writing](../rebuttal writing/) See also: [slide generation](../slide generation/)