audit-feedback-loop

Scan the current repo and score its feedback loop maturity for AI-assisted development

By zernie · 364 installs

npx skills add zernie/vigiles --skill audit-feedback-loop

Source repository · Upstream listing

Scan the current repository and score its feedback loop maturity for AI assisted development. Instructions Analyze this repository and score its feedback loop maturity using the levels below. Check for each signal, then output a summary report. Maturity Levels Level 0 — Vibes No CI config, no linter rules, no CLAUDE.md. The AI agent is flying blind. Level 1 — Guardrails Has CI + standard linters, but no custom rules. The agent gets basic feedback but can't learn project specific conventions. Level 2 — Architecture as Code Has custom lint rules, CLAUDE.md rules have enforcement annotations. The agent gets rich, project specific feedback. Level 3 — The Organism Has CI + custom rules + screenshot/visual tests + observability + scheduled agent tasks. The entire development loop is instrumented. Signals to Check Scan the repository for the following and note which exist: 1. CI Configuration : Look for .github/workflows/ , .circleci/ , Jenkinsfile , .gitlab ci.yml , bitbucket pipelines.yml , .travis.yml , etc. 2. Linter Config (language aware): JS/TS : eslint.config. , .eslintrc , biome.json , .prettierrc , deno.json Python : pyproject.toml (look for [tool.ruff] , [tool.pylint] , [tool.flake8] ), setup.cfg , .flake8 , ruff.toml Rust : clippy.toml , .clippy.toml , rustfmt.toml Go : .golangci.yml , .golangci.yaml Ruby : .rubocop.yml Java/Kotlin : checkstyle.xml , pmd.xml , detekt.yml 3. Custom Lint Rules : Look for custom plugins, rule directories, or inline rule definitions in linter configs JS/TS: eslint plugin , eslint rules/ directories Python: custom Ruff/Pylint plugins, AST based checks Rust: custom Clippy lints Go: custom analyzers 4. CLAUDE.md : Check if CLAUDE.md exists at the repo root 5. CLAUDE.md Enforcement : Check if using vigiles v2 specs ( CLAUDE.md.spec.ts exists) or v1 annotations ( Enforced by: in CLAUDE.md). v2 specs = higher maturity. 6. Type Safe Specs : Check for CLAUDE.md.spec.ts or .spec.ts files — indicates typed spec compilation via vigiles v2 7. Generated Types : Check for .vigiles/generated.d.ts — indicates linter rules are type checked at authoring time 8. Screenshot/Visual Tests : Look for Playwright ( playwright.config. ), Cypress ( cypress.config. ), Chromatic, Percy, BackstopJS configs 9. Observability : Search for imports/usage of @sentry/ , dd trace , @datadog/ , newrelic , @opentelemetry/ , sentry sdk , structlog , tracing (Rust), opentelemetry in source files 10. Scheduled Agent Tasks : Look for cron patterns in CI configs, .github/workflows/ with schedule: triggers, or references to scheduled Claude Code tasks Output Format Be specific about file paths and what you found. Give actionable recommendations tailored to the project's language and toolchain.