qa-expert

This skill should be used when establishing comprehensive QA testing processes for any software project. Use when creating test strategies, writing test cases following Google Testing Standards, executing test plans, tracking bugs with P0-P4 classification, calculating quality metrics, or generating

By daymade · 1,659 installs

npx skills add daymade/claude-code-skills --skill qa-expert

Source repository · Upstream listing

QA Expert Set up test cases, execution tracking, bug reports and QA handoffs using AAA test structure and OWASP security categories. When to Use This Skill Trigger this skill when: Setting up QA infrastructure for a new or existing project Writing standardized test cases (AAA pattern compliance) Executing comprehensive test plans with progress tracking Implementing security testing (OWASP Top 10) Filing bugs with proper severity classification (P0 P4) Generating QA reports (daily summaries, weekly progress) Calculating quality metrics (pass rate, coverage, gates) Preparing QA documentation for third party team handoffs Enabling autonomous LLM driven test execution Quick Start One command initialization : What gets created : Directory structure ( tests/docs/ , tests/e2e/ , tests/fixtures/ ) Tracking CSVs ( TEST EXECUTION TRACKING.csv , BUG TRACKING TEMPLATE.csv ) Documentation templates ( BASELINE METRICS.md , WEEKLY PROGRESS REPORT.md ) Master QA Prompt for autonomous execution README with preparation steps and links to the generated files The output directory is the project root; the script appends tests/ . Use a fresh destination: initialization overwrites its template files. Replace example CSV rows, write test specifications and bind the project harness before execution. Resolve <qa expert dir from this loaded Skill's directory, not the target project. For autonomous execution : Follow [the master prompt](references/master qa prompt.md) for preparation, bounded execution and interruption recovery. Initialization creates templates; it does not run tests or install a scheduler. Core Capabilities 1. QA Project Initialization Initialize QA directories and templates: Creates directory structure, tracking CSVs, documentation templates, and master prompt for autonomous execution. Use when : Starting QA from scratch or migrating to structured QA process. 2. Test Case Writing Write standardized, reproducible test cases following AAA pattern (Arrange Act Assert): 1. Read template: assets/templates/TEST CASE TEMPLATE.md 2. Follow structure: Prerequisites (Arrange) → Test Steps (Act) → Expected Results (Assert) 3. Assign priority: P0 (blocker) → P4 (low) 4. Include edge cases and potential bugs Test case format : TC [CATEGORY] [NUMBER] (e.g., TC CLI 001, TC WEB 042, TC SEC 007) Reference : See references/google testing standards.md for AAA guidelines and project bound coverage and release acceptance. For cross platform adapters or compatibility with another runtime/implementation, load [runtime compatibility acceptance](references/runtime compatibility acceptance.md) before choosing mocks, expected results or supported version cases. For payment, procurement, fulfillment or refund recovery, load [transaction recovery acceptance](references/transaction recovery acceptance.md) before selecting cases. For schema upgrades, accounting views or integration fixtures, load [migration and fixture acceptance](references/migration fixture acceptance.md). For file backed state, snapshot dependency checks, recovery or CLI argument, wrapper, compatibility alias, output or read cost changes, load [file persistence and CLI acceptance](references/file persistence cli acceptance.md). For admission decisions, account/resource bindings or recovery that can authorize an effect, load [admission and recovery acceptance](references/admission recovery acceptance.md) before choosing fault timing or side effect assertions. For responses, normalization or suggested edits that race with user changes, load [asynchronous editing and conflict acceptance](references/async edit conflict acceptance.md) before selecting timing, session and related object cases. Bind these recipes to the application's existing contract and test harness; retain the general AAA, tracking and reporting workflow. 3. Test Execution & Tracking Ground Truth Principle (critical): Test case documents (e.g., 02 CLI TEST CASES.md ) = authoritative source for test steps Tracking CSV = execution status only (do NOT trust CSV for test specifications) See references/ground truth principle.md for preventing doc/CSV sync issues Manual execution : 1. Read test case from category document (e.g., 02 CLI TEST CASES.md ) ← always start here 2. Execute test steps exactly as documented 3. Update TEST EXECUTION TRACKING.csv immediately after EACH test (never batch) 4. File bug in BUG TRACKING TEMPLATE.csv if test fails Autonomous execution (recommended): 1. Copy master prompt from references/master qa prompt.md 2. Paste to LLM session 3. Execute the authorized batch, track each result, file reproduced bugs and report evidence On interruption, read back checkpoints and reconcile uncertain side effects before choosing the first unmet test. Future execution requires an available, authorized host runner; a prompt alone does not keep a session running. 4. Bug Reporting File bugs with proper severity classification: Required fields : Bug ID: Sequential (BUG 001, BUG 002, ...) Severity: P0 (24h fix) → P4 (optional) Steps to Reproduce: Numbered, specific Environment: OS, versions, configuration Severity classification : P0 (Blocker) : Security vulnerability, core functionality broken, data loss P1 (Critical) : Major feature broken with workaround P2 (High) : Minor feature issue, edge case P3 (Medium) : Cosmetic issue P4 (Low) : Documentation typo Reference : Initialization creates tests/docs/templates/BUG TRACKING TEMPLATE.csv . 5. Quality Metrics Calculation Calculate metrics from the current tracking rows: Metrics dashboard includes : Test execution progress (X/Y tests, Z% complete) Pass rate (passed/executed %) Unique linked bug IDs and test priority breakdown Quality gates status (✅/❌ for each gate) [ scripts/calculate metrics.py ](scripts/calculate metrics.py) owns the built in checks and CSV field interpretation. Record results as ✅ PASSED or ❌ FAILED and completed status as Completed . Its P0 check only reads linked bug IDs and P0 in tracking notes; it does not read bug severity from the bug log. Coverage, OWASP mitigation and release acceptance need their own project evidence. The CLI prints failing checks but still exits 0; it is a report, not a release gate. Follow [release acceptance](references/google testing standards.md release criteria). Calculate current totals on demand rather than maintaining another summary table. 6. Progress Reporting Generate QA reports for stakeholders: Daily summary (end of day): Tests executed, pass rate, bugs filed Blockers (or None) Tomorrow's plan Weekly report (every Friday): Use template: WEEKLY PROGRESS REPORT.md (created by init script) Compare against baseline: BASELINE METRICS.md Assess quality gates and trends Reference : See references/llm prompts library.md for task specific reporting prompts. 7. Security Testing (OWASP) Implement OWASP Top 10 security testing: Coverage targets : 1. A01: Broken Access Control RLS bypass, privilege escalation 2. A02: Cryptographic Failures Token encryption, password hashing 3. A03: Injection SQL injection, XSS, command injection 4. A04: Insecure Design Rate limiting, anomaly detection 5. A05: Security Misconfiguration Verbose errors, default credentials 6. A07: Authentication Failures Session hijacking, CSRF 7. Others : Data integrity, logging, SSRF Select security acceptance from the target project's authoritative release policy. Each security test follows AAA pattern with specific attack vectors documented. Day 1 Onboarding For new QA engineers, follow [Day 1 onboarding](references/day1 onboarding.md) for its sequence, checkpoints and project setup examples. Autonomous Execution (⭐ Recommended) Enable LLM driven autonomous QA testing with single master prompt: Read : references/master qa prompt.md Features : Resume from the first unmet test after checkpoint and side effect reconciliation Execute the project's approved test plan and schedule Auto track results (updates CSV after each test) Auto file bugs (creates bug reports for failures) Auto generate reports (daily summaries, weekly reports) Stop on P0 bugs and report in the current conversation; external escalation needs authorization Benefits : Consistent bug documentation Immediate progress visibility Usage : Copy the master prompt, bind it to the actual project and execute an authorized batch. Reinvoke it to resume; use the host's authorized runner for unattended execution and verify its activity separately. Adapting for Your Project Small Project (50 tests) Timeline: 2 weeks Categories: 2 3 (e.g., Frontend, Backend) Daily: 5 7 tests Reports: Daily summary only Medium Project (200 tests) Timeline: 4 weeks Categories: 4 5 (CLI, Web, API, DB, Security) Daily: 10 12 tests Reports: Daily + weekly Large Project (500+ tests) Timeline: 8 10 weeks Categories: 6 8 (multiple components) Daily: 10 15 tests Reports: Daily + weekly + bi weekly stakeholder Reference Documents Access detailed guidelines from bundled references: references/day1 onboarding.md New QA engineer onboarding references/master qa prompt.md Preparation, execution, recovery and reporting SOP references/llm prompts library.md Prompts for specific QA tasks references/google testing standards.md AAA pattern, coverage planning, release acceptance and fail fast validation references/ground truth principle.md Preventing doc/CSV sync issues (critical for test suite integrity) Assets & Templates Test case templates and bug report formats: assets/templates/TEST CASE TEMPLATE.md Complete template with CLI and security examples Scripts Automation scripts for QA infrastructure: scripts/init qa project.py Initialize QA infrastructure (one command setup) scripts/calculate metrics.py Generate quality metrics dashboard Common Patterns Pattern 1: Starting Fresh QA Pattern 2: LLM Driven Testing (Autonomous) Pattern 3: Adding Security Testing Pattern 4: Third Party QA Handoff Success Criteria This skill is effective when: ✅ Test cases are reproducible by any engineer ✅ Quality gates objectively measured ✅ Bugs fully documented with repro steps ✅ Progress visible in real time (CSV tracking) ✅ Autonomous execution enabled (LLM can execute full plan) ✅ Third party QA teams can locate the harness and resume from verified prerequisites