skill-comply
Visualize whether skills, rules, and agent definitions are actually followed — auto-generates scenarios at 3 prompt strictness levels, runs agents, classifies behavioral sequences, and reports compliance rates with full tool call timelines. Use when checking whether agents actually follow the skills
By affaan-m · 2,835 installs
npx skills add affaan-m/ecc --skill skill-comply
Source repository · Upstream listing
skill comply: Automated Compliance Measurement
Measures whether coding agents actually follow skills, rules, or agent definitions by:
1. Auto generating expected behavioral sequences (specs) from any .md file
2. Auto generating scenarios with decreasing prompt strictness (supportive → neutral → competing)
3. Running claude p and capturing tool call traces via stream json
4. Classifying tool calls against spec steps using LLM (not regex)
5. Checking temporal ordering deterministically
6. Generating self contained reports with spec, prompts, and timelines
Supported Targets
Skills ( skills/ /SKILL.md ): Workflow skills like search first, TDD guides
Rules ( rules/common/ .md ): Mandatory rules like testing.md, security.md, git workflow.md
Agent definitions ( agents/ .md ): Whether an agent gets invoked when expected (internal workflow verification not yet supported)
When to Activate
User runs /skill comply <path
User asks "is this rule actually being followed?"
After adding new rules/skills, to verify agent compliance
Periodically as part of quality maintenance
Usage
Key Concept: Prompt Independence
Measures whether a skill/rule is followed even when the prompt doesn't explicitly support it.
Report Contents
Reports are self contained and include:
1. Expected behavioral sequence (auto generated spec)
2. Scenario prompts (what was asked at each strictness level)
3. Compliance scores per scenario
4. Tool call timelines with LLM classification labels
Advanced (optional)
For users familiar with hooks, reports also include hook promotion recommendations for steps with low compliance. This is informational — the main value is the compliance visibility itself.