sf-ai-agentforce-testing

Agentforce agent testing with dual-track workflow and 100-point scoring. TRIGGER when: user tests Agentforce agents, runs sf agent test commands, creates test specs, validates topic routing, or analyzes agent test coverage. DO NOT TRIGGER when: Apex unit tests (use sf-testing), building agents (use

By jaganpro · 1,297 installs

npx skills add jaganpro/sf-skills --skill sf-ai-agentforce-testing

Source repository · Upstream listing

sf ai agentforce testing: Agentforce Test Execution & Coverage Analysis Use this skill when the user needs formal Agentforce testing : multi turn conversation validation, CLI Testing Center specs, topic/action coverage analysis, preview checks, or a structured test fix loop after publish. When This Skill Owns the Task Use sf ai agentforce testing when the work involves: sf agent test workflows multi turn Agent Runtime API testing topic routing, action invocation, context preservation, guardrail, or escalation validation test spec generation and coverage analysis post publish / post activate test fix loops Delegate elsewhere when the user is: building or editing the agent itself → [sf ai agentforce](../sf ai agentforce/SKILL.md) or [sf ai agentscript](../sf ai agentscript/SKILL.md) running Apex unit tests → [sf testing](../sf testing/SKILL.md) creating seed data for actions → [sf data](../sf data/SKILL.md) analyzing session telemetry / STDM traces → [sf ai agentforce observability](../sf ai agentforce observability/SKILL.md) Core Operating Rules Testing comes after deploy / publish / activate. Use multi turn API testing as the primary path when conversation continuity matters. Use CLI Testing Center as the secondary path for single utterance and org supported test center workflows. Interactive and programmatic CLI preview use standard sf org login web authentication; ECA is only required for Agent Runtime API testing , not for live preview. Fixes to the agent should be delegated to [sf ai agentscript](../sf ai agentscript/SKILL.md) when Agent Script changes are needed. Do not use raw curl for OAuth token validation in the ECA flow; use the provided credential tooling. Script path rule Use the existing scripts under: ~/.claude/skills/sf ai agentforce testing/hooks/scripts/ These scripts are pre approved. Do not recreate them. <a id="phase 0 prerequisites agent discovery" </a Required Context to Gather First Ask for or infer: agent API name / developer name target org alias testing goal: smoke test, regression, coverage expansion, or bug reproduction whether the agent is already published and activated whether the org has Agent Testing Center available whether ECA credentials are available for Agent Runtime API testing Preflight checks: 1. discover the agent 2. confirm publish / activation state 3. verify dependencies (Flows, Apex, data) 4. choose testing track Dual Track Workflow Track A — Multi turn API testing (primary) Use when you need: multi turn conversation testing topic re matching validation context preservation checks escalation or action chain analysis across turns Requires: ECA / auth setup agent runtime access Track B — CLI Testing Center (secondary) Use when you need: org native sf agent test workflows test spec YAML execution quick single utterance validation CLI centered CI/CD usage where Testing Center is available Quick manual path For manual validation without full formal testing, use preview workflows first, then escalate to Track A or B as needed. Recommended Workflow 1. Discover and verify locate the agent in the target org confirm it is published and activated confirm required actions / Flows / Apex exist decide whether Track A or Track B fits the request 2. Plan tests Cover at least: main topics expected actions guardrails / off topic handling escalation behavior phrasing variation 3. Execute the right track Track A validate ECA credentials with the provided tooling retrieve metadata needed for scenario generation run multi turn scenarios with the provided Python scripts analyze per turn failures and coverage Track B generate or refine a flat YAML test spec run sf agent test commands inspect structured results and verbose action output 4. Classify failures Typical failure buckets: topic not matched wrong topic matched action not invoked wrong action selected action invocation failed context preservation failure guardrail failure escalation failure 5. Run fix loop When failures imply agent authoring issues: delegate fixes to [sf ai agentscript](../sf ai agentscript/SKILL.md) re publish / re activate if needed re run focused tests before full regression Testing Guardrails Never skip these: test only after publish/activate include harmful / off topic / refusal scenarios use multiple phrasings per important topic clean up sessions after API tests keep swarm execution small and controlled Avoid these anti patterns: testing unpublished agents treating one happy path utterance as coverage storing ECA secrets in repo files debugging auth with brittle shell expanded curl commands changing both tests and agent simultaneously without isolating the cause Output Format When finishing a run, report in this order: 1. Test track used 2. What was executed 3. Pass/fail summary 4. Coverage gaps 5. Root cause themes 6. Recommended fix loop / next test step Suggested shape: Cross Skill Integration Need Delegate to Reason fix Agent Script logic [sf ai agentscript](../sf ai agentscript/SKILL.md) authoring and deterministic fix loops create test data [sf data](../sf data/SKILL.md) action ready data setup fix Flow backed actions [sf flow](../sf flow/SKILL.md) Flow repair fix Apex backed actions [sf apex](../sf apex/SKILL.md) Apex repair set up ECA / OAuth for Agent Runtime API [sf connected apps](../sf connected apps/SKILL.md) auth and app configuration analyze session telemetry [sf ai agentforce observability](../sf ai agentforce observability/SKILL.md) STDM / trace analysis Reference Map Start here [references/interview wizard.md](references/interview wizard.md) [references/multi turn testing.md](references/multi turn testing.md) [references/cli commands.md](references/cli commands.md) [references/test spec reference.md](references/test spec reference.md) Execution / auth [references/execution protocol.md](references/execution protocol.md) [references/multi turn execution.md](references/multi turn execution.md) [references/eca setup guide.md](references/eca setup guide.md) [references/credential convention.md](references/credential convention.md) [references/connected app setup.md](references/connected app setup.md) Coverage / fix loops [references/coverage analysis.md](references/coverage analysis.md) [references/agentic fix loops.md](references/agentic fix loops.md) [references/results scoring.md](references/results scoring.md) [references/known issues.md](references/known issues.md) Advanced / specialized [references/agentscript agents.md](references/agentscript agents.md) [references/agentscript testing patterns.md](references/agentscript testing patterns.md) [references/cli testing details.md](references/cli testing details.md) [references/deep conversation history patterns.md](references/deep conversation history patterns.md) [references/swarm execution.md](references/swarm execution.md) [references/trace analysis.md](references/trace analysis.md) [references/agent api reference.md](references/agent api reference.md) Templates / assets [references/test templates.md](references/test templates.md) [references/test plan format.md](references/test plan format.md) [assets/](assets/) Score Guide Score Meaning 90+ production ready test confidence 80–89 strong coverage with minor gaps 70–79 acceptable but coverage expansion recommended 60–69 partial validation only < 60 insufficient confidence; block release