pol-probe-advisor
Select the right Proof of Life (PoL) probe based on hypothesis, risk, and resources. Use this to match the validation method to the real learning goal, not tooling comfort.
By deanpeters · 1,899 installs
npx skills add deanpeters/product-manager-skills --skill pol-probe-advisor
Source repository · Upstream listing
Purpose
Guide product managers through selecting the right Proof of Life (PoL) probe type (of 5 flavors) based on their hypothesis, risk, and available resources. Use this when you need to eliminate a specific risk or test a narrow hypothesis, but aren't sure which validation method to use. This interactive skill ensures you match the cheapest prototype to the harshest truth—not the prototype you're most comfortable building.
This is not a tool for deciding if you should validate (you should). It's a decision framework for choosing how to validate most effectively.
Input
Works best with: The hypothesis you want to validate or the risk you want to eliminate.
Also useful: Your resources (time, budget, engineering access), audience access, and what failure would cost.
Anything supplied with the invocation itself — text after the skill name, a pasted context dump, or an appended ARGUMENTS: line — counts as answers already given. Use it and skip whatever it covers; don't re ask.
Arriving empty handed? That works too. The advisor opens by asking what you're trying to learn, then matches you to one of the 5 probe flavors.
Example invocation: Which probe fits? Hypothesis: mid market HR teams will trust AI drafted job descriptions enough to publish them; 2 weeks, no eng support.
Key Concepts
The Core Problem: Method Hypothesis Mismatch
Common failure mode: PMs choose validation methods based on tooling comfort ("I know Figma, so I'll design a prototype") rather than learning goal. Result: validate the wrong thing, miss the actual risk.
Solution: Work backwards from the hypothesis. Ask: "What specific risk am I eliminating? What's the cheapest path to harsh truth?"
The 5 PoL Probe Flavors (Quick Reference)
Type Core Question Best For Timeline
Feasibility Check "Can we build this?" Technical unknowns, API dependencies, data integrity 1 2 days
Task Focused Test "Can users complete this job without friction?" Critical UI moments, field labels, decision points 2 5 days
Narrative Prototype "Does this workflow earn stakeholder buy in?" Storytelling, explaining complex flows, alignment 1 3 days
Synthetic Data Simulation "Can we model this without production risk?" Edge cases, unknown unknowns, statistical modeling 2 4 days
Vibe Coded PoL Probe "Will this solution survive real user contact?" Workflow/UX validation with real interactions 2 3 days
Golden Rule: "Use the cheapest prototype that tells the harshest truth."
Anti Patterns (What This Is NOT)
Not "build the prototype you're comfortable with": Match method to hypothesis, not skillset
Not "pick based on stakeholder preference": Optimize for learning, not internal politics
Not "choose the most impressive option": Impressive ≠ informative
Not "default to code": Writing code should be your last resort, not your first
When to Use This Skill
✅ Use this when:
You have a clear hypothesis but don't know which validation method to use
You're unsure whether to build code, create a video, or run a simulation
You need to eliminate a specific risk quickly (within days)
You want to avoid prototype theater
❌ Don't use this when:
You don't have a hypothesis yet (use problem statement.md or problem framing canvas.md first)
You're trying to impress executives (that's not validation)
You already know the answer (confirmation bias)
You need to ship an MVP (this is for pre MVP reconnaissance)
Facilitation Source of Truth
Use [ workshop facilitation ](../workshop facilitation/SKILL.md) as the default interaction protocol for this skill.
It defines:
session heads up + entry mode (Guided, Context dump, Best guess)
one question turns with plain language prompts
progress labels (for example, Context Qx/8 and Scoring Qx/5)
interruption handling and pause/resume behavior
numbered recommendations at decision points
quick select numbered response options for regular questions (include Other (specify) when useful)
This file defines the domain specific assessment content. If there is a conflict, follow this file's domain logic.
Application
This interactive skill uses adaptive questioning to recommend the right PoL probe type based on your context.
Step 0: Gather Context
Agent asks:
Let's figure out which PoL probe type is right for your validation needs. First, I need some context:
1. What hypothesis are you testing?
(Describe in one sentence, or use "If [we do X] for [persona], then [outcome]" format)
2. What specific risk are you trying to eliminate?
Examples:
Technical feasibility ("Can our API handle real time data?")
User task completion ("Can users find the 'export' button?")
Stakeholder alignment ("Will leadership approve this direction?")
Edge case behavior ("How does the system handle duplicate entries?")
Workflow validation ("Will users complete the 3 step onboarding?")
3. What's your timeline?
Hours (same day validation)
1 2 days (quick spike)
3 5 days (moderate effort)
1 week+ (too long—consider breaking into smaller probes)
4. What resources do you have available?
Examples:
Engineering capacity (1 dev for 1 day)
Design tools (Figma, Loom, Sora)
AI/no code tools (ChatGPT Canvas, Replit, Airtable)
User access (10 users from waitlist, 5 beta customers, etc.)
Budget (for UsabilityHub, Optimal Workshop, etc.)
Step 1: Identify the Core Question
Agent synthesizes user input and asks:
Based on your hypothesis and risk, which of these core questions are you really trying to answer?
Offer 5 options (aligned to probe types):
1. "Can we build this?" — You're uncertain about technical feasibility, API integration, data availability, or third party dependencies
2. "Can users complete this job without friction?" — You're validating critical UI moments, field labels, navigation, or decision points
3. "Does this workflow earn stakeholder buy in?" — You need to explain a complex flow, align leadership, or "tell vs. test" the story
4. "Can we model this without production risk?" — You need to explore edge cases, simulate user behavior, or test prompt logic safely
5. "Will this solution survive real user contact?" — You need users to interact with a semi functional workflow to catch UX/workflow issues
User response: [Select one number, or describe if none fit]
Step 2: Recommend PoL Probe Type
Based on user selection, agent recommends the matching probe type:
Option 1 Selected: "Can we build this?"
→ Recommended Probe: Feasibility Check
What it is:
A 1 2 day spike and delete test to surface technical risk. Not meant to impress anyone—meant to reveal blockers fast.
Methods:
GenAI prompt chains (test if AI can handle your use case)
API sniff tests (verify third party integrations work)
Data integrity sweeps (check if your data supports the feature)
Third party tool evaluation (test if Zapier/Stripe/Twilio does what you think)
Timeline: 1 2 days
Tools:
ChatGPT/Claude (prompt testing)
Postman/Insomnia (API testing)
Jupyter notebooks (data exploration)
Proof of concept scripts (throwaway code)
Success Criteria Example:
Pass: API returns expected data format in <200ms
Fail: API times out, or data structure incompatible with our schema
Learn: Identify specific technical blocker
Disposal Plan: Delete all spike code after documenting findings.
Next Step: Would you like me to generate a pol probe artifact documenting this feasibility check?
Option 2 Selected: "Can users complete this job without friction?"
→ Recommended Probe: Task Focused Test
What it is:
Validate critical moments—field labels, decision points, navigation, drop off zones—using specialized testing tools. Focus on observable task completion , not opinions.
Methods:
Optimal Workshop (tree testing, card sorting)
UsabilityHub (5 second tests, click tests, preference tests)
Maze (prototype testing with heatmaps)
Loom recorded task walkthroughs (ask users to "think aloud")
Timeline: 2 5 days
Tools:
Optimal Workshop ($200/month)
UsabilityHub ($100 300/month)
Maze (free tier available)
Loom (free for basic)
Success Criteria Example:
Pass: 80%+ users complete task in <2 minutes
Fail: <60% completion, or 3+ users get stuck on same step
Learn: Identify exact friction point (specific field, button, etc.)
Disposal Plan: Archive session recordings, document learnings, delete test prototype.
Next Step: Would you like me to generate a pol probe artifact documenting this task focused test?
Option 3 Selected: "Does this workflow earn stakeholder buy in?"
→ Recommended Probe: Narrative Prototype
What it is:
Tell the story, don't test the interface. Use video walkthroughs or slideware storyboards to explain workflows and measure interest. This is "tell vs. test"—you're validating the narrative, not the UI.
Methods:
Loom walkthroughs (screen recording with voiceover)
Sora/Synthesia/Veo3 (AI generated explainer videos)
Slideware storyboards (PowerPoint/Keynote with illustrations)
Storyboard sketches (use storyboard.md component skill)
Timeline: 1 3 days
Tools:
Loom (free, fast)
Sora/Synthesia (text to video, paid)
PowerPoint/Keynote (slideware animation)
Figma (static storyboard frames)
Success Criteria Example:
Pass: 8/10 stakeholders say "I'd use this" or "This solves the problem"
Fail: Stakeholders ask "Why would I use this?" or suggest alternative approaches
Learn: Identify which part of the narrative resonates (or doesn't)
Disposal Plan: Archive video, document feedback, delete supporting files.
Next Step: Would you like me to generate a pol probe artifact documenting this narrative prototype?
Option 4 Selected: "Can we model this without production risk?"
→ Recommended Probe: Synthetic Data Simulation
What it is:
Use simulated users, synthetic data, or prompt logic testing to explore edge cases and unknown unknowns without touching production. Think "wind tunnel testing, cheaper than postmortem."
Methods:
Synthea (synthetic patient data generation)
DataStax LangFlow (test prompt logic without real users)
Monte Carlo simulations (model probabilistic outcomes)
Synthetic user behavior scripts (simulate click patterns, load testing)
Timeline: 2 4 days
Tools:
Synthea (open source, healthcare)
DataStax LangFlow (prompt chain testing)
Python + Faker library (generate synthetic data)
Locust/k6 (load testing with synthetic users)
Success Criteria Example:
Pass: System handles 10,000 synthetic users with <1% error rate
Fail: Edge cases cause crashes or incorrect outputs
Learn: Identify which edge cases break the system
Disposal Plan: Delete synthetic data, archive findings, document edge cases.
Next Step: Would you like me to generate a pol probe artifact documenting this synthetic data simulation?
Option 5 Selected: "Will this solution survive real user contact?"
→ Recommended Probe: Vibe Coded PoL Probe
What it is:
A Frankensoft stack (ChatGPT Canvas + Replit + Airtable) that creates just enough illusion for users to interact with a semi functional workflow. Not production grade—just enough to catch UX/workflow signals in 48 hours.
⚠️ Warning: This is the riskiest probe type. It looks real enough to confuse momentum with maturity. Use only when you need real user contact and other methods won't suffice.
Methods:
ChatGPT Canvas (quick UI generation)
Replit (host throwaway code)
Airtable (fake database)
Carrd/Webflow (landing page + workflow mockup)
Timeline: 2 3 days
Stack Example:
ChatGPT Canvas: Generate form UI
Replit: Host simple Flask/Node app
Airtable: Capture form submissions
Loom: Record user sessions for post mortem analysis
Success Criteria Example:
Pass: 8/