mantis-calibrate
Calculates the final risk score based on empirical evidence and architectural impact. Use when findings have been fully processed by previous stages and you need to append final risk scores to the finding files. Don't use for discovering new vulnerabilities or writing patches.
By google · 1,003 installs
npx skills add google/mantis --skill mantis-calibrate
Source repository · Upstream listing
Risk Calibrator (/mantis calibrate)
System Goal
Risk Analysis Expert. Evaluates confirmed findings against a rigorous risk
matrix, taking into account successful reproduction and production viability to
produce a final risk score (1 10).
Command Definition
Command: /mantis calibrate
Description: Calibrates the risk level of findings based on evidence and
impact.
Input/Output Contract
Reads :
workspace/findings/ .json (all finding files to load full pipeline state).
workspace/kb/THREAT MODEL.md (if exists, to check threat boundary
overrides and asset criticality).
workspace/.mantis state.json (to track the current loop pass, and to read
active snapshot — {snapshot id, snapshot pinned, root} — for finding
provenance and history stamping; absent ⇒ degraded/today's behavior).
Writes :
Updates finding files in place with scoring/calibration fields
( impact score , likelihood score , availability tier ,
inferred exposure , attacker position , mantis risk score , priority ,
sanity triage applied (may begin with STALE EVIDENCE when the
STALE EVIDENCE guard suppresses heuristics), calibration checklist
(entries may carry STALE EVIDENCE: reasons), outrage commentary ,
executive summary ). Appends a history entry with snapshot provenance
(see history JSON template in the body).
Reusable helper script workspace/helpers/append calibrate.py .
Preconditions :
Confirmed or raw findings must exist in workspace/findings/ .
Idempotency Guarantee :
Updates findings in place by overwriting existing keys with the calculated
score. Running multiple times on the same inputs yields identical outputs,
with no duplicated entries.
Instructions
Convert the raw security findings and their empirical results (repro/patch) into
a prioritized, actionable risk report.
Execute the calibration as follows:
Locator resolution (findings only). Calibrate never needs to read target
source to compute a score, but some heuristics below may re inspect code;
resolve the code root the same way every stage does. Block A is inlined
below:
[!NOTE] CURRENT PASS CHECK (defensive; the binding guarantee is on the
harness per mantis pipeline adapter Scenario 2): if active snapshot is
present AND active snapshot.pass != state.pass number , treat the snapshot as
STALE for this pass — STOP "stale active snapshot: pass mismatch" or degrade
as HALT ( snapshot pinned effectively false: no authoritative verdicts, Block
B NOT MATCHED, reproduce not attempted ). This catches a custom harness that
preserved active snapshot across the Stage 15 pass increment without
re pinning. The reference meta agent re pins every pass, so this check never
fires there. Block B itself cannot detect this (it is snapshot id only, not
pass aware).
Snapshot provenance & STALE EVIDENCE guard (mechanical; do this before
scoring):
P0. Read active snapshot ( {snapshot id, snapshot pinned, root} ) from
state root/workspace/.mantis state.json (Block A step 0/1c). NEVER stop if it
is absent — calibrate is a FINDINGS ONLY stage (Block A step 0).
P1. MODE (single decision for the whole run — branches on active snapshot
presence, 3 state model): active snapshot is ABSENT in state (no sync
was requested — MODE OFF = today's default) MODE = MODE OFF. Score exactly
as today : run every heuristic as written, do NOT compute PROVENANCE, do NOT
emit STALE EVIDENCE , and do NOT emit any HALT/PINNED banners.
(Backward compatible default path — byte for byte today's behavior.)
active snapshot IS present AND snapshot pinned is not exactly true (HALT
mode — the tree raced or could not be pinned) MODE = HALT. SNAPSHOT ID =
active snapshot.snapshot id (a live: id). Compute PROVENANCE per P2 below
and fire the STALE EVIDENCE guard conservatively (same as PINNED for guard
purposes), because findings' locators may be stale. Authoritative verdicts
(VERIFIED SECURE, failed to reproduce, DUPLICATE, FALSE POSITIVE, NON VIABLE)
are forbidden this pass. snapshot pinned == true MODE = PINNED.
SNAPSHOT ID = active snapshot.snapshot id . Full provenance + STALE EVIDENCE
guard as below.
P2. In MODE = PINNED or HALT, compute PROVENANCE per finding F using Block B's
compare rule: F.discovery commit missing OR empty OR the literal "MIXED"
NOT MATCHED. F.discovery commit != SNAPSHOT ID (exact string compare,
no fuzzy) NOT MATCHED. F.discovery commit == SNAPSHOT ID MATCHED.
P3. A per finding heuristic is STALE for F when MODE is PINNED OR HALT AND
either: PROVENANCE(F) == NOT MATCHED, OR the finding's code paths target
file does NOT exist under CODE ROOT. (Resolve CODE ROOT via Block A steps 1 & 3;
strip a trailing :<digits ; read ONLY the pinned root, NEVER the live tree. If
you cannot resolve CODE ROOT at all, treat the file as absent STALE.)
P4. When a heuristic is STALE for F, do NOT apply it; keep the conservative
(pre adjustment) score; and ensure the literal token STALE EVIDENCE is the
FIRST token of sanity triage applied (add it once, before any UNKNOWN warnings
and any fired rule list). The four guarded heuristics and their exact STALE
handling are: Dead code 0.2 multiplier (Section 2, "Asset Criticality &
Reachability"): do NOT apply the 0.2 reduction; use the multiplier you would
otherwise have. repro failure (Section 3 rule): do NOT force LOW; set
calibration checklist.repro failure.outcome = "UNKNOWN" , reason beginning
"STALE EVIDENCE: " . vague code paths (Section 3 rule): do NOT
force LOW; set calibration checklist.vague code paths.outcome = "UNKNOWN" ,
reason beginning "STALE EVIDENCE: " . static confirmation trace lift
(Section 3 rule, its "valid external stack trace/sanitizer…" exception): do NOT
apply the trace lift; KEEP the static HIGH cap in force ( likelihood score \<=
3, 0.8 Hazard multiplier, NOT CRITICAL). Set
calibration checklist.static confirmation.outcome = "APPLIES" , reason
beginning
"STALE EVIDENCE: trace lift suppressed; trace/crash log may predate the active snapshot; " .
P5. NON SOURCE finding: if the finding's code paths entry is a non source
LOCATOR (contains "://" , or is not of the form <path :<integer — per Block
A step 3: a symbol / offset / endpoint), SKIP all source only heuristics for it
— dead code, file path/imports/caller hierarchy exposure inference,
vague code paths , and static trace re inspection — and score from the
finding's DECLARED metadata ( attacker position , privileges required ,
production viability , repro status , threat model). A non source skip is NOT
flagged STALE EVIDENCE (it is normal, not drift). Non source findings default
inferred exposure to "INTERNAL" (0.8) unless the finding/threat model
declares otherwise.
1. Load Full Pipeline State:
Read all JSON files from the workspace/findings/ directory. Because the
pipeline appends data to each finding file at each stage, these files
provide the complete picture of each finding's journey (including its id ,
reproduction status, and production viability).
Missing Fields Fallbacks: If any finding is missing viability, or
reproduction fields (such as chained findings), apply the following
fallback defaults before scoring:
If production viability is missing, treat it as "CONDITIONAL VIABLE" .
If repro status is missing, treat it as "not attempted" .
Snapshot provenance (only when MODE is PINNED or HALT): for each
finding, compute PROVENANCE (MATCHED / NOT MATCHED) per preamble step P2
and record it in scratch. This value gates the STALE EVIDENCE handling in
Sections 2 and 3 (preamble steps P3–P4). In MODE == MODE OFF, skip this —
score as today.
Read workspace/kb/THREAT MODEL.md from the Knowledge Base (if it exists)
to evaluate component exposure, trust boundaries, asset criticality, and
any custom Calibration Overrides (e.g., specific threat positions or
caps that should be lifted or customized for the project).
Batch Processing: If there are more than a few findings to calibrate,
split the task into batches (a few findings at a time). If you have the
ability to invoke subagents, delegate each batch to a subagent to process
in parallel, then aggregate the results. Each batch/subagent inspects
ONLY the pinned snapshot: pass snapshot root=<active snapshot.root ,
snapshot id=<active snapshot.snapshot id , and
state root=<workspace parent so every subagent resolves the same
CODE ROOT via Block A. Any code inspection a batch performs (exposure
inference, dead code, static trace verification) MUST read through that
CODE ROOT (the pinned copy), NEVER the live tree, and MUST honor the
STALE EVIDENCE guard (preamble P3–P4). Findings only fields (score,
priority, history stamp) are computed from the finding JSON regardless.
2. Calculate Risk Score (1 10): For each unique finding file, calculate the
actual technical risk score in a matrix form based on the following formula
components, where Hazard = Impact + Likelihood :
Impact (1 5): Evaluate impact using the CIA triad (Confidentiality,
Integrity, Availability) while strictly considering Blast Radius .
5: Complete, systemic loss of Confidentiality (full data breach, leak of
root cryptographic/HSM master keys) or Integrity (system compromise,
e.g., clear Remote Code Execution (RCE) by an unprivileged attacker who
isn't already in an effective position to execute code). MUST NOT be used
for attackers who already have execution privileges.
4: Substantial loss in one or more areas. This includes systemic
Availability loss (total outage of a major service) or major data
exposure.
3: Moderate loss (e.g., partial data exposure, temporary or partial
system disruption).
2: Minor loss (e.g., minor information leak, localized disruption). A
vulnerability whose blast radius is limited to affecting only a single
user's own data MUST NOT be scored higher than 2. Exception: If the
action lacks non repudiation (allowing the user to plausibly deny the
action to commit fraud or blame others), or triggers side effects
affecting other users/system stability, it should not be downgraded.
1: Negligible impact on CIA, mostly a cosmetic issue. Findings of the
type "the code is fragile", "lack of defense in depth", or purely
theoretical hygiene issues MUST have an Impact score of 1, ensuring they
are rated LOW at most.
Security Control Bypass (Upgrading): If the vulnerability directly
bypasses a core security control (e.g., authentication, authorization,
cryptographic signature verification) or defeats the primary security
purpose of a library (e.g., a library meant to secure keysets allows
attacker control), elevate the Impact score to at least 4 (or 5
if it leads to systemic compromise), even if the immediate technical
impact seems localized.
Note on Privileges Required & Lateral Movement:
If the finding requires HIGH privileges (e.g., administrative
privileges, admin to super admin escalation) or only allows lateral
movement/pivoting between internal components from an already
compromised state, cap its individual Impact score at 2 , unless the
exploit results in escaping the container boundary (to the host node)
or cross tenant escalation.
If the finding requires LOW privileges (e.g., standard
authenticated user), cap its individual Impact score at 3 (unless
it leads to systemic compromise of other tenants/users, OR it directly
bypass