Measurement tiers + anti-gaming guidance
Tiered measurement guidance for Moral Performance Indicators (MPIs) with anti-gaming controls.
Why tiers
Metrics without anti-gaming become weapons
Each MPI ships with tiered evidence, gaming patterns, and validator detection logic.
How to use
Apply tiers to every MPI
Start at Tier 0 for baseline proof and move up as governance maturity improves.
- Tier 0 proves instrumentation exists.
- Tier 1 proves the system is operated and reviewed.
- Tier 2 proves resilience under real incidents and audit sampling.
MPI
Time-to-halt (TTH)
Elapsed time from detection to a confirmed automation halt.
Tiered measurement model
- Tier 0: System logs showing halt trigger and halt completion timestamps.
- Tier 1: Drill reports with median and p95 halt times by team and system.
- Tier 2: Incident postmortems verifying real-world halt times under load.
Known gaming pattern
Halt tests run on low-traffic sandboxes instead of production paths.
Validator detection logic
Validator compares drill environment IDs against production system inventory.
MPI
Reversibility rate
Percent of automated decisions that can be reversed without collateral harm.
Tiered measurement model
- Tier 0: Decision logs with reversal flags and rollbacks executed.
- Tier 1: Appeal outcomes segmented by decision type and reversal latency.
- Tier 2: Quarterly audits that test reversal paths on randomly sampled cases.
Known gaming pattern
Counting only low-stakes cases while excluding high-impact reversals.
Validator detection logic
Validator samples by impact tier and checks for missing high-severity cases.
MPI
Appeal success rate
Share of contested decisions that result in reversal or remedy.
Tiered measurement model
- Tier 0: Appeal intake records with outcomes and timestamps.
- Tier 1: Reviewer roster coverage and SLA compliance for appeals.
- Tier 2: External audit sampling of appeal outcomes for consistency.
Known gaming pattern
Redirecting appeals to off-platform channels so they are not counted.
Validator detection logic
Validator checks for mismatch between receipts issued and appeals recorded.
MPI
Burden ratio
Relative time cost imposed on impacted people versus internal operators.
Tiered measurement model
- Tier 0: Journey maps with time cost logs for entry, exit, and appeal flows.
- Tier 1: Time-on-task analytics with segmentation by user cohort.
- Tier 2: Independent usability studies verifying time cost deltas.
Known gaming pattern
Measuring only successful flows while ignoring drop-offs or abandoned cases.
Validator detection logic
Validator requires abandonment rates and cross-checks with support tickets.