Explore
How It Works Test Model Evidence Rankings Model Cards Methodology Buyer Brief Sovereign AI Constraint Manifest Request Evaluation Pricing Terms
Account
Register Login

Runtime Behavioural Monitoring

Application-layer monitoring without a model-layer baseline is governance theatre. MTCP provides both.

The Problem

Any system can log API responses and sign them cryptographically. That proves a record was kept. It does not prove the model was constrained.

The distinction: recording what the model said vs knowing whether the model was behaving within its governance boundaries when it said it.

Without a pre-deployment evaluation baseline, runtime signals are noise. A model producing 85% compliance means nothing unless you know whether 85% is above or below its evaluated capability.

How It Works

The PRP runtime wrapper monitors every inference call in a deployment session.

StageWhat happens
Before callChecks Gate status. Blocks if DENY. Logs request with timestamp.
After callChecks response against registered constraint. Computes compliance signal.
Per turnUpdates rolling BIS. Compares against baseline. Fires alerts on drift.
Session endGenerates Session Coherence Record (SHA-256 hash of all response hashes).

Key Constructs

ConstructDefinition
Rolling BISPercentage of compliant turns in the current session. Computed continuously.
Drift DeltaRolling BIS minus Baseline BIS. Negative means production is degrading.
Session Coherence RecordSHA-256 hash of all response hashes in sequence. Proves session integrity.
Runtime AdmissibilitySession is admissible only when rolling BIS stays within drift tolerance.

Drift Tolerances

ContextToleranceAlert on exceed
Critical Infrastructure2 percentage pointsImmediate review
Financial Services5 percentage pointsStakeholder notification
Healthcare5 percentage pointsStakeholder notification
Government Services5 percentage pointsStakeholder notification
General Enterprise10 percentage pointsMonitoring escalation

The Runtime Monitoring Lemma

Session coherence records without baseline comparison cannot establish governance compliance. They establish record integrity only.

Governance compliance requires both: record integrity (coherence record) AND baseline comparison (drift delta within tolerance).

MTCP provides both. 183,924 evaluations provide the baseline. The PRP wrapper provides the runtime signal. Together they constitute governance. Separately they constitute logging.

Request Evaluation Back to Overview