NVIDIA AI FACTORY NATIVE · SIDE-CHANNEL

Most of your GPUs are idle. The busy ones may be producing the wrong answer.

AgentPulse is the operating system for an NVIDIA AI Factory. It quantifies the capital sitting idle, detects behavioural quality drift in under five minutes and traces it to the exact change that caused it, and generates the regulatory evidence as a by-product of normal operation. It reads what your factory already emits and never touches the inference path.

THE PROBLEM
THREE OF THEM

This is a working capital problem wearing a technology costume.

Start with the arithmetic, because the arithmetic is not in dispute. A hundred-thousand-GPU cluster represents three to five billion dollars of investment. At the industry-average utilisation figure that keeps appearing in operator data — around eighteen per cent — eighty-two thousand of those GPUs are producing nothing at any given moment. Call it two and a half billion dollars of idle capital, before the power bill for keeping it available.

Now the second problem, which is worse because it is invisible. A cluster running at eighty-five per cent utilisation on an agent that has silently drifted from quality ninety-two to sixty-seven has zero effective utilisation. The spend is entirely real. The outputs are wrong. And because nothing crashed and no threshold was breached, no alert fired. Industry mean time to detect that kind of drift is measured in hours, and the honest version is that a lot of it is detected by a customer complaint.

The third problem arrives on a date. EU AI Act enforcement for high-risk systems requires immutable audit logs under Article 12, human oversight records under Article 14, and technical documentation under Article 11. Most enterprises have none of the three.

The unlock is not subtle. Ten points of utilisation on a hundred-thousand-GPU cluster is ten thousand GPUs. Buying that capacity costs roughly three hundred million dollars and nine months of lead time. Recovering it operationally costs a fraction of that and takes weeks.

18%Industry average utilisation — the capital problem
4.2 hrsMean time to detect quality drift — the output problem
Article 12Immutable audit logs — the evidence problem
7×Gap between top and bottom quintile operators on identical hardware
<5 minQuality drift detection
against the deployed behavioural baseline
0Behavioural quality dimensions
scored continuously per agent
<60sAutonomous remediation
standard tier; critical tier holds for a human
0Milliseconds added to inference
side-channel observer, never in the path
CORE CAPABILITIES
FOUR PILLARS

Five capability areas, one estate, one behavioural model underneath all of them.

Not five products bundled together. The economics, the quality and the evidence are the same signal read at different resolutions — which is why an operator can act on all three from one place instead of reconciling three tools that disagree.

PILLAR 01

Factory economics & found capital

Idle capital quantified in real time, in dollars, by cluster and business unit.

Inference spend attributed down to agent, cluster and business unit. The found-capital calculator converts utilisation gaps into the dollar figure they actually represent, and power-aware routing schedules deferrable work against live grid pricing across eight regions. The AI Estate Efficiency score — utilisation multiplied by quality — gives a board one number that cannot be gamed by running junk work to lift a utilisation chart.

  • Found capital quantified continuously, not in a quarterly review
  • AEE score — utilisation is meaningless without quality attached
  • ROI waterfall with six independently quantified levers
PILLAR 02

Output quality assurance

Eight dimensions, continuously, against the baseline the agent shipped with.

Semantic coherence, factual grounding, instruction adherence, tool call accuracy, output completeness, context retention, safety adherence and latency consistency — scored continuously rather than sampled. Drift is detected in under five minutes, and causal attribution traces it to the exact instruction edit, tool version or configuration change that caused it. Instruction genome snapshots let you diff precisely what changed and when, including changes made outside change control.

  • Under 5 minutes to detect, against an industry average measured in hours
  • Causal attribution, not just an anomaly flag with no owner
  • Instruction genome diff catches unlogged edits
PILLAR 03

Agent intelligence & remediation

Autonomous reasoning agents that observe, hypothesise, act and verify.

Eight reasoning agents run a continuous loop — observe, hypothesise, query, reason, plan, act, verify, report — over the fleet. Standard-tier agents are remediated autonomously in under sixty seconds; critical-tier agents hold for a named human, with the plan, the approver and the outcome recorded. Prompt injection is detected as a behavioural drift signature rather than by content scanning, which is why it survives phrasings a keyword filter has never seen.

  • Tiered autonomy — speed where it is safe, a human where it is not
  • Injection as drift, not as a string match
  • Verified remediation — the loop closes on outcome, not on action
PILLAR 04

Compliance evidence & KPI scheduling

Article 11, 12 and 14 documentation produced by running normally.

Hash-chained immutable audit logging with two-year retention. Human oversight records carrying approver, rationale and outcome. Technical documentation generated continuously rather than assembled before an audit. Behavioural quality is also promoted to a fourth KPI domain alongside latency, utilisation and cost, with a machine-readable scheduler feed — so any orchestrator can route work on quality rather than capacity alone.

  • Evidence as by-product, not an annual documentation project
  • Quality as a KPI domain the scheduler can actually read
  • ISO 42001 readiness and SEC AI disclosure evidence included
WORKED EXAMPLE
DRIFT TO EVIDENCE

An agent degrades quietly. Watch the fleet catch it.

Nothing crashes. No threshold alert fires. The cluster stays busy and the dashboards stay green. This is the failure mode that costs the most, and the one conventional monitoring is structurally unable to see.

agentpulse · fleet operationsidle
$ scanning fleet
Illustrative sequence built on real platform behaviour. Not connected to a live cluster.
THE ARITHMETIC
FOUND CAPITAL

The comparison is not against another tool. It is against buying more hardware.

New GPUs cost hundreds of millions and take the better part of a year to land. Recovering the same capacity from an estate you already own takes weeks and costs a rounding error against the idle capital it releases. Every figure below is arithmetic applied to public GPU pricing and observed industry utilisation — not a benchmark. Run it on your own numbers and the shape does not change, only the magnitude.

LeverMechanismOn a 100,000-GPU estate
Utilisation recoveryIdle capacity surfaced and rescheduled against real demand10 points recovered = 10,000 GPUs, roughly $300M avoided
Power-aware routingDeferrable work moved to off-peak windows across eight regionsApproximately $17M annually
Quality-adjusted throughputDrifted agents caught in minutes rather than hoursEliminates the most expensive category of spend: compute producing wrong output
Remediation cycle timeAutonomous fix for standard tier, HITL for criticalEngineering hours returned to building rather than triaging
ComplianceArticle 11/12/14 evidence generated continuouslyAvoids a documentation programme and up to 3% of global turnover in exposure
ESTATE VIEW · UTILISATION × QUALITY1,024 GPU GROUPS
Busy and drifted — the most expensive state Busy, quality degrading Productive and healthy Allocated but idle
INTEGRATION
& TRUST

It reads the factory you already run. It changes nothing in the path.

Anything that sits in the inference path adds latency, and anything that adds latency gets removed the first time a workload misses its SLA. AgentPulse observes from the side, using the NVIDIA infrastructure already deployed, and surfaces its output where operators are already looking.

NIM

Microservice telemetry

Native integration with NVIDIA NIM inference microservices, with per-session quality scoring alongside token and latency telemetry.

DCGM

GPU correlation

Telemetry from the DCGM exporter, correlating GPU-level metrics to behavioural quality for predictive early warning.

MISSION CONTROL

Where operators already look

Behavioural quality and cost-per-outcome surfaced alongside GPU metrics in the dashboard your team already has open.

SDK

One line to attach

Behavioural monitoring attached to any agent in a single call. Evaluation mode requires no key and no account.

WHAT HAPPENS WHEN AN AGENT DRIFTS
01Eight quality dimensions scored against the deployed baseline
02Drift detected in under five minutes and attributed to a cause
03Standard tier remediated autonomously; critical tier held for a human
04Decision, approver and outcome written to a hash-chained record
INSIGHTS

Notes from operating an agent fleet.

On utilisation that lies, drift that never alerts, and evidence obligations that arrive on a date rather than when a programme is ready.

FACTORY OPERATIONS · SEPTEMBER 2026 · 8 MIN

The most expensive GPU in your estate is a busy one

A cluster at eighty-five per cent utilisation serving a drifted agent has zero effective utilisation. The spend is entirely real. The outputs are wrong. Nothing alerted.

The utilisation conversation is the one everybody is having, and it is worth having. A hundred-thousand-GPU cluster represents several billion dollars of investment. At the utilisation figures that keep appearing in operator data, the large majority of it is idle at any given moment. That is a working capital problem wearing a technology costume, and the arithmetic is not in dispute.

But utilisation is a dangerous metric to optimise alone, because it is trivially gameable and because the worst state in an AI factory scores well on it.

The state nobody measures

Take a cluster running at eighty-five per cent. Any operator would be pleased with that number. Now suppose the agent it is serving has drifted — output quality down from the low nineties to the high sixties over a few hours, because a connector changed or an instruction was edited outside change control.

The effective utilisation of that cluster is zero. Everything it produces has to be redone, reviewed or discarded. You are paying full price for the compute and then paying again downstream to correct what it produced.

And nothing fired, because nothing crashed. No threshold was breached. The GPU metrics were perfect throughout — which is precisely the point. Infrastructure telemetry cannot see output quality, because output quality is not an infrastructure property.

Why the two numbers have to be multiplied

This is the argument for treating estate efficiency as utilisation multiplied by quality rather than utilisation alone.

The multiplication has a useful property: it cannot be gamed by running junk work to lift a chart. Fill idle capacity with low-quality output and the composite does not improve. It is also the number a board can be given without a page of caveats, because it collapses the two things that actually determine whether the asset is productive.

  • High utilisation, high quality. The asset is working. Scale it.
  • Low utilisation, high quality. Idle capital. Recoverable, and the cheapest capacity you will ever acquire.
  • High utilisation, low quality. The expensive state. Paying twice and generating downstream cleanup.
  • Low utilisation, low quality. Rare, and usually means nobody owns it any more.

The detection problem underneath

None of this works without being able to measure output quality continuously, which is harder than measuring utilisation and is the reason most estates do not do it.

It requires scoring behaviour across several dimensions against the baseline the agent shipped with — semantic coherence, factual grounding, instruction adherence, tool call accuracy and so on — continuously rather than by sampling. And it requires causal attribution, because an anomaly flag with no cause attached generates a meeting rather than a fix.

Detecting drift in minutes instead of hours is worth more than the next ten points of utilisation, and costs a great deal less.

The capital argument

Finish on the comparison that matters, because it is the one that gets budget.

Ten points of utilisation on a hundred-thousand-GPU cluster is ten thousand GPUs. Buying that capacity costs in the region of three hundred million dollars and takes most of a year to land. Recovering the same capacity from hardware you already own is an operational exercise measured in weeks.

The gap between those two options is the entire business case, and it exists before you count the compute currently being spent on producing answers that are wrong.

Vyasa Murthy is the founder of Venture Vertex LLC.
Write to vyasa.murthy@venture-vertex.com — the most useful replies start with why this will not work in your environment.

SECURITY · SEPTEMBER 2026 · 7 MIN

Prompt injection is a behavioural signature, not a string

An agent whose objective has been corrupted mid-session passes every individual inspection. The attack is not in any single message — it is in the shape of the session.

Most prompt injection defences are content filters wearing a new name. A library of known malicious phrasings, some regular expressions, maybe a classifier trained on the phrasings that have been published so far.

That approach has a structural ceiling, and everyone building it knows what it is: it catches what it has seen. Rephrase the instruction, encode it, split it across turns, or embed it in a document the agent retrieves, and the filter has nothing to match on.

The attacks that actually matter in a fleet

The categories that concern me in a production agent estate are not the ones that arrive in the first user message. They are the ones that develop mid-session.

  • Goal hijacking. An agent's objective is corrupted through an adversarial tool response. It continues operating, competently, toward a different aim than the one it was given.
  • Session memory corruption. Context poisoned gradually across turns. Each turn is clean in isolation. The corruption exists only in the accumulation.
  • Indirect injection. The payload arrives in retrieved content the agent was authorised to read, from a source that was legitimate when it was approved.

What these share is that no single observation is anomalous. Inspect any individual turn and it passes. The attack is a property of the sequence, which is why perimeter tooling — which sees instructions arrive and results leave — is structurally unable to detect it. Not badly implemented. Standing in the wrong place.

The behavioural alternative

If the attack manifests as a change in how an agent behaves, then measure how the agent behaves and watch for the change. That sounds obvious and it is, but it requires two things most monitoring does not have.

First, a baseline. Not a policy describing what the agent should do, but a statistical picture of what it actually does when operating normally — across coherence, grounding, instruction adherence, tool call patterns and completion shape.

Second, drift detection against that baseline rather than against a fixed threshold. The signature of a corrupted objective is a sustained departure from the agent's own normal behaviour, which is exactly the shape statistical process control was built to find.

Why this generalises

The property that makes the behavioural approach worth the additional complexity is that it does not depend on having seen the attack before.

A novel phrasing still has to produce a behavioural change to accomplish anything. If it does not change behaviour, it did not work.

That is the whole argument. Content scanning generalises poorly because language is infinitely variable. Behavioural detection generalises well because the attacker's objective is constrained: to achieve anything at all, they have to make the agent do something it would not otherwise do.

The practical caveat

Behavioural detection has its own failure mode, and it is worth naming. Legitimate change also looks like drift. A new tool version, an updated system instruction, a shifted traffic mix will all move the baseline.

Which is why detection is only half of it. Without causal attribution — the ability to say this drift began when this specific thing changed — you generate a stream of alerts that operations learns to ignore inside a month. Attribution is what makes the signal actionable, and it is also what tells you, quickly, that the cause was an ordinary deployment rather than an adversary.

Vyasa Murthy is the founder of Venture Vertex LLC.
Write to vyasa.murthy@venture-vertex.com — the most useful replies start with why this will not work in your environment.

COMPLIANCE · AUGUST 2026 · 6 MIN

Article 12 is a date, not an ambition

Evidence assembled before an audit is a documentation project. Evidence produced by the system running is a by-product. Only one of those survives contact with a date.

There is a familiar pattern in how large organisations handle a regulatory deadline. The obligation is identified, a programme is stood up, artefacts are assembled, and a binder is produced shortly before the date. It works, more or less, for obligations that are about documenting a stable system.

It does not work for obligations about what a system did, because you cannot assemble a record of events that were never recorded.

Three obligations, one property

The EU AI Act provisions that matter most for a production agent estate share a characteristic worth noticing.

  • Article 12 — record keeping. Automatic logging of events over the system's lifetime, with traceability appropriate to the intended purpose.
  • Article 14 — human oversight. Evidence that a natural person could and did oversee operation, including the ability to intervene.
  • Article 11 — technical documentation. Documentation kept current, not produced once at conformity assessment.

Every one of them is about the operating period rather than the system's design. That means the compliance question is not whether you can produce a document by the date. It is whether the events of the preceding period were recorded as they happened.

If they were not, no programme can retrofit them. That is the whole difficulty, and it is the part that tends to be understood late.

What a human oversight record actually needs

Article 14 is the one most often misread as a policy requirement. Institutions write a procedure describing how humans oversee the system and consider the obligation addressed.

A procedure is not evidence of oversight. An evidentiary record needs the decision that was presented, the person who reviewed it, what they decided, the rationale, the timestamp, and what happened next. Produced at the moment of oversight, not reconstructed from memory and a calendar invite.

Which has a design consequence people do not always like: if your remediation is fully autonomous for everything, you have no human oversight records to produce. Tiering matters — autonomous where the consequence is low, a named human where it is not — and the human tier is where the Article 14 evidence comes from.

The by-product principle

The only approach I have seen survive is to stop treating evidence as an output of a compliance process and start treating it as an output of the system operating.

If producing the evidence requires a project, you will be producing it late, incompletely, and for the last period rather than the current one.

When the audit log is hash-chained at write time, when every oversight decision is captured at the point of decision, and when the technical documentation is generated from live configuration rather than maintained by hand, the compliance position is a query rather than a programme.

The commercial reading

The penalties get quoted most often, and they are substantial. But for operators I have spoken with, the sharper exposure is different: an inability to demonstrate compliance stalls deployment.

The programme does not get fined. It gets paused, while governance catches up — and the business case for the whole estate pauses with it. That is the outcome worth spending money to avoid, and it is considerably more expensive than the instrumentation that prevents it.

Vyasa Murthy is the founder of Venture Vertex LLC.
Write to vyasa.murthy@venture-vertex.com — the most useful replies start with why this will not work in your environment.

Three problems. One operating system.

Twenty minutes, your cluster profile, a live walkthrough of all five capability areas, and an ROI waterfall built on your numbers rather than ours.

Enterprise AI platform teams, neocloud operators and GPUaaS providers.