Continuous assurance for AI SOC agents. Verify that every closure, escalation, and suppression was earned, using your own evidence.
▼ SCROLL TO TRACE
// Live agent trace
Your AI SOC analyst or triage agent makes hundreds of decisions per run. DetectTrace connects each trace to the security evidence the agent could see, then checks whether its claims were supported, whether required evidence was skipped, and whether its confidence was earned. A correct verdict reached for the wrong reason still gets flagged.
// How it works
Three steps from black-box agent to defensible decisions.
Connect your agent’s traces to the security evidence behind each case, so every decision is tied to what the agent could actually see.
Score reasoning, evidence coverage, and confidence on every case, and replay a regression suite whenever a model, prompt, or tool changes.
Get findings, trends, and a monthly assurance memo your leadership can act on, with each result linked to its evidence.
// What we catch
Agreement with analysts is a lagging indicator. These are the failures that verdict-only testing misses.
The verdict was correct, but a key claim has no backing in your telemetry. It is a latent failure waiting for a different alert.
The case was closed without the sign-in history, process tree, or consent record the investigation required.
A high-confidence benign closure that turned out to be wrong, flagged before it becomes an unsafe default.
A prompt or model change that quietly flips past decisions. Every analyst override becomes a replayable test.
Vendor-neutral by design. DetectTrace works alongside your security stack and your agent vendor, and does not replace either.
// Proof
See exactly what you receive. Every item below appears only when it is real.
What you receive
Headline metrics
Dimension scores (0–4)
All values are invented for illustration. They are not customer results or benchmarks. Tags show where each metric comes from: the open-source Community Edition, or the design-partner service. Dimension scores for grounding, correlation and conclusions are design-partner features.
What practitioners say
Case studies
Security & assurance commitments
// Community Edition
The Community Edition is public on GitHub under the MIT license and still in development. It reads your agent’s OpenTelemetry or Langfuse traces and your analysts’ verdicts, then writes a dashboard that opens offline. DetectTrace sends no telemetry and makes no update checks.
Free · self-hosted · MIT
Continuous assurance on your live cases
Requires traces from an agent you can instrument or export, plus analyst verdicts for the same cases. It cannot assess a closed third-party agent whose traces you cannot get. The Community Edition shows what changed, not why, and it does not fail builds.
Requires Python 3.11 or later and uv. The demo runs on synthetic data. A PyPI release is being prepared.
We are working with a small group of founding design partners. One agent, one alert class, built around your SOC, starting with a scoped Evaluation Sprint.