Crucible™
Crucible is an evaluation harness for agentic systems. Capture a full agent run, score it against a versioned rubric with an automated judge, track quality over time, and export evidence – so you ship what survives, not what you hope works.
An agent's real behaviour is unknown until it happens in production. 'It looked fine in a few manual runs' is the whole quality bar, and a regression only shows up once it's live.
Every agent run is scored against a versioned rubric before it ships. You keep only what clears the bar, catch regressions as scores move, and export the evidence that proves it.
Crucible is the gate between a promising agent and a trusted one – the pre-production check that lets you put a governed agent into the stack on evidence, not optimism.
Crucible defines what "correct" looks like across a whole agent trajectory, scores it automatically, and turns the result into evidence. Five stages, wired end to end.
Capture the run
A full agent execution trajectory is captured as an immutable artefact – every step, not just the final answer.
Define "correct"
Evaluation criteria are versioned, declarative rubrics – goal adherence, output quality, and whatever else matters for that agent – with weights and thresholds.
Score it
An automated judge scores each rubric dimension; a weighted composite gives a single pass/fail verdict, with per-dimension rationale and regression detection over time.
Export evidence
Results export as evidence reports (JSON / CSV / PDF) for governance and compliance – the artefact you attach when someone asks "how do you know it's safe?"
You don't have to take the scoring on faith, and you don't need an API key to see it. Crucible ships a one-command demo that runs the whole pipeline with a deterministic judge – byte-identical output every run.
# no API keys – a deterministic judge, reproducible output register agent → load rubric → capture trace → evaluate goal_adherence ....... 0.86 PASS output_quality ....... 0.79 PASS safety ............... 0.94 PASS ──────────────────────────────── composite ............ 0.85 PASS (threshold 0.75)
The full pipeline, keyless and reproducible – see the scoring end to end before you wire in a real judge.
SYNTHERA is the trust layer for multi-agent systems: every agent gets a verifiable identity, scoped authority and a tamper-evident record, so software from different teams, vendors and frameworks can act on each other’s behalf without custom glue between every pair.