AI Solutions Engineering

A confident answer is not a defensible one.

Answers are cheap. Evidence is not. A working briefing on turning a hard question into an investigation that keeps a record every claim can be traced to.

Arjun Jaggi
Applied AI Researcher and Executive Advisor
October 16, 2026
The Gap Nobody Names

An agent hands you a fluent answer. It cannot tell you whether to believe it.

Ask a hard question and a confident paragraph arrives in seconds. What does not arrive is what the model weighed, what it skipped, or what it found that pointed the other way.

A fluent answer confident, in seconds The evidence it weighed The line it would not cross The trail to check it none of this is kept
01

No record of what it weighed

You cannot see the evidence it used, or the evidence it passed over.

02

No line it agreed not to cross

Nothing was committed in advance, so the answer cannot be proven wrong.

03

No way for anyone else to check

A reviewer who was not there is left with only the prose to trust.

Arjun Jaggi · AI Solutions Engineering02
Why Now

Fluency outran accountability. The gap between them is the problem

Agents are being handed real analysis and real decisions. The better the prose gets, the easier it is to trust an answer that nothing stands behind.

Fluency Accountability the gap Earlier Each model generation
Directional illustration. The shape of the trend, not measured values.
01

Confidence reads as correctness

A well-written answer feels right, whether or not it holds up.

02

The stakes moved up

Agents now touch research, diligence, and decisions that have to stand up later.

03

Someone will ask how you know

A board, a customer, or a reviewer eventually asks for the basis. Prose is not a basis.

Arjun Jaggi · AI Solutions Engineering03
The Shift

Stop asking for an answer. Ask for an investigation

The fix is not a better prompt. It is a different shape of work, one that keeps a record as it goes. One tool built for exactly this is Zorp, a local research agent.

A prompt
Nothing kept
Question Answer

Fluent in seconds. It will not tell you whether to believe it, or what it found that pointed the other way.

An investigation
A record to answer to
Question› Registered intent› Sources› Evidence› Checkpoint› Answer

Every claim in the answer traces back to the record. It is checkable by someone who was not there.

Answers are cheap. Evidence is not.
Arjun Jaggi · AI Solutions Engineering04
Commit Before You Look

Say what would prove you wrong, before any evidence exists

Before Zorp gathers anything, it commits the hypothesis, the metric, and a kill threshold to a human-readable, hash-verified record. A run cannot quietly rewrite what it set out to test.

hypothesis metric threshold committed and hashed, before any evidence exists kill threshold attempt 1 within threshold recorded attempt 2 conflicts with attempt 1 recorded anyway attempt 3 crosses the threshold KILLED. The record says why.
!

The kill threshold

A number, set in advance, that says what would prove the hypothesis wrong.

Who holds the line

The agent never proposes the threshold. A human does, and only a human can move it. Every attempt is recorded, and when a run crosses the line, the record says why.

Arjun Jaggi · AI Solutions Engineering05
What the Answer Is Accountable To

Every claim resolves to a row, not a paragraph

Each investigation writes to a six-part evidence record. Measurements are typed values, not narrative, so a claim in the report resolves to a stored row rather than to a paragraph the model wrote about itself.

tracks the parent table preregistrations Committed hypothesis and threshold, hash-sealed. experiments Every attempt, including the one that ended the run. metrics Typed values, such as accuracy 0.87, not prose. checkpoints Each human yes or no, and when. validations Redundancy and feasibility, each with its citation.
Tracks is one investigation. Every claim in the report resolves to a row in one of these tables, checkable by someone who was not there.
Arjun Jaggi · AI Solutions Engineering06
The Human Is the Author of Record

Four capabilities, one loop, a human gate before each

Validate, investigate, co-write, and deliver. A human checkpoint sits between every step, because a research checkpoint has no safe default. The models can run entirely local, so nothing leaves the machine.

● HUMAN GATE
01Validate

Is the question worth investigating. Scored on redundancy and feasibility, each must cite evidence or score zero.

● HUMAN GATE
02Investigate

Gather evidence through staged, pre-registered attempts. One attempt per step, so each surfaces at a checkpoint.

● HUMAN GATE
03Co-write

Draft the artifact from the record. The model is handed only what was recorded, and cites only those figures.

● HUMAN GATE
04Deliver

Match the finished artifact to the right format and audience.

The author of record

The model drafts, but a human approves every step and signs the result. The human is always the author of record, never the agent.

Arjun Jaggi · AI Solutions Engineering07
Where It Runs

Local by default, and it does not care what field you are in

Point the loop at a model on your own hardware and the question, the sources, and the record never leave. The same loop runs a lab question and a market question, because it reasons about evidence, not about the subject.

YOUR MACHINE Local model open-weight, on your hardware Evidence record question, sources, attempts The loop Outside nothing sent
01

Nothing leaves

The question, the sources, and the evidence record all stay on the machine you run it on.

02

The loop is domain-agnostic

It checks evidence, redundancy, and feasibility. Those hold in any field, so one loop fits them all.

03

Safe for the sensitive work

Because nothing is sent out, you can point it at the questions you could never hand to an API.

Arjun Jaggi · AI Solutions Engineering08
What You Get Back

An answer you can defend, not just deliver

The record turns a confident paragraph into something a reviewer, a board, or a customer can check line by line, long after the run is done.

THE REPORT A claim[1] Another claim[2] A number[3] THE RECORD [1]a stored row [2]a stored row [3]a stored row every claim, a row
01

Defensible

Every claim traces to a stored row, not a sentence the model wrote about itself.

02

Auditable

Someone who was not there can follow the record and reach the same place.

03

Reproducible

The registered intent and the attempts re-run, so the result is not a one-off.

04

Honest about failure

A killed run is kept, with the threshold it crossed and the reason why.

Arjun Jaggi · AI Solutions Engineering09
The One Move

Take one decision that has to hold up. Run it as an investigation.

Do not boil the ocean. Pick a single question where being wrong is expensive, and put a record behind the answer before anyone acts on it.

01

Pick a question that must be defensible

One where someone will later ask how you know, and the honest answer today is a shrug.

02

Set the kill threshold first

With a human, before any evidence, say what would prove it wrong. Then let the agent look.

03

Run it and keep the record

Let every claim resolve to a row, and keep the attempts that failed alongside the one that held.

What you learn

The first investigation shows you how much of your current answer was confidence, and how much was evidence.

Arjun Jaggi · AI Solutions Engineering10
The Through-Line
A confident answer is not a defensible one. Own the evidence. Turn the question into an investigation, and keep the record every claim answers to.
Arjun Jaggi
Applied AI Researcher and Executive Advisor
Start a conversation →
The tool in this briefing
Zorp

A local research agent that turns a question into a preregistered investigation and an evidence record.

← → or click to advance · F for fullscreen
01 / 11
⛶ Fullscreen