Adapted from StartupAI source material dated May 12, 2026. This note explains the product judgment, not internal implementation details.
Source material: ADR-020
Opening thesis
We are rebuilding the engine that runs validation under the hood — for tighter control over reliability, cost, and what we can see when something goes wrong. The rule we set for ourselves: you should not feel it. Same workflow, same review points, same evidence rules. Here is why “change the engine, keep the promise” is the discipline that matters.
When “progress” becomes your problem
Anyone building on AI infrastructure is aiming at a moving target — frameworks shift, model behavior shifts, costs shift, and the real reliability lessons only show up in production. A product that cannot evolve internally either freezes too early or breaks the experience every time it improves.
That is the trap: a team improves performance and accidentally moves a gate, weakens an evidence boundary, or makes a recommendation harder to audit. The engineering story sounds like progress; you experience it as inconsistency. You should not have to relearn what a gate or a score means because we changed something you cannot even see.
Change the engine, hold the contract
So we treat the founder-facing promise as a contract the internals are not allowed to break. The workflow, the order of your review points, the way approvals request-approve-resume, the boundary between hypothesis and observed evidence, the durable record that stays the source of truth — those stay put. The engine underneath can change; the meaning of your validation cannot.
We also do not take this on vendor faith. Before committing, we measured the new approach on real runs and held it to the existing bar — lower cost and fewer moving parts, with quality at least as good. And we are rolling it out a phase at a time, most-proven first, each later phase earning its own verification rather than riding the last one’s success.
The honest part: during the switch we carry two engines in parallel, which is genuinely more complex for us. We took that on so the change is invisible to you — which is the whole point.
Judge the upgrade by the decisions
When a product advertises AI sophistication, ask whether the sophistication shows up as better decisions or just as impressive-sounding machinery. New internals only matter if they make the workflow more reliable, more auditable, and more cost-aware.
The useful filter is continuity. Reward the tool that can tell you what stayed stable, what improved, and how it checked that your decision loop still means what it meant yesterday — not the one that just names a shiny new framework.