Head-to-head empirical ablation: One-Shot Ungated Nemotron (Arm A) vs. Referee-Gated + Tavily Closed
Loop (Arm B).
๐ Statistical Rigor &
Hypothesis Testing:
Fisher's Exact Test p = 1.2 ร 10โปโท confirms Arm B's pass rate gain (93.3% vs
13.3%) is statistically significant (Odds Ratio: 91.0x).
Cost per Usable Kernel3.6x$0.045 โ $0.012 per verified asset
Prompt
Filter:
Metric / Dimension
Arm A: One-Shot Ungated
Arm B: VeriKernel Closed Loop
Empirical Advantage
Arm A: Defect Interception Breakdown
80% Tripped
"Ungated LLMs produce code that compiles cleanly (88.5%), but fails silent physics &
determinism checks (80.8%) without our verification harness."
Arm B: Throughput Scaling vs Baseline
~20x Speedup
"Click any bar to inspect trial prompt variant, LLM reasoning chain, and Tavily recovery search
payload."
Arm B: Retries-to-Pass Distribution
93.3% Recovered
"86.7% of raw LLM attempts fail on pass 1, but iterative Referee diagnostic injection recovers
93.3% within 4 attempts."
Cost vs. Speedup Pareto Frontier
Pareto Optimal
"Arm A clusters at 0x usable speedup; Arm B achieves 11x-21x verified speedup at < $0.02
compute cost per kernel."
Trial Inspection
Verified Artifacts & Cryptographic
Certificate
โ Referee Certified
Export the referee-certified C++ kernel and markdown certificate containing the SHA-256 seal,
determinism diffs, Ghia RMSE, and pinned bandwidth benchmarks.
VeriKernel features a 3-tier architecture: (1) Live Containerized VM Backend with 8
pinned CPU cores, (2) In-Memory Availability Guardrails (IP rate limits, daily run
caps, cloud spend limits), and (3) Zero-Latency Static Fallback for GitHub Pages &
Netlify.
Note: For HTTPS-hosted deployments (GitHub Pages/Netlify), use an HTTPS backend URL (ngrok, Cloudflare
Tunnel or Caddy) to prevent Mixed Content security blocking.