Independent benchmarks, comparisons and field trials of AI models, agents and developer tools. Every result ships with its methodology and raw data.https://heldoutlabs.com/https://heldoutlabs.com/why-we-run-our-own-benchmarks/https://heldoutlabs.com/why-we-run-our-own-benchmarks/Vendor benchmarks are run by the vendor, on the vendor's tasks, at launch. We re-run comparisons independently, publish the raw data, and update results as models change.Wed, 28 Oct 2026 00:00:00 GMT