Essays

Why we run our own benchmarks

Vendor benchmarks are run by the vendor, on the vendor's tasks, at launch. We re-run comparisons independently, publish the raw data, and update results as models change.