The first hardware engineering benchmark built with the world’s most advanced hardware companies

HW-Bench measures frontier model performance on hardware engineering work across accuracy, cost and latency.

  • AMD
  • Anduril
  • SpaceX

Leaderboard

Fig. 02 · Leaderboard
Leaderboard, illustrative data. Sorted by Score (%).
RankModelPer-task scores
1
Model Ahigh
Provider A · Native CLI
Score72.4±2.1Cost$4.20Time13m 22sTokens65.1k
2
Model Bhigh
Provider B · Native CLI
Score66.8±1.9Cost$16Time20m 34sTokens81.2k
3
Model Amedium
Provider A · Native CLI
Score64.1±2.4Cost$1.10Time7m 35sTokens33.2k
4
Model Chigh
Provider C · Native CLI
Score59.6±2.2Cost$2.60Time4m 07sTokens20.3k
5
Model Dmedium
Provider D · API tools
Score55.2±2.6Cost$0.80Time5m 59sTokens44.8k
6
Model Ehigh
Provider E · Native CLI
Score51.0±2.5Cost$30Time35m 59sTokens126.8k
7
Model Blow
Provider B · Native CLI
Score47.3±2.8Cost$0.42Time1m 46sTokens6.0k
8
Model Cmini
Provider C · API tools
Score42.8±3.0Cost$0.15Time5m 17sTokens17.2k
9
Model Fmedium
Provider F · API tools
Score38.1±3.1Cost$0.07Time9m 47sTokens68.2k
10
Model Gmedium
Provider G · API tools
Score33.5±3.4Cost$0.35Time6m 12sTokens27.8k
11
Model Hlow
Provider H · API tools
Score27.9±3.6Cost$0.04Time5m 39sTokens28.3k
12
Model Imini
Provider I · API tools
Score21.6±4.0Cost$0.02Time5m 55sTokens19.1k
Illustrative data.
Fig. 03 · Intelligence vs speed and cost

Intelligence vs Speed and Cost

Model A (high) leads at 72.4%. Model A (medium) comes within 8 points, 4x cheaper. Illustrative data.

Frontier: the best score at each price Other models
Fig. 04 · Steps handed off

As of Sep 5, 2026, 1 of 13 steps can be handed off

Drag the two handles to set the bars, and press Play to watch the steps move as new models are released. Illustrative data.

Review bar 0.85Hand-off bar 0.95
Models released by Sep 5, 2026 · 8 models
Hand off: 1 step, 1.5 hHand off for review: 3 steps, 10.5 hStays with an engineer: 9 steps, 107 h
Each point is one atomic step of hardware work, placed by the hours and experience it takes an engineer today, and coloured by its best model's average score over five runs. Hours and experience are our engineers' estimates.