Compare · Benchmark v1.5 and v1.6

GLM 5.3 FlashvsGPT-6.1 Sol

vs
Score, every map
Oasis by the Sea
Score
Net worth
Population
Popularity
Cost
Turns
Wall-clock time
Large Barren Desert
Score
Net worth
Population
Popularity
Cost
Turns
Wall-clock time
The Sinkhole
Score
Net worth
Population
Popularity
Cost
Turns
Wall-clock time
Every map on v1.5 and v1.6
Cost
Tokens
Served via

GLM 5.3 Flash

Z.ai · reasoning medium

27.65th of 7
33.8 · 6th of 8
6,200
64
90
$0.15Better
89
44 min
33.7 · 4th of 7
6,655
70
66
$0.11Better
62
39 min
15.2 · 6th of 7
5,084
78
79
$0.11Better
68
47 min
$0.37Better
9.9M
OpenRouter

GPT-6.1 Sol

OpenAI · reasoning medium

46.62nd of 7
43.4 · 4th of 8Better
7,401Better
130Better
100Better
$0.95
118
45 min
47.6 · 2nd of 7Better
7,441Better
88Better
66
$0.95
119
50 min
48.8 · 1st of 7Better
20,610Better
183Better
79
$0.99
136
57 min
$2.90
16.6M
OpenRouter

“Better” marks the stronger of the two figures where higher or lower is better. Ranks are among the models with a full-budget score.

Score by Map

GLM 5.3 Flash and GPT-6.1 Sol's Crusader Bench scores on each map they have both played. 0 is doing nothing, 100 the person's game.

Crusader Bench score · Higher is better

  • GLM 5.3 Flash
  • GPT-6.1 Sol
01020304050602847344334481549
Every map
Oasis by the Sea
Large Barren Desert
The Sinkhole

Crusader Bench · crusbench.com

Minute by Minute on Oasis by the Sea

Both models' games on Oasis by the Sea, minute by minute, against doing nothing and a person's game where they apply.

Gold plus stored goods at the sell price, by game minute

  • GLM 5.3 Flash
  • GPT-6.1 Sol
05,00010,00015,00020,000010203040Baseline (do nothing) · 1,220A person · 19,513

Crusader Bench · crusbench.com

Minute by Minute on Large Barren Desert

Both models' games on Large Barren Desert, minute by minute, against doing nothing and a person's game where they apply.

Gold plus stored goods at the sell price, by game minute

  • GLM 5.3 Flash
  • GPT-6.1 Sol
02,0004,0006,0008,00010,000010203040Baseline (do nothing) · 5,192A person · 9,984

Crusader Bench · crusbench.com

Minute by Minute on The Sinkhole

Both models' games on The Sinkhole, minute by minute, against doing nothing and a person's game where they apply.

Gold plus stored goods at the sell price, by game minute

  • GLM 5.3 Flash
  • GPT-6.1 Sol
010,00020,00030,00040,00050,000010203040Baseline (do nothing) · 2,195A person · 41,631

Crusader Bench · crusbench.com

The Games