dudeinhawaii on GLM-5.3 Artificial Analysis Benchmarks

Comment on GLM-5.3 Artificial Analysis Benchmarks parent

It would make reading and comparing a bit easier if the data was sorted by a dimension.

Cost per task:

  Model                        Score    Cost / Task    Output Tokens / Task
  -------------------------------------------------------------------------
  Muse Spark 1.2 (xhigh)        56.8          $0.40                  30,430
  Gemini 3.7 Flash (high)       56.0          $0.40                  36,847
  GPT-5.6 Terra (max)           56.6          $0.51                  20,838
  GPT-5.6 Sol (high)            57.3          $0.52                   7,545
  GLM-5.2 (max)                 53.0          $0.56                  32,200
  GLM-5.3 (max)                 59.5          $0.68                  41,107
  GPT-5.5 (xhigh)               56.3          $0.69                  16,893
  Grok 4.6 (high)               60.9          $0.84                  21,735
  Kimi K3 (max)                 59.7          $0.84                  25,474
  GPT-5.6 Sol (xhigh)           59.0          $0.87                  11,098
  Qwen3.8 2.4T A95B             57.7          $0.95                  32,472
  Claude Opus 5 (medium)        58.6          $0.98                  12,459
  Qwen3.8 Max                   58.1          $1.13                  38,287
  GPT-5.6 Sol (max)             60.9          $1.23                  16,879
  Claude Opus 5 (high)          61.5          $1.52                  21,353
  Claude Opus 4.8 (max)         57.3          $1.65                  33,557

Benchmark score:

  Model                        Score    Cost / Task    Output Tokens / Task
  -------------------------------------------------------------------------
  Claude Opus 5 (high)          61.5          $1.52                  21,353
  GPT-5.6 Sol (max)             60.9          $1.23                  16,879
  Grok 4.6 (high)               60.9          $0.84                  21,735
  Kimi K3 (max)                 59.7          $0.84                  25,474
  GLM-5.3 (max)                 59.5          $0.68                  41,107
  GPT-5.6 Sol (xhigh)           59.0          $0.87                  11,098
  Claude Opus 5 (medium)        58.6          $0.98                  12,459
  Qwen3.8 Max                   58.1          $1.13                  38,287
  Qwen3.8 2.4T A95B             57.7          $0.95                  32,472
  Claude Opus 4.8 (max)         57.3          $1.65                  33,557
  GPT-5.6 Sol (high)            57.3          $0.52                   7,545
  Muse Spark 1.2 (xhigh)        56.8          $0.40                  30,430
  GPT-5.6 Terra (max)           56.6          $0.51                  20,838
  GPT-5.5 (xhigh)               56.3          $0.69                  16,893
  Gemini 3.7 Flash (high)       56.0          $0.40                  36,847
  GLM-5.2 (max)                 53.0          $0.56                  32,200

salamo 24d

This matches my experience with Sol. Read and thought for a while, and edited files, tested, edited again, then ran out of budget in a relatively short time. But its solution was very good and was done quickly, so all things equal I prefer that over something much more verbose like Deepseek.

Comments