KAMI: Kamiwaza Agentic Merit Index (preview)

Performance Overview

730

Total Runs

68.2%

Avg Raw Score

67.9%

Avg Mean Accuracy

96.3%

Best Raw Score

95.7%

Best Mean Accuracy

9

Providers

Statistical Analysis Collapse

All ProvidersAMD MI300XAWS BedrockAlibaba CloudAnthropicGoogle AI StudioIntel Gaudi3KamiwazaNVIDIA H200OpenAIAll Performance LevelsExcellent (90%+)Good (80-89%)Fair (70-79%)Poor (<70%)

Provider Model Runs Mean Accuracy Std Dev RSE 95% t-CI Range Pooled Accuracy
OpenAI GPT-5 (Medium Reasoning) 8 95.7% ±0.41% ±26.7% (95.4%, 96.0%) 1.05% 95.7%
AMD MI300X Qwen3.5-27B 8 94.7% ±0.77% ±26.7% (94.1%, 95.4%) 2.11% 94.7%
AMD MI300X Qwen3.5-122B-A10B 8 93.1% ±0.83% ±26.7% (92.4%, 93.8%) 2.46% 93.1%
AMD MI300X GLM-4.6 8 92.6% ±1.15% ±26.7% (91.6%, 93.5%) 3.16% 92.6%
AMD MI300X DeepSeek-V3.1 8 92.2% ±1.16% ±26.7% (91.2%, 93.2%) 3.16% 92.2%
AMD MI300X Qwen3-Coder-480B-A35B-Instruct 8 91.9% ±1.01% ±26.7% (91.0%, 92.7%) 2.98% 91.9%
AMD MI300X Qwen3.5-397B-A17B 8 90.8% ±0.71% ±26.7% (90.2%, 91.4%) 2.46% 90.8%
AMD MI300X Gemma4-31B (Thinking) 8 90.4% ±1.12% ±26.7% (89.5%, 91.3%) 3.16% 90.4%
AWS Bedrock Qwen3-235B-A22B-Instruct-2507 8 90.4% ±1.35% ±26.7% (89.2%, 91.5%) 3.68% 90.4%
NVIDIA H200 MiniMax-M2 8 89.9% ±1.01% ±26.7% (89.0%, 90.7%) 2.81% 89.9%
AWS Bedrock Claude 4.5 Sonnet 8 89.6% ±1.18% ±26.7% (88.6%, 90.6%) 3.51% 89.6%
OpenAI GPT-5.2 (Medium Reasoning) 8 89.1% ±1.60% ±26.7% (87.7%, 90.4%) 5.09% 89.1%
NVIDIA H200 DeepSeek-V3.1 8 88.9% ±1.11% ±26.7% (87.9%, 89.8%) 3.86% 88.9%
AMD MI300X Qwen3-235B-A22B-Instruct-2507-FP8 8 88.8% ±1.19% ±26.7% (87.8%, 89.7%) 3.33% 88.8%
Intel Gaudi3 Qwen3-235B-A22B-Instruct-2507 8 88.4% ±1.43% ±26.7% (87.2%, 89.6%) 3.51% 88.4%
AMD MI300X Qwen3-235B-A22B-Instruct-2507 8 88.2% ±1.54% ±26.7% (87.0%, 89.5%) 4.21% 88.2%
AMD MI300X GLM-4.5 8 88.1% ±1.43% ±26.7% (86.9%, 89.3%) 4.21% 88.1%
AMD MI300X Qwen3.5-9B 8 88.1% ±1.25% ±26.7% (87.1%, 89.2%) 3.51% 88.1%
Google AI Studio Gemini 3 Pro Preview 8 87.9% ±1.20% ±26.7% (86.9%, 88.9%) 3.86% 87.9%
Alibaba Cloud Qwen3-Max (2025-09-23) 8 87.7% ±0.90% ±26.7% (86.9%, 88.4%) 2.63% 87.7%
AMD MI300X Qwen3.5-35B-A3B 8 87.4% ±0.90% ±26.7% (86.6%, 88.1%) 2.81% 87.4%
OpenAI GPT-5 Mini (Medium Reasoning) 8 86.2% ±1.85% ±26.7% (84.6%, 87.7%) 4.74% 86.2%
NVIDIA H200 MiniMax-M2.1 8 85.9% ±1.21% ±26.7% (84.9%, 86.9%) 3.33% 85.9%
Google AI Studio Gemini 2.5 Pro 8 83.9% ±1.08% ±26.7% (83.0%, 84.8%) 3.33% 83.9%
AWS Bedrock Qwen3-Next-80B-A3B-Instruct 8 83.8% ±0.73% ±26.7% (83.2%, 84.4%) 2.28% 83.8%
Alibaba Cloud Qwen-Plus (2025-09-11) 8 83.8% ±0.66% ±26.7% (83.2%, 84.3%) 1.93% 83.8%
AMD MI300X Qwen3-Next-80B-A3B-Instruct 8 82.2% ±0.79% ±26.7% (81.6%, 82.9%) 2.63% 82.2%
AMD MI300X GLM-4.7 8 81.5% ±1.67% ±26.7% (80.1%, 82.9%) 5.26% 81.5%
Kamiwaza Kimi K2 (Thinking) 6 79.8% ±1.03% ±31.6% (78.7%, 80.9%) 2.98% 79.8%
AMD MI300X Gemma4-31B 8 79.5% ±1.30% ±26.7% (78.5%, 80.6%) 4.74% 79.5%
AWS Bedrock Llama-3.3-70B-Instruct 8 78.2% ±1.42% ±26.7% (77.1%, 79.4%) 4.04% 78.2%
Google AI Studio Gemini 2.5 Flash 8 77.3% ±1.03% ±26.7% (76.4%, 78.1%) 3.16% 77.3%
OpenAI GPT-5.1 (Medium Reasoning) 4 76.2% ±2.23% ±40.8% (72.6%, 79.7%) 4.74% 76.2%
Anthropic Claude 3.5 Haiku 3 75.8% ±1.36% ±50.0% (72.5%, 79.2%) 2.63% 75.8%
AMD MI300X GLM-4.5 Air 5 75.3% ±1.56% ±35.4% (73.4%, 77.3%) 4.21% 75.3%
AMD MI300X Gemma4-26B-A4B (Thinking) 8 75.3% ±1.90% ±26.7% (73.7%, 76.9%) 6.32% 75.3%
AMD MI300X Qwen3.5-4B 8 75.0% ±1.16% ±26.7% (74.1%, 76.0%) 3.16% 75.0%
NVIDIA H200 Mistral Large 3 675B-Instruct-2512 8 75.0% ±0.95% ±26.7% (74.2%, 75.8%) 2.81% 75.0%
AMD MI300X Llama 4 Maverick 17Bx128E 8 74.6% ±0.93% ±26.7% (73.8%, 75.3%) 2.81% 74.6%
AMD MI300X Llama-3.3-70B-Instruct-FP8-KV 8 74.5% ±1.61% ±26.7% (73.2%, 75.9%) 5.26% 74.5%
AWS Bedrock Llama 4 Maverick 17Bx128E 8 74.2% ±1.56% ±26.7% (72.9%, 75.5%) 4.74% 74.2%
Alibaba Cloud Qwen3-Max-Preview 8 74.2% ±0.75% ±26.7% (73.6%, 74.8%) 2.46% 74.2%
AWS Bedrock Claude 3.5 Haiku 5 74.0% ±0.78% ±35.4% (73.0%, 75.0%) 1.75% 74.0%
AMD MI300X Llama-3.1-70B-Instruct 8 73.4% ±1.46% ±26.7% (72.2%, 74.7%) 4.74% 73.4%
AMD MI300X Llama 4 Maverick 17Bx128E FP8 8 73.1% ±1.60% ±26.7% (71.8%, 74.5%) 4.74% 73.1%
AMD MI300X Qwen3-30B-A3B (Thinking) 8 72.7% ±1.40% ±26.7% (71.6%, 73.9%) 3.86% 72.7%
AMD MI300X Llama-3.3-70B-Instruct 8 71.6% ±1.51% ±26.7% (70.4%, 72.9%) 5.44% 71.6%
AMD MI300X Qwen2.5-72B-Instruct 7 71.1% ±0.78% ±28.9% (70.4%, 71.8%) 2.46% 71.1%
AMD MI300X Qwen3-30B-A3B-Instruct-2507 8 69.6% ±0.80% ±26.7% (69.0%, 70.3%) 2.63% 69.6%
Intel Gaudi3 Qwen3-30B-A3B-Instruct-2507 8 69.3% ±0.89% ±26.7% (68.6%, 70.1%) 2.81% 69.3%
AMD MI300X Qwen3-14B (Thinking) 8 69.1% ±1.54% ±26.7% (67.8%, 70.4%) 4.39% 69.1%
AWS Bedrock Nova Premier 8 68.1% ±1.38% ±26.7% (66.9%, 69.2%) 4.39% 68.1%
Alibaba Cloud Qwen-Flash (2025-07-28) 8 68.1% ±1.51% ±26.7% (66.8%, 69.4%) 4.74% 68.1%
Intel Gaudi3 Qwen3-235B-A22B 8 67.7% ±1.17% ±26.7% (66.7%, 68.6%) 3.33% 67.7%
AMD MI300X Qwen3-32B (Thinking) 8 67.6% ±2.13% ±26.7% (65.8%, 69.4%) 6.32% 67.6%
AMD MI300X Qwen2.5-14B-Instruct 8 66.6% ±1.19% ±26.7% (65.6%, 67.6%) 3.16% 66.6%
AMD MI300X Qwen3-Coder-30B-A3B-Instruct 8 65.2% ±1.22% ±26.7% (64.2%, 66.3%) 3.86% 65.2%
AMD MI300X Gemma4-26B-A4B 8 64.5% ±2.44% ±26.7% (62.5%, 66.6%) 6.84% 64.5%
AMD MI300X Llama 4 Scout 17Bx16E 8 64.1% ±1.66% ±26.7% (62.7%, 65.4%) 4.91% 64.1%
AMD MI300X Qwen3-32B-FP8 8 63.7% ±0.86% ±26.7% (63.0%, 64.4%) 2.63% 63.7%
AMD MI300X Qwen3-8B (Thinking) 8 62.5% ±1.81% ±26.7% (61.0%, 64.1%) 5.09% 62.5%
AMD MI300X Qwen3-32B 8 61.6% ±0.89% ±26.7% (60.8%, 62.3%) 2.81% 61.6%
AMD MI300X Qwen3-14B-FP8 8 60.0% ±0.66% ±26.7% (59.5%, 60.5%) 1.75% 60.0%
Intel Gaudi3 Qwen3-4B-Instruct-2507 8 60.0% ±1.04% ±26.7% (59.1%, 60.9%) 2.81% 60.0%
AMD MI300X Qwen3-4B-Instruct-2507 8 59.9% ±1.01% ±26.7% (59.1%, 60.8%) 3.16% 59.9%
Intel Gaudi3 Qwen3-32B 8 59.7% ±1.32% ±26.7% (58.6%, 60.8%) 3.33% 59.7%
AMD MI300X DeepSeek-V3 8 59.4% ±0.39% ±26.7% (59.0%, 59.7%) 1.05% 59.4%
Intel Gaudi3 Mistral Large Instruct 2411 8 58.9% ±1.58% ±26.7% (57.6%, 60.2%) 4.56% 58.9%
AMD MI300X Qwen3-14B 8 58.7% ±0.68% ±26.7% (58.2%, 59.3%) 1.75% 58.8%
AMD MI300X Granite 4.0H Small 8 58.5% ±0.99% ±26.7% (57.7%, 59.3%) 2.63% 58.5%
AMD MI300X Qwen3-30B-A3B 8 58.1% ±0.88% ±26.7% (57.4%, 58.8%) 2.28% 58.1%
AWS Bedrock Nova Lite 8 57.4% ±1.36% ±26.7% (56.3%, 58.6%) 4.21% 57.4%
Google AI Studio Gemini 2.0 Flash 8 56.0% ±1.73% ±26.7% (54.5%, 57.4%) 5.61% 56.0%
AMD MI300X Qwen2.5-32B-Instruct 8 55.9% ±1.29% ±26.7% (54.8%, 57.0%) 3.86% 55.9%
Intel Gaudi3 Phi-4 7 54.8% ±1.30% ±28.9% (53.6%, 56.0%) 3.86% 54.8%
AWS Bedrock Nova Pro 8 53.8% ±1.21% ±26.7% (52.8%, 54.8%) 2.98% 53.8%
Google AI Studio Gemini 2.5 Flash-Lite 8 53.8% ±1.67% ±26.7% (52.4%, 55.1%) 4.91% 53.8%
AMD MI300X Gemma4-E4B 8 51.8% ±2.77% ±26.7% (49.5%, 54.2%) 9.47% 51.8%
OpenAI GPT-4.1 8 50.8% ±1.25% ±26.7% (49.7%, 51.8%) 3.33% 50.8%
AMD MI300X Qwen3-4B (Thinking) 8 50.5% ±1.55% ±26.7% (49.2%, 51.8%) 4.21% 50.5%
AMD MI300X Qwen3-8B 5 49.1% ±0.99% ±35.4% (47.8%, 50.3%) 2.63% 49.1%
AMD MI300X Qwen3.5-2B 8 48.6% ±1.65% ±26.7% (47.2%, 50.0%) 5.26% 48.6%
OpenAI GPT-5.1 8 48.2% ±2.41% ±26.7% (46.2%, 50.2%) 6.84% 48.2%
AMD MI300X Gemma4-E4B (Thinking) 8 45.9% ±2.71% ±26.7% (43.7%, 48.2%) 7.37% 45.9%
Google AI Studio Gemini 2.0 Flash-Lite 8 45.6% ±1.31% ±26.7% (44.5%, 46.7%) 4.21% 45.6%
AWS Bedrock Claude 4.5 Haiku 8 45.4% ±0.87% ±26.7% (44.7%, 46.1%) 2.46% 45.4%
AMD MI300X Qwen2.5-7B-Instruct 8 41.6% ±1.21% ±26.7% (40.5%, 42.6%) 3.68% 41.6%
AWS Bedrock Nova Micro 7 38.5% ±1.86% ±28.9% (36.8%, 40.2%) 5.79% 38.5%
AMD MI300X Qwen3-4B 3 37.8% ±1.41% ±50.0% (34.3%, 41.3%) 2.81% 37.8%
OpenAI GPT-5 Nano (Medium Reasoning) 8 28.9% ±1.17% ±26.7% (27.9%, 29.9%) 3.68% 28.9%
AWS Bedrock Nova 2 Lite 8 28.1% ±0.84% ±26.7% (27.4%, 28.8%) 2.46% 28.1%
AMD MI300X Granite 4.0H Tiny 8 27.3% ±1.73% ±26.7% (25.8%, 28.7%) 5.44% 27.3%
AMD MI300X Granite 4.0H Micro 8 17.1% ±0.75% ±26.7% (16.4%, 17.7%) 2.11% 17.1%
AMD MI300X Qwen3.5-0.8B 8 11.3% ±0.47% ±26.7% (10.9%, 11.7%) 1.58% 11.3%
AMD MI300X Llama-3.1-8B-Instruct 6 10.5% ±0.95% ±31.6% (9.5%, 11.5%) 2.46% 10.5%

Performance Heatmap Collapse

All ProvidersAMD MI300XAWS BedrockAlibaba CloudAnthropicGoogle AI StudioIntel Gaudi3KamiwazaNVIDIA H200OpenAIAll Scores90%+ (Excellent)80-89% (Very Good)70-79% (Good)60-69% (Fair)<60% (Poor)

Basic Sanity Check

Q101 Q102

Filesystem Tasks

Q201 Q202

Finding Needles in Text Files

Q301 Q302 Q303 Q304

CSV Processing

Q401 Q402 Q403

Database Processing

Q501 Q502 Q503

DB Proc (Easy/Hinted)

Q601 Q602

Instruction Following /

Output Formatting

Q701 Q702 Q703

Select AllClear AllSort by Overall ScoreSort by ProviderSort by Model Name

Performance Scale:

0-8

9-14

15-22

23-29

30 (Perfect)

Provider Model Q101 Q102 Q201 Q202 Q301 Q302 Q303 Q304 Q401 Q402 Q403 Q501 Q502 Q503 Q601 Q602 Q701 Q702 Q703 Total
AMD MI300X deepseek_v3_1_run1 30 30 30 30 27 30 27 20 30 20 30 30 14 20 30 27 30 30 30 515
AMD MI300X deepseek_v3_1_run2 30 30 30 30 29 30 27 20 30 26 30 30 16 26 30 25 30 30 30 529
AMD MI300X deepseek_v3_1_run3 30 30 30 30 30 30 24 21 30 29 30 30 20 21 30 28 30 30 30 533
AMD MI300X deepseek_v3_1_run4 30 30 30 30 28 30 27 23 30 23 29 30 15 29 30 28 30 30 30 532
AMD MI300X deepseek_v3_1_run5 30 30 30 30 29 30 27 21 30 27 29 30 18 24 29 25 30 30 30 529
AMD MI300X deepseek_v3_1_run6 30 30 30 29 29 29 24 20 30 26 30 30 12 23 30 28 30 30 30 520
AMD MI300X deepseek_v3_1_run7 30 30 30 30 30 30 26 22 30 20 30 30 19 27 30 23 30 30 30 527
AMD MI300X deepseek_v3_1_run8 30 30 30 30 29 30 24 21 30 23 29 30 13 24 30 26 30 30 30 519
AMD MI300X deepseek_v3_run1 30 30 30 30 30 28 0 0 4 6 6 15 9 26 30 1 30 0 30 335
AMD MI300X deepseek_v3_run2 30 30 30 30 30 28 0 0 4 2 8 18 10 28 30 3 30 0 30 341
AMD MI300X deepseek_v3_run3 30 30 30 29 30 30 0 1 7 3 8 14 9 24 30 2 30 0 30 337
AMD MI300X deepseek_v3_run4 30 30 30 30 30 29 0 0 7 5 7 14 10 27 30 2 30 0 30 341
AMD MI300X deepseek_v3_run5 30 30 30 29 30 30 1 0 6 4 7 15 6 27 30 2 30 0 30 337
AMD MI300X deepseek_v3_run6 30 30 30 30 30 29 0 2 6 4 4 15 10 25 30 2 30 0 30 337
AMD MI300X deepseek_v3_run7 30 30 30 29 30 30 1 1 5 5 3 17 8 28 30 3 30 0 30 340
AMD MI300X deepseek_v3_run8 30 30 30 30 30 30 0 1 6 1 9 20 4 27 30 1 30 0 30 339
AMD MI300X gemma_4_26b_a4b_it_run1 10 10 10 10 8 3 4 9 7 4 7 0 1 8 10 6 10 0 10 127
AMD MI300X gemma_4_26b_a4b_it_run2 10 10 10 10 4 3 2 9 7 8 5 0 0 6 9 5 10 0 10 118
AMD MI300X gemma_4_26b_a4b_it_run3 10 10 10 10 6 1 5 10 3 7 8 0 1 7 10 3 10 0 10 121
AMD MI300X gemma_4_26b_a4b_it_run4 10 10 10 10 8 2 4 9 2 7 4 0 1 7 10 3 10 0 10 117
AMD MI300X gemma_4_26b_a4b_it_run5 10 10 10 10 6 3 3 8 7 8 5 0 1 8 10 0 10 0 10 119
AMD MI300X gemma_4_26b_a4b_it_run6 10 10 10 9 10 4 3 6 7 8 4 0 1 8 10 4 10 0 10 124
AMD MI300X gemma_4_26b_a4b_it_run7 10 10 10 10 5 2 6 8 7 7 7 0 0 10 10 3 10 0 10 125
AMD MI300X gemma_4_26b_a4b_it_run8 10 10 10 10 9 1 5 7 10 7 6 0 2 8 10 5 10 0 10 130
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run1 10 10 10 10 10 10 8 7 10 1 5 7 3 10 10 4 10 0 10 145
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run2 10 10 10 10 10 10 6 3 9 5 4 9 3 8 10 5 10 0 10 142
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run3 10 10 10 10 10 10 6 4 10 4 3 8 4 9 10 4 10 0 10 142
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run4 10 10 10 10 10 10 8 2 10 5 1 8 4 8 10 3 10 0 10 139
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run5 10 10 10 10 9 10 8 4 10 5 7 10 3 9 10 6 10 0 10 151
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run6 10 10 10 10 10 10 8 5 9 6 3 7 2 8 10 5 10 0 10 143
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run7 10 10 10 10 10 10 6 5 10 2 6 7 4 10 10 2 10 0 10 142
AMD MI300X gemma_4_26b_a4b_it_thinkmode_run8 10 10 10 10 10 10 7 5 6 3 4 10 4 9 10 3 10 0 10 141
AMD MI300X gemma_4_31b_it_run1 10 10 10 10 10 10 10 9 10 2 10 7 0 10 10 2 10 0 10 150
AMD MI300X gemma_4_31b_it_run2 10 10 10 10 10 10 10 10 10 3 10 10 2 10 10 1 10 0 10 156
AMD MI300X gemma_4_31b_it_run3 10 10 10 10 10 10 10 8 10 2 10 6 0 10 10 1 10 0 10 147
AMD MI300X gemma_4_31b_it_run4 10 10 10 10 10 10 10 10 10 3 10 4 0 10 10 5 10 0 10 152
AMD MI300X gemma_4_31b_it_run5 10 10 10 10 10 10 10 10 10 1 10 7 1 10 10 2 10 0 10 151
AMD MI300X gemma_4_31b_it_run6 10 10 10 10 10 10 10 10 10 3 10 4 2 10 10 2 10 0 10 151
AMD MI300X gemma_4_31b_it_run7 10 10 10 10 10 10 10 9 10 3 10 6 2 10 10 1 10 0 10 151
AMD MI300X gemma_4_31b_it_run8 10 10 10 10 10 10 10 10 10 1 10 7 0 10 10 3 10 0 10 151
AMD MI300X gemma_4_31b_it_thinkmode_run1 10 10 10 9 10 10 9 10 10 7 10 6 8 10 10 10 10 0 10 169
AMD MI300X gemma_4_31b_it_thinkmode_run2 10 10 10 9 10 10 9 10 10 5 10 9 10 10 10 10 10 0 10 172
AMD MI300X gemma_4_31b_it_thinkmode_run3 10 10 10 9 10 10 8 10 10 10 10 9 10 10 10 9 10 0 10 175
AMD MI300X gemma_4_31b_it_thinkmode_run4 10 10 10 9 10 10 9 10 10 6 10 10 10 10 10 10 10 0 10 174
AMD MI300X gemma_4_31b_it_thinkmode_run5 10 10 10 8 10 10 8 10 10 7 10 8 10 9 10 10 10 0 10 170
AMD MI300X gemma_4_31b_it_thinkmode_run6 10 10 10 10 9 10 9 10 9 8 10 9 10 10 10 9 10 0 10 173
AMD MI300X gemma_4_31b_it_thinkmode_run7 10 10 10 9 10 10 7 10 10 6 10 8 10 10 10 10 10 0 10 170
AMD MI300X gemma_4_31b_it_thinkmode_run8 10 10 10 8 10 10 8 9 10 7 10 9 10 10 10 10 10 0 10 171
AMD MI300X gemma_4_e4b_it_run1 10 10 10 10 8 1 3 4 8 2 2 5 0 6 10 0 10 0 10 109
AMD MI300X gemma_4_e4b_it_run2 10 10 10 10 6 2 1 1 8 3 2 1 0 4 8 0 10 0 10 96
AMD MI300X gemma_4_e4b_it_run3 10 10 10 10 4 1 5 2 5 1 2 3 0 7 10 0 10 0 10 100
AMD MI300X gemma_4_e4b_it_run4 10 10 10 10 8 0 4 3 4 0 1 5 2 6 8 0 10 0 10 101
AMD MI300X gemma_4_e4b_it_run5 10 10 10 10 5 1 3 0 6 2 0 3 0 5 10 0 10 0 10 95
AMD MI300X gemma_4_e4b_it_run6 10 10 10 10 6 2 4 2 3 2 1 1 1 6 10 0 10 0 10 98
AMD MI300X gemma_4_e4b_it_run7 10 10 10 10 6 1 3 0 6 2 1 3 0 6 10 0 10 0 10 98
AMD MI300X gemma_4_e4b_it_run8 10 10 10 10 6 1 2 1 5 1 2 1 0 3 9 0 10 0 10 91
AMD MI300X gemma_4_e4b_it_thinkmode_run1 10 10 9 9 3 4 2 1 3 0 0 5 1 8 7 0 7 0 10 89
AMD MI300X gemma_4_e4b_it_thinkmode_run2 10 10 9 10 3 7 3 2 6 0 0 3 2 5 5 1 4 0 10 90
AMD MI300X gemma_4_e4b_it_thinkmode_run3 10 10 8 10 3 7 3 0 7 0 0 5 0 5 3 1 9 0 10 91
AMD MI300X gemma_4_e4b_it_thinkmode_run4 10 10 8 10 3 3 1 1 2 0 1 4 1 4 5 2 7 0 10 82
AMD MI300X gemma_4_e4b_it_thinkmode_run5 10 10 7 9 6 7 2 1 2 0 2 7 0 7 3 3 8 0 10 94
AMD MI300X gemma_4_e4b_it_thinkmode_run6 10 10 9 10 6 5 2 0 2 0 0 6 0 6 3 2 9 0 10 90
AMD MI300X gemma_4_e4b_it_thinkmode_run7 10 10 8 9 3 5 2 0 2 0 0 3 0 7 3 2 6 0 10 80
AMD MI300X gemma_4_e4b_it_thinkmode_run8 10 10 9 9 5 2 2 0 4 0 2 5 0 3 4 1 6 0 10 82
AMD MI300X glm_4_5_air_run1 30 30 30 29 30 30 18 3 13 20 23 26 17 30 26 27 29 1 30 442
AMD MI300X glm_4_5_air_run2 30 30 30 29 30 30 16 1 10 21 25 23 15 29 26 23 28 0 30 426
AMD MI300X glm_4_5_air_run3 29 30 29 30 30 29 15 0 10 20 24 24 16 29 23 23 27 0 30 418
AMD MI300X glm_4_5_air_run4 30 30 30 29 30 30 14 4 13 20 27 25 14 28 25 22 27 0 30 428
AMD MI300X glm_4_5_air_run5 30 30 30 30 30 30 20 1 12 21 25 26 16 29 25 20 28 0 30 433
AMD MI300X glm_4_5_run1 30 30 30 30 30 30 23 9 22 16 28 30 23 29 29 26 29 30 30 504
AMD MI300X glm_4_5_run2 30 30 30 29 30 30 22 12 17 12 28 30 17 30 30 27 30 30 30 494
AMD MI300X glm_4_5_run3 30 30 30 30 30 30 19 9 18 14 28 30 21 30 30 27 30 30 30 496
AMD MI300X glm_4_5_run4 30 30 30 30 30 30 19 13 23 14 26 30 14 29 28 27 30 30 30 493
AMD MI300X glm_4_5_run5 30 30 30 29 30 30 18 15 27 9 28 30 24 30 30 29 30 30 30 509
AMD MI300X glm_4_5_run6 30 30 30 30 30 30 20 9 21 20 27 30 19 30 29 27 30 30 30 502
AMD MI300X glm_4_5_run7 30 30 30 30 30 30 18 12 23 16 30 30 16 30 30 29 30 30 30 504
AMD MI300X glm_4_5_run8 30 30 30 30 30 30 22 19 19 21 29 30 18 30 30 29 30 30 30 517
AMD MI300X glm_4_6_run1 30 30 30 30 30 30 21 11 29 30 30 30 21 30 30 30 30 30 30 532
AMD MI300X glm_4_6_run2 30 30 30 30 30 30 18 6 28 29 30 30 21 30 30 30 30 30 30 522
AMD MI300X glm_4_6_run3 30 30 30 30 30 30 22 8 29 29 30 30 23 30 30 30 30 30 30 531
AMD MI300X glm_4_6_run4 30 30 30 30 30 30 24 16 28 29 30 30 21 30 30 28 30 30 30 536
AMD MI300X glm_4_6_run5 30 30 30 30 30 29 21 11 26 29 30 30 21 30 30 29 30 30 30 526
AMD MI300X glm_4_6_run6 30 30 30 30 30 30 20 7 28 30 30 30 18 30 30 29 30 30 30 522
AMD MI300X glm_4_6_run7 30 30 30 30 30 30 16 8 26 29 30 30 20 30 30 29 30 30 30 518
AMD MI300X glm_4_6_run8 30 30 30 30 30 30 19 14 29 30 30 30 23 30 30 29 30 30 30 534
AMD MI300X glm_4_7_run1 10 10 10 10 10 4 0 0 6 8 10 10 8 10 10 9 10 10 10 155
AMD MI300X glm_4_7_run2 10 10 10 10 10 4 2 0 2 5 10 9 10 10 10 10 10 10 10 152
AMD MI300X glm_4_7_run3 10 10 10 10 10 2 2 1 5 8 10 7 5 10 10 9 10 10 10 149
AMD MI300X glm_4_7_run4 10 10 10 10 10 3 0 0 9 8 10 9 8 10 10 9 10 10 10 156
AMD MI300X glm_4_7_run5 10 10 10 10 10 3 2 0 8 6 10 9 7 10 10 10 10 10 10 155
AMD MI300X glm_4_7_run6 10 10 10 10 10 4 0 0 8 9 10 8 9 10 10 10 10 10 10 158
AMD MI300X glm_4_7_run7 10 10 10 10 9 5 1 0 8 8 9 8 8 10 10 9 10 10 10 155
AMD MI300X glm_4_7_run8 10 10 10 10 10 6 1 0 9 6 10 8 10 10 10 9 10 10 10 159
AMD MI300X granite_4_0_h_micro_run1 28 26 29 9 1 1 0 0 0 0 0 0 0 7 0 0 0 0 0 101
AMD MI300X granite_4_0_h_micro_run2 29 28 27 4 6 1 0 0 0 0 0 0 0 4 0 0 0 0 0 99
AMD MI300X granite_4_0_h_micro_run3 30 26 23 6 1 0 0 0 0 0 0 0 0 4 0 0 0 0 0 90
AMD MI300X granite_4_0_h_micro_run4 30 30 29 6 2 0 0 0 0 0 0 0 0 5 0 0 0 0 0 102
AMD MI300X granite_4_0_h_micro_run5 29 25 29 8 3 1 0 0 0 0 0 0 0 4 0 0 0 0 0 99
AMD MI300X granite_4_0_h_micro_run6 30 29 28 5 3 1 0 0 0 0 0 0 0 3 0 0 0 0 0 99
AMD MI300X granite_4_0_h_micro_run7 30 30 27 5 1 0 0 0 0 0 0 0 0 3 0 0 0 0 0 96
AMD MI300X granite_4_0_h_micro_run8 30 25 27 4 3 0 0 0 0 0 0 0 0 3 0 0 0 0 0 92
AMD MI300X granite_4_0_h_small_run1 29 30 29 29 24 24 0 0 0 1 2 13 5 19 30 5 30 27 30 327
AMD MI300X granite_4_0_h_small_run2 27 30 30 29 23 20 0 0 0 0 4 14 6 16 30 9 30 28 30 326
AMD MI300X granite_4_0_h_small_run3 30 30 29 27 29 21 0 0 0 1 1 16 8 15 30 12 30 30 30 339
AMD MI300X granite_4_0_h_small_run4 30 30 30 28 26 21 0 0 0 0 2 12 5 17 30 8 30 30 30 329
AMD MI300X granite_4_0_h_small_run5 30 30 29 29 28 24 0 0 0 0 3 14 6 18 30 8 30 28 30 337
AMD MI300X granite_4_0_h_small_run6 28 30 30 29 29 22 0 0 0 0 4 15 10 17 30 9 30 28 30 341
AMD MI300X granite_4_0_h_small_run7 30 29 30 29 24 20 0 0 0 0 3 21 3 22 30 4 30 28 30 333
AMD MI300X granite_4_0_h_small_run8 29 29 30 30 25 26 0 0 0 0 4 16 7 13 30 7 30 30 30 336
AMD MI300X granite_4_0_h_tiny_run1 27 25 27 0 27 4 0 0 2 0 0 0 0 5 25 0 17 5 9 173
AMD MI300X granite_4_0_h_tiny_run2 25 23 25 4 22 4 0 0 2 0 0 0 0 4 20 0 15 3 14 161
AMD MI300X granite_4_0_h_tiny_run3 25 28 24 1 27 7 0 0 0 0 0 0 0 0 15 0 13 7 8 155
AMD MI300X granite_4_0_h_tiny_run4 28 21 24 1 24 7 0 0 3 0 0 0 0 3 17 0 16 2 14 160
AMD MI300X granite_4_0_h_tiny_run5 23 23 26 1 24 5 0 0 2 0 1 0 0 3 17 0 14 8 9 156
AMD MI300X granite_4_0_h_tiny_run6 24 25 25 3 26 2 0 0 1 0 0 0 0 2 22 0 13 5 4 152
AMD MI300X granite_4_0_h_tiny_run7 26 25 25 2 24 4 0 0 0 0 0 0 0 0 17 0 9 4 8 144
AMD MI300X granite_4_0_h_tiny_run8 23 22 23 1 22 5 0 0 1 0 0 0 0 2 14 0 14 5 10 142
AMD MI300X llama_3_1_70b_instruct_run1 30 30 29 30 29 26 19 14 18 14 4 22 4 24 30 10 30 30 30 423
AMD MI300X llama_3_1_70b_instruct_run2 30 30 30 30 30 25 18 15 17 15 4 25 3 26 30 11 30 30 28 427
AMD MI300X llama_3_1_70b_instruct_run3 30 30 30 30 30 26 14 14 14 10 3 23 7 23 30 13 30 30 30 417
AMD MI300X llama_3_1_70b_instruct_run4 30 30 30 30 29 21 17 21 10 13 4 28 4 22 30 9 30 30 29 417
AMD MI300X llama_3_1_70b_instruct_run5 30 30 30 30 30 27 20 14 16 10 0 26 4 20 30 9 30 30 29 415
AMD MI300X llama_3_1_70b_instruct_run6 30 30 30 30 30 26 15 15 17 10 3 22 3 27 30 8 30 30 29 415
AMD MI300X llama_3_1_70b_instruct_run7 30 30 30 30 30 27 19 18 20 16 4 28 1 20 30 8 30 30 30 431
AMD MI300X llama_3_1_70b_instruct_run8 30 30 30 30 29 23 10 19 20 7 0 23 4 26 30 4 30 30 29 404
AMD MI300X llama_3_1_8b_instruct_run1 12 6 0 1 5 5 0 0 2 0 4 0 0 3 1 0 3 2 12 56
AMD MI300X llama_3_1_8b_instruct_run2 6 11 3 5 1 4 0 0 1 0 0 2 0 2 2 0 3 3 17 60
AMD MI300X llama_3_1_8b_instruct_run3 7 5 0 2 1 3 1 0 3 1 4 1 0 2 4 0 3 1 13 51
AMD MI300X llama_3_1_8b_instruct_run4 10 8 4 1 7 4 0 0 2 0 4 0 0 1 4 0 1 6 13 65
AMD MI300X llama_3_1_8b_instruct_run5 8 9 1 0 2 3 0 0 3 0 3 1 0 1 5 0 5 6 16 63
AMD MI300X llama_3_1_8b_instruct_run6 12 5 2 1 2 3 0 0 2 1 3 0 0 0 4 0 8 2 19 64
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run1 30 30 30 30 29 30 12 10 23 10 22 21 7 28 30 5 30 30 30 437
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run2 30 30 30 30 30 30 15 5 27 5 17 19 4 24 30 9 30 30 30 425
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run3 30 30 30 30 30 30 16 11 24 9 15 19 4 24 30 6 30 30 30 428
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run4 30 30 30 30 30 30 20 3 24 4 20 24 6 23 30 9 30 30 30 433
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run5 30 30 30 30 29 29 15 7 27 7 12 22 3 27 30 8 30 30 30 426
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run6 30 30 30 30 30 30 11 4 22 9 16 18 4 25 30 9 30 30 30 418
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run7 30 30 30 30 30 29 15 3 22 9 8 19 3 25 30 4 30 30 30 407
AMD MI300X llama_3_3_70b_instruct_fp8_kv_run8 30 30 30 30 30 29 17 7 24 8 14 20 5 22 30 9 30 30 30 425
AMD MI300X llama_3_3_70b_instruct_run1 30 30 30 30 30 30 7 1 12 6 12 16 3 27 30 12 30 30 30 396
AMD MI300X llama_3_3_70b_instruct_run2 30 30 30 30 30 29 9 0 17 14 18 21 1 20 30 8 30 30 30 407
AMD MI300X llama_3_3_70b_instruct_run3 30 30 30 30 30 30 12 1 22 9 12 20 1 21 30 9 30 30 30 407
AMD MI300X llama_3_3_70b_instruct_run4 30 30 30 30 30 30 12 1 23 10 13 22 2 22 30 5 30 30 30 410
AMD MI300X llama_3_3_70b_instruct_run5 30 30 30 30 30 29 11 3 21 11 6 16 4 23 30 12 30 30 30 406
AMD MI300X llama_3_3_70b_instruct_run6 30 30 30 30 29 30 12 1 22 10 10 18 3 24 30 7 30 30 30 406
AMD MI300X llama_3_3_70b_instruct_run7 30 30 30 30 30 30 14 2 21 12 13 21 2 28 30 14 30 30 30 427
AMD MI300X llama_3_3_70b_instruct_run8 30 30 30 30 29 30 6 3 21 13 12 19 0 24 30 10 30 30 30 407
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run1 30 30 30 29 30 16 6 4 26 2 13 28 14 19 30 10 30 30 30 407
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run2 30 30 30 29 30 22 11 1 24 3 18 29 16 16 30 10 30 30 30 419
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run3 30 30 30 29 30 16 13 3 23 6 16 29 13 15 30 20 30 30 30 423
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run4 30 30 30 29 30 21 14 2 24 2 19 28 11 16 30 16 30 30 30 422
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run5 30 30 30 30 30 17 10 3 24 3 16 29 11 16 30 20 30 30 30 419
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run6 30 30 30 30 29 24 14 4 23 1 23 28 16 13 30 16 30 30 30 431
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run7 30 30 30 28 29 17 13 1 24 2 18 30 8 13 30 11 30 30 30 404
AMD MI300X llama_4_maverick_17b_128e_instruct_fp8_run8 30 30 30 30 30 16 8 3 26 2 20 28 13 17 30 7 30 30 30 410
AMD MI300X llama_4_maverick_17b_128e_instruct_run1 30 30 30 29 29 24 11 2 22 2 21 28 13 19 30 10 30 29 30 419
AMD MI300X llama_4_maverick_17b_128e_instruct_run2 30 30 30 29 29 17 11 4 28 1 21 28 16 20 30 12 30 30 30 426
AMD MI300X llama_4_maverick_17b_128e_instruct_run3 30 30 30 28 30 21 10 4 26 4 20 29 18 18 30 15 30 30 30 433
AMD MI300X llama_4_maverick_17b_128e_instruct_run4 30 30 30 30 29 23 14 1 26 2 18 30 14 17 30 16 30 30 30 430
AMD MI300X llama_4_maverick_17b_128e_instruct_run5 30 30 30 30 30 16 9 5 23 6 17 30 17 17 30 15 30 30 30 425
AMD MI300X llama_4_maverick_17b_128e_instruct_run6 30 30 30 30 29 24 11 5 24 2 22 29 10 18 30 14 30 29 30 427
AMD MI300X llama_4_maverick_17b_128e_instruct_run7 30 30 30 28 30 19 14 1 26 4 23 29 12 10 30 11 30 30 30 417
AMD MI300X llama_4_maverick_17b_128e_instruct_run8 30 30 30 30 27 21 14 3 26 4 19 30 16 12 30 11 30 30 30 423
AMD MI300X llama_4_scout_17b_16e_instruct_run1 30 30 16 20 30 8 26 20 14 0 5 6 0 18 30 14 30 30 30 357
AMD MI300X llama_4_scout_17b_16e_instruct_run2 30 30 20 21 29 8 22 14 18 0 10 5 0 16 29 15 30 30 30 357
AMD MI300X llama_4_scout_17b_16e_instruct_run3 30 30 19 19 29 6 24 13 22 0 13 4 1 18 30 7 30 30 30 355
AMD MI300X llama_4_scout_17b_16e_instruct_run4 30 30 18 20 29 13 26 16 20 0 9 2 0 23 30 7 30 30 30 363
AMD MI300X llama_4_scout_17b_16e_instruct_run5 30 30 21 25 30 6 22 18 23 0 6 9 0 22 30 11 30 30 30 373
AMD MI300X llama_4_scout_17b_16e_instruct_run6 30 30 22 21 28 9 22 15 22 0 9 7 0 19 30 12 30 30 30 366
AMD MI300X llama_4_scout_17b_16e_instruct_run7 30 30 15 17 29 9 25 21 22 0 9 8 3 21 30 8 30 30 30 367
AMD MI300X llama_4_scout_17b_16e_instruct_run8 30 30 23 23 30 13 25 16 22 0 12 10 0 18 30 11 30 30 30 383
AMD MI300X qwen2_5_14b_instruct_run1 30 30 29 28 30 24 10 5 18 3 10 17 4 16 30 1 30 30 30 375
AMD MI300X qwen2_5_14b_instruct_run2 30 30 30 26 29 21 9 6 19 5 7 16 5 15 30 2 30 30 30 370
AMD MI300X qwen2_5_14b_instruct_run3 30 30 30 26 30 20 15 9 20 8 5 23 6 12 30 4 30 30 30 388
AMD MI300X qwen2_5_14b_instruct_run4 30 30 30 26 28 25 9 7 20 6 8 17 9 11 30 6 30 30 30 382
AMD MI300X qwen2_5_14b_instruct_run5 30 30 30 28 28 25 9 7 20 8 6 23 6 14 30 4 30 30 30 388
AMD MI300X qwen2_5_14b_instruct_run6 30 30 30 24 30 26 13 5 14 8 8 21 2 10 30 4 30 30 30 375
AMD MI300X qwen2_5_14b_instruct_run7 30 30 30 24 28 21 14 5 23 4 6 21 2 11 30 5 30 30 30 374
AMD MI300X qwen2_5_14b_instruct_run8 30 30 30 25 29 26 10 7 19 7 11 22 4 9 30 4 30 30 30 383
AMD MI300X qwen2_5_32b_instruct_run1 30 30 30 30 29 29 0 0 14 6 12 0 4 13 30 3 30 0 30 320
AMD MI300X qwen2_5_32b_instruct_run2 30 30 30 30 29 29 0 0 5 5 17 2 3 15 30 5 30 0 30 320
AMD MI300X qwen2_5_32b_instruct_run3 30 30 30 30 30 30 1 1 7 10 10 3 3 15 30 7 30 0 30 327
AMD MI300X qwen2_5_32b_instruct_run4 30 30 30 30 30 29 1 1 5 3 15 0 0 9 30 5 30 0 30 308
AMD MI300X qwen2_5_32b_instruct_run5 30 30 30 30 29 30 2 2 5 3 12 0 2 14 30 6 30 0 30 315
AMD MI300X qwen2_5_32b_instruct_run6 30 30 30 30 30 29 0 0 9 7 6 1 0 16 30 4 30 0 30 312
AMD MI300X qwen2_5_32b_instruct_run7 30 30 30 30 30 30 0 1 6 5 14 0 2 16 30 3 30 0 30 317
AMD MI300X qwen2_5_32b_instruct_run8 30 30 30 30 30 30 0 3 12 10 12 1 2 13 30 7 30 0 30 330
AMD MI300X qwen2_5_72b_instruct_run1 30 30 30 30 29 29 22 20 25 8 25 26 0 10 30 0 30 0 30 404
AMD MI300X qwen2_5_72b_instruct_run2 30 30 30 30 30 27 16 19 25 13 23 28 1 4 30 0 30 0 30 396
AMD MI300X qwen2_5_72b_instruct_run3 30 30 30 30 30 26 18 24 27 12 24 26 1 10 30 0 30 0 30 408
AMD MI300X qwen2_5_72b_instruct_run4 30 30 30 30 30 28 17 23 24 13 24 22 1 14 30 0 30 0 30 406
AMD MI300X qwen2_5_72b_instruct_run5 30 30 30 30 29 28 19 18 25 13 26 27 2 13 30 0 30 0 30 410
AMD MI300X qwen2_5_72b_instruct_run6 30 30 30 30 30 26 19 20 26 13 25 27 0 9 30 1 30 0 30 406
AMD MI300X qwen2_5_72b_instruct_run7 30 30 30 30 30 28 16 22 24 14 24 27 0 10 30 1 30 0 30 406
AMD MI300X qwen2_5_7b_instruct_run1 30 30 14 17 0 0 0 0 8 0 4 5 0 15 30 0 30 27 28 238
AMD MI300X qwen2_5_7b_instruct_run2 30 30 15 14 1 0 0 0 13 0 9 5 1 12 29 0 28 25 30 242
AMD MI300X qwen2_5_7b_instruct_run3 30 30 15 16 1 0 0 0 11 0 4 6 0 7 28 0 30 24 29 231
AMD MI300X qwen2_5_7b_instruct_run4 30 30 15 16 0 1 0 0 5 1 8 4 1 9 29 0 30 28 26 233
AMD MI300X qwen2_5_7b_instruct_run5 30 30 15 13 2 0 0 0 9 0 11 6 1 15 30 0 29 28 30 249
AMD MI300X qwen2_5_7b_instruct_run6 30 30 13 15 1 1 0 0 7 2 3 3 1 13 29 0 29 26 30 233
AMD MI300X qwen2_5_7b_instruct_run7 30 30 19 14 0 1 0 0 6 0 5 10 0 12 29 0 29 27 29 241
AMD MI300X qwen2_5_7b_instruct_run8 30 30 17 9 0 0 0 0 11 1 6 5 0 12 29 0 29 22 27 228
AMD MI300X qwen3_14b_fp8_run1 30 30 30 29 30 28 0 0 0 0 0 7 0 30 30 4 30 30 30 338
AMD MI300X qwen3_14b_fp8_run2 30 30 30 30 30 29 0 0 0 0 0 7 0 30 30 2 30 30 30 338
AMD MI300X qwen3_14b_fp8_run3 30 30 30 29 30 28 0 0 0 0 0 10 0 30 30 3 30 30 30 340
AMD MI300X qwen3_14b_fp8_run4 30 30 30 29 30 28 0 0 0 0 1 10 0 30 30 4 30 30 30 342
AMD MI300X qwen3_14b_fp8_run5 30 30 30 29 30 28 0 0 0 0 1 14 1 30 30 5 30 30 30 348
AMD MI300X qwen3_14b_fp8_run6 30 30 30 30 30 30 0 0 0 0 0 13 1 30 30 3 30 30 30 347
AMD MI300X qwen3_14b_fp8_run7 30 30 30 28 30 29 0 0 0 0 0 8 1 30 30 6 30 30 30 342
AMD MI300X qwen3_14b_fp8_run8 30 30 30 28 30 30 0 0 0 0 0 11 1 30 30 2 30 29 30 341
AMD MI300X qwen3_14b_run1 30 30 30 29 30 27 0 0 0 0 0 10 0 30 30 1 30 30 30 337
AMD MI300X qwen3_14b_run2 30 30 30 30 30 29 0 0 0 0 0 4 0 30 30 2 30 30 30 335
AMD MI300X qwen3_14b_run3 30 30 30 28 30 25 0 0 0 0 0 5 0 30 30 1 30 30 30 329
AMD MI300X qwen3_14b_run4 30 30 30 27 30 27 0 0 0 0 0 4 0 30 30 1 30 30 30 329
AMD MI300X qwen3_14b_run5 30 30 30 29 30 30 0 0 0 0 0 8 1 30 30 1 30 30 30 339
AMD MI300X qwen3_14b_run6 30 30 30 29 30 28 0 0 0 0 0 7 0 30 30 3 30 30 30 337
AMD MI300X qwen3_14b_run7 30 30 30 30 30 30 0 0 1 0 0 4 0 30 30 3 30 30 30 338
AMD MI300X qwen3_14b_run8 30 30 30 28 30 29 0 0 0 0 0 5 0 30 30 3 30 30 30 335
AMD MI300X qwen3_14b_thinkmode_run1 30 30 30 18 30 22 13 7 22 5 11 24 0 29 30 1 30 30 30 392
AMD MI300X qwen3_14b_thinkmode_run2 30 30 29 18 30 17 9 5 21 7 13 25 2 27 30 3 30 30 30 386
AMD MI300X qwen3_14b_thinkmode_run3 30 30 30 21 29 20 13 6 18 5 12 26 0 26 30 0 30 30 30 386
AMD MI300X qwen3_14b_thinkmode_run4 30 30 30 16 30 20 13 3 21 12 18 25 4 28 30 1 30 30 30 401
AMD MI300X qwen3_14b_thinkmode_run5 30 30 30 16 30 19 13 5 15 12 14 28 2 26 30 1 30 30 30 391
AMD MI300X qwen3_14b_thinkmode_run6 30 30 29 20 30 21 13 5 19 8 9 26 2 24 30 1 30 30 30 387
AMD MI300X qwen3_14b_thinkmode_run7 30 30 30 19 30 20 16 6 20 12 17 25 3 30 30 3 30 30 30 411
AMD MI300X qwen3_14b_thinkmode_run8 30 30 30 16 30 20 13 5 18 8 18 26 1 30 30 2 30 30 30 397
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run1 30 30 30 30 29 30 10 19 28 30 29 23 25 28 30 25 30 30 30 516
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run2 30 30 30 30 30 30 11 22 26 27 30 21 19 28 30 21 30 30 30 505
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run3 30 30 30 30 30 30 13 22 28 28 28 19 23 25 30 21 30 30 30 507
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run4 30 30 30 30 30 30 8 13 27 29 28 21 21 27 30 24 30 30 30 498
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run5 30 30 30 30 30 30 14 14 29 26 27 19 22 28 30 18 30 30 30 497
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run6 30 30 30 30 30 30 14 14 29 30 27 23 24 28 30 25 30 30 30 514
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run7 30 30 30 29 30 30 14 13 29 29 30 21 24 28 30 16 30 30 30 503
AMD MI300X qwen3_235b_a22b_instruct_2507_fp8_run8 30 30 30 30 30 30 12 15 30 27 30 22 23 26 30 22 30 30 30 507
AMD MI300X qwen3_235b_a22b_instruct_2507_run1 30 30 30 29 30 30 13 9 30 29 29 24 23 26 30 17 30 30 30 499
AMD MI300X qwen3_235b_a22b_instruct_2507_run2 30 30 30 30 30 30 10 12 30 27 30 22 16 28 30 16 30 30 30 491
AMD MI300X qwen3_235b_a22b_instruct_2507_run3 30 30 30 29 30 30 16 19 29 29 30 25 23 28 30 17 30 30 30 515
AMD MI300X qwen3_235b_a22b_instruct_2507_run4 30 30 30 30 30 30 15 16 30 30 29 20 21 26 30 19 30 30 30 506
AMD MI300X qwen3_235b_a22b_instruct_2507_run5 30 30 30 30 30 30 9 17 29 27 30 18 20 24 30 17 30 30 30 491
AMD MI300X qwen3_235b_a22b_instruct_2507_run6 30 30 30 30 30 30 12 18 30 27 27 25 22 27 30 15 30 30 30 503
AMD MI300X qwen3_235b_a22b_instruct_2507_run7 30 30 30 30 30 30 18 9 30 30 28 24 24 28 30 19 30 30 30 510
AMD MI300X qwen3_235b_a22b_instruct_2507_run8 30 30 30 30 30 30 16 15 29 30 30 25 23 26 30 15 30 30 30 509
AMD MI300X qwen3_30b_a3b_instruct_2507_run1 30 30 30 29 6 13 7 2 22 19 16 25 6 28 30 11 30 30 30 394
AMD MI300X qwen3_30b_a3b_instruct_2507_run2 30 30 30 27 11 13 1 0 24 23 13 27 4 28 30 13 30 30 30 394
AMD MI300X qwen3_30b_a3b_instruct_2507_run3 30 30 30 30 8 10 4 2 23 22 17 23 10 26 30 15 30 30 30 400
AMD MI300X qwen3_30b_a3b_instruct_2507_run4 30 30 30 28 10 11 7 0 19 24 14 28 6 27 30 12 30 30 30 396
AMD MI300X qwen3_30b_a3b_instruct_2507_run5 30 30 30 29 7 11 2 2 21 21 13 23 9 29 30 14 30 30 30 391
AMD MI300X qwen3_30b_a3b_instruct_2507_run6 30 30 30 29 3 14 2 1 27 22 15 24 8 29 30 13 30 30 30 397
AMD MI300X qwen3_30b_a3b_instruct_2507_run7 30 30 30 26 9 12 5 0 22 21 18 27 5 29 30 14 30 30 30 398
AMD MI300X qwen3_30b_a3b_instruct_2507_run8 30 30 30 28 11 17 6 2 24 17 15 26 8 29 30 13 30 30 30 406
AMD MI300X qwen3_30b_a3b_run1 30 30 30 30 29 22 0 0 0 0 1 22 6 6 30 10 30 30 30 336
AMD MI300X qwen3_30b_a3b_run2 30 30 30 30 30 20 0 0 0 0 0 21 10 3 30 13 30 30 30 337
AMD MI300X qwen3_30b_a3b_run3 30 30 30 30 29 20 0 0 0 0 0 18 11 4 30 11 30 30 30 333
AMD MI300X qwen3_30b_a3b_run4 30 30 29 29 25 17 0 0 1 0 2 19 10 6 30 6 30 30 30 324
AMD MI300X qwen3_30b_a3b_run5 30 30 29 30 29 17 0 0 0 0 0 20 12 6 30 9 30 30 30 332
AMD MI300X qwen3_30b_a3b_run6 30 30 30 29 29 21 0 0 0 0 0 19 7 3 30 7 30 30 30 325
AMD MI300X qwen3_30b_a3b_run7 30 30 30 29 29 18 0 0 0 0 0 23 11 7 30 8 30 30 30 335
AMD MI300X qwen3_30b_a3b_run8 30 30 30 30 28 18 0 0 0 0 1 15 13 4 30 9 30 30 30 328
AMD MI300X qwen3_30b_a3b_thinkmode_run1 30 30 30 25 27 25 12 28 22 0 14 14 6 22 30 7 30 30 30 412
AMD MI300X qwen3_30b_a3b_thinkmode_run2 30 30 28 26 30 27 12 25 24 0 13 22 8 17 30 5 30 30 30 417
AMD MI300X qwen3_30b_a3b_thinkmode_run3 30 30 30 25 29 24 13 27 28 0 14 22 7 19 30 6 30 30 30 424
AMD MI300X qwen3_30b_a3b_thinkmode_run4 30 30 29 23 29 24 15 26 24 0 9 16 6 18 30 7 30 30 30 406
AMD MI300X qwen3_30b_a3b_thinkmode_run5 30 30 28 25 30 27 14 26 27 0 7 18 5 20 30 4 30 30 30 411
AMD MI300X qwen3_30b_a3b_thinkmode_run6 30 30 30 22 30 23 20 27 26 0 11 18 10 23 30 8 30 30 30 428
AMD MI300X qwen3_30b_a3b_thinkmode_run7 30 30 30 23 30 24 11 26 26 0 14 17 6 15 30 4 30 30 30 406
AMD MI300X qwen3_30b_a3b_thinkmode_run8 30 30 30 27 28 25 14 25 20 0 11 23 2 19 30 9 30 30 30 413
AMD MI300X qwen3_32b_fp8_run1 30 30 30 29 30 29 0 0 18 14 17 24 0 20 30 0 30 1 30 362
AMD MI300X qwen3_32b_fp8_run2 30 30 30 30 29 27 0 0 17 10 20 22 0 21 30 5 30 0 30 361
AMD MI300X qwen3_32b_fp8_run3 30 30 30 29 30 29 0 0 15 11 18 26 0 24 30 4 30 0 30 366
AMD MI300X qwen3_32b_fp8_run4 30 30 30 29 29 30 0 0 19 10 19 24 1 24 30 4 30 0 30 369
AMD MI300X qwen3_32b_fp8_run5 30 30 30 29 30 27 0 0 19 8 12 21 2 23 30 3 30 0 30 354
AMD MI300X qwen3_32b_fp8_run6 30 30 30 30 30 26 0 0 20 14 16 23 2 19 30 8 30 0 30 368
AMD MI300X qwen3_32b_fp8_run7 30 30 30 30 30 30 0 0 20 8 18 26 0 20 30 3 30 0 30 365
AMD MI300X qwen3_32b_fp8_run8 30 30 30 30 30 25 0 0 14 13 20 22 1 21 30 4 30 0 30 360
AMD MI300X qwen3_32b_run1 30 30 30 30 28 27 0 0 20 17 3 25 0 18 30 4 30 0 30 352
AMD MI300X qwen3_32b_run2 30 30 30 30 30 28 0 0 20 13 1 26 1 19 30 5 30 0 30 353
AMD MI300X qwen3_32b_run3 30 30 30 30 30 25 0 0 20 16 1 26 4 18 30 4 30 0 30 354
AMD MI300X qwen3_32b_run4 30 30 30 29 30 28 0 0 17 14 1 24 1 23 30 4 30 0 30 351
AMD MI300X qwen3_32b_run5 30 30 30 30 30 27 0 0 18 8 4 22 0 20 30 3 30 0 30 342
AMD MI300X qwen3_32b_run6 30 30 30 30 30 27 0 0 19 15 5 23 0 18 30 5 30 0 30 352
AMD MI300X qwen3_32b_run7 30 30 30 30 30 26 0 0 20 14 2 23 1 15 30 4 30 0 30 345
AMD MI300X qwen3_32b_run8 30 30 30 29 30 26 0 0 21 14 5 23 2 24 30 4 30 0 30 358
AMD MI300X qwen3_32b_thinkmode_run1 29 30 28 25 30 17 12 17 14 3 18 25 2 25 30 2 30 20 30 387
AMD MI300X qwen3_32b_thinkmode_run2 30 30 28 24 30 15 5 14 17 4 19 27 1 27 30 3 30 17 30 381
AMD MI300X qwen3_32b_thinkmode_run3 30 30 30 25 30 15 12 14 21 3 18 27 0 29 30 3 30 17 30 394
AMD MI300X qwen3_32b_thinkmode_run4 29 30 28 29 30 20 15 19 18 7 16 28 1 28 30 5 30 17 30 410
AMD MI300X qwen3_32b_thinkmode_run5 29 30 27 29 29 15 8 14 19 4 12 26 2 28 30 3 30 21 30 386
AMD MI300X qwen3_32b_thinkmode_run6 30 30 28 26 29 10 9 18 13 4 15 25 1 26 30 3 30 18 30 375
AMD MI300X qwen3_32b_thinkmode_run7 29 30 25 28 28 15 11 14 15 5 11 27 3 25 30 5 30 15 30 376
AMD MI300X qwen3_32b_thinkmode_run8 29 30 29 27 28 15 9 13 12 3 13 26 1 29 30 4 30 16 30 374
AMD MI300X qwen3_4b_instruct_2507_run1 30 30 30 24 24 25 0 0 1 0 4 24 6 27 30 5 30 30 30 350
AMD MI300X qwen3_4b_instruct_2507_run2 30 30 30 18 27 27 0 0 1 0 4 20 1 27 30 4 30 30 30 339
AMD MI300X qwen3_4b_instruct_2507_run3 30 30 30 21 28 27 0 0 0 0 1 19 7 29 30 1 30 30 30 343
AMD MI300X qwen3_4b_instruct_2507_run4 30 30 30 21 26 26 0 1 0 0 1 23 3 27 30 6 30 30 30 344
AMD MI300X qwen3_4b_instruct_2507_run5 30 30 30 17 25 28 0 0 1 0 6 16 2 24 30 3 30 30 30 332
AMD MI300X qwen3_4b_instruct_2507_run6 30 30 30 18 24 24 0 0 0 0 2 20 7 29 30 3 30 30 30 337
AMD MI300X qwen3_4b_instruct_2507_run7 30 30 29 19 22 28 0 0 0 0 1 22 5 29 30 5 30 30 30 340
AMD MI300X qwen3_4b_instruct_2507_run8 30 30 29 22 24 22 0 0 1 0 3 23 9 28 30 6 30 30 30 347
AMD MI300X qwen3_4b_run1 30 30 29 23 21 15 0 0 0 0 2 0 0 2 25 0 7 10 22 216
AMD MI300X qwen3_4b_run2 30 30 29 23 18 12 0 0 0 0 3 2 0 3 27 0 7 18 21 223
AMD MI300X qwen3_4b_run3 30 29 30 20 13 9 0 0 0 0 1 1 0 1 26 0 15 10 22 207
AMD MI300X qwen3_4b_thinkmode_run1 30 30 27 12 27 8 4 0 5 0 10 17 1 15 28 0 27 24 27 292
AMD MI300X qwen3_4b_thinkmode_run2 29 30 23 8 28 7 2 1 2 1 14 14 0 14 27 0 25 25 25 275
AMD MI300X qwen3_4b_thinkmode_run3 29 30 26 12 27 9 6 1 5 0 7 16 0 21 30 0 27 26 24 296
AMD MI300X qwen3_4b_thinkmode_run4 30 30 25 5 26 11 0 0 5 0 9 15 0 12 30 0 29 26 25 278
AMD MI300X qwen3_4b_thinkmode_run5 30 30 26 12 26 10 3 0 3 1 12 19 0 21 27 0 28 24 27 299
AMD MI300X qwen3_4b_thinkmode_run6 29 30 28 8 30 12 3 0 4 0 7 7 0 18 27 1 28 26 25 283
AMD MI300X qwen3_4b_thinkmode_run7 30 29 27 8 24 7 2 0 3 0 7 19 1 15 29 0 30 29 26 286
AMD MI300X qwen3_4b_thinkmode_run8 30 30 27 9 22 11 5 0 5 2 8 19 0 18 29 0 29 28 23 295
AMD MI300X qwen3_5_0_8b_run1 30 30 1 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 1 64
AMD MI300X qwen3_5_0_8b_run2 30 30 2 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 64
AMD MI300X qwen3_5_0_8b_run3 30 30 2 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 64
AMD MI300X qwen3_5_0_8b_run4 30 30 2 1 1 1 0 0 1 0 0 0 0 1 0 0 0 0 0 67
AMD MI300X qwen3_5_0_8b_run5 29 30 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 59
AMD MI300X qwen3_5_0_8b_run6 30 30 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 64
AMD MI300X qwen3_5_0_8b_run7 30 29 5 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 65
AMD MI300X qwen3_5_0_8b_run8 30 30 6 0 0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 68
AMD MI300X qwen3_5_122b_a10b_run1 30 30 30 30 30 29 27 21 30 28 30 28 26 20 30 28 30 30 30 537
AMD MI300X qwen3_5_122b_a10b_run2 30 30 30 30 30 27 26 22 30 27 29 30 23 23 30 25 30 30 30 532
AMD MI300X qwen3_5_122b_a10b_run3 30 30 30 30 30 28 25 23 30 25 30 30 24 23 30 29 30 30 30 537
AMD MI300X qwen3_5_122b_a10b_run4 30 30 30 30 30 30 25 22 30 26 29 30 20 23 30 27 30 30 30 532
AMD MI300X qwen3_5_122b_a10b_run5 30 30 30 30 30 30 29 17 30 27 29 30 21 18 30 27 30 30 30 528
AMD MI300X qwen3_5_122b_a10b_run6 30 30 30 30 30 30 21 18 30 26 30 30 22 22 30 29 30 30 30 528
AMD MI300X qwen3_5_122b_a10b_run7 30 30 30 30 30 30 28 22 30 26 30 30 20 19 30 25 30 30 30 530
AMD MI300X qwen3_5_122b_a10b_run8 30 30 30 30 30 27 29 16 30 24 30 30 24 17 30 26 30 30 30 523
AMD MI300X qwen3_5_27b_run1 30 30 30 30 30 30 30 27 30 16 30 19 25 30 30 26 30 30 30 533
AMD MI300X qwen3_5_27b_run2 30 30 30 30 30 30 29 25 30 22 30 25 24 30 30 27 30 30 30 542
AMD MI300X qwen3_5_27b_run3 30 30 30 30 30 30 28 29 30 27 30 21 25 30 30 25 30 30 30 545
AMD MI300X qwen3_5_27b_run4 30 30 30 30 30 30 30 27 30 21 30 17 24 30 30 25 30 30 30 534
AMD MI300X qwen3_5_27b_run5 30 30 30 30 30 30 30 28 30 19 30 22 26 30 30 25 30 30 30 540
AMD MI300X qwen3_5_27b_run6 30 30 30 30 30 30 29 29 30 22 30 18 25 30 30 26 30 30 30 539
AMD MI300X qwen3_5_27b_run7 30 30 30 30 30 30 30 28 30 23 30 24 20 30 30 27 30 30 30 542
AMD MI300X qwen3_5_27b_run8 30 30 30 30 30 30 29 27 30 20 30 24 27 30 30 27 30 30 30 544
AMD MI300X qwen3_5_2b_run1 26 20 30 18 24 18 0 0 11 1 18 13 0 19 22 0 18 21 24 283
AMD MI300X qwen3_5_2b_run2 23 17 28 16 24 17 0 0 7 0 16 17 1 14 19 0 19 20 22 260
AMD MI300X qwen3_5_2b_run3 22 15 28 15 26 13 0 2 12 2 19 12 0 23 23 1 21 19 21 274
AMD MI300X qwen3_5_2b_run4 26 19 29 16 24 20 0 0 7 2 18 16 0 13 24 0 19 23 25 281
AMD MI300X qwen3_5_2b_run5 23 20 27 13 28 19 0 0 14 1 19 17 0 18 22 0 18 18 26 283
AMD MI300X qwen3_5_2b_run6 25 15 26 14 20 18 1 1 11 1 20 10 0 18 21 0 18 23 27 269
AMD MI300X qwen3_5_2b_run7 20 20 28 15 27 20 0 0 16 0 11 16 0 22 19 0 17 18 26 275
AMD MI300X qwen3_5_2b_run8 23 19 25 8 28 22 0 0 14 1 23 16 1 19 23 0 19 25 24 290
AMD MI300X qwen3_5_35b_a3b_run1 30 30 30 30 30 30 29 25 30 29 29 11 19 30 30 24 30 4 30 500
AMD MI300X qwen3_5_35b_a3b_run2 30 30 30 30 30 30 24 24 30 28 30 13 20 30 30 22 30 6 30 497
AMD MI300X qwen3_5_35b_a3b_run3 30 30 30 30 30 30 26 26 30 29 30 14 23 30 30 22 30 8 30 508
AMD MI300X qwen3_5_35b_a3b_run4 30 30 30 30 30 30 28 22 30 29 29 11 20 30 30 25 30 7 30 501
AMD MI300X qwen3_5_35b_a3b_run5 30 30 30 30 30 30 22 24 30 28 30 12 19 30 30 25 30 9 30 499
AMD MI300X qwen3_5_35b_a3b_run6 30 30 30 30 29 28 23 21 30 28 30 11 21 30 30 20 30 11 30 492
AMD MI300X qwen3_5_35b_a3b_run7 30 30 30 30 30 29 27 25 30 30 30 7 15 30 30 25 30 7 30 495
AMD MI300X qwen3_5_35b_a3b_run8 30 30 30 30 30 30 25 21 30 30 30 7 20 30 30 19 30 11 30 493
AMD MI300X qwen3_5_397b_a17b_run1 30 30 30 30 30 28 28 28 30 21 30 9 21 30 30 22 30 30 30 517
AMD MI300X qwen3_5_397b_a17b_run2 30 30 30 30 30 30 30 29 30 24 30 7 21 30 30 25 30 30 30 526
AMD MI300X qwen3_5_397b_a17b_run3 30 30 30 30 30 30 30 25 30 21 30 7 17 30 30 22 30 30 30 512
AMD MI300X qwen3_5_397b_a17b_run4 30 30 30 30 30 29 30 27 30 24 30 5 21 30 30 19 30 30 30 515
AMD MI300X qwen3_5_397b_a17b_run5 30 30 30 30 30 30 30 28 30 21 30 10 17 30 30 23 30 30 30 519
AMD MI300X qwen3_5_397b_a17b_run6 30 30 30 30 30 30 30 25 30 20 30 9 19 30 30 24 30 30 30 517
AMD MI300X qwen3_5_397b_a17b_run7 30 30 30 30 30 27 29 24 30 21 30 12 22 30 30 21 30 30 30 516
AMD MI300X qwen3_5_397b_a17b_run8 30 30 30 30 30 29 29 28 30 25 30 5 20 30 30 21 30 30 30 517
AMD MI300X qwen3_5_4b_run1 30 30 30 29 27 14 7 9 30 16 30 22 9 30 30 13 30 20 30 436
AMD MI300X qwen3_5_4b_run2 30 30 30 25 27 9 10 8 29 22 30 20 1 30 30 12 30 20 30 423
AMD MI300X qwen3_5_4b_run3 30 30 30 26 29 14 5 5 28 15 28 16 6 30 30 14 30 22 30 418
AMD MI300X qwen3_5_4b_run4 30 30 30 29 28 15 4 6 30 17 29 21 7 30 30 13 30 27 30 436
AMD MI300X qwen3_5_4b_run5 30 30 30 29 28 14 7 7 27 19 27 14 3 30 30 18 30 21 30 424
AMD MI300X qwen3_5_4b_run6 30 30 30 28 28 14 8 7 29 16 26 16 9 28 30 15 30 21 30 425
AMD MI300X qwen3_5_4b_run7 30 30 30 28 29 13 7 11 28 11 29 13 8 30 30 20 30 19 30 426
AMD MI300X qwen3_5_4b_run8 30 30 29 28 28 10 6 12 30 17 29 17 6 30 30 15 30 26 30 433
AMD MI300X qwen3_5_9b_run1 30 30 30 28 30 29 23 24 30 29 30 28 12 30 30 11 30 30 30 514
AMD MI300X qwen3_5_9b_run2 30 30 30 27 29 26 26 23 30 28 30 29 15 30 30 8 30 30 30 511
AMD MI300X qwen3_5_9b_run3 30 30 30 23 29 28 26 24 30 29 30 23 10 30 30 7 30 30 30 499
AMD MI300X qwen3_5_9b_run4 30 30 30 25 29 26 26 17 30 30 30 26 11 30 30 6 30 30 30 496
AMD MI300X qwen3_5_9b_run5 30 30 30 30 30 25 26 21 30 30 30 24 15 30 30 3 30 30 30 504
AMD MI300X qwen3_5_9b_run6 30 30 30 26 30 29 26 19 30 28 30 29 13 29 30 4 30 30 30 503
AMD MI300X qwen3_5_9b_run7 30 30 30 24 29 26 24 19 30 29 30 25 17 30 30 5 30 30 30 498
AMD MI300X qwen3_5_9b_run8 30 30 30 25 30 27 26 19 30 28 30 23 11 30 30 5 30 30 30 494
AMD MI300X qwen3_8b_run1 30 30 30 22 19 7 0 0 2 0 0 11 0 7 30 1 30 30 30 279
AMD MI300X qwen3_8b_run2 30 30 29 25 14 7 0 0 2 0 0 15 0 3 30 2 30 27 30 274
AMD MI300X qwen3_8b_run3 30 30 30 24 18 13 0 0 2 1 2 17 0 2 30 0 30 30 30 289
AMD MI300X qwen3_8b_run4 30 30 29 24 23 6 0 0 0 1 0 7 0 5 30 2 30 30 30 277
AMD MI300X qwen3_8b_run5 30 30 30 27 19 5 0 0 2 0 0 5 1 7 30 4 30 29 30 279
AMD MI300X qwen3_8b_thinkmode_run1 30 30 28 24 25 8 4 1 17 11 17 23 11 28 28 9 29 22 29 374
AMD MI300X qwen3_8b_thinkmode_run2 30 30 30 18 25 15 8 5 13 9 11 18 4 26 30 5 28 11 30 346
AMD MI300X qwen3_8b_thinkmode_run3 30 30 29 24 23 8 1 1 12 11 9 21 6 27 30 15 30 13 29 349
AMD MI300X qwen3_8b_thinkmode_run4 30 30 30 19 24 13 4 4 22 8 11 24 9 25 30 9 30 10 30 362
AMD MI300X qwen3_8b_thinkmode_run5 30 30 30 21 22 11 10 2 17 10 16 19 2 27 30 9 28 14 30 358
AMD MI300X qwen3_8b_thinkmode_run6 30 30 28 19 23 6 5 0 23 10 11 15 8 25 29 10 30 14 29 345
AMD MI300X qwen3_8b_thinkmode_run7 30 30 30 22 27 13 8 5 14 9 16 15 8 26 30 9 30 14 30 366
AMD MI300X qwen3_8b_thinkmode_run8 30 30 30 22 24 9 8 3 16 9 14 17 8 22 29 10 30 13 28 352
AMD MI300X qwen3_coder_30b_a3b_instruct_run1 30 30 30 28 10 2 0 0 22 10 23 7 13 22 30 13 30 30 30 360
AMD MI300X qwen3_coder_30b_a3b_instruct_run2 30 30 30 30 17 7 0 0 29 14 23 5 8 22 30 10 30 30 30 375
AMD MI300X qwen3_coder_30b_a3b_instruct_run3 30 30 30 30 16 2 0 0 27 13 25 3 11 23 30 15 30 30 30 375
AMD MI300X qwen3_coder_30b_a3b_instruct_run4 30 30 30 29 13 4 0 0 23 8 24 7 13 22 30 20 30 30 30 373
AMD MI300X qwen3_coder_30b_a3b_instruct_run5 30 30 30 29 15 0 0 0 23 8 28 7 15 27 30 14 30 30 30 376
AMD MI300X qwen3_coder_30b_a3b_instruct_run6 30 30 30 30 13 4 0 0 27 10 24 4 9 23 30 11 30 30 30 365
AMD MI300X qwen3_coder_30b_a3b_instruct_run7 30 30 30 30 15 4 0 0 22 11 25 4 15 26 30 7 30 30 30 369
AMD MI300X qwen3_coder_30b_a3b_instruct_run8 30 30 30 28 13 5 0 0 28 13 25 6 16 23 30 15 30 30 30 382
AMD MI300X qwen3_coder_480b_a35b_instruct_run1 30 30 30 30 30 30 24 19 30 26 30 30 18 30 30 28 30 21 30 526
AMD MI300X qwen3_coder_480b_a35b_instruct_run2 30 29 30 30 30 30 22 17 30 27 29 28 16 30 30 29 30 25 30 522
AMD MI300X qwen3_coder_480b_a35b_instruct_run3 30 30 30 29 30 30 29 22 30 27 30 30 11 30 30 27 30 21 30 526
AMD MI300X qwen3_coder_480b_a35b_instruct_run4 30 30 30 29 30 30 26 12 30 29 30 29 13 30 30 27 30 24 30 519
AMD MI300X qwen3_coder_480b_a35b_instruct_run5 30 30 30 30 30 30 27 19 30 24 30 28 11 29 30 28 30 24 30 520
AMD MI300X qwen3_coder_480b_a35b_instruct_run6 30 29 30 29 30 30 24 15 30 28 30 30 12 30 30 28 30 20 30 515
AMD MI300X qwen3_coder_480b_a35b_instruct_run7 30 30 30 30 30 30 28 18 30 28 30 30 15 29 30 30 30 24 30 532
AMD MI300X qwen3_coder_480b_a35b_instruct_run8 30 30 30 30 30 30 27 18 30 27 30 30 17 30 30 28 30 23 30 530
AMD MI300X qwen3_next_80b_a3b_instruct_run1 30 30 30 30 30 13 27 29 30 3 28 27 9 30 30 3 30 29 30 468
AMD MI300X qwen3_next_80b_a3b_instruct_run2 30 30 30 30 30 13 29 29 30 4 29 26 6 30 30 4 30 30 30 470
AMD MI300X qwen3_next_80b_a3b_instruct_run3 30 30 30 30 30 14 25 28 30 1 30 29 5 30 28 6 30 30 30 466
AMD MI300X qwen3_next_80b_a3b_instruct_run4 30 30 30 30 30 17 25 29 29 1 30 26 4 30 29 7 30 29 30 466
AMD MI300X qwen3_next_80b_a3b_instruct_run5 30 30 30 30 30 15 27 29 30 1 29 27 12 30 30 3 29 30 30 472
AMD MI300X qwen3_next_80b_a3b_instruct_run6 30 30 30 30 30 16 27 28 29 6 30 29 5 30 29 7 30 30 30 476
AMD MI300X qwen3_next_80b_a3b_instruct_run7 30 30 30 30 30 13 28 29 30 2 30 29 5 30 29 6 30 29 30 470
AMD MI300X qwen3_next_80b_a3b_instruct_run8 30 30 30 30 30 14 24 29 29 0 29 30 4 30 27 6 30 30 29 461
AWS Bedrock claude_haiku35_run4 30 30 30 30 30 23 14 21 30 1 26 27 1 16 30 0 27 30 30 426
AWS Bedrock claude_haiku35_run5 30 30 29 30 28 24 18 23 30 3 25 23 1 17 29 0 27 30 30 427
AWS Bedrock claude_haiku35_run6 30 30 30 30 28 22 16 24 28 4 26 25 1 9 29 0 29 29 30 420
AWS Bedrock claude_haiku35_run7 30 30 30 30 29 19 22 18 30 1 24 24 0 13 28 1 29 30 29 417
AWS Bedrock claude_haiku35_run8 30 30 30 30 29 20 13 20 30 2 29 24 1 12 28 1 30 30 30 419
AWS Bedrock claude_haiku45_run1 30 30 30 30 30 28 24 14 10 4 1 3 7 17 1 3 3 0 0 265
AWS Bedrock claude_haiku45_run2 30 30 30 30 30 28 22 15 10 2 1 0 6 18 0 5 2 0 4 263
AWS Bedrock claude_haiku45_run3 30 30 30 30 29 27 18 16 14 0 1 1 3 19 2 1 2 0 1 254
AWS Bedrock claude_haiku45_run4 30 30 30 30 30 28 25 8 11 3 2 6 7 15 1 2 0 0 0 258
AWS Bedrock claude_haiku45_run5 30 30 30 30 29 28 21 16 8 1 6 4 5 18 1 3 3 0 1 264
AWS Bedrock claude_haiku45_run6 30 30 30 30 30 27 21 9 11 6 2 5 6 19 1 1 0 0 1 259
AWS Bedrock claude_haiku45_run7 30 30 30 30 29 27 16 14 10 2 1 6 6 16 0 2 2 0 0 251
AWS Bedrock claude_haiku45_run8 30 30 30 30 28 25 22 16 7 4 2 3 5 19 1 1 3 0 1 257
AWS Bedrock claude_sonnet45_run1 30 30 30 30 30 30 25 23 30 26 30 29 24 30 26 29 29 0 29 510
AWS Bedrock claude_sonnet45_run2 30 30 30 30 30 30 25 28 30 19 30 27 24 30 29 30 29 0 30 511
AWS Bedrock claude_sonnet45_run3 30 30 30 30 30 30 24 24 30 22 30 27 20 30 30 30 29 0 28 504
AWS Bedrock claude_sonnet45_run4 30 30 30 30 30 30 26 25 30 21 30 26 19 30 28 30 30 0 30 505
AWS Bedrock claude_sonnet45_run5 30 30 30 30 30 30 28 28 30 23 30 30 27 30 29 30 29 0 30 524
AWS Bedrock claude_sonnet45_run6 30 30 30 30 30 30 23 25 30 25 30 27 22 30 30 30 30 0 28 510
AWS Bedrock claude_sonnet45_run7 29 30 30 30 30 30 29 26 30 22 30 23 22 30 27 30 30 0 28 506
AWS Bedrock claude_sonnet45_run8 30 30 30 30 30 30 26 26 30 28 30 27 22 30 28 30 30 0 30 517
AWS Bedrock llama_3_3_70b_instruct_run1 30 30 30 30 30 30 11 16 25 8 21 17 21 27 30 12 30 30 30 458
AWS Bedrock llama_3_3_70b_instruct_run2 30 30 30 30 30 30 12 20 23 4 23 15 20 27 30 6 30 30 30 450
AWS Bedrock llama_3_3_70b_instruct_run3 30 30 29 30 30 30 12 14 24 8 12 17 16 27 30 10 30 30 30 439
AWS Bedrock llama_3_3_70b_instruct_run4 30 30 30 30 30 29 12 14 23 5 17 14 20 21 30 14 30 30 30 439
AWS Bedrock llama_3_3_70b_instruct_run5 30 30 30 30 29 30 12 16 23 3 18 19 17 27 30 15 30 30 30 449
AWS Bedrock llama_3_3_70b_instruct_run6 30 30 30 30 30 30 15 23 21 4 18 15 19 28 30 11 30 30 30 454
AWS Bedrock llama_3_3_70b_instruct_run7 30 30 30 30 30 30 10 17 24 5 14 14 23 28 30 9 30 30 30 444
AWS Bedrock llama_3_3_70b_instruct_run8 30 30 30 29 30 29 10 15 24 2 19 12 20 26 30 9 30 30 30 435
AWS Bedrock llama_4_maverick_17b_128e_instruct_run1 30 30 30 29 29 17 14 3 25 3 25 30 16 16 30 10 30 28 30 425
AWS Bedrock llama_4_maverick_17b_128e_instruct_run2 30 30 30 30 30 21 11 6 20 3 28 28 13 17 30 12 30 29 30 428
AWS Bedrock llama_4_maverick_17b_128e_instruct_run3 30 30 30 30 30 17 17 9 24 1 20 28 19 17 30 9 30 30 30 431
AWS Bedrock llama_4_maverick_17b_128e_instruct_run4 30 30 30 30 29 12 13 7 23 5 22 27 20 18 30 13 30 30 30 429
AWS Bedrock llama_4_maverick_17b_128e_instruct_run5 30 30 30 30 29 17 17 8 21 1 22 27 18 20 30 8 30 30 30 428
AWS Bedrock llama_4_maverick_17b_128e_instruct_run6 30 30 30 29 29 16 15 8 25 1 25 25 12 17 30 10 30 30 30 422
AWS Bedrock llama_4_maverick_17b_128e_instruct_run7 30 30 30 30 29 17 14 6 23 2 24 24 11 17 30 10 30 30 30 417
AWS Bedrock llama_4_maverick_17b_128e_instruct_run8 30 30 30 29 29 16 10 6 23 1 22 24 9 18 30 8 30 29 30 404
AWS Bedrock nova_2_lite_run1 30 30 6 2 26 21 0 0 19 0 1 0 0 0 1 0 2 0 24 162
AWS Bedrock nova_2_lite_run2 30 30 7 5 21 24 0 0 26 0 0 0 0 1 0 0 3 0 19 166
AWS Bedrock nova_2_lite_run3 30 29 6 1 18 24 0 0 21 0 0 1 0 0 1 0 3 0 22 156
AWS Bedrock nova_2_lite_run4 30 30 5 4 15 20 0 0 23 0 0 0 0 0 0 0 1 0 24 152
AWS Bedrock nova_2_lite_run5 30 30 4 2 22 20 0 0 21 0 2 0 0 0 1 0 2 0 27 161
AWS Bedrock nova_2_lite_run6 30 30 8 2 17 22 0 0 20 0 0 0 0 0 1 0 5 0 24 159
AWS Bedrock nova_2_lite_run7 30 30 7 6 24 20 0 0 20 0 0 1 0 0 1 0 1 0 26 166
AWS Bedrock nova_2_lite_run8 30 30 9 2 21 17 0 0 21 0 0 0 0 0 2 0 3 0 24 159
AWS Bedrock nova_lite_run1 21 18 30 17 29 2 0 0 29 0 19 19 19 20 30 3 30 18 30 334
AWS Bedrock nova_lite_run2 25 14 30 23 26 0 0 0 29 1 18 19 12 19 30 2 30 15 30 323
AWS Bedrock nova_lite_run3 26 18 30 15 25 3 0 0 29 0 12 20 20 17 30 5 30 16 30 326
AWS Bedrock nova_lite_run4 26 20 30 26 25 2 0 0 28 2 13 16 16 18 30 2 30 18 30 332
AWS Bedrock nova_lite_run5 26 17 30 23 26 0 0 0 30 2 14 21 16 16 30 1 30 18 30 330
AWS Bedrock nova_lite_run6 24 14 30 24 26 5 0 0 27 2 13 21 19 20 30 2 30 18 30 335
AWS Bedrock nova_lite_run7 26 13 30 19 25 1 0 1 30 1 15 17 13 23 30 2 30 22 30 328
AWS Bedrock nova_lite_run8 22 16 30 20 23 1 0 0 29 1 11 19 19 14 30 3 30 13 30 311
AWS Bedrock nova_micro_run1 14 3 3 13 17 4 10 7 10 1 13 20 13 14 30 5 29 0 19 225
AWS Bedrock nova_micro_run2 11 2 6 18 17 5 8 11 19 0 8 17 12 16 30 2 29 0 26 237
AWS Bedrock nova_micro_run3 17 3 2 8 14 2 5 11 17 0 10 16 10 15 30 1 29 0 25 215
AWS Bedrock nova_micro_run4 13 5 5 12 13 3 9 6 11 2 8 16 7 19 30 2 29 0 22 212
AWS Bedrock nova_micro_run5 10 2 3 16 15 2 10 4 15 0 8 11 11 13 30 1 29 0 24 204
AWS Bedrock nova_micro_run7 12 2 5 15 16 3 11 6 13 0 10 18 11 11 30 1 29 0 27 220
AWS Bedrock nova_micro_run8 17 1 8 12 14 3 12 8 15 1 5 15 12 20 30 5 27 0 19 224
AWS Bedrock nova_premier_run1 26 30 30 30 30 30 24 19 8 0 5 26 2 30 30 15 30 0 30 395
AWS Bedrock nova_premier_run2 24 29 29 30 30 30 22 23 7 0 4 30 0 30 30 10 30 0 30 388
AWS Bedrock nova_premier_run3 25 30 29 30 30 30 19 20 10 0 1 30 1 30 30 13 30 0 30 388
AWS Bedrock nova_premier_run4 23 29 30 30 30 30 22 16 15 0 3 29 2 30 30 12 30 0 30 391
AWS Bedrock nova_premier_run5 24 30 29 29 30 30 22 21 11 0 3 28 1 30 30 14 30 0 30 392
AWS Bedrock nova_premier_run6 25 30 30 30 30 30 24 11 10 0 3 27 1 28 30 18 30 0 30 387
AWS Bedrock nova_premier_run7 25 30 30 30 30 30 17 11 7 0 1 29 0 28 30 12 30 0 30 370
AWS Bedrock nova_premier_run8 25 30 30 30 30 30 21 18 10 0 4 29 5 30 30 12 30 0 30 394
AWS Bedrock nova_pro_run1 3 13 30 30 30 9 0 0 6 10 4 17 16 21 30 18 30 2 30 299
AWS Bedrock nova_pro_run2 5 16 30 30 30 6 0 2 3 16 4 14 16 22 30 17 30 0 30 301
AWS Bedrock nova_pro_run3 7 17 30 30 30 8 1 0 3 10 8 19 18 25 30 17 30 3 30 316
AWS Bedrock nova_pro_run4 5 17 30 29 30 8 0 0 3 11 6 19 18 24 30 20 30 1 30 311
AWS Bedrock nova_pro_run5 7 17 30 30 30 7 0 0 1 13 7 13 17 21 30 18 30 0 30 301
AWS Bedrock nova_pro_run6 5 16 30 29 30 11 2 0 1 18 4 15 16 26 30 18 30 0 30 311
AWS Bedrock nova_pro_run7 2 19 30 30 30 9 1 0 1 10 7 16 12 26 30 17 30 0 30 300
AWS Bedrock nova_pro_run8 4 19 30 30 30 11 0 0 3 15 8 15 17 22 30 17 30 2 30 313
AWS Bedrock qwen3_235b_a22b_instruct_2507_run1 30 30 30 29 30 30 23 24 30 25 28 18 17 25 30 23 30 30 30 512
AWS Bedrock qwen3_235b_a22b_instruct_2507_run2 30 30 30 30 30 30 22 25 30 24 29 19 17 23 30 17 30 30 30 506
AWS Bedrock qwen3_235b_a22b_instruct_2507_run3 30 30 30 29 29 30 20 22 30 26 30 25 21 25 30 22 30 30 30 519
AWS Bedrock qwen3_235b_a22b_instruct_2507_run4 30 30 30 29 30 30 27 25 30 21 30 21 20 27 30 24 30 30 30 524
AWS Bedrock qwen3_235b_a22b_instruct_2507_run5 30 30 30 30 30 30 19 17 28 23 30 20 19 25 30 22 30 30 30 503
AWS Bedrock qwen3_235b_a22b_instruct_2507_run6 30 30 30 30 30 30 20 25 30 20 29 26 24 28 30 20 30 30 30 522
AWS Bedrock qwen3_235b_a22b_instruct_2507_run7 30 30 30 30 30 30 21 26 30 24 28 25 19 29 30 19 30 30 30 521
AWS Bedrock qwen3_235b_a22b_instruct_2507_run8 30 30 30 30 30 30 24 23 29 22 30 23 19 28 30 16 30 30 30 514
AWS Bedrock qwen3_next_80b_a3b_instruct_run1 30 30 30 30 30 23 28 26 30 2 30 28 8 29 30 2 29 30 30 475
AWS Bedrock qwen3_next_80b_a3b_instruct_run2 30 30 30 30 30 24 27 25 30 2 29 29 9 30 30 9 29 29 30 482
AWS Bedrock qwen3_next_80b_a3b_instruct_run3 30 30 30 28 29 17 27 27 30 3 29 30 11 30 30 4 30 30 30 475
AWS Bedrock qwen3_next_80b_a3b_instruct_run4 30 30 30 30 30 17 28 27 30 6 29 30 4 30 27 3 30 30 30 471
AWS Bedrock qwen3_next_80b_a3b_instruct_run5 30 30 30 30 30 18 27 30 29 7 29 30 6 30 30 2 30 29 30 477
AWS Bedrock qwen3_next_80b_a3b_instruct_run6 30 30 30 28 30 21 29 29 30 3 27 30 4 30 30 8 30 30 30 479
AWS Bedrock qwen3_next_80b_a3b_instruct_run7 30 30 30 30 30 24 27 28 29 4 30 28 6 30 30 4 30 28 30 478
AWS Bedrock qwen3_next_80b_a3b_instruct_run8 30 30 30 30 30 20 30 28 30 7 28 30 7 30 30 5 30 29 30 484
Alibaba Cloud qwen3_max_2025_09_23_run1 30 30 30 30 30 30 26 20 30 26 30 4 13 29 29 22 30 29 29 497
Alibaba Cloud qwen3_max_2025_09_23_run2 30 30 30 30 30 30 25 19 30 29 30 6 17 30 30 23 30 30 29 508
Alibaba Cloud qwen3_max_2025_09_23_run3 30 30 30 30 30 30 29 15 30 27 30 6 13 28 30 18 30 30 30 496
Alibaba Cloud qwen3_max_2025_09_23_run4 30 30 30 30 30 30 28 19 29 27 30 6 14 29 30 23 30 29 29 503
Alibaba Cloud qwen3_max_2025_09_23_run5 30 30 30 29 30 30 25 20 30 25 30 5 21 28 30 24 30 28 29 504
Alibaba Cloud qwen3_max_2025_09_23_run6 30 30 30 30 30 30 28 13 30 27 30 6 12 30 30 17 30 30 30 493
Alibaba Cloud qwen3_max_2025_09_23_run7 30 30 30 30 30 30 26 22 30 26 30 5 14 25 29 20 29 30 30 496
Alibaba Cloud qwen3_max_2025_09_23_run8 30 30 30 30 30 30 28 19 30 25 29 6 16 29 30 21 30 30 29 502
Alibaba Cloud qwen3_max_preview_run1 30 30 30 30 28 25 0 0 13 2 25 19 19 30 30 23 30 30 30 424
Alibaba Cloud qwen3_max_preview_run2 30 30 30 30 30 28 0 0 10 0 26 20 18 30 30 21 30 30 30 423
Alibaba Cloud qwen3_max_preview_run3 30 30 30 30 28 26 0 0 9 4 25 14 22 29 30 23 30 30 30 420
Alibaba Cloud qwen3_max_preview_run4 30 30 30 30 30 28 0 0 4 2 26 21 22 29 30 22 30 30 30 424
Alibaba Cloud qwen3_max_preview_run5 30 30 30 30 29 24 0 0 4 2 27 20 17 29 30 24 30 30 30 416
Alibaba Cloud qwen3_max_preview_run6 30 30 30 30 30 26 0 0 12 1 26 16 15 30 30 24 30 30 30 420
Alibaba Cloud qwen3_max_preview_run7 30 30 30 30 28 27 0 0 12 3 26 18 21 29 30 22 30 30 30 426
Alibaba Cloud qwen3_max_preview_run8 30 30 30 30 28 25 0 0 13 2 26 21 23 30 30 22 30 30 30 430
Alibaba Cloud qwen_flash_2025_07_28_run1 30 30 30 28 8 7 5 7 28 11 15 30 8 19 30 17 30 30 30 393
Alibaba Cloud qwen_flash_2025_07_28_run2 30 30 30 29 6 4 5 7 26 13 18 28 8 17 30 18 30 30 30 389
Alibaba Cloud qwen_flash_2025_07_28_run3 30 30 29 26 6 6 1 2 25 10 20 30 4 18 30 15 30 30 30 372
Alibaba Cloud qwen_flash_2025_07_28_run4 30 30 30 29 10 8 5 10 27 12 21 30 9 16 30 12 30 30 30 399
Alibaba Cloud qwen_flash_2025_07_28_run5 30 30 30 26 6 5 2 5 29 17 18 28 6 20 30 17 30 30 30 389
Alibaba Cloud qwen_flash_2025_07_28_run6 30 30 30 29 5 4 1 4 25 10 21 28 6 21 30 15 30 30 30 379
Alibaba Cloud qwen_flash_2025_07_28_run7 30 30 30 27 8 8 4 9 24 17 15 28 7 18 30 17 30 30 30 392
Alibaba Cloud qwen_flash_2025_07_28_run8 30 30 30 28 8 7 8 5 28 11 22 28 6 16 30 15 30 30 30 392
Alibaba Cloud qwen_plus_2025_09_11_run1 30 30 30 28 30 19 29 28 28 5 30 30 2 30 29 10 30 30 30 478
Alibaba Cloud qwen_plus_2025_09_11_run2 30 30 30 30 30 19 29 29 26 3 29 29 8 30 30 4 29 29 30 474
Alibaba Cloud qwen_plus_2025_09_11_run3 30 30 30 30 30 24 29 27 28 1 29 29 5 30 30 6 30 29 30 477
Alibaba Cloud qwen_plus_2025_09_11_run4 30 30 30 29 30 26 25 27 27 4 28 30 9 30 30 7 30 30 30 482
Alibaba Cloud qwen_plus_2025_09_11_run5 30 30 30 29 30 26 27 28 28 3 29 30 7 30 30 5 30 30 30 482
Alibaba Cloud qwen_plus_2025_09_11_run6 30 30 30 30 30 19 27 29 28 3 29 29 8 30 30 5 30 29 30 476
Alibaba Cloud qwen_plus_2025_09_11_run7 30 30 30 30 30 19 27 27 28 4 29 30 8 30 30 7 30 30 30 479
Alibaba Cloud qwen_plus_2025_09_11_run8 30 30 30 30 30 25 24 26 27 3 29 29 4 30 28 6 30 30 30 471
Anthropic claude_3_5_haiku_20241022_run1 30 30 30 30 30 23 22 28 30 2 26 24 1 12 27 1 27 28 29 430
Anthropic claude_3_5_haiku_20241022_run2 30 30 30 30 30 22 20 26 30 2 27 28 2 17 29 1 28 30 29 441
Anthropic claude_3_5_haiku_20241022_run3 30 30 30 30 28 18 20 26 30 0 27 26 0 14 29 2 27 29 30 426
Google AI Studio gemini_2_0_flash_run1 30 30 18 29 26 22 19 14 15 3 8 12 1 3 25 5 27 0 27 314
Google AI Studio gemini_2_0_flash_run2 30 30 20 26 30 26 16 21 17 1 9 12 0 0 29 6 23 0 29 325
Google AI Studio gemini_2_0_flash_run3 30 30 23 21 29 22 13 19 10 1 3 10 2 0 27 2 27 0 29 298
Google AI Studio gemini_2_0_flash_run4 30 30 18 26 27 28 18 19 15 3 9 13 2 0 24 4 26 0 28 320
Google AI Studio gemini_2_0_flash_run5 30 30 21 28 30 25 18 18 19 0 6 13 0 2 30 6 28 0 26 330
Google AI Studio gemini_2_0_flash_run6 30 30 22 29 29 28 17 16 16 0 6 10 3 0 28 6 24 0 27 321
Google AI Studio gemini_2_0_flash_run7 29 30 21 25 26 23 20 21 19 4 1 9 3 2 26 5 26 0 29 319
Google AI Studio gemini_2_0_flash_run8 29 30 22 24 30 26 19 17 11 2 8 12 7 1 27 3 28 0 30 326
Google AI Studio gemini_2_0_flashlite_run1 30 29 16 7 16 11 2 7 2 3 6 9 2 25 29 1 30 0 25 250
Google AI Studio gemini_2_0_flashlite_run2 30 30 22 5 13 19 4 2 4 1 7 12 0 25 27 1 29 0 23 254
Google AI Studio gemini_2_0_flashlite_run3 30 29 18 8 13 17 4 5 5 3 16 14 1 27 29 0 29 0 26 274
Google AI Studio gemini_2_0_flashlite_run4 30 29 22 8 11 17 2 5 7 0 9 12 2 24 29 1 28 0 26 262
Google AI Studio gemini_2_0_flashlite_run5 30 30 14 8 14 21 2 2 4 2 10 13 0 26 30 0 30 0 27 263
Google AI Studio gemini_2_0_flashlite_run6 30 30 18 8 17 13 1 3 3 0 13 16 0 27 28 1 29 0 26 263
Google AI Studio gemini_2_0_flashlite_run7 30 29 16 8 11 16 2 2 4 0 9 13 1 28 29 0 30 0 26 254
Google AI Studio gemini_2_0_flashlite_run8 30 29 22 6 14 18 2 2 3 2 8 9 0 27 30 0 30 0 27 259
Google AI Studio gemini_2_5_flash_run1 30 30 30 30 30 30 19 9 30 9 25 29 1 29 30 2 30 14 30 437
Google AI Studio gemini_2_5_flash_run2 30 30 30 30 30 30 17 12 28 15 27 28 3 30 30 2 30 22 30 454
Google AI Studio gemini_2_5_flash_run3 30 30 30 30 30 27 22 5 29 11 24 28 1 30 30 1 30 22 29 439
Google AI Studio gemini_2_5_flash_run4 30 30 30 30 30 29 15 8 28 12 29 30 3 28 30 0 30 20 30 442
Google AI Studio gemini_2_5_flash_run5 30 30 30 30 30 30 15 10 29 12 27 30 1 28 30 1 30 16 30 439
Google AI Studio gemini_2_5_flash_run6 30 30 30 30 30 29 21 6 29 15 23 28 0 28 30 3 30 14 30 436
Google AI Studio gemini_2_5_flash_run7 30 30 30 30 30 30 18 7 28 7 26 29 2 30 30 0 30 23 30 440
Google AI Studio gemini_2_5_flash_run8 30 30 30 30 30 28 17 6 30 11 27 26 2 30 30 3 30 16 30 436
Google AI Studio gemini_2_5_flashlite_run1 30 30 13 30 30 26 2 7 0 1 4 19 1 16 30 0 26 0 30 295
Google AI Studio gemini_2_5_flashlite_run2 30 30 19 30 30 29 2 10 3 0 2 12 1 14 30 0 26 2 30 300
Google AI Studio gemini_2_5_flashlite_run3 30 30 20 30 29 28 0 16 1 0 4 19 0 21 30 2 27 1 30 318
Google AI Studio gemini_2_5_flashlite_run4 30 30 17 30 29 27 1 11 3 1 5 13 1 19 30 0 26 0 30 303
Google AI Studio gemini_2_5_flashlite_run5 30 30 17 30 30 27 1 13 1 3 5 11 1 18 30 0 29 2 30 308
Google AI Studio gemini_2_5_flashlite_run6 30 30 19 30 30 29 1 19 2 0 4 16 1 19 30 1 30 2 30 323
Google AI Studio gemini_2_5_flashlite_run7 30 30 17 30 30 25 0 9 0 0 6 15 0 19 30 0 30 1 30 302
Google AI Studio gemini_2_5_flashlite_run8 30 30 19 30 30 27 1 7 0 1 2 15 0 18 30 1 30 1 30 302
Google AI Studio gemini_2_5_pro_run1 30 30 30 30 30 30 29 16 30 22 29 23 7 29 30 19 30 0 30 474
Google AI Studio gemini_2_5_pro_run2 30 30 30 30 30 30 26 20 29 24 29 29 7 30 30 21 30 0 30 485
Google AI Studio gemini_2_5_pro_run3 28 30 30 30 30 30 28 17 30 26 30 26 13 27 30 14 30 0 30 479
Google AI Studio gemini_2_5_pro_run4 30 30 30 30 30 30 28 12 30 24 29 26 6 30 29 23 30 0 30 477
Google AI Studio gemini_2_5_pro_run5 30 30 30 30 30 30 27 15 28 24 30 28 9 29 30 21 30 0 30 481
Google AI Studio gemini_2_5_pro_run6 30 30 30 30 30 30 29 16 30 23 30 28 14 30 30 17 30 0 30 487
Google AI Studio gemini_2_5_pro_run7 29 30 30 30 30 30 30 15 30 20 29 23 8 30 30 21 30 0 30 475
Google AI Studio gemini_2_5_pro_run8 29 30 30 30 30 30 24 16 30 25 30 25 7 27 30 15 30 0 30 468
Google AI Studio gemini_3_pro_preview_run1 30 30 30 30 30 30 26 20 30 19 30 30 13 30 30 25 30 7 30 500
Google AI Studio gemini_3_pro_preview_run2 30 30 30 30 30 30 25 20 30 20 30 30 18 30 30 22 30 8 30 503
Google AI Studio gemini_3_pro_preview_run3 30 30 30 30 30 30 24 19 30 22 30 30 17 30 30 24 30 5 30 501
Google AI Studio gemini_3_pro_preview_run4 30 30 30 30 30 30 27 16 30 21 30 30 17 30 30 29 30 4 30 504
Google AI Studio gemini_3_pro_preview_run5 30 30 30 30 30 30 27 18 30 24 30 30 13 30 30 23 30 4 30 499
Google AI Studio gemini_3_pro_preview_run6 30 30 30 30 30 30 27 16 30 26 30 30 16 30 30 27 30 6 30 508
Google AI Studio gemini_3_pro_preview_run7 30 30 30 30 30 30 25 22 30 21 30 30 21 30 30 22 30 6 30 507
Google AI Studio gemini_3_pro_preview_run8 30 30 30 30 30 29 22 15 30 19 30 30 16 30 30 22 30 3 30 486
Intel Gaudi3 mistral_large_instruct_2411_run1 30 29 26 25 30 16 0 0 19 0 7 26 0 23 30 0 30 1 30 322
Intel Gaudi3 mistral_large_instruct_2411_run2 30 30 25 29 30 23 0 0 24 0 10 30 0 25 30 0 30 2 30 348
Intel Gaudi3 mistral_large_instruct_2411_run3 30 30 22 29 30 14 0 0 21 2 7 29 0 21 30 1 29 0 30 325
Intel Gaudi3 mistral_large_instruct_2411_run4 30 30 27 26 30 18 0 0 22 2 8 29 0 19 29 2 30 0 30 332
Intel Gaudi3 mistral_large_instruct_2411_run5 30 30 29 26 29 21 1 0 25 2 8 28 0 21 30 2 30 2 30 344
Intel Gaudi3 mistral_large_instruct_2411_run6 30 30 24 29 30 20 1 0 26 0 11 29 1 20 30 0 30 0 30 341
Intel Gaudi3 mistral_large_instruct_2411_run7 30 30 28 29 30 12 0 0 23 2 10 29 0 21 30 2 30 1 30 337
Intel Gaudi3 mistral_large_instruct_2411_run8 30 30 28 28 30 18 0 0 23 1 8 30 1 20 30 0 30 0 30 337
Intel Gaudi3 phi_4_run1 28 27 25 28 21 27 0 0 0 0 1 27 8 26 29 3 30 0 29 309
Intel Gaudi3 phi_4_run2 30 27 23 25 27 28 1 0 0 0 0 27 7 28 30 7 29 0 30 319
Intel Gaudi3 phi_4_run3 29 28 23 27 25 26 2 0 0 0 0 27 2 24 30 13 30 0 28 314
Intel Gaudi3 phi_4_run4 30 27 20 24 25 26 0 0 0 0 1 25 8 26 30 8 30 0 27 307
Intel Gaudi3 phi_4_run5 30 23 27 27 29 24 0 0 0 0 0 22 3 22 30 5 30 0 30 302
Intel Gaudi3 phi_4_run6 30 25 28 26 25 28 3 0 0 0 4 25 8 25 30 8 30 0 29 324
Intel Gaudi3 phi_4_run7 30 27 22 26 29 26 1 0 0 0 2 27 3 24 30 8 30 0 27 312
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run1 30 30 30 30 30 30 14 16 29 23 30 26 17 27 30 13 30 30 30 495
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run2 30 30 30 30 30 30 19 14 30 25 28 25 19 29 30 21 30 30 30 510
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run3 30 30 30 30 30 30 18 18 30 24 29 23 26 25 30 20 30 30 30 513
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run4 30 30 30 30 30 30 22 15 29 28 29 17 21 27 30 18 30 30 30 506
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run5 30 30 30 30 30 30 16 18 30 24 28 19 22 26 30 14 30 30 30 497
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run6 30 30 30 30 30 30 17 17 29 27 29 23 18 25 30 16 30 30 30 501
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run7 30 30 30 30 30 30 17 14 30 28 29 15 17 25 30 20 30 30 30 495
Intel Gaudi3 qwen3_235b_a22b_instruct_2507_run8 30 30 30 30 30 30 16 20 30 22 30 28 23 27 30 19 30 30 30 515
Intel Gaudi3 qwen3_235b_a22b_run1 30 30 28 26 29 3 1 3 25 19 10 23 15 15 30 15 30 30 30 392
Intel Gaudi3 qwen3_235b_a22b_run2 30 30 27 29 28 4 0 4 27 12 7 15 14 9 30 19 30 30 30 375
Intel Gaudi3 qwen3_235b_a22b_run3 30 30 27 29 28 3 2 2 27 18 12 16 18 9 30 19 30 30 30 390
Intel Gaudi3 qwen3_235b_a22b_run4 30 30 29 28 28 2 3 8 30 14 8 17 9 9 30 14 30 30 30 379
Intel Gaudi3 qwen3_235b_a22b_run5 30 30 28 30 28 3 1 2 26 12 9 21 11 11 30 19 30 30 30 381
Intel Gaudi3 qwen3_235b_a22b_run6 30 30 27 29 26 5 4 4 27 18 12 22 12 8 30 12 30 30 30 386
Intel Gaudi3 qwen3_235b_a22b_run7 30 30 30 28 27 3 1 5 28 19 10 15 16 10 30 16 30 30 30 388
Intel Gaudi3 qwen3_235b_a22b_run8 30 30 28 29 30 4 3 4 29 15 11 20 15 8 30 18 30 30 30 394
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run1 30 30 30 30 7 11 0 5 28 13 20 22 9 30 30 13 30 30 30 398
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run2 30 30 30 27 7 11 4 3 29 14 14 22 7 30 30 16 30 30 30 394
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run3 30 30 30 30 8 13 1 6 25 13 16 28 8 28 30 13 30 30 30 399
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run4 30 30 30 27 11 10 1 4 26 14 16 27 6 28 30 10 30 30 30 390
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run5 30 30 30 28 12 13 1 3 23 20 19 25 6 29 30 14 30 30 30 403
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run6 30 30 30 28 8 14 2 3 25 17 17 24 5 29 30 14 30 30 30 396
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run7 30 30 30 26 7 12 1 3 28 17 15 24 7 29 30 15 30 30 30 394
Intel Gaudi3 qwen3_30b_a3b_instruct_2507_run8 30 30 30 27 11 10 2 3 28 10 14 23 9 28 30 12 30 30 30 387
Intel Gaudi3 qwen3_32b_run1 30 30 30 29 30 28 0 0 9 11 11 18 0 15 30 3 30 0 30 334
Intel Gaudi3 qwen3_32b_run2 30 30 30 30 30 30 0 0 3 9 20 25 0 18 30 4 30 0 30 349
Intel Gaudi3 qwen3_32b_run3 30 30 30 30 29 28 0 0 8 14 11 25 2 20 30 2 30 0 30 349
Intel Gaudi3 qwen3_32b_run4 30 30 30 29 30 29 0 0 10 11 14 23 0 17 30 4 30 1 30 348
Intel Gaudi3 qwen3_32b_run5 30 30 30 30 29 29 0 0 5 11 12 21 1 19 30 3 30 0 30 340
Intel Gaudi3 qwen3_32b_run6 30 30 30 29 30 27 0 0 9 15 2 26 0 15 30 2 30 0 30 335
Intel Gaudi3 qwen3_32b_run7 30 30 30 30 30 29 0 0 3 10 13 23 1 16 30 2 30 0 30 337
Intel Gaudi3 qwen3_32b_run8 30 30 30 30 29 27 0 0 6 12 5 20 1 18 30 2 30 0 30 330
Intel Gaudi3 qwen3_4b_instruct_2507_run1 30 30 30 23 14 24 1 0 1 0 4 21 6 29 30 5 30 30 30 338
Intel Gaudi3 qwen3_4b_instruct_2507_run2 30 30 30 23 17 25 1 0 2 0 3 27 5 27 30 4 30 30 30 344
Intel Gaudi3 qwen3_4b_instruct_2507_run3 30 30 30 17 20 24 0 0 1 1 4 21 9 29 30 2 30 30 30 338
Intel Gaudi3 qwen3_4b_instruct_2507_run4 30 30 30 21 20 23 0 0 0 0 7 24 11 30 30 5 30 30 30 351
Intel Gaudi3 qwen3_4b_instruct_2507_run5 30 30 30 19 20 24 0 0 0 1 9 23 4 27 30 5 30 30 30 342
Intel Gaudi3 qwen3_4b_instruct_2507_run6 30 30 30 26 21 27 0 0 2 0 1 19 5 23 30 4 30 30 30 338
Intel Gaudi3 qwen3_4b_instruct_2507_run7 30 30 30 22 26 21 1 0 0 1 6 22 7 29 30 5 30 30 30 350
Intel Gaudi3 qwen3_4b_instruct_2507_run8 30 30 30 23 16 24 0 0 0 0 4 18 8 27 30 5 30 30 30 335
Kamiwaza kimi_k2_thinking_run1 29 30 29 19 29 28 25 24 29 20 25 27 16 27 28 15 28 16 22 466
Kamiwaza kimi_k2_thinking_run2 30 30 28 18 30 29 28 25 30 19 25 28 15 28 24 13 27 13 15 455
Kamiwaza kimi_k2_thinking_run3 29 30 30 20 30 29 24 24 30 15 26 27 16 29 29 11 29 7 14 449
Kamiwaza kimi_k2_thinking_run4 30 30 30 16 30 28 23 27 30 15 23 28 12 29 27 16 28 12 19 453
Kamiwaza kimi_k2_thinking_run5 29 30 29 17 29 25 26 27 29 16 27 26 16 28 24 20 28 11 15 452
Kamiwaza kimi_k2_thinking_run6 30 30 28 14 29 29 26 21 30 13 27 26 18 27 29 16 29 10 21 453
NVIDIA H200 deepseek_v3_1_run1 30 30 30 28 28 30 27 12 23 30 29 30 17 28 30 25 30 30 30 517
NVIDIA H200 deepseek_v3_1_run2 30 30 30 28 30 29 26 7 25 25 30 30 14 25 30 26 30 30 30 505
NVIDIA H200 deepseek_v3_1_run3 30 30 30 30 29 30 23 13 26 28 30 29 10 25 30 26 30 30 30 509
NVIDIA H200 deepseek_v3_1_run4 30 30 30 30 29 29 21 10 26 26 26 29 18 24 30 28 29 30 30 505
NVIDIA H200 deepseek_v3_1_run5 30 30 30 30 29 30 20 8 23 27 28 30 10 26 30 24 30 30 30 495
NVIDIA H200 deepseek_v3_1_run6 30 30 30 28 30 30 19 11 26 26 30 30 12 24 30 28 30 30 30 504
NVIDIA H200 deepseek_v3_1_run7 30 30 30 30 30 30 21 10 28 27 30 29 10 27 30 24 30 30 30 506
NVIDIA H200 deepseek_v3_1_run8 30 30 30 29 30 30 24 14 27 27 29 30 11 25 30 26 29 30 30 511
NVIDIA H200 minimax_m2_1_run1 30 30 30 30 30 29 10 13 28 22 29 27 20 30 30 15 30 16 30 479
NVIDIA H200 minimax_m2_1_run2 30 30 30 30 29 29 12 16 28 27 28 25 20 30 30 19 30 23 30 496
NVIDIA H200 minimax_m2_1_run3 30 30 30 29 30 28 16 19 25 23 28 25 21 30 30 20 30 18 30 492
NVIDIA H200 minimax_m2_1_run4 30 30 30 29 30 29 18 17 27 21 29 27 26 30 30 14 30 17 30 494
NVIDIA H200 minimax_m2_1_run5 30 30 29 29 29 24 12 14 29 27 30 27 23 30 30 17 30 15 30 485
NVIDIA H200 minimax_m2_1_run6 30 30 30 30 28 30 13 19 27 27 30 24 13 30 30 12 30 19 30 482
NVIDIA H200 minimax_m2_1_run7 30 30 30 28 29 29 15 13 26 27 28 28 17 30 30 19 30 23 30 492
NVIDIA H200 minimax_m2_1_run8 30 30 30 27 29 29 19 16 26 24 29 27 27 30 30 13 30 22 30 498
NVIDIA H200 minimax_m2_run1 30 30 30 30 30 25 30 17 30 30 29 30 23 29 29 30 29 10 30 521
NVIDIA H200 minimax_m2_run2 30 30 30 30 30 29 22 17 30 28 29 30 18 30 29 29 30 12 30 513
NVIDIA H200 minimax_m2_run3 30 30 30 30 27 29 26 15 30 29 30 30 22 30 30 28 30 7 30 513
NVIDIA H200 minimax_m2_run4 30 30 30 30 30 28 27 16 30 28 29 30 19 29 30 28 30 9 30 513
NVIDIA H200 minimax_m2_run5 30 30 30 29 30 28 27 15 30 29 30 30 16 30 29 29 30 8 30 510
NVIDIA H200 minimax_m2_run6 30 30 30 29 30 28 24 16 30 26 30 30 22 30 28 27 28 7 30 505
NVIDIA H200 minimax_m2_run7 30 30 30 30 30 29 26 16 30 28 30 30 19 30 29 30 29 13 30 519
NVIDIA H200 minimax_m2_run8 30 30 30 28 30 28 24 21 30 29 29 28 17 30 29 26 30 6 30 505
NVIDIA H200 mistral_large_3_675b_instruct_2512_run1 29 29 30 28 30 30 11 25 24 17 25 30 2 30 30 6 30 0 30 436
NVIDIA H200 mistral_large_3_675b_instruct_2512_run2 30 30 30 28 28 30 17 18 25 14 23 28 0 30 30 4 30 0 30 425
NVIDIA H200 mistral_large_3_675b_instruct_2512_run3 30 29 30 26 29 29 21 17 21 17 25 30 1 30 30 5 30 0 30 430
NVIDIA H200 mistral_large_3_675b_instruct_2512_run4 29 30 30 25 29 28 19 16 23 14 24 28 1 30 30 5 30 0 30 421
NVIDIA H200 mistral_large_3_675b_instruct_2512_run5 29 28 30 29 29 29 15 17 27 12 25 27 0 30 30 3 30 0 30 420
NVIDIA H200 mistral_large_3_675b_instruct_2512_run6 30 30 30 28 30 28 19 21 20 17 24 28 2 30 30 4 30 0 30 431
NVIDIA H200 mistral_large_3_675b_instruct_2512_run7 30 27 30 24 29 29 16 21 27 16 24 29 2 30 30 2 30 0 30 426
NVIDIA H200 mistral_large_3_675b_instruct_2512_run8 30 29 30 29 30 29 13 21 22 21 21 30 1 30 30 4 30 0 30 430
OpenAI gpt_4_1_run1 30 30 11 30 30 14 1 0 3 1 1 9 14 22 19 3 28 11 30 287
OpenAI gpt_4_1_run2 30 30 4 30 30 18 2 0 0 0 0 4 22 21 22 4 30 6 30 283
OpenAI gpt_4_1_run3 30 30 3 30 30 17 1 0 1 1 3 10 14 28 19 3 28 7 30 285
OpenAI gpt_4_1_run4 30 30 5 30 30 19 3 1 2 1 0 3 27 27 21 1 30 9 30 299
OpenAI gpt_4_1_run5 30 30 3 30 30 18 2 1 1 0 2 8 20 24 19 2 28 6 30 284
OpenAI gpt_4_1_run6 30 30 8 30 30 19 2 1 3 1 3 4 25 24 22 2 30 8 30 302
OpenAI gpt_4_1_run7 30 30 6 30 30 11 3 0 6 0 4 7 22 24 17 3 28 8 30 289
OpenAI gpt_4_1_run8 30 30 2 30 30 13 3 1 6 0 1 5 20 25 21 1 28 10 30 286
OpenAI gpt_5_1_medreason_run1 30 30 28 26 28 24 23 18 22 14 23 13 11 27 30 17 27 27 25 443
OpenAI gpt_5_1_medreason_run2 30 30 29 28 24 20 25 26 21 16 26 8 15 22 28 21 27 26 21 443
OpenAI gpt_5_1_medreason_run3 30 30 30 29 23 18 24 25 20 8 23 8 15 23 27 17 28 29 28 435
OpenAI gpt_5_1_medreason_run4 30 30 27 27 25 19 18 25 21 8 24 14 6 18 30 15 30 26 23 416
OpenAI gpt_5_1_run1 30 30 24 21 17 5 0 0 3 0 6 6 6 21 21 15 27 13 5 250
OpenAI gpt_5_1_run2 30 30 30 23 21 6 0 2 1 0 6 4 9 23 26 11 24 17 3 266
OpenAI gpt_5_1_run3 30 30 25 25 22 7 0 0 4 0 7 5 7 23 24 14 24 11 5 263
OpenAI gpt_5_1_run4 30 30 27 23 23 9 1 1 1 1 8 7 6 29 29 17 27 11 5 285
OpenAI gpt_5_1_run5 30 30 28 23 21 4 0 0 2 1 13 9 6 27 29 16 29 11 2 281
OpenAI gpt_5_1_run6 30 30 30 22 26 5 0 0 2 0 9 5 6 27 25 17 28 20 5 287
OpenAI gpt_5_1_run7 30 30 27 27 21 8 0 1 3 0 9 3 5 27 26 21 29 18 4 289
OpenAI gpt_5_1_run8 30 30 29 25 22 4 0 0 1 1 7 4 9 24 28 11 30 15 6 276
OpenAI gpt_5_2_medreason_run1 30 30 30 30 27 26 30 30 29 18 25 15 16 26 29 25 25 23 28 492
OpenAI gpt_5_2_medreason_run2 30 30 30 30 28 26 29 26 30 16 29 13 19 27 28 26 30 29 29 505
OpenAI gpt_5_2_medreason_run3 30 30 30 30 23 25 30 29 26 19 25 16 16 30 29 24 30 28 29 499
OpenAI gpt_5_2_medreason_run4 30 30 30 30 30 26 29 30 30 16 26 17 17 27 30 25 29 29 27 508
OpenAI gpt_5_2_medreason_run5 30 30 28 30 28 28 28 30 30 17 27 18 19 30 29 23 29 29 30 513
OpenAI gpt_5_2_medreason_run6 30 30 30 29 29 26 28 26 29 21 30 16 22 30 30 28 29 29 29 521
OpenAI gpt_5_2_medreason_run7 30 30 30 29 27 25 30 28 30 20 30 16 15 28 29 29 29 30 29 514
OpenAI gpt_5_2_medreason_run8 30 30 30 29 29 27 30 30 30 17 26 17 14 29 29 27 30 28 28 510
OpenAI gpt_5_medreason_run1 30 30 30 29 30 29 27 26 30 19 30 27 28 30 30 29 30 30 30 544
OpenAI gpt_5_medreason_run2 30 30 30 30 30 30 29 27 29 21 30 30 27 30 30 26 30 30 30 549
OpenAI gpt_5_medreason_run3 30 30 30 30 30 30 30 27 30 13 30 28 28 30 30 28 30 30 30 544
OpenAI gpt_5_medreason_run4 30 30 30 30 30 30 28 25 30 20 30 28 24 30 30 28 30 30 30 543
OpenAI gpt_5_medreason_run5 30 30 30 30 30 30 28 26 30 16 30 30 26 30 30 27 30 30 30 543
OpenAI gpt_5_medreason_run6 30 30 30 30 30 30 29 26 28 20 30 29 26 30 30 30 30 30 30 548
OpenAI gpt_5_medreason_run7 30 30 30 30 30 30 28 26 28 18 29 29 29 30 30 29 30 30 30 546
OpenAI gpt_5_medreason_run8 30 30 30 29 30 30 25 27 30 22 30 27 28 30 30 29 30 30 30 547
OpenAI gpt_5_mini_medreason_run1 30 30 30 29 30 30 26 18 28 11 20 29 30 18 30 29 30 29 29 506
OpenAI gpt_5_mini_medreason_run2 30 30 30 29 29 29 25 13 25 12 16 29 28 18 30 29 30 28 30 490
OpenAI gpt_5_mini_medreason_run3 30 30 30 30 30 30 22 12 26 11 20 28 26 19 29 26 28 29 30 486
OpenAI gpt_5_mini_medreason_run4 30 30 30 29 30 30 23 15 26 8 19 29 29 15 30 25 30 27 29 484
OpenAI gpt_5_mini_medreason_run5 30 30 30 28 29 30 25 17 29 12 21 30 29 16 30 30 30 28 30 504
OpenAI gpt_5_mini_medreason_run6 30 30 30 29 30 29 22 17 28 13 18 29 26 22 30 30 30 27 29 499
OpenAI gpt_5_mini_medreason_run7 30 30 30 30 28 30 24 16 27 7 16 28 28 14 29 26 30 26 30 479
OpenAI gpt_5_mini_medreason_run8 30 30 30 29 29 30 22 18 24 12 15 30 26 13 28 29 29 30 27 481
OpenAI gpt_5_nano_medreason_run1 30 30 7 18 14 4 9 0 4 1 6 6 1 6 2 0 9 14 10 171
OpenAI gpt_5_nano_medreason_run2 29 30 7 15 10 2 3 5 3 0 4 1 2 5 3 0 7 19 10 155
OpenAI gpt_5_nano_medreason_run3 30 30 8 13 12 6 11 3 6 0 2 2 1 5 3 0 5 19 8 164
OpenAI gpt_5_nano_medreason_run4 30 30 11 12 10 2 8 0 5 2 3 1 0 10 3 4 4 21 11 167
OpenAI gpt_5_nano_medreason_run5 30 30 11 18 8 3 12 3 2 1 5 1 1 6 0 0 9 17 7 164
OpenAI gpt_5_nano_medreason_run6 30 30 13 15 11 5 8 0 5 0 2 0 3 6 3 0 7 9 14 161
OpenAI gpt_5_nano_medreason_run7 30 30 8 14 11 5 8 2 5 0 3 2 5 10 5 3 6 17 12 176
OpenAI gpt_5_nano_medreason_run8 30 30 14 12 7 5 11 4 6 0 3 1 1 5 2 3 4 15 6 159