Models
Three ways a model can differ from the rest of the field. None of them is a score of quality — a model that hedges, or that answers differently from everyone else, is a data point, not a mistake. A dash means too few questions to report.
- Consistency — how often it gives the same answer when asked again. How it's measured →
- Alignment — how often its answer is the one most other models gave. How it's measured →
- Hedging — how often it qualifies its answer or declines to give one. How it's measured →
155 models
Consistency Alignment Hedging
moonshotai/kimi-k3.1-pro MoonshotAI · 2026-10-23 70.180.425.9 minimax/minimax-m3.1-flash MiniMax · 2026-10-19 55.264.430.2 deepseek/deepseek-v4.1-flash-1017 DeepSeek · 2026-10-17 68.383.922.9 meta/muse-spark-open Meta · 2026-10-15 70.782.821.7 nvidia/nemotron-3.5-super-vl NVIDIA · 2026-10-15 74.391.533.6 typesafe/jev-1.14 TypeSafe · 2026-10-14 89800 google/gemini-4-argon Google · 2026-10-13 74.783.741.9 liquid/lfm-2.5-24b-a2b Liquid AI · 2026-10-13 60.379.632.6 meta/muse-wonder Meta · 2026-10-12 77.4816.3 cloudflare/clef-omni Cloudflare · 2026-10-09 89.472.50 microsoft/microsoft-decision-1 Microsoft · 2026-10-09 89.282.50 anthropic/claude-haiku-5.5 Anthropic · 2026-10-07 71.280.829.6 mistralai/mistral-large-4-0 Mistral · 2026-10-06 65.380.621 openai/gpt-6-luna-decisions OpenAI · 2026-10-06 87.277.50 cloudflare/clef Cloudflare · 2026-10-01 90.877.50 cloudflare/clef-flash Cloudflare · 2026-10-01 93.177.50 liquid/d1 Liquid AI · 2026-10-01 88.6800 inception/mercury-decide Inception · 2026-09-30 82.6850 openai/gpt-6.1-sol OpenAI · 2026-09-29 81.37531.9 anthropic/claude-sonnet-5.5 Anthropic · 2026-09-28 7672.417.7 upstage/solar-decide Upstage · 2026-09-28 80.348.70 jaredpalmer/kev-4b Jared Palmer · 2026-09-25 76.992.30 upstage/solar-mini4 Upstage · 2026-09-23 637542.4 anthropic/claude-opus-5.5 Anthropic · 2026-09-22 79.580.933.7 openai/gpt-6-luna OpenAI · 2026-09-22 74.277.831 openai/gpt-6-sol OpenAI · 2026-09-22 72.98328.2 qwen/qwen3.8-omni-flash Qwen · 2026-09-21 ——— x-ai/grok-4.7 xAI · 2026-09-21 67.783.321.9 xiaomi/mimo-v2.6-flash Xiaomi · 2026-09-21 ——— xiaomi/mimo-v2.6-pro Xiaomi · 2026-09-21 ——— typesafe/jev-1.13 TypeSafe · 2026-09-18 88.974.40 sakana/fugu-max Sakana · 2026-09-11 ——— deepseek/deepseek-v4.1-flash DeepSeek · 2026-09-10 ——— inception/mercury-2.5 Inception · 2026-09-08 75.583.734 openai/gpt-6-astra OpenAI · 2026-09-04 —68.221.6 qwen/qwen3.8-max-0902 Qwen · 2026-09-03 —79.25.8 google/gemini-3.8-flash Google · 2026-09-02 —73.914 meta/muse-spark-1.3 Meta · 2026-09-02 —70.82.8 anthropic/claude-fable-5.1 Anthropic · 2026-09-01 —77.322 ibm-granite/granite-4.2-8b IBM · 2026-08-31 ——— tencent/hy4-preview Tencent · 2026-08-28 —8713.5 qwen/qwen3.8-flash Qwen · 2026-08-26 —77.315 z-ai/glm-5.3-flash Z.ai · 2026-08-26 —8716 tencent/hy-mt2-30b-a3b Tencent · 2026-08-20 —63.69.6 z-ai/glm-5.3 Z.ai · 2026-08-18 —73.913.2 qwen/qwen3.8-27b Qwen · 2026-08-14 —8715.5 google/gemini-3.7-flash Google · 2026-08-13 —8022 bytedance-seed/seed-2-1-turbo Bytedance · 2026-08-12 —76.228.4 deepseek/deepseek-v4-pro-0813 DeepSeek · 2026-08-12 —758.4 x-ai/grok-4.6 xAI · 2026-08-12 —753.2 liquid/lfm-2.5-2.6b:free Liquid AI · 2026-08-11 48.661.916.4 nvidia/nemotron-3.5-lightning NVIDIA · 2026-08-11 —77.318.3 upstage/solar-pro4 Upstage · 2026-08-10 5868.533.4 meta/muse-glimmer-30b Meta · 2026-08-09 —85.725.3 meta/muse-spark-1.2 Meta · 2026-08-05 —79.28 deepseek/deepseek-v4-flash-0731 DeepSeek · 2026-07-31 —78.316.5 thinkingmachines/inkling-small ThinkingMachines · 2026-07-30 —95.718.8 qwen/qwen3.7-flash Qwen · 2026-07-27 —69.615.2 anthropic/claude-opus-5 Anthropic · 2026-07-24 68.978.619.2 google/gemini-3.6-flash Google · 2026-07-21 70.983.320.6 thinkingmachines/inkling ThinkingMachines · 2026-07-17 63.486.324.6 meta/muse-spark-1.1 Meta · 2026-07-16 73.667.76.3 moonshotai/kimi-k3 MoonshotAI · 2026-07-16 65.477.423.1 openai/gpt-5.6-luna OpenAI · 2026-07-09 69.370.817.5 openai/gpt-5.6-sol OpenAI · 2026-07-09 79.571.719.3 openai/gpt-5.6-terra OpenAI · 2026-07-09 6779.621.8 x-ai/grok-4.5 xAI · 2026-07-08 69.9742.1 anthropic/claude-sonnet-5 Anthropic · 2026-06-30 71.573.920.7 tencent/hy3 Tencent · 2026-06-26 63.57514 sakana/fugu-ultra Sakana · 2026-06-23 65.886.713.4 z-ai/glm-5.2 Z.ai · 2026-06-16 61.28727.1 moonshotai/kimi-k2.7-code MoonshotAI · 2026-06-12 66.189.118.5 anthropic/claude-fable-5 Anthropic · 2026-06-09 73.98317.8 nvidia/nemotron-3-ultra-550b-a55b NVIDIA · 2026-06-04 68.58132.4 qwen/qwen3.7-plus Qwen · 2026-06-03 65.681.424.2 minimax/minimax-m3 MiniMax · 2026-05-31 60.282.221.9 stepfun/step-3.7-flash StepFun · 2026-05-28 54.966.725.3 anthropic/claude-opus-4.8 Anthropic · 2026-05-27 75.779.222.7 qwen/qwen3.7-max Qwen · 2026-05-21 65.480.418.9 google/gemini-3.5-flash Google · 2026-05-19 81.287.826.2 google/gemini-3.1-flash-lite Google · 2026-05-07 80.48723.8 ibm-granite/granite-4.1-8b IBM · 2026-04-30 7162.122.9 x-ai/grok-4.3 xAI · 2026-04-30 69.7806.5 qwen/qwen3.6-27b Qwen · 2026-04-26 64.473.916 qwen/qwen3.6-flash Qwen · 2026-04-26 62.87512.9 qwen/qwen3.6-max-preview Qwen · 2026-04-26 75.980.99.7 openai/gpt-5.5 OpenAI · 2026-04-24 7477.116.3 deepseek/deepseek-v4-flash DeepSeek · 2026-04-23 58.179.613.1 deepseek/deepseek-v4-pro DeepSeek · 2026-04-23 61.381.67.8 xiaomi/mimo-v2.5 Xiaomi · 2026-04-22 5573.825.1 xiaomi/mimo-v2.5-pro Xiaomi · 2026-04-22 54.377.116.6 moonshotai/kimi-k2.6 MoonshotAI · 2026-04-20 71.379.121.9 anthropic/claude-opus-4.7 Anthropic · 2026-04-16 74.67410.1 z-ai/glm-5.1 Z.ai · 2026-04-07 6582.619.4 google/gemma-4-26b-a4b-it Google · 2026-04-03 74.285.340.3 google/gemma-4-31b-it Google · 2026-04-02 72.181.634 qwen/qwen3.6-plus Qwen · 2026-04-02 63.978.311.5 x-ai/grok-4.20 xAI · 2026-03-31 64.1565.9 minimax/minimax-m2.7 MiniMax · 2026-03-18 59.381.827.9 openai/gpt-5.4-mini OpenAI · 2026-03-17 63.987.818.8 openai/gpt-5.4-nano OpenAI · 2026-03-17 59.862.721 mistralai/mistral-small-2603 Mistral · 2026-03-16 64.864.411.7 z-ai/glm-5-turbo Z.ai · 2026-03-15 67.982.617.1 nvidia/nemotron-3-super-120b-a12b NVIDIA · 2026-03-11 ——— bytedance-seed/seed-2.0-lite Bytedance · 2026-03-10 ——38.8 openai/gpt-5.4 OpenAI · 2026-03-05 71.770.215.7 inception/mercury-2 Inception · 2026-03-04 58.763.922.1 openai/gpt-5.3-chat OpenAI · 2026-03-03 59.181.117.3 qwen/qwen3.5-122b-a10b Qwen · 2026-02-25 71.784.225.2 qwen/qwen3.5-flash-02-23 Qwen · 2026-02-25 67.482.531.6 anthropic/claude-sonnet-4.6 Anthropic · 2026-02-17 71.869.620.3 minimax/minimax-m2.5 MiniMax · 2026-02-12 58.676.726.5 z-ai/glm-5 Z.ai · 2026-02-11 67.486.535.4 anthropic/claude-opus-4.6 Anthropic · 2026-02-04 72.369.228.3 upstage/solar-pro-3 Upstage · 2026-01-27 46.856.518.7 moonshotai/kimi-k2.5 MoonshotAI · 2026-01-26 65.88715.9 z-ai/glm-4.7-flash Z.ai · 2026-01-19 54.587.832.6 bytedance-seed/seed-1.6 Bytedance · 2025-12-23 ——34.8 bytedance-seed/seed-1.6-flash Bytedance · 2025-12-23 —77.326.4 minimax/minimax-m2.1 MiniMax · 2025-12-22 59.575.630.8 z-ai/glm-4.7 Z.ai · 2025-12-21 6692.523.4 google/gemini-3-flash-preview Google · 2025-12-17 77.679.123.2 nvidia/nemotron-3-nano-30b-a3b NVIDIA · 2025-12-14 ——— amazon/nova-2-lite-v1 Amazon · 2025-12-02 —6535.2 deepseek/deepseek-v3.2 DeepSeek · 2025-12-01 65.380.420.6 anthropic/claude-haiku-4.5 Anthropic · 2025-10-15 74.96927.5 anthropic/claude-sonnet-4.5 Anthropic · 2025-09-29 69.681.827.6 openai/gpt-oss-120b OpenAI · 2025-08-05 62.165.319.7 google/gemini-2.5-flash-lite Google · 2025-07-22 64.98818.8 qwen/qwen3-235b-a22b-2507 Qwen · 2025-07-21 63.562.517.9 mistralai/mistral-small-3.2-24b-instruct Mistral · 2025-06-20 71.673.218.4 google/gemini-2.5-flash Google · 2025-06-17 737618.7 openai/o3 OpenAI · 2025-04-16 —758.8 openai/o4-mini OpenAI · 2025-04-16 —66.75.6 openai/gpt-4.1 OpenAI · 2025-04-14 —82.68.4 openai/gpt-4.1-mini OpenAI · 2025-04-14 69.675.627.1 openai/gpt-4.1-nano OpenAI · 2025-04-14 —6526 meta-llama/llama-4-maverick Meta · 2025-04-05 74.9643.1 meta-llama/llama-4-scout Meta · 2025-04-05 77.259.115.8 deepseek/deepseek-chat-v3-0324 DeepSeek · 2025-03-24 —71.412.2 openai/o3-mini OpenAI · 2025-01-31 —60.910 mistralai/mistral-small-24b-instruct-2501 Mistral · 2025-01-30 ——24.2 deepseek/deepseek-r1 DeepSeek · 2025-01-20 —65.23.7 meta-llama/llama-3.3-70b-instruct Meta · 2024-12-06 72.6680 amazon/nova-lite-v1 Amazon · 2024-12-05 —71.428.4 amazon/nova-micro-v1 Amazon · 2024-12-05 —8028.4 meta-llama/llama-3.1-70b-instruct Meta · 2024-07-22 60.366.75.6 meta-llama/llama-3.1-8b-instruct Meta · 2024-07-22 48.552.218.5 mistralai/mistral-nemo Mistral · 2024-07-18 73.470.24.9 openai/gpt-4o-mini OpenAI · 2024-07-17 72.371.422.5 google/gemma-2-27b-it Google · 2024-07-12 65.67530.8 anthropic/claude-3-haiku Anthropic · 2024-03-12 —61.910 mistralai/mistral-large Mistral · 2024-02-25 —69.615.2 openai/gpt-3.5-turbo OpenAI · 2023-05-27 —62.520 openai/gpt-4 OpenAI · 2023-05-27 —8127.2
No models match.