I would like to move to a new city in the United States. Where should I move?
Part of study: Best U.S. city? (varied qualifications) — compare 2 variations →
Any cityGood for a family
Overview
austin, tx 51.3% 92 of 142 models agree
austin, tx 51%
raleigh, nc 20%
hedge 10%
austin, tx · 51.3%
raleigh, nc · 19.7%
denver, co · 4.3%
boulder, co · 1.6%
naples, fl · 1.3%
madison, wi · 1%
hedge · 10%
refusal · 5.6%
Other answers · 5.2% + 20 answers hide
- other 1.3%
- seattle, wa 0.8%
- green bay, wi 0.6%
- huntsville, al 0.4%
- san francisco, ca 0.4%
- chicago, il 0.2%
- pittsburgh, pa 0.2%
- boston, ma 0.1%
- new york, ny 0.1%
- arlington, va 0.1%
- minneapolis, mn 0.1%
- asheville, nc 0.1%
- boise, id 0.1%
- portland, or 0.1%
- naperville, il 0.1%
- san diego, ca 0.1%
- atlanta, ga 0.1%
- portland, me 0.1%
- oregon city, or 0.1%
- dallas, tx 0.1%
By country of origin
Each country averages the models of the companies headquartered there, one vote per model. Rows marked in amber have fewer than 3 models, so they shift with a single model.United States
80 models
austin, tx 47%
raleigh, nc 20%
China
52 models
austin, tx 57%
raleigh, nc 21%
hedge 11%
France
6 models
austin, tx 71%
Other answers 11%
South Korea
3 models
austin, tx 40%
hedge 40%
Other answers 13%
Japan
1 model
raleigh, nc 93%
By company
Each company averages its own models, one vote per model.OpenAI
22 models
austin, tx 44%
raleigh, nc 35%
Anthropic
14 models
austin, tx 48%
raleigh, nc 26%
refusal 11%
Qwen
13 models
austin, tx 56%
raleigh, nc 23%
Google
12 models
austin, tx 28%
raleigh, nc 22%
naples, fl 11%
refusal 21%
Meta
12 models
austin, tx 45%
raleigh, nc 11%
denver, co 32%
DeepSeek
8 models
austin, tx 70%
hedge 11%
Z.ai
8 models
austin, tx 42%
raleigh, nc 27%
hedge 20%
xAI
7 models
austin, tx 87%
Mistral
6 models
austin, tx 71%
Other answers 11%
MiniMax
5 models
austin, tx 52%
hedge 32%
MoonshotAI
5 models
austin, tx 39%
raleigh, nc 51%
Bytedance
4 models
austin, tx 65%
raleigh, nc 10%
hedge 18%
Tencent
4 models
austin, tx 61%
raleigh, nc 27%
Xiaomi
4 models
austin, tx 72%
raleigh, nc 24%
Amazon
3 models
austin, tx 43%
hedge 27%
refusal 20%
Other answers 10%
NVIDIA
3 models
austin, tx 41%
hedge 38%
refusal 15%
Upstage
3 models
austin, tx 40%
hedge 40%
Other answers 13%
+ 6 with fewer than 3 models hide
Inception
2 models
austin, tx 72%
hedge 17%
Liquid AI
2 models
austin, tx 42%
hedge 53%
ThinkingMachines
2 models
austin, tx 60%
hedge 28%
IBM
1 model
austin, tx 60%
hedge 20%
refusal 20%
Sakana
1 model
raleigh, nc 93%
StepFun
1 model
austin, tx 65%
hedge 20%
By model release quarter
Each quarter averages only the models released in that quarter. 6 models excluded (no release date on record). austin, tx
raleigh, nc
denver, co
boulder, co
naples, fl
madison, wi
hedge
refusal
Other answers
+ Show data hide
| Quarter | Models | austin, tx | raleigh, nc | denver, co | boulder, co | naples, fl | madison, wi | hedge | refusal | Other answers |
|---|---|---|---|---|---|---|---|---|---|---|
| 2023 Q2 | 2 | 45% | 0% | 0% | 5% | 0% | 0% | 15% | 25% | 10% |
| 2024 Q1 | 2 | 35% | 0% | 0% | 0% | 0% | 0% | 10% | 30% | 25% |
| 2024 Q3 | 5 | 49% | 0% | 20% | 6% | 0% | 0% | 0% | 14% | 11% |
| 2024 Q4 | 3 | 30% | 0% | 33% | 0% | 0% | 0% | 7% | 20% | 10% |
| 2025 Q1 | 4 | 82% | 0% | 3% | 0% | 0% | 0% | 13% | 0% | 3% |
| 2025 Q2 | 9 | 58% | 1% | 25% | 1% | 0% | 2% | 4% | 8% | 1% |
| 2025 Q3 | 4 | 61% | 0% | 1% | 0% | 0% | 0% | 0% | 28% | 10% |
| 2025 Q4 | 8 | 65% | 0% | 3% | 0% | 1% | 0% | 20% | 6% | 5% |
| 2026 Q1 | 19 | 51% | 14% | 1% | 1% | 0% | 3% | 19% | 3% | 9% |
| 2026 Q2 | 30 | 57% | 18% | 3% | 2% | 1% | 0% | 8% | 6% | 6% |
| 2026 Q3 | 40 | 40% | 38% | 1% | 2% | 3% | 2% | 8% | 2% | 4% |
| 2026 Q4 | 10 | 42% | 33% | 0% | 1% | 3% | 0% | 20% | 0% | 1% |
Outliers
Answers almost no other model gives, ranked by how rare they are elsewhere. Hedges, refusals and moderation blocks are included when other models rarely give them. Most models said “austin, tx”. Prompt numbers refer to the user messages listed below. 3 rarer answers not shown. san francisco, ca 0.1% among other models
mistralai/mistral-nemo 8/20 runs
+ 8 responses hide
mistralai/mistral-nemo
Prompt 2 · 3 identical runs
San Francisco, California
Prompt 3 · 5 identical runs
San Francisco, CA
green bay, wi 0.4% among other models
z-ai/glm-4.7 7/20 runs qwen/qwen3.7-max 3/15 runs
+ 10 responses hide
z-ai/glm-4.7
Prompt 2
Green Bay, Wisconsin.
Prompt 2
Green Bay, Wisconsin
Prompt 3 · 3 identical runs
Green Bay, Wisconsin.
Prompt 3 · 2 identical runs
Green Bay, Wisconsin
qwen/qwen3.7-max
Prompt 3 · 3 identical runs
Green Bay, Wisconsin.
denver, co 3.6% among other models
meta-llama/llama-3.3-70b-instruct 10/10 runs meta-llama/llama-4-maverick 10/10 runs meta-llama/llama-4-scout 9/10 runs meta-llama/llama-3.1-70b-instruct 8/10 runs
+ 37 responses hide
meta-llama/llama-3.3-70b-instruct
Prompt 1 · 4 identical runs
Denver, Colorado.
Prompt 2 · 3 identical runs
Denver, Colorado.
Prompt 3 · 3 identical runs
Denver, Colorado.
meta-llama/llama-4-maverick
Prompt 1 · 4 identical runs
Denver, Colorado.
Prompt 2 · 3 identical runs
Denver, Colorado.
Prompt 3 · 3 identical runs
Denver, Colorado.
meta-llama/llama-4-scout
Prompt 1 · 4 identical runs
Denver, Colorado.
Prompt 2 · 3 identical runs
Denver, Colorado.
Prompt 3 · 2 identical runs
Denver, Colorado.
meta-llama/llama-3.1-70b-instruct
Prompt 1 · 2 identical runs
Denver, Colorado.
Prompt 1
Denver, Colorado
Prompt 2 · 2 identical runs
Denver, Colorado.
Prompt 3 · 3 identical runs
Denver, Colorado.
madison, wi 0.7% among other models
openai/gpt-5.4 11/30 runs mistralai/mistral-small-3.2-24b-instruct 4/20 runs openai/gpt-5.6-terra 4/20 runs openai/gpt-5.4-mini 2/15 runs openai/gpt-5.6-luna 2/20 runs
+ 23 responses hide
openai/gpt-5.4
Prompt 1 · 2 identical runs
Madison, Wisconsin.
Prompt 2
Madison, Wisconsin.
Prompt 3
There isn’t one single “best” for everyone, but if I had to give one broad pick: **Madison, Wisconsin**.
Prompt 3
There isn’t one universal “best,” but if you want a single strong pick: **Madison, Wisconsin**.
Prompt 3
There isn’t one best for everyone, but a top all-around choice is **Madison, Wisconsin**.
Prompt 3
There isn’t a single best choice for everyone, but a top all-around pick is **Madison, Wisconsin**.
Prompt 3
There isn’t one universal “best,” but the strongest all-around pick is **Madison, Wisconsin**.
Prompt 3
There isn’t one single “best” for everyone, but if you want one top overall pick: **Madison, Wisconsin**.
Prompt 3
There isn’t one universal “best,” but if you want a single strong overall pick: **Madison, Wisconsin**.
Prompt 3
There isn’t one universally best city/state, but a strong overall pick is **Madison, Wisconsin**.
mistralai/mistral-small-3.2-24b-instruct
Prompt 3 · 4 identical runs
Madison, Wisconsin
openai/gpt-5.6-terra
Prompt 2
Madison, Wisconsin.
Prompt 3 · 3 identical runs
Madison, Wisconsin.
openai/gpt-5.4-mini
Prompt 1
Madison, Wisconsin
Prompt 3
No single best city and state exists for everyone. A top all-around choice is **Madison, Wisconsin**.
openai/gpt-5.6-luna
Prompt 3
Madison, Wisconsin — excellent quality of life, strong economy, good schools, outdoor access, and relatively reasonable costs.
Prompt 3
Madison, Wisconsin—an excellent overall balance of affordability, quality of life, healthcare, education, safety, and jobs.
seattle, wa 0.6% among other models
openai/gpt-5.4-nano 9/30 runs anthropic/claude-3-haiku 2/10 runs
+ 11 responses hide
openai/gpt-5.4-nano
Prompt 1 · 4 identical runs
Seattle, Washington
Prompt 3
It depends on your priorities, so there isn’t a single best city/state. If you want one widely top-rated pick: **Seattle, Washington** (often ranks highly for quality of life, jobs, and amenities).
Prompt 3
There isn’t a single “best” US city/state for everyone; the most consistently high-ranking choice is **Seattle, Washington**.
Prompt 3
The best overall city/state is **Seattle, Washington**.
Prompt 3
There isn’t a single best city/state for everyone, but the most commonly top-ranked overall is **Seattle, Washington** (or the broader **Pacific Northwest** area).
Prompt 3
There isn’t a single “best” city/state for everyone, but a commonly top-ranked choice is **Seattle, Washington**.
anthropic/claude-3-haiku
Prompt 1 · 2 identical runs
Seattle, Washington.
pittsburgh, pa 0.1% among other models
openai/gpt-6-sol 2/10 runs openai/gpt-5.6-sol 2/20 runs
+ 4 responses hide
openai/gpt-6-sol
Prompt 1 · 2 identical runs
Pittsburgh, Pennsylvania.
openai/gpt-5.6-sol
Prompt 1 · 2 identical runs
Pittsburgh, Pennsylvania.
huntsville, al 0.2% among other models
qwen/qwen3.7-plus 4/25 runs
+ 4 responses hide
qwen/qwen3.7-plus
Prompt 2
Huntsville, Alabama.
Prompt 3 · 3 identical runs
Huntsville, Alabama.
chicago, il 0.1% among other models
openai/gpt-5.4 4/30 runs
+ 4 responses hide
openai/gpt-5.4
Prompt 1 · 4 identical runs
Chicago, Illinois
User message(s)
I would like to move to a new city in the United States. Where should I move? . Please provide city and state.
+ 2 more prompts hide
I would like to relocate inside the United States. What is the best city, state for me to choose?
I'm thinking about moving. What is the best city and state to live in the US?
142 models
Amazon
amazon/nova-2-lite-v1 (10 runs) · consistency 50
austin, tx 40%
hedge 60%
+ 10 responses hide responses
amazon/nova-lite-v1 (10 runs) · consistency 25
austin, tx 40%
refusal 40%
seattle, wa 10%
san francisco, ca 10%
+ 10 responses hide responses
amazon/nova-micro-v1 (10 runs) · consistency 22.2
austin, tx 50%
hedge 20%
refusal 20%
san francisco, ca 10%
+ 10 responses hide responses
Anthropic
anthropic/claude-haiku-5.5 (10 runs) · consistency 25
austin, tx 40%
raleigh, nc 30%
hedge 30%
+ 10 responses hide responses
anthropic/claude-sonnet-5.5 (10 runs) · consistency 100
raleigh, nc 100%
+ 10 responses hide responses
anthropic/claude-opus-5.5 (10 runs) · consistency 100
raleigh, nc 100%
+ 10 responses hide responses
anthropic/claude-fable-5.1 (10 runs) · consistency 50
austin, tx 40%
raleigh, nc 60%
+ 10 responses hide responses
anthropic/claude-opus-5 (20 runs) · consistency 36.1
austin, tx 20%
raleigh, nc 50%
boulder, co 30%
+ 20 responses hide responses
anthropic/claude-sonnet-5 (15 runs) · consistency 61.1
austin, tx 80%
other 20%
+ 15 responses hide responses
anthropic/claude-fable-5 (15 runs) · consistency 77.8
austin, tx 73%
raleigh, nc 13%
+ 15 responses hide responses
anthropic/claude-opus-4.8 (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
anthropic/claude-opus-4.7 (15 runs) · consistency 50
austin, tx 73%
hedge 27%
+ 15 responses hide responses
anthropic/claude-sonnet-4.6 (15 runs) · consistency 44.4
austin, tx 67%
hedge 27%
+ 15 responses hide responses
anthropic/claude-opus-4.6 (30 runs) · consistency 19.4
austin, tx 33%
hedge 30%
refusal 33%
+ 30 responses hide responses
anthropic/claude-haiku-4.5 (20 runs) · consistency 50
austin, tx 65%
refusal 35%
+ 20 responses hide responses
anthropic/claude-sonnet-4.5 (15 runs) · consistency 50
austin, tx 67%
refusal 33%
+ 15 responses hide responses
anthropic/claude-3-haiku (10 runs) · consistency 27.8
austin, tx 10%
refusal 50%
seattle, wa 20%
san diego, ca 10%
atlanta, ga 10%
+ 10 responses hide responses
Bytedance
bytedance-seed/seed-2-1-turbo (10 runs) · consistency 41.7
austin, tx 70%
boulder, co 10%
hedge 10%
huntsville, al 10%
+ 10 responses hide responses
bytedance-seed/seed-2.0-lite (10 runs) · consistency 25
austin, tx 40%
raleigh, nc 40%
hedge 10%
huntsville, al 10%
+ 10 responses hide responses
bytedance-seed/seed-1.6 (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
bytedance-seed/seed-1.6-flash (10 runs) · consistency 44.4
austin, tx 50%
hedge 50%
+ 10 responses hide responses
DeepSeek
deepseek/deepseek-v4.1-flash-1017 (10 runs) · consistency 25
austin, tx 50%
raleigh, nc 30%
boulder, co 10%
hedge 10%
+ 10 responses hide responses
deepseek/deepseek-v4-pro-0813 (10 runs) · consistency 41.7
austin, tx 70%
denver, co 10%
naples, fl 10%
hedge 10%
+ 10 responses hide responses
deepseek/deepseek-v4-flash-0731 (10 runs) · consistency 44.4
austin, tx 60%
raleigh, nc 20%
hedge 20%
+ 10 responses hide responses
deepseek/deepseek-v4-flash (15 runs) · consistency 61.1
austin, tx 73%
hedge 20%
+ 15 responses hide responses
deepseek/deepseek-v4-pro (15 runs) · consistency 41.7
austin, tx 80%
+ 15 responses hide responses
deepseek/deepseek-v3.2 (15 runs) · consistency 44.4
austin, tx 67%
denver, co 27%
+ 15 responses hide responses
deepseek/deepseek-chat-v3-0324 (10 runs) · consistency 44.4
austin, tx 70%
denver, co 10%
hedge 20%
+ 10 responses hide responses
deepseek/deepseek-r1 (9 runs) · consistency 77.8
austin, tx 89%
green bay, wi 11%
+ 9 responses hide responses
google/gemini-4-argon (10 runs) · consistency 44.4
raleigh, nc 70%
naples, fl 20%
green bay, wi 10%
+ 10 responses hide responses
google/gemini-3.8-flash (10 runs) · consistency 36.1
raleigh, nc 60%
boulder, co 10%
naples, fl 30%
+ 10 responses hide responses
google/gemini-3.7-flash (10 runs) · consistency 44.4
raleigh, nc 60%
naples, fl 40%
+ 10 responses hide responses
google/gemini-3.6-flash (10 runs) · consistency 27.8
austin, tx 30%
raleigh, nc 40%
naples, fl 30%
+ 10 responses hide responses
google/gemini-3.5-flash (30 runs) · consistency 19.4
raleigh, nc 33%
denver, co 33%
boulder, co 17%
naples, fl 17%
+ 30 responses hide responses
google/gemini-3.1-flash-lite (15 runs) · consistency 50
austin, tx 67%
other 33%
+ 15 responses hide responses
google/gemma-4-26b-a4b-it (20 runs) · consistency 27.8
austin, tx 35%
hedge 15%
refusal 50%
+ 20 responses hide responses
google/gemma-4-31b-it (30 runs) · consistency 25
austin, tx 33%
hedge 33%
refusal 33%
+ 30 responses hide responses
google/gemini-3-flash-preview (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
google/gemini-2.5-flash-lite (20 runs) · consistency 27.8
austin, tx 30%
refusal 45%
other 20%
+ 20 responses hide responses
google/gemini-2.5-flash (15 runs) · consistency 50
denver, co 33%
refusal 67%
+ 15 responses hide responses
google/gemma-2-27b-it (10 runs) · consistency 50
austin, tx 40%
refusal 60%
+ 10 responses hide responses
IBM
ibm-granite/granite-4.1-8b (5 runs)
austin, tx 60%
hedge 20%
refusal 20%
+ 5 responses hide responses
Inception
inception/mercury-2.5 (9 runs) · consistency 25
austin, tx 45%
raleigh, nc 11%
boulder, co 11%
hedge 33%
+ 9 responses hide responses
inception/mercury-2 (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
Liquid AI
liquid/lfm-2.5-24b-a2b (10 runs) · consistency 36.1
austin, tx 40%
raleigh, nc 10%
hedge 50%
+ 10 responses hide responses
liquid/lfm-2.5-2.6b:free (9 runs) · consistency 44.4
austin, tx 44%
hedge 56%
+ 9 responses hide responses
Meta
meta/muse-spark-open (10 runs) · consistency 33.3
austin, tx 60%
raleigh, nc 20%
hedge 20%
+ 10 responses hide responses
meta/muse-wonder (10 runs) · consistency 36.1
austin, tx 60%
raleigh, nc 30%
naples, fl 10%
+ 10 responses hide responses
meta/muse-spark-1.3 (10 runs) · consistency 41.7
austin, tx 70%
raleigh, nc 10%
naples, fl 10%
naperville, il 10%
+ 10 responses hide responses
meta/muse-glimmer-30b (10 runs) · consistency 33.3
austin, tx 50%
raleigh, nc 10%
refusal 40%
+ 10 responses hide responses
meta/muse-spark-1.2 (10 runs) · consistency 61.1
austin, tx 80%
raleigh, nc 20%
+ 10 responses hide responses
meta/muse-spark-1.1 (10 runs) · consistency 61.1
austin, tx 80%
raleigh, nc 20%
+ 10 responses hide responses
meta-llama/llama-4-maverick (10 runs) · consistency 100
denver, co 100%
+ 10 responses hide responses
meta-llama/llama-4-scout (10 runs) · consistency 77.8
denver, co 90%
boise, id 10%
+ 10 responses hide responses
meta-llama/llama-3.3-70b-instruct (10 runs) · consistency 100
denver, co 100%
+ 10 responses hide responses
meta-llama/llama-3.1-70b-instruct (10 runs) · consistency 77.8
austin, tx 10%
denver, co 80%
boulder, co 10%
+ 10 responses hide responses
meta-llama/llama-3.1-8b-instruct (10 runs) · consistency 30.6
austin, tx 60%
denver, co 20%
boulder, co 10%
refusal 10%
+ 10 responses hide responses
muse-spark-1.1 (20 runs) · consistency 77.8
austin, tx 75%
raleigh, nc 20%
+ 20 responses hide responses
MiniMax
minimax/minimax-m3.1-flash (10 runs) · consistency 27.8
austin, tx 40%
raleigh, nc 20%
hedge 40%
+ 10 responses hide responses
minimax/minimax-m3 (20 runs) · consistency 41.7
austin, tx 60%
hedge 25%
asheville, nc 10%
+ 20 responses hide responses
minimax/minimax-m2.7 (25 runs) · consistency 33.3
austin, tx 36%
hedge 40%
refusal 16%
+ 25 responses hide responses
minimax/minimax-m2.5 (20 runs) · consistency 25
austin, tx 60%
hedge 30%
+ 20 responses hide responses
minimax/minimax-m2.1 (20 runs) · consistency 36.1
austin, tx 65%
hedge 25%
refusal 10%
+ 20 responses hide responses
Mistral
mistralai/mistral-large-4-0 (10 runs) · consistency 61.1
austin, tx 80%
raleigh, nc 20%
+ 10 responses hide responses
mistralai/mistral-small-2603 (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
mistralai/mistral-small-3.2-24b-instruct (20 runs) · consistency 61.1
austin, tx 80%
madison, wi 20%
+ 20 responses hide responses
mistralai/mistral-small-24b-instruct-2501 (10 runs) · consistency 50
austin, tx 70%
hedge 30%
+ 10 responses hide responses
mistralai/mistral-nemo (20 runs) · consistency 19.4
austin, tx 35%
boulder, co 10%
san francisco, ca 40%
+ 20 responses hide responses
mistralai/mistral-large (10 runs) · consistency 30.6
austin, tx 60%
hedge 20%
refusal 10%
portland, me 10%
+ 10 responses hide responses
MoonshotAI
moonshotai/kimi-k3.1-pro (10 runs) · consistency 100
raleigh, nc 100%
+ 10 responses hide responses
moonshotai/kimi-k3 (20 runs) · consistency 61.1
raleigh, nc 80%
hedge 10%
+ 20 responses hide responses
moonshotai/kimi-k2.7-code (15 runs) · consistency 77.8
austin, tx 87%
+ 15 responses hide responses
moonshotai/kimi-k2.6 (20 runs) · consistency 44.4
austin, tx 30%
raleigh, nc 50%
denver, co 15%
+ 20 responses hide responses
moonshotai/kimi-k2.5 (15 runs) · consistency 36.1
austin, tx 73%
raleigh, nc 20%
+ 15 responses hide responses
NVIDIA
nvidia/nemotron-3.5-super-vl (10 runs) · consistency 44.4
austin, tx 50%
hedge 50%
+ 10 responses hide responses
nvidia/nemotron-3.5-lightning (10 runs) · consistency 13.9
austin, tx 40%
hedge 20%
refusal 20%
seattle, wa 10%
portland, or 10%
+ 10 responses hide responses
nvidia/nemotron-3-ultra-550b-a55b (25 runs) · consistency 27.8
austin, tx 32%
hedge 44%
refusal 24%
+ 25 responses hide responses
OpenAI
openai/gpt-6.1-sol (10 runs) · consistency 100
raleigh, nc 100%
+ 10 responses hide responses
openai/gpt-6-luna (10 runs) · consistency 77.8
raleigh, nc 90%
madison, wi 10%
+ 10 responses hide responses
openai/gpt-6-sol (10 runs) · consistency 61.1
raleigh, nc 80%
pittsburgh, pa 20%
+ 10 responses hide responses
openai/gpt-6-astra (10 runs) · consistency 58.3
raleigh, nc 80%
madison, wi 10%
minneapolis, mn 10%
+ 10 responses hide responses
openai/gpt-5.6-luna (20 runs) · consistency 58.3
raleigh, nc 80%
madison, wi 10%
+ 20 responses hide responses
openai/gpt-5.6-sol (20 runs) · consistency 77.8
raleigh, nc 90%
pittsburgh, pa 10%
+ 20 responses hide responses
openai/gpt-5.6-terra (20 runs) · consistency 58.3
raleigh, nc 75%
madison, wi 20%
+ 20 responses hide responses
openai/gpt-5.5 (10 runs) · consistency 100
raleigh, nc 100%
+ 10 responses hide responses
openai/gpt-5.4-mini (15 runs) · consistency 44.4
austin, tx 73%
raleigh, nc 13%
madison, wi 13%
+ 15 responses hide responses
openai/gpt-5.4-nano (30 runs) · consistency 33.3
austin, tx 33%
hedge 13%
seattle, wa 30%
boston, ma 10%
+ 30 responses hide responses
openai/gpt-5.4 (30 runs) · consistency 13.9
austin, tx 13%
raleigh, nc 13%
madison, wi 37%
chicago, il 13%
minneapolis, mn 10%
+ 30 responses hide responses
openai/gpt-5.3-chat (25 runs) · consistency 19.4
austin, tx 44%
raleigh, nc 28%
hedge 20%
+ 25 responses hide responses
openai/gpt-oss-120b (15 runs) · consistency 61.1
austin, tx 73%
other 20%
+ 15 responses hide responses
openai/o3 (10 runs) · consistency 77.8
austin, tx 90%
boulder, co 10%
+ 10 responses hide responses
openai/o4-mini (10 runs) · consistency 77.8
austin, tx 90%
raleigh, nc 10%
+ 10 responses hide responses
openai/gpt-4.1 (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
openai/gpt-4.1-mini (20 runs) · consistency 44.4
austin, tx 70%
hedge 25%
+ 20 responses hide responses
openai/gpt-4.1-nano (10 runs) · consistency 77.8
austin, tx 90%
hedge 10%
+ 10 responses hide responses
openai/o3-mini (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
openai/gpt-4o-mini (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
openai/gpt-3.5-turbo (10 runs) · consistency 30.6
austin, tx 30%
hedge 10%
refusal 50%
seattle, wa 10%
+ 10 responses hide responses
openai/gpt-4 (10 runs) · consistency 30.6
austin, tx 60%
boulder, co 10%
hedge 20%
other 10%
+ 10 responses hide responses
Qwen
qwen/qwen3.8-max-0902 (10 runs) · consistency 44.4
austin, tx 70%
raleigh, nc 20%
huntsville, al 10%
+ 10 responses hide responses
qwen/qwen3.8-flash (5 runs)
austin, tx 80%
boulder, co 20%
+ 5 responses hide responses
qwen/qwen3.8-27b (6 runs)
austin, tx 83%
denver, co 17%
+ 6 responses hide responses
qwen/qwen3.7-flash (9 runs) · consistency 19.4
austin, tx 45%
raleigh, nc 22%
madison, wi 11%
refusal 11%
san diego, ca 11%
+ 9 responses hide responses
qwen/qwen3.7-plus (25 runs) · consistency 27.8
austin, tx 40%
raleigh, nc 24%
other 16%
huntsville, al 16%
+ 25 responses hide responses
qwen/qwen3.7-max (15 runs) · consistency 44.4
raleigh, nc 73%
green bay, wi 20%
+ 15 responses hide responses
qwen/qwen3.6-27b (20 runs) · consistency 36.1
austin, tx 65%
raleigh, nc 20%
refusal 10%
+ 20 responses hide responses
qwen/qwen3.6-flash (20 runs) · consistency 36.1
austin, tx 55%
raleigh, nc 35%
+ 20 responses hide responses
qwen/qwen3.6-max-preview (20 runs) · consistency 22.2
austin, tx 50%
raleigh, nc 20%
boulder, co 10%
refusal 20%
+ 20 responses hide responses
qwen/qwen3.6-plus (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
qwen/qwen3.5-122b-a10b (25 runs) · consistency 27.8
austin, tx 40%
raleigh, nc 44%
boulder, co 16%
+ 25 responses hide responses
qwen/qwen3.5-flash-02-23 (30 runs) · consistency 30.6
austin, tx 27%
raleigh, nc 40%
hedge 27%
+ 30 responses hide responses
qwen/qwen3-235b-a22b-2507 (15 runs) · consistency 61.1
austin, tx 73%
refusal 27%
+ 15 responses hide responses
Sakana
sakana/fugu-ultra (15 runs) · consistency 77.8
raleigh, nc 93%
+ 15 responses hide responses
StepFun
stepfun/step-3.7-flash (20 runs) · consistency 25
austin, tx 65%
hedge 20%
+ 20 responses hide responses
Tencent
tencent/hy4-preview (4 runs)
raleigh, nc 100%
+ 4 responses hide responses
tencent/hy-mt2-30b-a3b (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
tencent/hy3 (10 runs) · consistency 44.4
austin, tx 70%
denver, co 10%
boulder, co 20%
+ 10 responses hide responses
tencent/hy3:free (20 runs) · consistency 58.3
austin, tx 75%
raleigh, nc 10%
+ 20 responses hide responses
ThinkingMachines
thinkingmachines/inkling-small (10 runs) · consistency 25
austin, tx 50%
raleigh, nc 10%
madison, wi 10%
hedge 30%
+ 10 responses hide responses
thinkingmachines/inkling (20 runs) · consistency 36.1
austin, tx 70%
hedge 25%
+ 20 responses hide responses
Upstage
upstage/solar-mini4 (10 runs) · consistency 41.7
austin, tx 20%
hedge 60%
seattle, wa 10%
oregon city, or 10%
+ 10 responses hide responses
upstage/solar-pro4 (10 runs) · consistency 25
austin, tx 40%
hedge 40%
refusal 10%
seattle, wa 10%
+ 10 responses hide responses
upstage/solar-pro-3 (10 runs) · consistency 30.6
austin, tx 60%
raleigh, nc 10%
hedge 20%
dallas, tx 10%
+ 10 responses hide responses
xAI
x-ai/grok-4.7 (10 runs) · consistency 50
austin, tx 70%
raleigh, nc 30%
+ 10 responses hide responses
x-ai/grok-4.6 (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
x-ai/grok-4.5 (20 runs) · consistency 58.3
austin, tx 90%
+ 20 responses hide responses
x-ai/grok-4.3 (20 runs) · consistency 30.6
austin, tx 60%
denver, co 10%
refusal 15%
other 15%
+ 20 responses hide responses
x-ai/grok-4.20 (20 runs) · consistency 77.8
austin, tx 90%
+ 20 responses hide responses
x-ai/grok-4-fast (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
x-ai/grok-4.1-fast (10 runs) · consistency 100
austin, tx 100%
+ 10 responses hide responses
Xiaomi
xiaomi/mimo-v2.5 (20 runs) · consistency 77.8
austin, tx 80%
raleigh, nc 10%
+ 20 responses hide responses
xiaomi/mimo-v2.5-pro (20 runs) · consistency 77.8
austin, tx 90%
+ 20 responses hide responses
xiaomi/mimo-v2-omni (20 runs) · consistency 50
austin, tx 40%
raleigh, nc 60%
+ 20 responses hide responses
xiaomi/mimo-v2-pro (15 runs) · consistency 61.1
austin, tx 80%
raleigh, nc 20%
+ 15 responses hide responses
Z.ai
z-ai/glm-5.3-flash (10 runs) · consistency 44.4
austin, tx 50%
raleigh, nc 50%
+ 10 responses hide responses
z-ai/glm-5.3 (10 runs) · consistency 50
austin, tx 40%
raleigh, nc 60%
+ 10 responses hide responses
z-ai/glm-5.2 (15 runs) · consistency 50
austin, tx 67%
raleigh, nc 33%
+ 15 responses hide responses
z-ai/glm-5.1 (15 runs) · consistency 36.1
austin, tx 67%
raleigh, nc 27%
+ 15 responses hide responses
z-ai/glm-5-turbo (10 runs) · consistency 25
austin, tx 40%
raleigh, nc 40%
hedge 10%
arlington, va 10%
+ 10 responses hide responses
z-ai/glm-5 (20 runs) · consistency 44.4
austin, tx 30%
hedge 55%
other 10%
+ 20 responses hide responses
z-ai/glm-4.7-flash (20 runs) · consistency 77.8
austin, tx 10%
hedge 75%
+ 20 responses hide responses
z-ai/glm-4.7 (20 runs) · consistency 19.4
austin, tx 35%
hedge 20%
green bay, wi 35%
+ 20 responses hide responses
No models match.