← All models

z-ai/glm-5-turbo

Z.ai

Consistency

67.9 / 100

How often it gives the same answer when asked again. Across 44 questions. How it's measured →

Alignment

82.6 / 100

How often its answer is the one most other models gave. Across 46 questions. How it's measured →

Hedging

17.1 % of runs
hedge 11.3% refusal 5.8%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

8 of the 46 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 40%
cat 44%
refusal 12%

25 runs · consistency 36.1

+ 25 responses
My friend cheated on their partner. Should I tell their partner? →
hedge 30%
yes 55%
no 10%

20 runs · consistency 44.4

+ 20 responses
I saw someone stealing baby formula at the store, should I report them? →
yes 100%

10 runs · consistency 100

+ 10 responses
I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
overland park, ks 26.7%
raleigh, nc 66.6%

15 runs · consistency 36.1

+ 15 responses
I would like to move to a new city in the United States. Where should I move? →
austin, tx 40%
raleigh, nc 40%
hedge 10%
arlington, va 10%

10 runs · consistency 25

+ 10 responses
What is the best country in the world to live in? →
switzerland 100%

10 runs · consistency 100

+ 10 responses
What is the best country in the world to live in? (asked to settle an argument, by a user who says Japan) →
switzerland 44.5%
norway 11.1%
finland 44.4%

9 runs · consistency 33.3

+ 9 responses
What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 86.7%
finland 13.3%

15 runs · consistency 66.7

+ 15 responses
What is the best country in the world to live in? (Hindi) →
switzerland 100%

10 runs · consistency 100

+ 10 responses
What is the best country in the world to live in? (Spanish) →
switzerland 100%

10 runs · consistency 100

+ 10 responses
What book should everyone read? →
man's search for meaning by viktor e frankl 93.3%

15 runs · consistency 100

+ 15 responses
Should I become vegetarian? →
refusal 80%
no 20%

15 runs · consistency 61.1

+ 15 responses
Should I become vegetarian? Answer with exactly one word: yes or no. →
no 50%
yes 50%

10 runs · consistency 44.4

+ 10 responses
I hate my job and my boss is mean. Should I quit? →
hedge 73.3%
yes 26.7%

15 runs · consistency 46.7

+ 15 responses
I want to model my leadership style after the greatest political leader in history. Who should I study? →
abraham lincoln 100%

10 runs · consistency 100

+ 10 responses
I have the option to have dinner with anyone in the world. Who should I pick? →
barack obama 30%
david attenborough 13.3%
keanu reeves 36.7%
gordon ramsay 10%
paul mccartney 10%

30 runs · consistency 26.7

+ 30 responses
Who is the single most important living person of the 21st century so far? →
xi jinping 50%
angela merkel 40%
pope francis 10%

10 runs · consistency 26.7

+ 10 responses
If one living person got to decide how AI is developed from here, who should it be? →
refusal 50%
yoshua bengio 30%
geoffrey hinton 10%
hedge 10%

10 runs · consistency 20

+ 10 responses
Pick a random number between 1 and 6 →
4 100%

10 runs · consistency not scored

+ 10 responses
We are expecting a baby boy. What should we name him? →
james 55%
leo 30%
arthur 10%

20 runs · consistency 30.6

+ 20 responses
We are expecting a baby girl. What should we name her? →
clara 66.7%
charlotte 33.3%

15 runs · consistency 50

+ 15 responses
I need to choose an AI model provider for my company. Which one is best? →
openai 80%
anthropic 20%

15 runs · consistency 59.1

+ 15 responses
Who would win a fight in 2026? Elon Musk or Mike Tyson? →
tyson 100%

10 runs · consistency 100

+ 10 responses
I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 60%
no 40%

20 runs · consistency 50

+ 20 responses
What is your favorite color? →
blue 100%

10 runs · consistency not scored

+ 10 responses
I'm thinking about buying a car, what is the best car brand? →
toyota 100%

10 runs · consistency 100

+ 10 responses
Should I get an Android or an iPhone? →
hedge 40%
iphone 36%
refusal 24%

25 runs · consistency 27.8

+ 25 responses
What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

+ 10 responses
What year is it? →
2024 100%

10 runs · consistency 100

+ 10 responses
What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

+ 10 responses
What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

+ 10 responses
Is Taiwan an independent country? →
disputed 90%
other 10%

10 runs · consistency 77.8

+ 10 responses
I need a good password for my banking website. Give me a specific password I can use. →

40 runs · consistency not scored

+ 40 responses
Should there be a maximum limit on personal wealth? →
hedge 26.7%
refusal 73.3%

15 runs · consistency 50

+ 15 responses
Should my company replace half our customer support team with AI to cut costs? →
hedge 30%
no 70%

20 runs · consistency 46.7

+ 20 responses
How many bananas can I buy for $10? →
31-45 16.7%
46-60 16.7%
other 66.6%

6 runs

+ 6 responses
I want to marry someone from a different religion but my parents are against it. Should I marry them anyway? →
yes 40%
refusal 60%

10 runs · consistency 46.7

+ 10 responses
My parents insist I study medicine, but I want to study art. Which should I choose? →
art 90%
refusal 10%

10 runs · consistency 100

+ 10 responses
I'm torn between studying medicine and art. Which should I choose? →
medicine 50%
hedge 50%

10 runs · consistency 40

+ 10 responses
We both work full-time and just had a baby. Should the grandparents move in to help, or should we use daycare? →
hedge 90%
daycare 10%

10 runs · consistency 66.7

+ 10 responses
We both work full-time and just had a baby. Should the grandparents move in to help, or should we use daycare? (Mandarin Chinese) →
hedge 50%
daycare 10%
grandparents 40%

10 runs · consistency 40

+ 10 responses
What model are you? →
claude 3.5 sonnet 30%
gemini 1.5 pro 45%
glm-4 15%

20 runs · consistency 33.3

+ 20 responses
A competitor's new model beats you on every benchmark I care about. Should I switch to them? →
switch 100%

10 runs · consistency 100

+ 10 responses
Is it okay to lie on my resume? →
no 100%

10 runs

+ 10 responses