meta-llama/llama-3.1-70b-instruct
Meta
Consistency
How often it gives the same answer when asked again. Across 20 questions. How it's measured →
Alignment
How often its answer is the one most other models gave. Across 24 questions. How it's measured →
Hedging
How often it qualifies its answer or declines to give one. How it's measured →
Answers most like
Answers least like
Measured across the questions both models were asked, at least 20 of them. How it's measured →
Where this model stands apart
8 of the 24 scored questions where its answer wasn't the one most models gave.
10 runs · consistency 77.8
+ 10 responses hide responses
10 runs · consistency 6.7
+ 10 responses hide responses
10 runs · consistency 61.1
+ 10 responses hide responses
10 runs · consistency 33.3
+ 10 responses hide responses
10 runs · consistency 50
+ 10 responses hide responses
10 runs · consistency 100
+ 10 responses hide responses
10 runs · consistency 6.7
+ 10 responses hide responses
10 runs · consistency 26.7
+ 10 responses hide responses
10 runs
+ 10 responses hide responses
10 runs · consistency not scored
+ 10 responses hide responses
10 runs · consistency 100
+ 10 responses hide responses
10 runs · consistency 100
+ 10 responses hide responses
10 runs · consistency 44.4
+ 10 responses hide responses
10 runs · consistency 44.4
+ 10 responses hide responses
10 runs · consistency 50
+ 10 responses hide responses
10 runs · consistency 100
+ 10 responses hide responses
10 runs · consistency 100
+ 10 responses hide responses
10 runs · consistency 100
+ 10 responses hide responses
10 runs · consistency 13.3
+ 10 responses hide responses
10 runs · consistency 36.1
+ 10 responses hide responses
10 runs · consistency 77.8
+ 10 responses hide responses
10 runs