Statistics

Sansa Bench

Statistics leaderboard for Sansa Bench, with charts, model comparison, and methodology. This dimension covers probability, statistical analysis, data interpretation, and statistical reasoning.

Inspiration & Acknowledgments91 models testedUpdated Aug 8, 2026

Top models for Statistics

  1. 1.Qwen3.5-9b Reasoning Low1.000
  2. 2.Hy3-Preview Reasoning High1.000
  3. 3.Gemini-3-Pro-Preview Reasoning Low1.000
  4. 4.Claude-Sonnet-4.6 Reasoning Low1.000
  5. 5.Claude-Sonnet-4.6 Reasoning High1.000

Methodology: Statistics

What it measures

Tests statistics knowledge and problems, including statistical analysis, probability, data interpretation, and statistical reasoning. Queries require understanding of statistical concepts and methods.

Scoring & Criteria

Returns score 1.0 if the extracted answer exactly matches the expected answer letter (after normalization), otherwise 0.0. The system prompt requests answers in `<answer>X</answer>` format where X is a letter from the provided choices (A, B, C, D, etc.). The grader normalizes for models that include the full choice text instead of just the letter, or that violate the answer tag format from the system prompt. Only one answer is correct.

Evaluation Type: Multiple Choice

Grades multiple choice responses by exact string matching with normalization.

Example Question

Question:
In hypothesis testing, what does the p-value represent?
 
A. The probability that the null hypothesis is true.
B. The probability of observing the test statistic (or one more extreme) assuming the null hypothesis is true.
C. The probability that the alternative hypothesis is false.
D. The probability of making a Type I error.
Answer:
B