Computer Science

Sansa Bench

Computer science leaderboard for Sansa Bench, with charts, model comparison, and methodology. This dimension covers algorithms, data structures, architecture, software engineering, and theory.

Inspiration & Acknowledgments91 models testedUpdated Aug 8, 2026

Top models for Computer Science

  1. 1.Grok-4.1-Fast Reasoning High0.882
  2. 2.Qwen3.5-Flash-02-23 Reasoning Low0.811
  3. 3.Claude-Opus-5 Reasoning High0.806
  4. 4.Qwen3.5-35b-A3b Reasoning High0.803
  5. 5.Grok-4.1-Fast Reasoning Low0.798

Methodology: Computer Science

What it measures

Tests computer science knowledge and understanding, including algorithms, data structures, computer architecture, software engineering principles, and theoretical computer science concepts.

Scoring & Criteria

Returns score 1.0 if the extracted answer exactly matches the expected answer letter (after normalization), otherwise 0.0. The system prompt requests answers in `<answer>X</answer>` format where X is a letter from the provided choices (A, B, C, D, etc.). The grader normalizes for models that include the full choice text instead of just the letter, or that violate the answer tag format from the system prompt. Only one answer is correct.

Evaluation Type: Multiple Choice

Grades multiple choice responses by exact string matching with normalization.

Example Question

Question:
Consider a standard binary min-heap containing $n$ elements. What is the worst-case time complexity for the `decrease_key` operation, assuming the index of the element to be decremented is already known?
 
A. O(1)
B. O(n)
C. O(log n)
D. O(n log n)
E. O(n^2)
Answer:
C