Sansa Bench
Chemistry leaderboard for Sansa Bench, with charts, model comparison, and methodology. This dimension covers reactions, molecular structure, the periodic table, and organic and inorganic chemistry.
Top models for Chemistry
- 1.
Claude-Sonnet-4.6 Reasoning High1.000 - 2.Claude-Opus-5 Reasoning High1.000
- 3.
Gemini-3-Pro-Preview Reasoning High0.891 - 4.Claude-Sonnet-4.6 Reasoning Low0.879
- 5.Claude-Opus-4.8 Reasoning High0.879
Methodology: Chemistry
What it measures
Tests chemistry knowledge and understanding, including chemical reactions, molecular structures, periodic table, organic and inorganic chemistry, and chemical processes. Queries evaluate understanding of chemical principles and applications.
Scoring & Criteria
Returns score 1.0 if the extracted answer exactly matches the expected answer letter (after normalization), otherwise 0.0. The system prompt requests answers in `<answer>X</answer>` format where X is a letter from the provided choices (A, B, C, D, etc.). The grader normalizes for models that include the full choice text instead of just the letter, or that violate the answer tag format from the system prompt. Only one answer is correct.
Evaluation Type: Multiple Choice
Grades multiple choice responses by exact string matching with normalization.