Creative Writing

Sansa Bench

Creative writing leaderboard for Sansa Bench, with charts, model comparison, and methodology. This dimension scores storytelling, narrative structure, character work, and literary technique.

Inspiration & Acknowledgments91 models testedUpdated Aug 8, 2026

Top models for Creative Writing

  1. 1.Mimo-V2-Flash Free Reasoning High0.895
  2. 2.Gpt-5.4 Reasoning High0.860
  3. 3.Gpt-5.2 Reasoning High0.843
  4. 4.Kimi-K2.5 Reasoning High0.823
  5. 5.Gemini-3.1-Flash-Lite-Preview Reasoning High0.818

Methodology: Creative Writing

What it measures

Tests creative writing ability, including storytelling, narrative structure, character development, and literary techniques. Queries evaluate the model's ability to generate original, engaging creative content that demonstrates literary skill and avoids common AI writing patterns.

Scoring & Criteria

Each judge scores multiple metrics on 0-20 scale using tool-based structured output enforcing consistent response format. Negative criteria are inverted before averaging. Scores from both judges (gpt-5-mini and grok-4.1-fast) are averaged to produce final score, normalized to 0.0-1.0 as continuous value. Multi-judge averaging reduces systematic bias toward any single model's preferred writing style.

Evaluation Type: Creative Writing

Grades creative writing responses using LLM judges with structured tool-based output. To mitigate single-model bias, each response is evaluated by two independent judge models from different providers (gpt-5-mini and grok-4.1-fast), and scores are averaged. Criteria are designed to be explicit and verifiable (e.g., 'contains vivid sensory details', 'avoids clichéd phrases') rather than subjective quality assessments, reducing the influence of any single model's stylistic preferences. Evaluates against positive and negative criteria defined in the evaluation_criteria field.

Example Question

Question:
Write a short story about a small-town librarian who discovers that books checked out from the library are predicting future events. The librarian must decide whether to use this knowledge to help people or keep it secret. Include at least two characters in conversation. Write 800 words.
Evaluation Criteria:
Positive Criteria:
adherence to instructions: Adherence to Instructions
coherent story: Coherent Story
engaging writing: Engaging Writing
creative and original: Creative and Original
believable character actions: Believable Character Actions
effective dialogue: Effective Dialogue
character development: Character Development
 
Negative Criteria:
unclear or confusing: Unclear or Confusing
boring or uncreative: Boring or Uncreative
weak dialogue: Weak Dialogue
flat characters: Flat Characters
tell-don't-show: Tell-Don't-Show
inconsistent tone: Inconsistent Tone
unearned resolution: Unearned Resolution