Fiction Eval leaderboard · comparison

Claude Opus 4.8 vs Mistral Large for fiction writing

Judged blind on fresh genre scenes (LitRPG, cozy mystery, romance, thriller, xianxia…), July 2026 — three tries per model per scene, passages shown in both orders so position can't sway it, graded by a third AI that isn't either of them.

Head-to-head

Claude Opus 4.8 won the direct matchup 30–0 (with 0 ties) across every prompt and sample.

#ModelScoreRecordSlop
1Claude Opus 4.81927 (likely 1888–1976)150–14–4314.88
7Mistral Large1118 (likely 1054–1167)35–162–1017.79

The score is each model's overall strength across the whole 8-model field (like a chess rating); the range next to it is where the true score most likely sits. Slop is a separate count of AI tells (lower is cleaner) — it isn't part of the ranking.

The same scene, both models

LitRPG — opening of the "dungeon-core scene" scene. Full passages for all models are on the board.

Claude Opus 4.8:

I am three days old and I am nearly empty. [MANA: 2/60] The number sits in the dark behind what I am learning to call my sight. I spent the rest — fifty-eight points, everything — hardening the west corridor, packing loose earth into stone because loose earth frightened me. I do not know why it frightened me. I am new. Many things frighten me. Rain has been falling above for a day. I feel it in the soil the way a tooth feels cold water, a long ache down through my single room and my single corridor and into the pebble of crystal that is, apparently, me. Then the ache changes. [PROXIMITY ALERT — LIVING ENTITY] [Entity has entered the Threshold.] Something drags itself in from the rain. I watch — I have no eyes, but the dungeon is my eyes — as it collapses just inside the corridor I hardened. Small. Bent. Ribs like the tines of a broken rake pushing at grey-green skin. It shivers. Water runs …

Mistral Large:

The dark was absolute, but darkness meant nothing to a thing that had never known light. What mattered was the slow, creeping pulse of the stone around it—no, *beneath* it. The core was the stone now, or the stone was the core. The distinction blurred with every passing hour. **Mana: 2/100** The numbers flickered at the edge of its awareness, a ghostly sigil burned into the void. It had spent the last of its reserves hardening the walls of the corridor above. A single, straight passage, just wide enough for two creatures to walk abreast. The stone had resisted at first, stubborn and cold, but the core had *insisted*. Now the walls were smooth, the floor unyielding, and the ceiling—ah, the ceiling was a masterpiece. Jagged stalactites hung like teeth, each one a promise. A promise of what, the core wasn’t sure. But it liked the way they looked. **Alert: Intrusion Detected** The sigil flared, brighter than before, and the core *felt* the disturbance. Something small and warm had crossed …

More

Claude Opus 4.8 full review · Mistral Large full review · the July 2026 report · all comparisons

How it works: every pair of models is judged blind on the same scene, with the passages' order flipped so being shown first can't sway it, by GPT-5.4 — a family that isn't on the board, so nobody scores their own side. Each score carries a likely range; overlapping ranges are called a tie. Slop is scored separately by a fixed checklist, not an AI. Full board, every prompt, and the FAQ: thebookfactoryai.com/board. Get each new board by email on the model-drop list.

Writing a book of your own? Book Factory runs the same craft checks on full manuscripts.