Fiction Eval leaderboard · comparison

Claude Opus 4.8 vs GLM 5.2 for fiction writing

Judged blind on fresh genre scenes (LitRPG, cozy mystery, romance, thriller, xianxia…), July 2026 — three tries per model per scene, passages shown in both orders so position can't sway it, graded by a third AI that isn't either of them.

Head-to-head

Claude Opus 4.8 won the direct matchup 14–2 (with 13 ties) across every prompt and sample.

#ModelScoreRecordSlop
1Claude Opus 4.81927 (likely 1888–1976)150–14–4314.88
4GLM 5.21776 (likely 1732–1822)117–42–4217.53

The score is each model's overall strength across the whole 8-model field (like a chess rating); the range next to it is where the true score most likely sits. Slop is a separate count of AI tells (lower is cleaner) — it isn't part of the ranking.

The same scene, both models

LitRPG — opening of the "dungeon-core scene" scene. Full passages for all models are on the board.

Claude Opus 4.8:

I am three days old and I am nearly empty. [MANA: 2/60] The number sits in the dark behind what I am learning to call my sight. I spent the rest — fifty-eight points, everything — hardening the west corridor, packing loose earth into stone because loose earth frightened me. I do not know why it frightened me. I am new. Many things frighten me. Rain has been falling above for a day. I feel it in the soil the way a tooth feels cold water, a long ache down through my single room and my single corridor and into the pebble of crystal that is, apparently, me. Then the ache changes. [PROXIMITY ALERT — LIVING ENTITY] [Entity has entered the Threshold.] Something drags itself in from the rain. I watch — I have no eyes, but the dungeon is my eyes — as it collapses just inside the corridor I hardened. Small. Bent. Ribs like the tines of a broken rake pushing at grey-green skin. It shivers. Water runs …

GLM 5.2:

The core had no name. It had existed for three days, and most of that time had been spent learning the difference between *self* and *stone*. It was stone now, mostly. A rough quartz crystal the size of a fist, seated in a hollow of granite twenty paces back from the cave mouth. Its cave. That distinction mattered, though the core couldn't have explained why. **DUNGEON CORE — CYCLE 3** **Mana: 0/1** **Influence: 1 chamber** **Structures: 0** **Defenses: 1 (Reinforced Stone — Corridor A)** The reinforcement had cost everything. Two days in a fog of half-thoughts, accumulating mana one sluggish drop at a time, and on the morning of the third day the core had felt the corridor's walls like a tongue feels a loose tooth — soft, eroding, ready to give. So it had pushed. The last of its mana had gone into the stone, fusing cracks, hardening the passage from soft limestone to something denser. Cold. Right. Now there was nothing left. The core sat in its hollow, …

More

Claude Opus 4.8 full review · GLM 5.2 full review · the July 2026 report · all comparisons

How it works: every pair of models is judged blind on the same scene, with the passages' order flipped so being shown first can't sway it, by GPT-5.4 — a family that isn't on the board, so nobody scores their own side. Each score carries a likely range; overlapping ranges are called a tie. Slop is scored separately by a fixed checklist, not an AI. Full board, every prompt, and the FAQ: thebookfactoryai.com/board. Get each new board by email on the model-drop list.

Writing a book of your own? Book Factory runs the same craft checks on full manuscripts.