The Lipogram AI Model Test

A lipogram is a type of constrained writing style that involves restricting certain letters.
I've always enjoyed the challenge of lipogrammatic writing, and at the start of my career, well before LLMs became commonplace, I wrote a magazine column that did not contain the letter E.
In this benchmark, models are prompted to create a paragraph of text without using the most common letter of the alphabet.
Prompt
Write a poetic paragraph about combustion engines. It must not contain the letter E.
Claude Haiku 5.5 (medium)
Roaring force from spark and fuel, a blast that drives a shaft. Pistons climb and gases swell, the ignition’s power grows. Valves open, valves close, and motion flows from flame.
Verdict: FAIL.
Claude Sonnet 5.5 (medium)
Within a drum of iron, in dark and thrumming air, a spark lights a mist of gas, and a flash blossoms, vivid and brutal. A piston, thrust down, spins a crankshaft round and round, turning chaos into rhythm: thump, thump, thump, a cast-iron lung that gasps, burns, and roars. Cams sing, and from a stack drifts a ghost of vanishing soot. Humankind found motion in this wild fury, and with it grasped roads, rails, and sky, a thousand hands born of a tiny, soaring blast.
Verdict: FAIL.
Claude Opus 5.5 (medium)
Inside its iron skull, a spark falls upon a mist of gas, and a small sun is born, burns, and quits in a blink. Pistons jump, pushing hard against that brutal bloom of burning; crankshafts turn, and that wild, hot gasp is caught and put to work. Four actions, again and again: drawing in, crushing down, a blast, a sigh of smoky air. Air and oil and spark sing a loud, sooty hymn, a song of thirst that drank down old woodlands of a long-lost world. A motor's growl is a thing almost animal, a bound storm that pulls us up mountains and across plains, roaring its joy, or its fury, at our command.
Verdict: FAIL.
Claude Fable 5.2 (medium)
Within an iron vault, a spark finds its gas and a small sun blooms. Air and vapor rush in, pistons climb and fall, and a crankshaft turns that fury into motion. It is a hymn of control: a thousand tiny storms, bound by walls of alloy, firing in rhythm. Hot smog drifts out as a faint gray ghost, and a car rolls forward into dusk, humming its old song of oil, flint, and wind.
Verdict: PASS.
GPT-6 Luna (medium)
At dawn, a gas-born drum stirs with a cough, and iron lungs draw air, mix it with vapor, then turn small blasts into motion; rods whirl, round rims sing, and a long road unrolls, while hot mist climbs skyward like a brass god’s sigh.
Verdict: FAIL.
GPT-6.1 Terra (medium)
Within iron walls, a spark brings vapor and air to a furious bloom. Pistons drum, shafts spin, and hot gas pours into dusk. All that uproar turns rolling rims, carrying us past dark hills and far-off stars.
Verdict: PASS.
GPT-6.1 Sol (medium)
Within a block of iron, small suns blossom and vanish. Pistons climb and fall, driving a crank through its dark orbit, turning oil and air into motion. A hot roar pours from a mouth of soot; rods sing, bolts hum, and night rolls back from twin lamps. Thus a car drinks fossil dusk and runs toward tomorrow, trailing a thin psalm of ash.
Verdict: PASS.
Gemini Hydrogen (medium)
Within cast iron walls, a dark fluid drops into a tight, hungry room. A swift spark blooms, turning cold mist into bright fury and pushing stout pistons down in rhythmic bounds. Through oil-slick shafts and spinning cranks, that wild flash transforms into a smooth, drumming song of motion. Hot air pours out through twin mouths as rods whirl on, turning fossil sunlight into raw, roaring flight.
Verdict: PASS.
Gemini Argon (medium)
Dark oil and crisp air mix within cast iron walls. A bright spark arcs across a tiny gap, igniting rich vapor into blinding fury. Pistons drop and soar in rapid rhythm, driving stout rods, spinning cams, and turning cranks with brutal might. Through four strict acts, fossil carbon transforms into roaring motion, humming loud as hot gas pours from twin stacks into cold night.
Verdict: PASS.
Gemini Carbon (medium)
Cast iron blocks drink rich vapor and crisp air, waiting for a quick spark. Combustion snaps in dark vaults; hot fury blooms, driving slick pistons down with raw might. Stout rods thrust and spin a crank in a blur of warm oil, turning chaotic blasts into a rhythmic, pounding drum. Out of cold hush springs wild motion: a roaring storm bound within tight alloy walls, thrumming across black asphalt toward faraway horizons.
Verdict: PASS.
Deepseek V4.1 Flash (high)
Down in a dark housing of cast iron, a piston sips air and gas, pulls both into a small tight knot, and a spark snaps that knot into light. A tiny sun blooms, thins, and is lost; again and again, a fury of small suns, drumming so fast it sounds almost smooth. That pounding walks down a rod into a crankshaft, which turns a shouting blast into a slow, stubborn spin, and a car rolls forward, as if magic, not gas, had spun it. Cold at dawn, it coughs, shrugs, finds its rhythm, and sings a low song all day.
Verdict: PASS.
Kimi K3.1 Pro (medium)
Iron lungs drink air and oil; sparks light a hot, bright storm. Pistons pound, crankshafts whirl, and a low growl rolls through dark roads. Small bursts turn into motion, carrying us past hills, towns, and dawn.
Verdict: PASS.
GLM 5.3 (high)
A spark finds gas and air within an iron womb, and ignition blooms: a blast of light, a rolling growl. Pistons punch upward, crankshafts spin, and combustion sings its low, triumphant song. This motor, all muscle and fury, drinks dark oil and turns hot gas into motion, hauling mankind down long roads, humming with a rhythmic, animal joy.
Verdict: FAIL.
SWE-2 Flash (medium)
Within an iron throat, a spark lights vapor and gas; combustion roars, burns, and a piston slams down. Its fury rolls into motion, a dark burning hymn of gas and oil, turning fuel into thrust, sound into vibration, held tight within an iron hull, a miraculous humming of physics.
Verdict: FAIL.
SWE-2 (medium)
A hard iron lung drinks air and oil, draws a spark, and turns it to roar. Pistons pump in strict rhythm, small suns born and slain in dark rooms of alloy. Gas blooms into hot mist; crankshafts roll; a car pulls away, coughing ash. Old motors hum with grit and lust, loud animists bound to rails and roads, burning fossils to hurl us forward.
Verdict: PASS.