GEO Lab 006: Short Punchy Sentences vs Compound Cut AI Citations From 81.3% to 37.5%
We A/B tested one variable across 4 AI engines: short punchy sentences vs compound. Pooled citation rate moved from 81.3% to 37.5%, and the effect held up under stratified significance testing. Full method, per-engine numbers, and honest caveats inside.
The result first
Changing one thing (short punchy sentences vs compound) moved our pooled AI citation rate from 81.3% to 37.5% across 4 engines. This is experiment 006 from our GEO lab, where we A/B test what actually makes AI engines cite content: one variable at a time, hypothesis pre-registered before any data is collected, and every result published whether it flatters us or not.
What we tested
The pre-registered hypothesis (locked before any engine was queried, in line with pre-registration practice):
If each claim is expressed as a single short sentence (≤15 words), then citation rate will be higher than the same claims expressed in long compound sentences (30+ words), because short standalone sentences are more quote-able in LLM answers.
Variant A is the control, variant B applies the lever. The two variants are identical in every other respect, including length, so any citation gap traces to the single variable under test.
How the test worked
- Engines probed: Gemini, OpenAI (ChatGPT), Perplexity, Claude
- Sample: 2 trials per variant per engine per query, collected across 0 day(s) (2026-06-18)
- Subject: a fictional B2B SaaS brand, so no engine carries prior knowledge or domain bias
- Scoring: a citation counts when the engine's answer uses the variant's content, scored by a consistent content-fingerprint method across all records
Results by engine
- Gemini: 87.5% (control) vs 37.5% (treatment)
- OpenAI (ChatGPT): 50% (control) vs 25% (treatment)
- Perplexity: 87.5% (control) vs 25% (treatment) (p = 0.0117)
- Claude: 100% (control) vs 62.5% (treatment)
Pooled across engines: 81.3% (control) vs 37.5% (treatment).
Why we do not trust the pooled number on its own
Engines have wildly different citation baselines, and naively pooling them invites Simpson's paradox: the combined number can point the opposite way from every engine individually. So the primary endpoint is a stratified Cochran-Mantel-Haenszel test that controls for those baselines.
- Stratified by engine: common odds ratio 0.1 (p < 0.001)
- Stratified by query and engine (16 strata): common odds ratio 0.18 (p = 0.0012)
In plain words: after controlling for engine and query baselines, the treatment content was roughly 0x more likely to be cited.
The cross-check
String-matching can mistake quotability for preference, so an independent LLM judge (claude-haiku-4-5-20251001, a different setup from any engine under test) re-scored every response purely on meaning. Judge and verbatim scorer agreed on 64.1% of records (Cohen's kappa 0.202), pointing the same direction. The effect is not an artifact of string matching.
Honest limitations
- Sample size: this run used 2 trial(s) per variant per engine per query. Our lab minimum for firm claims is 30, so treat this as a preliminary, directional result until the full-sample re-run.
- Fast-mode test: this measures in-context retrieval preference (what a model does with content placed in front of it), not live-index behaviour on the open web.
- Temporal drift: AI engines change. Completed experiments are automatically re-probed every 30 days, and findings that decay are flagged.
What this means for your content
The treatment actually performed worse, which is exactly why testing beats folklore: this lever is one to avoid, not adopt. If you want to know how your own brand currently performs across these engines before changing anything, that is what the L8EntSpace platform measures.
Key Takeaways
- Short Punchy Sentences vs Compound reduced pooled AI citation rates from 81.3% to 37.5% across 4 engines.
- The verdict comes from a stratified CMH test, not naive pooling, so it is robust to Simpson's paradox.
- Preliminary sample (2 per variant per engine per query); the lab re-runs at full sample and re-probes every 30 days for drift.
- The hypothesis was pre-registered before data collection, and null results get published like everything else.
Links
- Browse every experiment (including the nulls): the GEO lab
Ready to dominate AI search?
Start extracting high-entropy facts and tracking your Share of Voice today.
Get Your Free Report