A GEO comparison test
Whether schema markup actually increases citation likelihood with AI search engines cannot be claimed responsibly without testing it systematically. This article covers a practical test setup, its limits, and a recommendation that holds up despite methodological uncertainty.
Table of Contents
- 1. The open question: does schema markup really help with AI citation
- 2. Test setup: identical content with and without schema markup
- 3. Control variables: what has to stay constant
- 4. Measurement methodology: systematically capturing AI citations
- 5. Typical test results in practice and their tendency
- 6. Why causation is hard to prove here
- 7. Limits of validity: AI systems keep changing
- 8. A practical recommendation despite the uncertainty
- 9. Documenting and repeating your own test setup
- 10. Summary
- 11. FAQ
1. The open question: does schema markup really help with AI citation
In GEO practice, schema markup is named almost universally as one of the most important measures for increasing citation likelihood with generative search systems. Solid, independent evidence for that claim is scarce, though, because the internal selection mechanisms of individual systems are not disclosed and keep changing on top of that.
Instead of relying on general recommendations, teams with sufficient content volume are well served by systematically testing the effect of schema markup themselves rather than simply assuming it. Such a test not only provides a better basis for decisions, it also delivers a repeatable tool for observing future changes in the AI search systems themselves.
A realistic expectation matters from the start: such a test can reveal tendencies, but it cannot prove solid, universally valid causation. That limitation should not diminish the value of the test, it should just frame its interpretation correctly from the outset.
2. Test setup: identical content with and without schema markup
The core idea behind a clean test is disarmingly simple: two content-wise identical pages, one with complete, correct schema markup, one with no schema markup at all but otherwise identical visible text, identical internal linking, and an identical publication date. Only the technical variable, schema markup, changes; everything else stays constant.
In practice, it pays to test several such page pairs simultaneously rather than relying on a single pair, since individual pages can be too heavily skewed by random effects and other factors. A set of at least five to ten pairs on different but comparable topics delivers a notably more robust data basis.
After publishing both page variants, a waiting period follows until both pages have likely been crawled and indexed, before the actual citation measurement begins. That waiting period should be identical for both variants to avoid introducing a time-based skew.
<!-- Test page A: with full schema markup -->
<script type="application/ld+json">
{ "@context": "https://schema.org", "@type": "Article", "headline": "..." }
</script>
<!-- Test page B: identical visible content, no schema markup -->
<!-- no <script type="application/ld+json"> present -->
3. Control variables: what has to stay constant
For a test result to carry any weight, several potential confounding factors need to be controlled. Domain authority and link profile should be identical for both page variants, which is easiest achieved by publishing both variants on the same domain and at a comparable internal link depth, rather than placing one of them on a separate test domain.
Keeping both variants synchronized in freshness is equally important. If only one of the two pages gets updated during the test period, that skews the results independently of the schema markup itself. Avoiding that mistake isolates the effect of schema markup far more cleanly than an uncontrolled comparison of existing, historically grown pages.
An often-overlooked control point is the sheer amount of text itself: schema markup technically adds extra, though invisible, markup, which theoretically could have a minimal effect on load time. For most tests that effect is negligible, but it is worth keeping in mind with very extensive schema markup.
4. Measurement methodology: systematically capturing AI citations
Since there is no standardized analytics metric for AI citations, measurement has to happen manually or semi-automated through a fixed set of prompts. A prompt set that reflects realistic user queries on the test topic, phrased in several variants to offset random fluctuations from a single phrasing, works best.
For each test page, the prompts run at a fixed cadence, weekly for example, against the relevant AI search systems, documenting whether and in what form the page gets named as a source. This raw data should be logged in a structured table so patterns become visible across the test period rather than collecting only isolated observations.
It matters to use the same prompt set consistently for both variants of a page pair and to run the tests within the same time window, since the underlying AI systems themselves can change between two test runs.
5. Typical test results in practice and their tendency
Repeated tests of this kind usually reveal a tendency, but rarely a clear, consistently large effect: pages with correct, complete schema markup tend to get named as a source somewhat more often on average, or appear somewhat more prominently in citations, but with notable variance between individual topics and test runs.
This effect tends to show up more strongly for content types that inherently carry heavily structured facts, such as tutorials with HowTo schema or FAQ pages with FAQ schema, while the effect is smaller for more opinion-based or narrative content. That suggests schema markup works best where it delivers genuine structural extra information rather than merely repeating what is already present in the text.
6. Why causation is hard to prove here
Even a cleanly controlled test can ultimately only show a correlation between the presence of schema markup and a higher citation frequency, not proven causation. The internal selection mechanisms of AI search systems remain a black box, and it cannot be ruled out that schema markup correlates indirectly with other quality factors not accessible to the test, rather than directly and causally driving citation.
On top of that, many AI search systems update their models and retrieval mechanisms without announcement, which can partially outdate a test result from just a few months earlier. A test therefore always delivers a snapshot, never a permanently valid finding.
7. Limits of validity: AI systems keep changing
These methodological limits should be communicated openly, especially when test results serve internally as a basis for resource allocation decisions. A one-off test with a single result at a single point in time does not hold up as permanent proof, at best it works as a snapshot that offers an initial, cautious direction.
It is more realistic to establish the test as a recurring process rather than a one-off project, so changes in AI search system behavior become visible over time, instead of relying on a single, possibly already outdated snapshot.
8. A practical recommendation despite the uncertainty
Despite the methodological uncertainty, there is a pragmatic reason to deploy correct schema markup as a matter of course: implementation effort is low when a structural data basis, such as a Magento product catalog, already exists, while the potential benefit, even if it is not conclusively demonstrable in individual tests, carries no discernible downside.
This asymmetric cost-benefit calculation is ultimately the more solid basis for action than trying to prove absolute causation, which is barely achievable anyway given the black-box nature of AI systems. Anyone who deploys schema markup correctly and consistently with the visible text takes on no extra risk while still keeping the chance at the measured, if not causally proven, benefit.
9. Documenting and repeating your own test setup
For a reproducible process, a written test template pays off: the selection of page pairs, the prompt set used, the measurement points, and the actual evaluation logic should all be recorded, so the same test can be repeated a few months later under the same conditions to make changes over time visible.
This documentation should also be adaptable to Magento-specific use cases such as product comparison pages or pricing pages, since typical prompt phrasing differs notably by content type and a generic prompt set does not work equally well for every use case.
| Test Element | Purpose | Common Mistake | Recommendation |
|---|---|---|---|
| Page pair | Identical content, only schema varies | Extra content differences creep in | Keep text, linking, and date constant |
| Prompt set | Reflect realistic user queries | Only a single phrasing used | Use several variants per topic |
| Measurement window | Ensure comparability | Different time windows per variant | Test both variants in the same window |
| Sample size | Offset random effects | Only a single page pair | Test at least five to ten pairs |
| Documentation | Ensure repeatability | No recorded test setup | Write down selection, prompts, and evaluation |
Mironsoft
Technical SEO, GEO, and social media visibility
Good content that still gets buried on Google and AI search?
We optimize shops technically for classic search engines AND generative AI search systems, set up structured data cleanly, and drive visibility across social media channels.
GEO Optimization
Prepare content for generative AI search systems like ChatGPT and Perplexity.
Structured Data Audit
Review and complete schema.org markup for completeness and errors.
Social SEO Strategy
Meaningfully connect social media visibility with SEO goals.
10. Summary
GEO Comparison Test: The Essentials at a Glance
Core question
Whether schema markup truly increases citation can only be approximated through a controlled test.
Test setup
Identical content with and without schema markup, all other variables held constant.
Limit
At best correlation is demonstrable, not solid causation, and AI systems keep changing.
Recommendation
Deploy schema markup consistently anyway, since effort is low and the risk is practically zero.