Retail LLMO LabAbout this Lab

About this Lab|Methodology and Metric Definitions

Learn how the Retail LLMO Lab observes AI answers and defines coverage, first-position rate, Top 3 rate and related metrics.

Family of four replacing appliances

Tracks recommendations and retailer visibility for a family of four replacing major appliances.

Selected

About this Lab

This public monitoring dashboard repeatedly asks the same questions to observe which electronics retailers and e-commerce sites generative AI presents as places to buy, then publishes mechanically aggregated results.

What We Observe

We prepare fixed shopper personas and queries, then submit them through the ChatGPT web interface. We record the answer, citations and sources, product cards, and the retailer list for each product in the order shown.

How Rankings Are Calculated

Within each query, retailers are ranked using the following sequence.

  1. More products linked to that retailer in the answer
  2. If tied, the higher position in the retailer list
  3. If still tied, the greater number of retailer appearances

All rates use the number of successfully observed queries as their denominator.

  • Coverage: share of queries where the retailer appeared at least once
  • First-position rate: share of queries where the retailer ranked first
  • Top 3 rate: share of queries where the retailer ranked in the top three

How to Read the Data

  • Generative AI answers can change each time, even for the same query. A daily observation is a point-in-time snapshot, and a ranking change does not necessarily indicate the effect of an optimization measure.
  • The current dataset covers ChatGPT only and does not represent other generative AI systems.
  • Price, stock and delivery text is recorded as displayed in the AI answer and may differ from the retailer's actual selling conditions.
  • Product and retailer naming variations are normalized, with normalization decisions retained in the source research records.
  • This dashboard does not judge retailer quality or superiority; it records only how retailers appear in AI answers.

Updates

Data is added after each observation and accumulated as a daily trend. Last updated is the time of the latest aggregation.

Product and service names are trademarks or registered trademarks of their respective owners.