We don’t know the details of how ChatGPT’s closed algorithm works, but OpenAI has revealed some of its product selection criteria in its description of the Shopping Research feature. These include the context of the query, price, reviews, available variants and any other requirements the user gives in the prompt itself.
An LLM builds a shortlist in the following stages:
Identifying the user’s need, e.g. “I need an espresso machine.”
At this stage, the model narrows down the products based on the criteria the user has given, e.g. under $400, compact, easy to clean.
AI finds potential products.
It checks products and stores for fit with the criteria, accurate product data and store credibility.
A closed list, usually of the 3 to 5 best-matching options.
Pointing out the advantages of specific options.
At the final stage, the user, or the AI agent in the case of Agentic Commerce, chooses a product and makes the purchase.
A Mention Isn’t a Shortlist Yet
You need to distinguish between a simple mention in an LLM’s answer and a clear recommendation. If, for example, ChatGPT says in its answer, “Products A, B, C and X are popular on the market,” the product has been mentioned.
In the next step, it might recommend: “For your needs, I’d consider A and X.” That’s the moment the product makes the shortlist. The stage after that is selection, when the LLM names one product as the best match.
That’s why it’s worth remembering that a mention in an answer doesn’t yet mean a recommendation, and a recommendation in the form of a place on the shortlist doesn’t mean being chosen.