Skip to content
JanusLabs.Explore example report

Common questions › Trusting the numbers

Why does the same question get a different answer each time?

AI answers can vary with the service, retrieved sources, question, location and account conditions. One answer is one observation, not a reliable picture of every buyer.

Why answers vary

An assistant can compose a different answer or retrieve different sources each time. Its models, search results and settings can change too. A saved answer tells you what was observed under the recorded conditions.

What the Pilot does

Our UK Pilot uses 20 fixed questions across ChatGPT Search, Google AI Mode and Google AI Overviews. Record each service separately, retain original answers and sources, and keep failed readings unknown. A clean or recorded collection setup cannot represent every buyer’s personalised experience.

Compare carefully

Repeat unchanged questions under compatible conditions when a follow-up is explicitly arranged. JanusLabs does not currently offer daily monitoring. Repeated observations are not independent buyers, and changes after a website edit do not prove the edit caused them.

Read the intended method · Read the Pilot observation

Read next

See the intended experienceExplore a static example of the intended experience. Public app access and client onboarding are not available.

Explore example report