Observatory method

Every ranking, step by step.

Every ranking starts from published questions, repeated on several AI assistants, read with fixed rules and counted with their margin of uncertainty. Here you will find the steps, the thresholds, the sources and the limits.

The cycle

Eight steps, always the same.

The same cycle applies to every series and every country. Only the source of the topics changes. Weekly rankings are published every Monday, on the week just closed.

From signal to closed edition
  1. The signal

    An external source tells what matters at that moment. It is always an official or licensed API or dataset, never a copied page.

  2. Choosing the topics

    The editorial team keeps the topics where a recommendation makes sense and discards breaking news, private individuals and sensitive topics. Choices and discards stay on record.

  3. The questions

    For each topic, three fixed phrasings (choice, comparison, budget), written in the country’s language and published word for word.

  4. Collection

    Each question goes to each assistant, from an access point in the country, in fresh sessions. From three to ten repetitions, until the interval is narrow enough.

  5. Reading

    A model suggests the names present in the answer; the code accepts them only if they really appear in the text. New or ambiguous cases go to a person.

  6. The count

    For each brand, the share of answers in which it is named first and the share in which it is named, with a 95% interval.

  7. The thresholds

    At least three valid answers per cell, at least 70% of cells measured, at least eight topics. Below the threshold the edition is not published, and we say so.

  8. Closing

    The edition is frozen with date, sample, assistants and files. It is never recalculated: an error leads to a public withdrawal and a correction next to it.

Assistants and channels

Each assistant, its own channel.

An API and an interface can answer the same question differently. That is why each assistant’s channel is declared, and data from different channels is never mixed. Each edition lists the assistants measured.

AI assistants and collection channels
AssistantChannelWeb search
ChatGPTWeb interface and OpenAI API, in separate columnsYes
GeminiGoogle Gemini APIYes, with Google Search
PerplexityPerplexity API and web interface, in separate columnsYes
ClaudeAnthropic APIYes
CopilotWeb interfaceYes
AI OverviewsGoogle results from a licensed providerPart of the search
AI ModeWeb interfaceYes

The definitions

Every word, one measure.

The words of the rankings have a precise meaning, the same in every edition.

The measures of the rankings
Named first
The first brand in the registry that appears in the answer text. It is the measure that orders the rankings.
Named
The brand appears at least once in the answer, in any position.
Recommended
The answer points to it as a recommended choice, not just as an example. This is decided by rules and review, never by the model alone.
Cited
The answer links to a page on the brand’s domain. It counts only where the assistant shows its sources.
Share of voice
The brand’s mentions out of all brand mentions in the series’ answers.
Tie
Two brands whose intervals overlap. The table says so instead of inventing an order.

Topic sources

Topics only from official channels.

No page is copied automatically. Every reading of the signal carries its source, time and fingerprint, so a topic can always be traced back to its origin.

Where each series’ topics come from
SeriesSignal sourceType
Trending topicsGoogle TrendsOfficial API
The most searched questionsEditorial questions by sector, ordered with Google Trends and Wikimedia PageviewsEditorial list and official APIs
Before buyingEditorial purchase categories, ordered with Google TrendsEditorial list and official API
Leading brandsWikidataCC0 open dataset
Who makes the pressWebz.io News Search and GDELTLicensed API and open dataset

What we don’t do

The rules that do not bend.

Four commitments apply to every series, every country and every edition.

No ranking without data

If the sample is not enough, the edition is not published. There are no estimated, filled-in or reconstructed values.

No number from the model

The model reads the texts and suggests names. Counting, weighting and ordering are done by code, with published rules.

No judgement on products

We report what AI assistants answered. We do not say which brand is better.

No positions for sale

The order does not depend on subscriptions, sponsorships or requests from brands.

Reusing the data

Open data, under a CC BY 4.0 licence.

Rankings and counts for each edition can be downloaded as CSV and JSON with the field dictionary and the method version. You can reuse them, including for commercial purposes, by citing “TrustInsider, Observatory”, the series, the country and the edition.

A correct citation of an Observatory data point

A sample sentence written by someone reusing an Observatory data point: the notes show the elements the licence requires you to cite.

QuestionHow do you cite an Observatory data point in an article?

Sample article reusing the data

According to “TrustInsider, Observatory”, Trending topics series, Italy, edition for the stated week, the brand cited was named first more often than the others.

  1. Source

    The attribution required by the CC BY 4.0 licence, word for word.

  2. Citation

    The series and the country, so that the data point can be found in the right file.

  3. Citation

    The edition, because closed editions are not recalculated.

Errors and corrections

An error is disclosed.

Anyone who believes a figure is wrong writes to the editorial team stating the edition and the row. The check starts again from the recorded answers; the outcome and any correction stay public next to the edition.

From report to public correction

The path of an error report on an edition: from the request to the editorial team to the public note next to the edition.

  1. Write to the editorial team

    You state the edition and the row you believe is wrong.

  2. We verify

    The check starts again from the recorded answers, not from an estimate.

  3. We publish the outcome

    The outcome stays public next to the edition, even if the data point holds.

  4. We correct if needed

    The incorrect edition is withdrawn with a note, and the correction is published alongside.

Frequently asked questions

On the method, in brief.

How many times we repeat each question, which confidence interval we use, how we weight the assistants and why questions start from accounts with no history.

How many times do you repeat each question?

Three to ten times per question and assistant, until the interval is narrow enough: a single answer is an anecdote, several answers give a frequency.

Which interval do you use?

The 95% Jeffreys interval. With few samples per cell it is more reliable than the normal approximation and always stays between 0 and 100%. It is the same method used by the TrustInsider platform.

How do you weight the assistants?

By each assistant’s usage share in the country, from public sources that are declared and dated in the edition note. The ranking for each single assistant always stays visible alongside.

Are the questions sent from an account with a history?

No. We use fresh sessions, with no history or preferences. It is a laboratory condition: a real person may see different answers.

Related paths

The Observatory publishes rankings with their methodology. From here you move on to the other series, to the edition methodology and to the page that brings them all together.

Observatory method: how rankings work | TrustInsider