Skip to content
Start a conversation

Research quality standards: Total quality, because someone will ask how you know.

When a launch or a market entry rides on the answer, cheap research can become the most expensive risk on the table.

  • 30+Years of senior experience per projectThree specialists, one per lens. No juniors.
  • 175+Behaviours checked per respondentBefore a single answer counts.
  • 2Independent expert reviewsA second senior reads it cold.
  • 0Synthetic respondents, everEvery person in your data is real.

The principle

Quality is built in at every step, long before the end.

Borrowed from the best of manufacturing: design defects out at every step instead of catching them at the end. Ten stages, one standard.

Choose a stage to read it.

Station 01 of 10 | Design

Quality starts before the first question. We design the research around your real decision and bring the learnings of the last cycle into this one.

How a partner earns a place

We audit our suppliers the way we audit our own data.

We buy reach, instruments and software, never the thinking. Six checks decide which suppliers get near your work, including the AI now built into their tools.

Research is a chain, and a chain doesn’t average out

Recruitment, platform, fieldwork, coding, analysis. One weak link weakens the whole study, and by the time anyone notices, it’s often too late to tell which link it was. So every supplier behind every link gets checked, and each check below rules out someone who would have quoted us less. We pay that difference instead of handing you the risk.

It’s also why you won’t find a wall of partner logos here. A logo tells you who we pay, not what we checked.

The problem gets in at fieldwork, and coding and analysis carry it forward. By the time it reaches the report, nobody can tell which link it came from.Every supplier behind every link passes the six checks below before it touches your study.
  1. 01

    We read the ESOMAR 37, not the sales deck

    The ESOMAR 37 Questions are the industry’s standard disclosure for online sample. Answered in public, they tell you where respondents come from, how often they’re contacted, what gets someone removed and how long the average panelist has been there. A supplier who won’t answer them is also telling you something.

  2. 02

    We check what the word verified means

    Verifying an identity and verifying a credential are different jobs. An expert network can confirm a person is who they claim to be, while a healthcare panel under ISO 20252 verifies identity, qualification and specialty in three factors, with photo ID and a medical registration number. For a regulated study only the second is enough, so we choose the partner by the kind of proof the question needs.

  3. 03

    We read the scope of the certificate, not the logo

    ISO 20252 isn’t one thing. Every certificate carries a Statement of Applicability listing which annexes it covers, and sample providers are commonly certified for access panels and online self-completion with telephone and face to face explicitly excluded. The logo on a homepage doesn’t tell you which fieldwork is covered, but that document does, and it’s public.

  4. 04

    We test the AI they have built into the tool

    Almost every platform now ships it: automatic coding, instant summaries, sentiment scoring, AI moderators, even synthetic respondents. We run each feature against material we have already coded by hand, and most of it fails, confidently: themes nobody raised, quotes nobody said, conclusions drawn from far too little. What survives we use only under a senior’s review, what doesn’t we switch off, and your report says which is which.

  5. 05

    We pilot the platform before your project is on it

    Diary and mobile ethnography apps, survey engines, listening dashboards, analysis environments: we run a real pilot on our own time before a client’s study ever touches a new tool. Finding out in week two of fieldwork that a platform loses video on certain phones isn’t a discovery you should be paying for.

  6. 06

    We check the numbers they publish about themselves

    Panel sizes, market counts, source totals, languages covered, archive depth. Suppliers routinely publish different figures on different pages of their own websites, and the difference is rarely small. We don’t repeat any of it on trust: we ask for the figure they’ll put in a contract, and that’s the figure we plan your study against.

The stack

Five domains, and each one rests on the one before.

Reach without verification gives you confident nonsense. Verification without instruments gives you real people answering shallow questions.

01

Reach

Who we can get to, where, and in what language.

How we pick a panel

We buy the strongest panel available for each audience, never the cheapest one that can fill the quota: first-party, permissioned, and running internal quality processes we’re allowed to inspect.

Consumer, B2B, healthcare, experts: a different specialist for each, because nobody is the best at all four.

When no panel reaches them

We recruit by hand, one person at a time. With senior executives, rare specialists and regulated professions this is the normal route.

It’s slower and it costs more, and it’s often the only way to get twenty hospital procurement directors, in four markets, who will genuinely talk.

Consumer and general B2B

Panel size
70 million+ first-party permissioned panelists
Markets
More than 80, with local-language fieldwork
Profiling depth
647 self-reported data points per panelist on average
Professional targeting
3.2 million professionals across 140 industries and 73,000 occupations
Marketplaces
Avoided wherever the audience allows. They resell inventory from thousands of panels they don’t own, so the chain of custody ends at their door

Healthcare

Credential-verified
2 million+ physicians and healthcare professionals
Coverage
27 countries directly, 70+ markets through partner networks
Patient panels
More than 130 distinct conditions

Experts, executives and hard targets

Expert networks
70% of the network at executive level, across 5,500+ subsectors
Hand recruitment
Professional platforms, gatekeepers, referral chains and existing communities, worked one contact at a time

Everyone we talk to

How participants are paid
Priced to the value of that person’s time. A physician or a procurement director is paid a professional rate, never a consumer one
Beyond cash
Vouchers and points, charitable donations, or a share of what the study found, depending on what that audience actually values
Locked at proposal stage
Incentives are agreed before fieldwork and never trimmed to protect a margin. An underpaid respondent is a fast respondent, and speed is the first thing that shows in the data
02

Verification

How we know a respondent is real, and that they are who the study needs them to be.

Proving a person is real

Identity verification confirms a human being answered: not a bot, not a duplicate, not someone sitting in a different country to the one they claim.

Proving they are the right person

Credential verification confirms that person is genuinely a cardiologist or a procurement director. A study can pass the first check and fail this one, and the failure rarely shows in the data.

Before they enter

Identity
Government ID validation, device fingerprinting, duplicate detection, geolocation matched against the claimed market
Credential, healthcare
Three-factor verification of identity, qualification and specialty, with photo ID and a medical registration number
Screener controls
5 to 8 control questions per screener, with the qualifying criteria veiled

While the survey runs

Behavioural tracking
175+ behaviours per session: copy-paste patterns, illogical sequences, network latency, device signals
Live replacement
Fraudulent and disengaged respondents removed and replaced while the survey is still open
Panel acceptance
96% of delivered completes accepted after the panel’s own cleaning

After delivery

Our second pass
Every complete re-read against four failure modes: straightlining, completion under half the median time, open-ends that answer a different question, and contradictions between paired questions
Reported to you
The exact number removed and the reason for each, in the method note
03

Instruments

What we can measure, and how precisely.

How we choose

By what the question needs, and by what the audience will actually sit through. Most studies use a handful of what’s below.

Why never all of them

Piling on instruments looks thorough and reads as indecision. A study that used every one of these would be a study nobody thought about.

Qualitative

Typical scale
10 to 50 sessions, depending on audiences, markets and languages
Eye tracking
Screen-based up to 1,200 Hz at 0.3° accuracy; wearable glasses at 50 to 100 Hz; webcam-based where scale matters more than precision
Techniques
In-depth interviews, focus groups, dyads and triads, mobile ethnography, diary studies, in-home and in-store observation, private online communities, usability testing, virtual reality environments

Quantitative

Sample range
400 floor for a readable total, 2,000 working ceiling
Why the ceiling
Above roughly 2,000 the margin of error barely moves. We’d rather spend that budget on a second lens than on a third decimal
Techniques
Complex branching logic, conjoint analysis, MaxDiff, pricing sensitivity, segmentation batteries, brand and campaign trackers, concept and A/B testing, geospatial sampling

Social listening

Source breadth
More than 100 million sources across social, forums, reviews, news, blogs and broadcast
Historical depth
Archive reaching back to 2010, so a trend has something to be a trend against
Beyond text
Image and logo recognition, so a brand that appears without being named still counts
Techniques
Netnography, social network analysis, community detection, cultural signal mapping, reputation and crisis tracking, competitor conversation share
04

Analysis environment

The software layer, and exactly where the human takes over.

What this layer is

Where computational social science actually happens: the software that codes, weights, models and maps everything the fieldwork brought back.

Why every row names the human

This is also where a lot of the industry’s overclaiming happens, so each row below says what the software does and where a person has to step in.

Qualitative analysis

Coding environment
The most cited QDA platform in academic publishing, used for coding frames, retrieval and traceability back to the transcript
Who codes
Frames are built by people, and every final code is a person’s call. Where the study warrants it, two analysts code independently and the agreement between them is measured
Transcription
40+ languages at roughly 90% machine accuracy, corrected by a human before coding begins

Quantitative analysis

Statistical environments
Weighting to population parameters, significance testing on every claimed difference, latent class and k-means segmentation, driver analysis
Simulation
Conjoint simulators your own team can run after the project closes
Syndicated benchmarks
50+ markets with multi-year trend, for context you should not pay to re-field

Social and network analysis

Graph capacity
Networks from ten nodes to ten million, for community detection and influence structure
Audience intelligence
Segmentation by affinity and interconnectivity across 1.5 billion+ profiles
Language
Sentiment classification in around 50 languages, hand-checked on a sample of every dataset
05

Delivery infrastructure

What you get access to, and for how long.

What you get
  • Dashboards built around the decision, not around the data
  • Wave-over-wave tracking
  • Geospatial mapping
  • Custom data apps, when the question needs a tool that doesn’t exist yet
Where it all lives

Everything lands in the Client Hub, which is more than a report archive.

Access doesn’t expire when the invoice is paid: it stays open indefinitely by default, so your team can go back to the raw material long after the project closes.

What it holds
Every interview in video or audio, every transcript, every source consulted, every report and dataset
Live elements
Real-time dashboards where the project includes them, updated wave by wave
Access control
Different levels by role, so an agency partner sees what they need and nothing else
Duration
Indefinite by default, and set by contract where you need something specific, such as one or two years with updates

The comparison

How the work actually gets done. And how it usually gets done.

Five differences that change what your evidence is worth when someone challenges it.

  1. Who runs your project

    Senior experts only, on every project

    Most others: juniors learning on your budget

    The people who scope your study are the people who run it, and the people who sign the conclusions. There’s no handoff the week after the contract is signed.

  2. Who is accountable

    One team that owns the result

    Most others: stitched together, and nobody owns it

    We buy panels, instruments and software from specialists. We never buy the thinking. One team designed the study, ran it and read it, so when a number is questioned there’s nobody else to point at.

  3. The method

    Three lenses fused into one reading, the H3™ Method

    Most others: one lens, or two in separate chapters

    Buying a second method is a budget decision. Reading two or three as a single body of evidence is a method decision, and that’s the part that usually gets skipped.

  4. What you’re left with

    A recommendation, and how confident we are in it

    Most others: findings handed over, interpretation left to you

    You leave the room knowing what to do and how sure we are. That’s the difference between buying research and buying advice, and it’s why we argue for a direction instead of presenting options.

  5. The timeline

    A fixed date, built from what the work really takes

    Most others: a date first, and the research trimmed to fit it

    You get a fixed date at proposal stage, and we meet it. It’s usually longer than a survey house would quote, because three lenses and a real analysis take more time than one questionnaire and a chart pack. What we never do is agree to a date we can only hit by cutting evidence.

The scope of this model

Every certificate has a Statement of Applicability. This is ours.

We read this document for every partner on your study. It seemed only fair to publish our own, in the same format.

HIPOPOTESIS Total Quality Model

Statement of Applicability

Reference
Rev. 2026.10
Applies to
Every study we run

Part A In scope

  1. A1

    Study design and scoping

    Every study is designed around the decision it serves and scoped in writing before fieldwork.

    In scopeThe ten stages
  2. A2

    Respondent verification

    Identity and, where the question needs it, credential, checked before, during and after fieldwork.

    In scopeThe stack, 02
  3. A3

    Supplier qualification

    Panels, platforms and analysis tools pass six checks before they get near a client study.

    In scopeThe supplier audit
  4. A4

    Instruments and measurement

    Each instrument chosen for what the question needs and what the audience will sit through.

    In scopeThe stack, 03
  5. A5

    Analysis and the use of AI

    Coding frames, modelling and interpretation done by people. AI can propose and double-check, a senior decides, and every use is declared.

    In scopeThe stack, 04
  6. A6

    Delivery and access to evidence

    Findings, raw material and datasets kept open to your team, indefinitely by default.

    In scopeThe stack, 05
  7. A7

    Senior accountability

    The people who scope the study run it and sign its conclusions. No junior handoff.

    In scopeThe comparison

Part B Conditions and exclusions

  1. B1

    Capacity

    We take a study on only when the seniors it needs are free to run it. When they aren’t, we tell you and give you the date when they will be.

    Precondition
  2. B2

    Adoption inside your organisation

    Which priority wins the budget, who builds it and how fast. We stay close while you act, but those calls are yours.

    Excluded
  3. B3

    The direction of the finding

    We commit to how the evidence is gathered and read, never in advance to what it will say.

    Excluded
  4. B4

    Certainty about the future

    We state how confident we are in a reading of the present. Markets still answer back.

    Excluded

Signed | Abdo López and Norah Walsh, founders

You’re welcome to ask us for the scope document of any partner on your study. You’ve just read ours.

Straight answers

Questions we get about our research quality standards

Something else on your mind? Ask us directly. You’ll get an answer from the people who would run the work.

Why is HIPOPOTESIS more expensive than a typical strategy or market research agency?

Because of who does the work and how much of it there is. Every project has three senior specialists minimum, each with ten years or more, who moderate, code and analyse themselves rather than briefing someone cheaper. We buy the strongest panel for your audience rather than the cheapest one that can fill the quota, run a second cleaning pass on data the panel has already cleaned, and review everything twice before it reaches you. Every one of those is a cost we could remove, and each one is a place where research can go wrong without anyone noticing. On a decision worth six or seven figures, the research is the cheapest part of the risk.

Who manages our project day to day?

The same three seniors who designed it. There’s no account manager sitting between you and the people doing the research, so nothing gets relayed, softened or lost on the way. You have three people to call and all three know the study, which in practice is faster than one coordinator who has to go and ask. Where a project needs a technical skill beyond the three, a data scientist for a complex model for instance, we bring in that specialist for that piece and tell you who they are. What never happens is the research being handed down to someone more junior so a senior can move on to the next pitch.

What happens after the presentation?

We don’t disappear. The evidence stays open to your team for as long as you need it, we stay reachable while the plan is executed, and when the market answers back we help you read what it actually said, including the parts that argue with us. What we can’t do is make an organisation move, and the scope document above says so in writing. Which priority wins the budget, who builds it and how fast, whether a decision survives the third meeting about it: that part is yours. We can put you on evidence that holds, argue for what we believe it means, and stay while you act on it.

How do you choose which panel to use for our audience?

By what has to be proved about the respondent, and we buy the strongest panel for that audience rather than the cheapest one that can fill the quota. General consumer work goes to first-party permissioned panels, because they own the relationship with the panelist and can tell us how that person was recruited. Healthcare goes to credential-verified panels, where identity, qualification and specialty are checked in three factors under ISO 20252. Experts, executives and hard B2B go to expert networks, which verify identity and run KYC but don’t verify professional credentials, so we use them where a credential isn’t what’s at stake. What we avoid wherever the audience allows it are marketplaces and exchanges, which resell inventory from thousands of panels they don’t own, so the chain of custody ends at their door. Where none of the above reach the person, we recruit by hand, and on the hardest projects the sample ends up mixed and you’re told which respondents came from where.

Do you use AI in your research?

Yes, and probably more than many firms would admit. The line we hold is between scaffolding and structure: scaffolding helps you build, then it comes down, and it holds up nothing in the finished thing. So AI transcribes, and a person corrects the transcript before a word is coded. It translates, and someone who speaks the language checks it. It’s a sparring partner while we frame a study, arguing with our own hypotheses and pushing us towards angles we hadn’t tried. It fixes our grammar, sharpens our English, and tells us when a chart is doing a poor job of showing what we found. It searches thousands of pages of transcript in seconds, so a senior spends the afternoon thinking instead of looking. On a large study it can sketch a first map of the material or read our analysis again looking for contradictions, and a senior checks each proposal against the source before anything counts. What it never does is structural: it doesn’t run an interview, invent a respondent or a data point, decide what a finding means or write a conclusion. Most platforms ship far more than that, switched on, and we only turn on what has passed our own test against material coded by hand. One place where the line gets concrete: automated sentiment classification is reliable in around fifty languages and automated emotion classification only in English, so outside English we code emotion by hand and say so. Every use of AI in your project is named in your report, which is still rare enough in this industry to be worth saying out loud.

How do you guarantee participants are real, and the findings hold?

On participants, there are three layers of checks. At the panel, government ID validation and third-party identity tools. During fieldwork, more than 175 behaviours tracked passively per session, with fraudulent and disengaged respondents removed and replaced live. After fieldwork, our own pass against your specific questionnaire: straightlining, completion under half the median time, open-ends that answer a different question, and contradictions between paired questions. On findings, we rely on triangulation and review. A pattern that appears in one lens is a hypothesis, in two it’s evidence, and in all three it’s solid enough to build a decision on. Then a second senior reads the whole thing cold, hunting for weak claims and anything that doesn’t hold. Where the lenses disagree, we say so rather than force a story, because the disagreement is often the most interesting part.

What does an ISO 20252 certificate actually cover?

Less than the logo implies. Every certificate carries a Statement of Applicability listing which annexes are in scope. A sample provider is typically certified for access panels, online self-completion and data processing, with telephone and face to face interviewing explicitly excluded. So we read that document for every partner, every time, and plan the fieldwork around what’s genuinely covered rather than around the badge on a homepage. It seemed only fair to publish our own, which is the scope document further up this page.

What sample size do we actually need?

For quantitative work, four hundred is our floor for a readable total and around two thousand is where we stop, because above that the margin of error barely moves. The real driver is subgroup analysis: if six segments have to be read separately, the total is set by the smallest one, not by the headline. For qualitative, ten to fifty sessions depending on how many distinct audiences, markets and languages are in scope. A design that needs more than fifty usually needs to become two studies.

Can you ever work faster?

Yes, in two ways, and neither of them involves cutting checks. The first is free: narrow the question. A study that has to answer one decision moves faster than one carrying three, and we’ll tell you which of the three is really urgent. The second costs money: on a genuine deadline we can bring in more senior specialists and run stages in parallel that would normally run in sequence, which buys weeks and raises the price, because parallel work needs more people and more coordination, not fewer checks. We quote that openly rather than absorbing it into a worse study without telling you. Either way you get a fixed date at proposal stage and we meet it. Three weeks is the fastest a complete study can honestly run, brief to report, and that assumes an audience the panel reaches quickly and no surprises in the screener. Large multi-market programmes across three lenses run to about four months, and the stage that moves least is recruitment, because a niche B2B or regulated healthcare target takes as long to reach as it takes. Speed you’ve paid for is fine, but speed taken out of the evidence is the expensive kind, because the decision gets taken twice.

Do we get the raw data and the recordings?

Yes. Every interview in video or audio, every transcript, every source, every report and dataset, in the Client Hub, with access levels set by role. Access is indefinite by default and can be shaped by contract when you need something specific. This matters more than it sounds: a report is one reading of the evidence, and the evidence should outlive the person who presented it.

Can we bring our own panel, supplier or existing data?

Yes, and it’s common on trackers, where comparability with previous waves matters more than the quality of any single new one. We’ll audit the source the same way we audit our own: ESOMAR 37 answers, certificate scope, verification method, and what the supplier will actually commit to in writing. If that audit turns up something you should know, we tell you, even when the supplier is already yours and the news is inconvenient.

What happens if a partner fails mid-project?

It becomes our problem. If a panel underdelivers on a quota, a platform breaks or a partner misses a date, we solve it, re-field where needed, and absorb the coordination. You have one team to call, whatever went wrong and whoever caused it, and you get told. A quota met by relaxing a screening criterion isn’t a quota met, and you’ll hear about that trade while you can still decide on it.

What all of this actually buys you is a decision you can defend.

In front of your board, your CEO or your investors, with evidence behind every line and a number for how sure we are. Tell us what you have to decide. If you don’t need us, you’ll hear that first.

  1. You get in touchBy email, through the form or on a video call, whichever suits you.
  2. We ask for the briefEvery detail we need, so the proposal is shaped around what you actually require.
  3. We design the proposalThe approach that answers your objectives, with the timeline and the budget.
  4. Approval, and we beginYou sign off, the paperwork is settled, and the work starts.
Start a conversation
  • Senior researchers only. No juniors.
  • End to end. Design, fieldwork, reporting.
  • No AI automation. Any use, disclosed.