Acquiescence Bias

Why this matters for your decision

Many concept tests and claim surveys work with agreement scales: this offer is interesting to me, this claim is credible, I would sign up for this tariff. Agreeing is easier than disagreeing, and it seems more polite. Some respondents agree because they do not examine the statement closely, others because they want to accommodate whoever is asking.

The consequence: agreement scores are systematically higher than what a real choice would show. Survey research has measured this several times. In an overview of ten studies, just over half agreed with a statement, but clearly fewer disagreed with the opposite statement. For a decision on price, claim or offer, this means that high agreement alone reveals little about whether people would choose the offer over alternatives.

Example

A consumer goods manufacturer tests a claim for a laundry detergent. 68 percent agree with the statement that the claim makes the product more attractive. In a second question, respondents are asked to choose between two packs with different claims. The scores are close together.

In the behavioural test, people each see only one variant of the offer, once with the new claim and once with the existing claim. What is measured is how many choose the product on the offer page. The difference between the variants is smaller than the agreement suggested. The decision thus shifts from the question of whether the claim is liked to the question of whether it changes the choice.

How it differs

Social desirability aligns answers with social norms; acquiescence bias is a content-independent response style. The demand effect arises from how respondents interpret the purpose of the study. Acquiescence bias differs from the framing effect in that it is not the wording of the offer but the form of the question that shifts the answer.

How to deal with it

In surveys, balanced scales with reversed statements help, as do questions that require a choice between concrete alternatives instead of asking for agreement. In a Painted Door Test, there is no statement to agree with. People see an offer with a price and either choose it or move on. This is how Horizon measures purchase intent, without a panel, without incentives and without anything being sold.

Limitations

Agreement scales remain useful for capturing perception, comprehensibility and tone, for example whether a claim is understood. They are then a diagnosis, not a measurement of demand. A behavioural test does not replace this diagnosis, but adds the question of whether a variant is chosen. It also shows only the effect in the tested environment, not the effect across all channels.