Asking customers about their plans nudges them toward those plans. The effect is real, smaller than the early studies suggested, and it contaminates your survey data.
A post-purchase survey is usually treated as measurement. It’s also an intervention. People who are asked what they intend to do become a little more likely to do it, which is useful for first use and a problem for anyone reading the survey as a neutral count.
Vicki Morwitz, Eric Johnson and David Schmittlein found in 1993 that asking people once whether they intended to buy a car or a personal computer made them more likely to buy one. Asking repeatedly made low-intent people less likely to buy Published. Utpal Dholakia and Morwitz then followed customers of a financial services firm who had been asked to take a satisfaction survey. Compared with customers who weren’t asked, they later bought more, defected less and were more profitable, and the effect grew for months and was still there a year later Published.
The field calls this the question-behavior effect, and like much of behavioral science it looked bigger in its early years. A 2016 meta-analysis by Chantelle Wood and colleagues pooled 116 published tests and found a small effect (d = 0.24). Corrected for the likelihood that null results went unpublished, the estimate fell to d = 0.15. The effect was larger for behaviors that are easy and socially desirable, and in student samples Published.
Using a product you’ve already bought is easy and desirable, which is the favorable case. So expect a nudge, not a transformation, and don’t design a survey around a big effect you haven’t measured.
A survey is also a nudge. Hold some buyers back, or you can’t tell how much.
This is one chapter of Used, Not Bought, which is free and readable in full on a single page with no form in front of it.