What is the only research method that can prove cause and effect?

Summary: To understand cause and effect, we need to conduct experiments. Experiments may include surveys as a data collection method, but surveys in themselves can’t provide the answer.

3 minutes to read. By author Michaela Mora on July 29, 2019
Topics: Analysis Techniques, Market Research, Survey Design

What is the only research method that can prove cause and effect?

Cause-effect research requires special research designs. However, many assume that surveys can uncover cause and effect links without much consideration.

Not long ago I got a call from a potential client asking for research to determine why a recent marketing campaign failed to increase sales, despite a significant increase in awareness.

He had conducted an advertising awareness survey, and the results showed that many in the target audience had noted the advertising and gave it high ratings, but didn’t make a purchase.

All possible explanations were mere speculations. He couldn’t pinpoint any particular cause for this. 

The main problem was that he looked for evidence of a cause-effect link, but the research design was not appropriate for that.

Cause-Effect Research=Experiment

The main method for cause-effect research is experimentation. In experimental-based research, we manipulate the causal or independent variables in a relatively controlled environment. This means that we control and monitor other variables affecting the dependent variable (e.g. sales) as much as possible.

In this case, the client had conducted the survey and analyzed the data without taking into account the effectiveness of different marketing collaterals, market penetration, competitor activity, and some characteristics of the purchase decision-makers.

After doing some digging around, we uncovered that in some markets, competitors had launched high-frequency advertising campaigns. This helped the client indirectly by increasing category awareness, but not his sales.

Moreover, the program targeted recent buyers who probably didn’t have a need for his products at that particular moment.

Marketing Experiments

Surveys that are not part of an experimental approach may show correlations, but not causality

To really connect the dots between cause and effect, we needed to create an experiment. This would include different renditions of the marketing collaterals, different markets, customers at different stages in the purchase cycle, and actions taken by competitors.

Experimentation in marketing has traditionally taken the form of standard test markets. In this approach, you launch controlled advertising in designated markets and sell the product through regular distribution channels.

However, these tests can be time-consuming, are often expensive, and may be difficult to administer.

Market Simulations

Simulated test markets are a more affordable solution. In this approach, we expose individuals to the product or concept (e.g. via actual marketing collaterals), and give them the opportunity to buy it. If they buy it, we ask them to evaluate the product and state their repeat purchase intent.

We can then combine trial and repeat estimates with data about promotions, distribution levels, competitor activity, and other relevant pieces of information.

User Research (UX)

Another experimentation channel is the popular freemium model, which mimics this process to some extent. The basic principle is to let people try it and observe what decision they make.

After this, we can follow up with research to understand what drove their decision while controlling for other variables that may affect the outcome. This approach goes deeper into user research.

Experiments are the Answer

In short, if you want to understand cause and effect, you need to conduct experiments.

Experiments may include surveys as a data collection method, but surveys in themselves can’t provide the answer. It is the experimental design that will lead you to it.

(An earlier version of this article was originally published on January 18, 2012. The article was last updated and revised on July 29, 2019.)

  • What To Consider in Survey Design
  • Is It Right to Include a Neutral Point in Rating Questions?
  • Multi-Response or Dichotomous Grid Questions?
  • Avoid These Survey Design Mistakes
  • How To Minimize Memory Errors in Surveys
  • The Accuracy of Election Polls
  • How Bad Surveys Can Turn Respondents Off
  • 10 Cognitive Biases You Shouldn’t Ignore In Research
  • Which Rating Scales Should I Use?
  • Survey Gamification? It’s About Good Survey Design
  • How Survey Tools May Improve User Experience
  • Guidelines to Write Attitudinal Questions in Surveys
  • Why We Need to Avoid Long Surveys
  • An Alternative To Multiple-Choice Questions
  • Validity and Reliability in Surveys
  • Making The Case For MaxDiff
  • How To Improve Online Survey Response Rates
  • Conjoint Analysis And Realism In Price Research
  • Making The Case Against The Van Westerndorp Price Sensitivity Meter
  • Comparing Willingness To Pay Measurements To Real Purchase
  • 6 Decisions To Make When Designing Product Concept Tests
  • What Is The Right Sample Size For A Survey?
  • 12 Research Techniques to Solve Choice Overload
  • UX Research Methods For User-Centric Design
  • 10 Key Pieces of Advice On How to Do And Use Market Research

Subscribe to our newsletter to get notified about future articles

What research method shows cause

Experimental research, often called true experimentation, uses the scientific method to establish the cause-effect relationship among a group of variables that make up a study.

What is the only research method capable of determining cause

Experimentation , where the researcher is able to manipulate the independent variable and control for the influence of other possible confounding variables (i.e., other potential influences on the dependent variable), is the most reliable and powerful method for determining cause and effect.