On this page
Three things decide how well quantitative research works: the sample, the data collection method, and the questionnaire. Quantitative research is relatively quick and objective, but each of these three areas can introduce limitations that reduce data quality.
Key takeaways
- Quantitative research collects numbers from a target population, usually through questionnaires and surveys.
- Sample definition and sample size affect both cost and the quality of the data.
- Online and offline data collection each have strengths and biases, and quality checks help clean the data.
- A short, simple, neutral questionnaire gives more reliable answers.
What is quantitative research?
Market research compiles and analyzes information and opinions. It uses quantitative and qualitative techniques. Quantitative methods typically rely on questionnaires, such as marketing research surveys, opinion polls, and long-term behavioral studies. Qualitative methods focus on groups, chat rooms, in-depth interviews, and demonstrations.
The advantage of quantitative analysis is that it is relatively quick and objective. You choose a target population, collect data, process the numbers, and get answers. Three limitations deserve attention: the sample, the data collection method, and the questionnaire.
Why does the sample matter?
A sample is the part of the population that you examine. Any research needs a clear sample definition, because it influences how much the research costs and how good the data is.
For online surveys, the population can be seen as a funnel. It starts with the general population of a country or market, narrows to the online (or increasingly smartphone) population, then to people who belong to an online panel or database. Finally, category users become the respondents.
A representative study would mirror the whole population, with men, women, and all ages. In business, however, you usually care only about category users or potential customers. The main sample issues are a definition that is too broad, one that is too narrow, and the sample size.
| Sample definition | Drawbacks | Benefits |
|---|---|---|
| Too broad | Results may not reflect your customer group well, and you collect a lot of irrelevant data. | Useful for comparison, for example collecting data from ages 26 to 35 when targeting 18 to 25 can reveal other groups worth pursuing. Data is quick to gather. |
| Too narrow | A very specific sample is hard to collect quickly and costs more. It can also exclude relevant people, such as older consumers who identify with a brand aimed at younger ones. | Reaches category users directly, so their opinions are insightful because they speak from experience. |
How large should the sample be?
Size matters. Ten, one hundred, and one thousand respondents give very different levels of reliability. With a small sample, repeating the survey on a similar group may not produce matching results. A larger sample is more reliable and supports more accurate segmentation and statistical analysis, so a larger sample is preferable if the budget allows.
How should data be collected?
The most common method is the online survey, which is inexpensive and easy. Traditional methods such as pen and paper, phone interviews, or tablet interviews remain options.
Online surveys
- Drawbacks: Surveys must stay fairly short so that people do not drop out, which limits how many questions you can ask. Data quality depends on the quality of the online panel. For example, a survey meant only for young women may be completed by men using false profiles.
- Benefits: Respondents fill them out themselves, so there is no interviewer bias. They can be optimized for smartphones, so people complete them quickly, and responses can be read in real time.
Offline surveys
Offline surveys are more old-fashioned, but are still considered the most representative when you want to study the entire population.
- Drawbacks: They are costly and slow. An interviewer must complete the survey with each respondent and can bias the answers, record them incorrectly, or even cheat, so supervisors are needed to check quality.
- Benefits: They do not depend on the internet, you can collect data from a truly random sample, and you know where the data is being collected.
Agencies and panels often claim to have quality respondents and experienced interviewers, but you should always ask what quality checks they use. Both methods have limitations and biases, and quality checks go a long way toward cleaning the data and producing reliable results.
How does the questionnaire affect data quality?
The structure of a questionnaire takes respondents on a journey, and they may react positively or negatively right away. Many people find it hard to write neutral questions, and surveys often ask for personal details such as income, marital status, or religion.
Good questions should
- be easy to understand
- ask about one issue, never several in one sentence
- not be offensive
- follow a logical order
- ask only for necessary personal details
Good answer options should
- include a neutral middle option such as “neither agree nor disagree”
- include an “I don’t know” option for knowledge questions
- be consistent throughout
- answer the question asked and nothing else
A poor questionnaire produces wrong data, so keep it simple, short, and structured. Adding short explanatory text before the questions can help people understand their purpose. With offline collection, interviewers usually need a briefing and must ask the questions as written.
Frequently asked questions
What is the main advantage of quantitative research?
It is comparatively quick and objective. You define a target population, collect data, process the numbers, and get answers.
Is a bigger sample always better?
A larger sample is generally more reliable and allows finer segmentation, so it is preferred when the budget allows. It still needs to match the target population.
Should I use online or offline surveys?
Online surveys are cheap, fast, and free of interviewer bias. Offline surveys cost more but can be more representative of the whole population.
How can I improve questionnaire quality?
Keep questions simple and neutral, ask one thing at a time, use a logical order, and offer neutral and “I don’t know” answer options.
Conclusion
Good quantitative research starts with clear business questions and relevant, high-quality data. Not every data point has the same business value, so the sample, the collection method, and the questionnaire should each be chosen deliberately.



