Skip to: Main Content / Navigation

  • Facebook
  • Twitter
  • LinkedIn
  • Add This

The trouble with convenience sampling



Article ID:
20130526-3
Published:
May 2013
Author:
Noel Roos

Article Abstract

Customer feedback is often emotionally-charged. The author reminds researchers that relying on non-representative data in favor of convenient data from established customers can lead to expensive mistakes and poor decision-making.

Editor's note: Noel Roos is vice president at Diedrich RPM, a Burnsville, Minn., research company. She can be reached at 320-760-8223 or at noel@diedrichrpm.com. Roos is located in Burnsville and Alexandria, Minn. This article appeared in the May 20, 2013, edition of Quirk's e-newsletter.     

 

Recently, a student completing his master's degree called to ask a question regarding convenience versus random sampling - and the perils of making decisions based purely on a convenience sample. 

 

"Is it poor business to make decisions on convenience data?" asked the student.


To the great frustration of the student, I said, "It depends."

  

Many companies today have continuous feedback surveys - and it's a good practice, especially if there is an incentive and a company can capture those who are not motivated by extreme happiness or anger. But the bottom line is that while continuous feedback surveys can reveal trends, companies should compare these results with a random sample before making expensive product, service or resource decisions.

  

For example, a retail company routinely gathers a convenience sample of its shoppers via a link on its Web site. Why does a shopper look for and click on this link? Usually because they are motivated by a particular emotion. This same company finds that the convenience sample reveals that it needs to offer lower prices on a certain product or risk losing customers. Should the company react and lower its prices (and possibly product quality to maintain an acceptable profitability level)?

  

No.

  

At least not yet. This trend warrants further research before changes and a new price/value strategy are created. We would recommend this retailer take the feedback seriously but caution that it's possible that only the emotionally-motivated have filled out the survey, missing the bulk of its shoppers.

  

A survey based on a random sample should be implemented to understand the true impact of price (and possibly quality) to understand if there is an issue. A change in price strategy before understanding how the full shopping population feels could result in keeping the small segment who complained while leaving money on the table from customers who did not complain - or worse yet, losing the rest of the population because the price/value equation was altered.

  

The squeaky wheel has many channels to voice displeasure in today's world - including social media, e-mail and yes, feedback surveys. Meanwhile, the happily satisfied keep quietly moving along. Given how loud the world can be, it's more important than ever to get the full picture through sound research practices before making expensive decisions that could negatively impact the bottom line.

Comment on this article

comments powered by Disqus

Related Glossary Terms

Search for more...

Related Events

RIVA COURSE 201: FUNDAMENTALS OF MODERATING
January 14 - 16, 2015
RIVA Training Institute will hold a course, themed 'Fundamentals of Moderating,' on January 14 - 16 in Rockville, Md.
RIVA COURSE 201: FUNDAMENTALS OF MODERATING
January 26-28, 2014
RIVA Training Institute will hold a course, themed 'Fundamentals of Moderating,' on January 26-28 in Rockville, Md.

View more Related Events...

Related Articles

There are 1068 articles in our archive related to this topic. Below are 5 selected at random and available to all users of the site.

By the Numbers: How to implement a screening process for research projects
A well-planned approach to vetting the value of a proposed research effort can pay a number of dividends, Brett Hagins writes, from saving time and money to advancing the researcher’s career.
Is the market research industry failing its TQM clients?
Total quality management (TQM) and continuous quality improvement (CQI) emerged in the 1980s. Clients increasingly ask for more info more often with less budget, which begs the question, is the market research industry failing to meet clients' demands? This article describes the principles of TQM and CQI that researchers need to understand in order to win and keep quality-driven clients.
By the Numbers: Behavioral science and the future of business
The author argues that behavioral science and its associated disciplines offer much promise in researchers’ efforts to go below the surface and uncover true insights.
A report on the 2005 Confirmit Annual MR Software Survey
Research software maker Confirmit conducted a wide-ranging study of marketing researchers and their use of software.
Supplier Side: Telephone data collection part 1: outsource or do it yourself?
In the early 1980s, many clients felt that if you didn’t do your own telephone interviewing, you couldn’t assure a quality job. A lot has changed since then. Part 1 in a two-part series, this article reviews the considerations when deciding whether to outsource telephone interviewing.

See more articles on this topic

Related Suppliers: Research Companies from the SourceBook

Click on a category below to see firms that specialize in the following areas of research and/or industries

Specialties

Conduct a detailed search of the entire Researcher SourceBook directory

Related Discussion Topics

Market research report
08/20/2013 by Aarkstore Store
Most commonly used research techniques
07/28/2010 by Curtis J. Fedder
yes, I have experience with those ethics issues
06/23/2010 by Michael R. Hollon
Ethics
06/11/2010 by Jim Santilli
Research and analysis to foresight your business perspective
02/19/2010 by Emmanuel M. Mendy

View More