Skip to: Main Content / Navigation

  • Facebook
  • Twitter
  • LinkedIn
  • Add This

By the Numbers: How to use research to measure an app's impact



Article ID:
20131005
Published:
October 2013, page 28
Author:
Jason Jacobson

Article Abstract

Your company’s app is a critical link to your consumers. Here’s a quick look at measuring its effectiveness.

Editor's note: Jason Jacobson is a UX research manager in the San Francisco office of research firm AnswerLab.

Apps represent a critical consumer touchpoint and an extension of a company’s brand identity. In addition to traditional desktop sites, mobile sites, brick-and-mortar presence, etc., apps have evolved into an important consumer interface for companies that offer search and browse capabilities, purchase functionality and transactional abilities. A study1 by Compuware revealed that consumers strongly prefer apps over mobile sites because they are considered more convenient, faster and easier to browse. And comScore reports show that the majority of mobile content is accessed via apps rather than the mobile Web.

While companies often invest a great deal of resources in app development, few quantitatively measure the customer experience after launch. App analytics on downloads, revenue and usage only tell part of the story. How do you evaluate what’s driving those numbers? What quantitative data do you have available to guide design and development decisions? How do you determine whether app changes are having the desired impact? What’s your reference point?

Deliver quantitative data

Continuously tracking the user experience on an app via a survey is critical to deliver quantitative data to help you:

  • provide a comprehensive portrait of who is using the app (demographics, customer relationship, etc.);
  • evaluate whether the app is consistently meeting user experience goals;
  • determine whether app changes improve users’ experiences;
  • compare the app user experience to competitive offerings;
  • establish which tasks app users want to accomplish and success rates;
  • quickly discover and identify areas or paths on the app that present the biggest obstacles;
  • assess the impact of the app on users’ brand impressions; and
  • integrate external data to further understand the potential impact of specific promotions, messages, etc.

Two quantitative methodologies can be used to track the app experience:

Survey surfaced within the app. The optimal scenario is to have the capability to surface a survey built into the app prior to launch. Having built-in survey capabilities results is a robust read of the app experience because app users can be surveyed in their natural context, the survey can be launched based on various criteria such as location (e.g., close to/near a store) or locations after certain transactions are completed. An added advantage of this approach is that we can use the survey as a customer relationship tool that identifies respondents with low ratings to certain questions and sends their information to a customer service rep for immediate resolution (with the user’s consent).

Survey sent to customer list/panel. If an app doesn’t have built-in survey capabilities, we can recruit respondents to take a survey about the app experience. Using a customer list or a panel, we can screen potential respondents based on app usage and other criteria and send them a link to take a survey to evaluate the app experience. This can be executed through a standard survey or longitudinally via a diary study. The downside of this approach is that it lacks the real-world context of the app usage and a reliance on recall of the experience.

The timing of app experience measurement is dependent upon a variety factors, including the popularity of the app and number of users, the frequency of use, the app’s functionality and the importance of the app to the customer-brand relationship. Apps that are highly popular, used for more frequent transactions, with a high impact, warrant a more frequent, continuous measurement, whereas apps that have a smaller user base for occasional use are good candidates for a wave research approach.

Flexible, repeatable, scalable

Tracking the app experience offers a flexible, repeatable and scalable research solution for user testing and feedback that can be implemented over the long term. Survey metrics can be mapped to business objectives and results diagnosed based on desired calls-to-action to offer insights to ensure an optimized user experience and holistic picture of the brand-consumer relationship. Brands that measure this experience are at the forefront of research, investing in a solution to ensure an optimized experience on this important touchpoint.

References

1 “Mobile apps vs. mobile websites – and the winner is? Compuware global consumer survey reveals preference for mobile apps.” http://investor.compuware.com/releasedetail.cfm?releaseid=747433

 

Comment on this article

comments powered by Disqus

Related Glossary Terms

Search for more...

Related Events

FROM PRACTITIONERS TO THE C-SUITE: WHO REALLY INFLUENCES B2B PURCHASES?
June 10 at 1:00 pm CDT, 2015
Illuminas will be sponsoring a one hour Webinar titled, ‘From practitioners to the C-suite: Who really influences B2B purchases?’ on June 10 at 1 p.m. CDT.
ADVANCED RESEARCH TECHNIQUES (ART) FORUM
June 14-17, 2015
The American Marketing Association will hold its annual advanced research techniques (ART) forum on June 14-17 at the U.S. Grant Hotel in San Diego.

View more Related Events...

Related Articles

There are 1881 articles in our archive related to this topic. Below are 5 selected at random and available to all users of the site.

Sponsored Content: Advancements in interviewing technologies: Bringing confidence to qualitative
Quester's Garrett McGuire extolls the virtues of tech-assisted interviewing in qualitative.
Using qualitative research to help name new products
An overview of the ways qualitative research can help the name generation process. Tips are presented for dealing with pronunciation issues, winnowing the list of candidates, and testing the final list of most promising options.
The seven heavenly virtues of VOC research
As a follow-up to his 2011 article on the seven deadly sins of voice-of-the-customer (VOC) research, GfK's Howard Lax outlines seven things researchers should do to establish a successful VOC program.
Gaining strategic business advantage through customer value measurement
Market research firms are increasingly adding customer value measurement (CVM) to their list of services. This article discusses CVM, including CVM basics and illustrative anecdotes.
Respondents in women’s health study cite doctor/patient disconnect
Qualitative and quantitative studies helped a woman-owned research firm investigate sensitive topics related to sexual health.

See more articles on this topic

Related Suppliers: Research Companies from the SourceBook

Click on a category below to see firms that specialize in the following areas of research and/or industries

Specialties

Industries

Conduct a detailed search of the entire Researcher SourceBook directory

Related Discussion Topics

TURF excel-based simulator
03/06/2015 by Nicky Turche
TURF excel-based simulator
12/16/2014 by Joseph O. Fayese
Hi Giovanni
10/17/2014 by Dohyun Kim
request
06/06/2014 by Monika Kunkowska
TURF excel-based simulator
04/17/2014 by Giovanni Olivieri

View More