Can Experience Benchmarking Really Help Make Better Products?

In this article, Telenav’s Research Director Craig Boyle explains the importance of using NPS and SUS as experience benchmarking metrics.

“On a scale of 0-10, how likely are you to recommend our product to a friend?”

If you’ve ever taken a survey with a similar question, you participated in a Net Promoter Score (NPS) study. What separates an NPS survey from your ordinary survey is that an NPS is more honed to the specific feelings and eventual actions of the customer. Originally created by Fred Reicheld and Bain & Company, it’s the one number that predicts an organization’s future success by measuring the customer’s experience. Also, it helps determine their willingness to not only return for another purchase or service but also make a recommendation to their family, friends or colleagues. The main advantage of an NPS survey is that it provides timely data that’s easily collected, interpreted and communicated across all channels of the business. It is a powerful and effective tool, which can greatly increase a company's revenue if used properly.

Participants are put in one of three categories based on their response — Promoters, Detractors and Passives:

  • Promoters—responded with a score of 9 or 10. They have a high potential to create future value for a company such as future upsell and cross-sell purchases, longer customer loyalty, and promoting the product or brand to other potential customers.
  • Detractors—responded with a score of 0 to 6. They are less likely to create future value for the company. In fact, they may deflect potential customers.
  • Passives—responded with a score of 7 or 8. They are the middle ground between Promoters and Detractors.

The NPS scale goes from -100 to +100 and interpretation depends on industry, but consider a  score above 20 to be good, over 35 to be excellent, and above 50 as world class as a starting point.

Over the past decade, many companies have adopted the Net Promoter Score as a critical measurement of the current customer satisfaction. In fact, 45% of companies that use NPS alone are among 2/3 of Fortune 1000 Companies. In the automotive industry, NPS is already been used extensively by companies like VW, GM and Toyota.

A promoter or a regular customer affects profitability. Acquisition costs go down when retention is high. Simple math - while regular customers aren’t always profitable, their choice to stick with a product or service typically reduces a company’s customer acquisition costs.

Customer follow up on the NPS lifecycle is key. While we need to follow up on bad scores with customers, we also need to follow up with the good customers who retain longer.

What about traditional survey methods?

An advantage of NPS is that it takes seconds to answer a single question versus many minutes for a lengthy customer satisfaction survey. However,there’s still a place for the deep detail that a traditional survey provides, NPS data is much easier to collect, faster to analyze and has a higher customer engagement rate.  NPS is also well suited to deployment via the web or mobile devices.

SUS: Agree to Disagree

Originally created by John Brooke in 1986, the System Usability Scale (SUS) allows you to evaluate a wide variety of products and services, including hardware, software, mobile devices and applications.

The SUS is a reliable tool for measuring usability. It consists of a 10-item questionnaire with five response options for respondents, ranging from Strongly Agree to Strongly Disagree.

Using the SUS, customers rank the following statements:

  1. I think that I would like to use this system frequently.
  2. I found the system unnecessarily complex.
  3. I thought the system was easy to use.
  4. I think that I would need the support of a technical person to be able to use this system.
  5. I found the various functions in this system were well integrated.
  6. I thought there was too much inconsistency in this system.
  7. I would imagine that most people would learn to use this system very quickly.
  8. I found the system very cumbersome to use.
  9. I felt very confident using the system.
  10. I needed to learn a lot of things before I could get going with this system.

Telenav’s Benchmarking Services

Telenav conducts cross-manufacturer benchmark studies on automotive infotainment and navigation systems with over 5,000 participants to date in the US and globally on a regular basis. We are Industry Leaders with unparalleled depth and breadth of data on navigation and are leaders in NPS and its relevance to the auto industry. Our consulting services do everything within the value chain from concept development to “Usability and Design Evaluation” to “How to achieve higher NPS scores for OEMs”. Our benchmarking Services within the consulting arm provide you with the 3 standard products- Net Promoter Score, Brand Experience Score and System Usability Score.

Our format is simple:

  • Standardized process
  • Recruit drivers from public
  • Match typical new car buyer profile
  • Allow 1hr/10-mile drive on mostly unfamiliar roads (they drive)
  • Standard route
  • Surveys administered at end of session
  • 32 participants drive four cars

Some Interesting Tidbits from Telenav Research:

In a recent survey of 4000 navigation users across the United States, Telenav researchers discovered that women are almost twice as likely as men to listen to voice guidance from their navigation system.  Our next article in this series  will explain the use of Brand Experience, a more in-depth measure, as the third metric for experience benchmarking, that diagnoses specific problem areas to improve products.

To learn more about Telenav’s UX consulting and benchmarking services, write to us at hmx@telenav.com.

Preferences

Privacy is important to us, so you have the option of disabling certain types of storage that may not be necessary for the basic functioning of the website. Blocking categories may impact your experience on the website. Cookie Policy

Accept all cookies

These items are required to enable basic website functionality.

Always active

These items help the website operator understand how its website performs, how visitors interact with the site, and whether there may be technical issues.

These items are used to deliver advertising that is more relevant to you and your interests.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.