Please login to the form below

What is MaxDiff?

MaxDiff - (aka maximum difference scaling) can help market researchers pare down a wealth of information into precise and actionable insights. Sarah Mackinnon, Research Manager at Creative Medical Research, looks into the pros and cons of this research methodology.

Facilitating effective decision making using MaxDiff scaling

The road to bringing a new medical device to market is full of tough questions and difficult decisions. What are the most significant customer needs in todays’ market? What products, features, or services should be prioritised for development first? How can we market this new product most effectively, in order to maximise sales?  It can be all too easy to end up drowning in a sea of insights, with plenty of exciting ideas, yet unsure which will deliver the greatest return on investment. For example:

  • Unmet needs uncovered in early stage qualitative/ ethnographic research
  • Potential features of a new product or service
  • Potential benefits of a wide range of new potential products or services
  • Draft marketing messages
MaxDiff involves presenting respondents with a series of best/worst prioritisation tasks, each task containing a subset of items from the longer list (usually 4-5). Respondents are simply asked to select the best and worst items from each set. An example task is shown below:Imagine your Doctor recommended a change in your current diabetes treatment.
We would like to understand what you would need in order to help you to adjust to the new treatment and to make the ongoing experience of managing your diabetes as positive and straightforward as possible.
On the following screens, you will see a selection of needs that other people with your condition have said are important to them when moving to a new diabetes treatment. For each set of needs shown, please select the ONE that is MOST and LEAST important to you.

In subsequent tasks, the way in which different list items are grouped together is controlled using an algorithm. The data is then analysed using a method known as Hierarchical Bayes estimation, to provide importance scores for all of the items relative to one another, even though all items are never shown together. The scores are then indexed to 100 to aid interpretation. The result is a clear prioritisation of market preferences as can be seen in the figure on the right.MaxDiff has several key advantages when compared to other more traditional commonly used methods for item prioritisation, namely ratings scales and ranking approaches.

MaxDiff scaling

Ratings scales
With ratings scales, respondents are asked to score each item on a scale of importance, which for example might range from 0 (not at all important) through to 7 (extremely important). This is simple enough in theory, but in multi-market studies often proves problematic as there are distinct cultural biases in how such scales are used.For example, compared to European respondents, Chinese and Japanese respondents tend to utilise the top end of the scale much more, leading to apparent differences in strength of preference between markets that are in fact meaningless to interpret. With MaxDiff, respondents are forced to make trade-offs rather than indicate strength of preference, so this issue is completely avoided. Additionally, ratings scales frequently fail to discriminate effectively between items, with results often showing many items as being ‘highly important’.This may well be valid, however it gives little direction for product developers when budgets are capped and only a small subset of ideas can be taken forward. The key issue here is that because each item is considered in isolation, respondents are not forced to prioritise. Again, MaxDiff overcomes this problem by forcing respondents to consider what is most and least important, leading to better discrimination between items in the final results.

Finally, it can be argued that MaxDiff results are likely to be more reflective of real-life decision making behaviour than ratings. In real life, we make choices based on the information available to us – we don’t sit there and score each marketing message we see based on how much we like it.

MaxDiff Scaling

MaxDiff and scale bias

Of course, asking respondents to rank their preferred items in order of priority both avoids the issue of scale bias and forces respondents to prioritise. However, this approach has its own pitfalls:

Firstly, because all items must be presented and evaluated simultaneously, only a relatively small number of items can be assessed. Each extra item included increases the difficulty of the task, and this can easily lead to lack of respondent engagement and poor data quality.

MaxDiff allows a much larger number of items to be considered as only 4-5 items are required to be evaluated at once. What is more, the choice tasks are also simpler for respondents to complete – rather than needing to prioritise all the items in a task, they are only required to select ‘best’ and ‘worst’.
Second, rankings provide purely ordinal data, that is, we know 1st is better than 2nd, but not how much better – there could be little difference between them, or, 1st could be way out in front. MaxDiff provides interval data, allowing us to clearly differentiate the ‘top tier’ priorities from those of lesser importance.

MaxDiff – limitations

All this said, MaxDiff itself has limitations. While it will deliver a clear hierarchy of relative priority for your tested items, MaxDiff alone will not tell you in an absolute sense how important a particular need is, or what percentage of people like your potential product feature; the list item with the highest MaxDiff score could either be the next big market game-changer, or just the best of a bad bunch of ideas.

Thinking of using MaxDiff in your next research project?
Therefore, as always, it’s important to ensure your research objectives are clearly defined at the outset. If required, MaxDiff scores can easily be augmented with other data in order to provide such insights. If you’re considering a study, talk to us and we’ll guide you through the best ways to maximise your study using MaxDiff. It’s not for everyone however, but you’ll see the benefits to a study when used in the right settings.

20th September 2016



Company Details

Creative Medical Research

01473 832211

Contact Website

9 Pegasus
Orion Court
Great Blakenham
United Kingdom

Latest content on this profile

Global Diabetes Influencers report
This report summarises the insights delivered by 6 global diabetes bloggers who shared their views on their diabetes management, ideals for their devices and how the industry can provide better support for people living with diabetes and their healthcare providers
Creative Medical Research
Evolution of Diabetes Management
Implantable continuous glucose monitors have only recently been approved for use yet they are the latest game changer in the ever changing environment of diabetes management. It is not only a key goal to improve health outcomes when designing a new product but increase the convenience to the end user. So what drives a person with diabetes to choose a particular device to manage their diabetes. What factors are most important to them?
Creative Medical Research
Global Influencers in Diabetes Insights report
A new report delivering the insights of influencers in the diabetes online community has been released by medical device market research agency, Creative Medical Research (CMR). The report highlights that technological advances in diabetes devices are seen to be device company led rather than offering a tailored people-centric approach. Findings also identified that the speed of product development is not adequate and that manufacturers should work with people with diabetes (PWD) to ensure devices are customisable and interoperable with others to enable greater success.
Creative Medical Research
What to look for in a medical market research company
Every year, medical device manufacturers spend huge sums on product development. Successful decisions about how that product will look, how it will work, labelling, packaging and price don't happen in a vacuum but are based on hard evidence - or at least, they should be. A market research agency's sole job is to access and communicate that evidence. Gathering customer insight and feedback is no simple task. It requires careful consideration, planning, proficiency in market research methods, and a strong desire to work collaboratively with the end client to fully understand their business objectives. . A good market research agency will help you understand your customers and ultimately make better decisions. But how do you know which agency is right for you?
Creative Medical Research
CES 2017 – Medical Device Top Picks
Connected tech was the overriding theme at this year's Consumer Electronics Show in Las Vegas. But among all that consumer gadgetry, there were some great medical devices too. So what are the ones to watch in 2017?
Creative Medical Research
CMR: towards a holistic view of patient care
The last five years have seen technology transform the traditional patient/HCP relationship. In this short clip, CMR's George Ashford and Lucy Snowdon discuss how tech can create a holistic view of healthcare and improve outcomes for patients and HCPs.
Creative Medical Research