GRIT Commentary: Killing the Error of Omission
We are wrong and we know it. Marketing research has always been plagued by error and assumptions; random sampling almost never is, all kinds of bias – observer, response, fatigue, scale. The list of issues goes on and on. Just as importantly, marketing research has been wrong by omission; that is to say that we could only ask questions – and evaluate the answers. At the end of the day, it is a calculated and reasonable “wrong”.
But we are getting better… and that shows no sign of slowing. Some of the improvements over the past several years are about the process (better sampling, improved questions); many others are about killing the error of omission – and to L&E, this is the exciting part.
New sources of data about consumers allow for vectors of knowledge that did not exist even 3 or 4 years ago. Behaviors can be established from any number of sources: mobile tracking, receipt scanning, in-store video – the list goes on and on. Social Media allows a sneak peek into peoples’ lives that lets us see how they wish to be perceived – and not just through their words, but also the images they associate with their life. Emotions and the emotional triggers can be identified through non-conscious methods from facial coding, to neuro methods and wearables.
As costs continue to fall from competitive pressure and technological advances (I just saw a Virtual Reality viewer for $20), it will be easier to put more of these pieces together to get a clearer picture of the “whole truth” – which has long been the goal in our industry. Let’s take a look at two examples.
Eye tracking technology lets us identify the area of a document or image that is getting attention. Facial coding technology allows us to understand the emotion a person is feeling at a particular point in time. Independently, each of those technologies answers an important question. Together they answer the question of the specific driver of that emotion. One particular client takes it a step further and integrates in-depth interviews based on laddering to understand the “why” of the emotional triggers. In this example, there is little error of omission, as multiple approaches within a single respondent engagement have answered the what, the how, and the why.
Behavioral research has generally been based on observation (expensive) or diaries (questionable). The mobile phone and, in particular, mobile panels change all this. Now, behavioral research can be conducted in connection with shopper journey, use tests, day in the life, etc., with reasonable completeness and accuracy. Scanner technology (the same kind used in Expensify) allows people to scan their store receipts instead of using a diary for their purchases. Each of these methods provides valuable information about a person’s life. The combination of these two methods provides a more holistic perspective of a person’s consumption life – as it lays out multiple places, multiple experiences, and multiple purchases – in the context of all their purchases (not just a category). The error of omission is still there, but smaller and easier to forgive.
Understanding everything that motivates a person is hard. Psychologists can spend years trying to understand someone and still not be comfortable that they have it right. But we can get better at understanding – as we should – for our businesses, for our clients, and for consumers.
Market research is now particularly well positioned to do this using a holistic approach that combines qualitative, quantitative, behavioral, non-conscious and observational data; shifting the conversation from “we could be wrong for all of these reasons” to “we think we’re right for all of the data points we have to use”. That’s a big (and exciting) difference – and the GRIT data tells us it’s now a reality.


Amanda is the Vice President of User Experience at 352 inc., a full-service user experience, design, development, and marketing agency. At 352, she leads a team that provides user research, usability testing, and UX strategy services to clients in a variety of verticals. Amanda’s expertise and knowledge of in-person and remote research techniques has helped companies new to user experience assimilate user-centered design into their existing processes. She has a human factors background and an engineering degree from Tufts University.




Abbe Macbeth, PhD is a Regional Sales Manager for Noldus Information Technology. Taking her expertise in Behavioral Neuroscience into scientific sales in 2010, Abbe set multiple company records for sales within the first two years. Quickly moving into a managerial role, she is now responsible for overseeing four sales regions and Noldus Consulting Services, US. Abbe is passionate about behavioral research in all forms, and delights in helping others find the perfect solution to meet their needs. Abbe holds a Bachlor’s degree in Cognitive Science, a Master’s degree in Psychology, and a PhD in Behavioral Neuroscience from City University of New York.
Brett Watkins


Jason received his doctorate in Psychology from the University of Utah. After a fellowship at MUSC in Charleston, SC, Jason joined Noldus in 2008. Jason also spent time with Nielsen Neurofocus and Brandtrust before returning to Noldus in 2013 as Product Expert and Lead Trainer.