Renee’s Takeaways – Get the scoop on L&E’s Qual Analysis and Insight Communication Webinar!

6 Steps to Perfect Qual Webinar Series Summary

Step 4 and 5 – Qualitative Analysis and Insight Communication Webinar – Webinar held on June 6, 2018

It’s going to be hard to top this one!  In this recent webinar in our series, focusing on Qualitative Analysis and Insight Communication, we had the opportunity to chat with three extremely knowledgeable panelists on these topics. First up, Shaun Stripling who most recently left Mullen Lowe as Chief Strategy Officer, and was the Global Director of an insight consultancy called Frank About Women where she oversaw six countries of female-focused marketing efforts. Next, we had Walt Barron, Chief Strategy Officer at McKinney. Walt was a journalist in a previous life until he switched over to advertising about 19 years ago. He went to the VCU Brandcenter and has worked in agencies ever since.  Last, but certainly not least, Joan Lewis. Joan started out with Procter & Gamble, doing everything from upstream innovation to brand work and advertising in media, along with partnerships with retailers. Most recently, she’s been doing Boards of Directors work for a variety of for-profit companies, including three companies in the research, insights and analytics industry.  All of this experience in the industry totaling about 30 years!!

In this webinar, we focused on Q&A based around Qualitative Analysis and Insight Communication, tips to help make analysis easier for the researcher, and how to communicate insights to your clients in the most compelling and impactful way.

Here’s what our panelists had to say!

We started by asking our panelists to share about findings they’ve seen presented to them, as well as presenting findings to their clients.  What sticks, and what kind of approaches are most compelling.

  • Incorporate the use of multimedia to keep your presentation interesting
  • If you can, put yourself in the consumer’s shoes. Immerse yourself in their experience, go through their exercise, walk through it the way they would.  By doing this, not only do you have the data to share, but you have a unique perspective to share your insights.
  • Try to tug on the heartstrings if you can, make an emotional connection with the consumer. That, coupled with powerful data, and you’ve got a real one-two punch!

We heard some great things from our panelists as far as what works, so we thought it would also be helpful to find out a few things not to do, and what they’ve found doesn’t work!

  • Do not just plow through your insights! Take some time to consider the room dynamics, and be prepared to pivot on the fly based on that.
  • DO NOT ever give your client a large, printed out report, they will never read it! Try putting the insights that you’ve shared at the end of the report, at the beginning. You’ll find that most people will then come on the journey with you, because now, they are intrigued.
  • Don’t show 10 slides about your company background before getting to the insights. Save them for the end, and keep it minimal.

We covered some big picture items, then moved on to focus in on some of the smaller moving parts.  Next, we asked about useful tools that help bring data to life.

  • Assign pre-work. It can be a great way to jump past some of the necessary items you have to cover when you’re looking for consumer information and insights.
  • Use tools such as social media listening tools, and the like. These tools can help pour through thousands of reviews and analyze them quickly to get to some rich insights.
  • The use of video clips can enrich your story, hearing it directly from the consumer.

Next, we asked about best practices for delivering insights to clients.

  • Try to dig deep into what the client already knows. That way, you are only delivering fresh insights, and not repeating what they’ve already heard.
  • Maybe a little bit of a cheat, but write your hypothesis first. Then, either way, right or wrong, you’ll look for the data to prove it, and perhaps uncover some insights you didn’t expect.
  • Have a conversation about what disproved your hypothesis, if that is the case. What did you hear that forced you to rethink?

We shifted direction a little bit, and went on to discuss a very common problem in delivering insights, confirmation bias.  How do we reduce that effect with our clients?

  • Ask your client right up front for permission to probe “the sacred cows.” Are they okay with you digging a little deeper and asking them to help with the “whys.”
  • Try seeing your clients as partners, and seeing them as part of the team. This creates a comfort level with asking questions that may seem uncomfortable.
  • Find your partner, or ally in the company or whoever is helping bring the work into the company. Very often, they are the ones who want the company to be more insight driven.

And last, we asked what happens to a qualitative report once it’s released “into the wild?” What kinds of report content and format follow it through the organization?

  • Try to consider your presentation back to the client the beginning of the journey, instead of the end.
  • Create a plan at the start to carry the report through the organization, beyond a presentation.
  • Supply your client with leave-behinds, brochures, videos, things that get people engaged and can travel on their own.

We hope you found this summary to be helpful! If you didn’t register for this webinar you can listen to this webinar in its entirety, or download a free, transcribed version by clicking here.

Be on the lookout for our next webinar, which will be this fall. If you can’t wait until then, you can always view our on-demand webinars and learn about the latest technology solutions. Don’t forget to subscribe to our blog so you can keep up with what is happening at L&E!

Until next time!

Your Research Design Engineer at L&E,

Renee Wyckoff

6 Steps to Perfect Qual Series: Step 5 – Insight Communication | New White Paper from L&E

6 Steps to Perfect Qual

White Paper Download

Step 5: Insight Communication

Once you’ve completed your qualitative research, it’s crucial to communicate the results in a way that motivates clients and stakeholders to take action. So, how can this be accomplished?

This penultimate white paper of our series explains the importance of telling stories with your research, using a golden thread and impactful deliverables to make sure your message is engaging and easy to follow. Most importantly, the white paper includes practical tips to get the most out of tools such as PowerPoint, video and word clouds.

Learn how to:

  • Build impactful communications through storytelling (with practical advice on finding the golden thread in the information)
  • Different ways of communicating insight using technology
  • How to get the most out of deliverables such as PowerPoint

To continue reading, download our latest white paper by clicking here (no form to fill out).

6 Steps to Perfect Qual – Steps 4 & 5: Qualitative Analytics and Insight Communications

Putting together qualitative analysis and communicating qualitative insight can seem a daunting process, so we wanted to offer you the latest techniques and best practices for telling strong stories and engaging clients with impactful deliverables.

Our third webinar in our “Six Steps to Perfect Qual” webinar series will guide you through the best methods to ask questions and get actionable next steps to lead your clients to true insight. We will discuss the impact of powerful communications through a combination of the latest technology and practical tips for storytelling and creating actionable deliverables.

In this webinar you’ll learn how to:

  • Build impactful communications through storytelling (with practical advice on finding the golden thread in the information)
  • Different ways of communicating insight using technology

Qualitative analysis: where do the humans bring value?

Robots replacing humans is a fear that has been increasingly dominant in the media in recent years. The increasing presence of technology in everyday life and the decreasing need for humans in a variety of tasks has led to the fear that humanity will one day be rendered obsolete. Although technology has been present in quantitative data analysis, especially big data analysis, for a number of years, it is now increasingly being used in qualitative data analysis too, because of developments that allow robots to process natural language. Technology can help qualitative research by providing textual analysis, sentiment analysis, image and video analysis and voice recognition, leading to interview analysis, but to what extent can technology take over the role of qualitative researchers? Ultimately, what value do humans bring to the process?

A major strength of technology based qualitative research is the speed. Although humans are fully capable of analyzing qualitative data, they can’t compete in terms of pace. Analysis completed by robots is therefore appealing when clients are looking for quick insights. Moreover, although the initial investment in the required technology is expensive, spending fewer hours on a project will ultimately make projects cheaper, which is always appealing for clients and will give the researcher that uses it an edge over competitors.

However, while robots can now understand language, they are certainly still unable to empathize.  As empathy is crucial for successful market research, technology’s role is therefore limited. In fact, using fast-paced machines to analyze the data is actually helpful, because the less time researchers spend analyzing data themselves, the more time they have to empathize with the respondents’ feelings. It is this “system 2” thinking that ultimately delivers high-quality results to clients because it allows researchers to see the world through the eyes of the consumer. Humans should utilize their strengths as great thinkers and collaborate with machine analysis to achieve the best results.

Moreover, although researchers aim to be objective, using machines reduces the risk of unconscious bias, which is crucial in providing accurate and actionable insights for clients. However, although machines may not have prejudices, their general accuracy can still be questioned. Although their understanding of natural language has improved, it still does not meet human standards and their ability to understand language traits such as humor and sarcasm, while contextualizing meaning, is still limited. Likewise, machines can be over enthusiastic to categorize data when it may not fit under a specific label, a problem that is specifically relevant during sentiment analysis (see our recent blog on this here). Humans on the other hand are more flexible, and can make judgement based on specific situations, rather than making routine decisions based on programming. Admittedly, the sometimes tedious process of data analysis can lead to errors from humans too. But, humans are definitely required in the analysis process, even if merely as quality control.

Although technology has a clear place within qualitative research analysis, we ultimately complete market research, both quantitative and qualitative, to understand people so that clients can meet their requirements with products and services. It’s therefore important that humans remain present in the process and are not distanced from dealing with the data. This is especially crucial because researchers’ knowledge of language, their flexible judgement and their ability to think, feel and empathize adds a value that machines cannot currently provide. When humans and robots work alongside each other, utilizing each other’s strengths, the results will be the most successful and deep, actionable insights will be delivered to clients.

6 Steps to Perfect Qual Series: Step 4 – Qualitative Analysis | New White Paper from L&E

6 Steps to Perfect Qual

White Paper Download

Step 4: Qualitative Analysis

To get to the heart of qualitative analysis, you need to dig deep, as well as scope the bigger picture, to provide actionable insight for the client to address the problem.

This next L&E trust guide sets the scene for the current scale of qualitative data, and offers research consultants a way to grasp the large amount of information by using the latest thinking and technology.

This paper will guide research consultants through the process of qualitative analysis to capitalize on scale, reach, cost, depth and speed. In this paper you will find:

  • Practical tips in categorizing and structuring data
  • The technology used to speed up the analysis stage
  • Support from L&E and technology partners

To continue reading, download our latest white paper by clicking here (no form to fill out).

Webinar | 6 Steps to Perfect Qual- Steps 4 & 5: Qualitative Analysis & Insights Communication

6 Steps to Perfect Qual – Free L&E Webinar Series (available via on-demand)

On June 6, 2018, L&E hosted our third webinar in our “Six Steps to Perfect Qual” webinar series for 2018 with Joan M. Lewis, Shaun Stripling and Walt Barron as our panelists. The focus was on steps 4 & 5: qualitative analysis and insights communications.

Guest Speakers: 

  • Joan M. Lewis, Former P&G Insights Director & Independent Advisor and Consultant 
  • Shaun Stripling, SVP, Chief Strategy Officer and Global Director of Frank About Women at Mullen
  • Walt Barron, Chief Strategy Officer, McKinney

Putting together qualitative analysis and communicating qualitative insight can seem a daunting process, so we wanted to offer you the latest techniques and best practices for telling strong stories and engaging clients with impactful deliverables.

Our third webinar will guide you through the best methods to ask questions and get actionable next steps to lead your clients to true insight. We will discuss the impact of powerful communications through a combination of the latest technology and practical tips for storytelling and creating actionable deliverables.

In this webinar you’ll learn how to:

  • Build impactful communications through storytelling (with practical advice on finding the golden thread in the information)
  • Different ways of communicating insight using technology

Is machine learning getting to grip with sarcasm? Sentiment and Semantics

It’s no secret that qualitative data is harder to analyze than quantitative. The replacement of ticked boxes for a plethora of data from verbatim, videos, group conversations and observations means that participant answers are vastly more time consuming to categorize. Not only this, but the context and motivations of the individuals need to be considered in addition to their responses and behaviors. But the effort is worth it; you can work to really understand consumer behavior and get to the ‘why’ behind the ‘what’.

Of the many techniques used to analyze qualitative information, sentiment analysis and semantic analysis are two we often come across. These provide insight into the data by looking at attitudes and themes. And as new technology continues to make its way into qualitative analysis, we need to understand how it can impact these two methods of analysis, and how it can help develop more meaningful insight.

As a reminder, sentiment analysis categorizes language based on opinions, often checking for a positive or negative viewpoint. This can include, for example, the views of consumers expressed on social media or online communities toward a specific product, idea or service. Although this deep analysis can be done by humans, it is quicker using technology – most often machine learning. Machine learning is helpful in analyzing large quantities of information and making judgements based on language that would be far too time consuming for researchers.

However, it’s important that sentiment analysis is not entirely reliant on technology. We are often asked to analyze data in a binary way, but the expressed sentiment is rarely that black and white. Technology often makes assumptions about the sentiment of a response to make it fit a binary format, while humans would be more cautious to force content into a category. Moreover, while humans can contextualize written language and understand colloquialisms and contradictions, as well as turns of phrase and humor such as sarcasm, machines struggle with this. Machines simply cannot understand all the nuances of language and its grammatical patterns to the same accuracy that a human can. In spite of the claims of some of the technology providers, we are far off being in a place where text can be analyzed by a machine as well as by a human. It is therefore important to use a joint approach to sentiment analysis; machines may make things quicker, but they’re also more likely to create inaccurate data through generalization, lack of contextual knowledge and a lack of natural language skills.

Semantic analysis, on the other hand, generates meaning by grouping together the themes in qualitative data. It is often referred to as topic or keyword analysis. This is an important approach when trying to understand the important subjects in the field of study, regardless of how a participant feels about them. This is often useful in the early stages of a research project, when exploring a broad idea and looking into other relevant and more specific ideas that need to be examined further. As with sentiment analysis, this can easily be done by a computer, and indeed, it is far more efficient to do so, leaving the researcher with more time for deeper analytical thinking. Furthermore, a machine learning process can take place with no prior knowledge of the documents – again saving time. However, there are limitations, as the grouping of themes needs to go beyond basic classification to give a meaningful representation of the qualitative information.

So machine learning speeds up sentiment and semantic analysis; for text based analyses this can open up a whole new world of information about consumers from social media, communities, and other online resources. The tech guys are working hard to solve the nuances of language such as sarcasm – machine learning’s biggest barrier in sentiment analysis. And then with semantic analysis comes the challenge of context – such as the ability to distinguish Mars the chocolate bar from Mars the planet. Technology is certainly getting closer to solving these problems, but in the meantime, it’s nice to keep the humans around.

For more on qualitative analysis, download our white paper here.

Renee’s Takeaways – Get the scoop on L&E’s Qual Research Recruiting Webinar!

6 Steps to Perfect Qual Webinar Series Summary

Step 2 – Qualitative Research Recruiting Webinar – Webinar held on April 11, 2018

Let’s add another webinar filled with great information to the books!  In this webinar in our series, we focused on Qualitative Recruitment and got to spend some time with three experts in our industry.  First up, Teressa Johnnson, Director, Sensory Science and Technical Support at The Wendy’s Company.  Next, Heather Hall, Vice President of Project Management at Illumination Research.  And last but not least, our very own Brett Watkins, CEO and President of L&E Research.

In this webinar, we focused on Q&A based around Qualitative Recruitment, tips to help your recruiting go as smoothly as possible, and also help ward off any issues before they become issues starting with the design process.

Here’s what our panelists had to say!

1. We started by asking about kicking off a new project with a recruiting partner.  What might our panelists be able to share with an amateur researcher in regards to getting recruiting started off on the right foot?

  • Partner, partner, partner! You want to be sure to work with recruiting companies who not only care about helping YOU be successful, but who also align with your core values. In any good relationship, personal or business, communication and honesty are key elements to be able to have a true partnership.   In the end, you’ll want to be sure that you can trust your partner to do what is best for your project.
  • Be clear about your expectations for the recruit right from the start! Have a discussion about who your ideal respondent is. Ask your recruiting partner if they have any past experience with the population you are trying to reach, and if they can offer and advice on the best ways to reach them.
  • Ask your recruiting partner what their plan is to find your population. If plan A does not work, what’s plan B?  Having this mapped out at the beginning, will help keep your recruiting from getting hung up, and keep the process moving along.

2. Next we discussed what might be at the top of our panelist’s checklist when kicking off a new project.

  • Be sure that your recruiting partner is fully aligned with you! Make sure you are crystal clear on who you really want for your research.  This will help eliminate issues down the line.
  • Have a kick-off call! Extremely important to have a kick-off call with your recruiting partner before getting started.  In the age of email, some things may be uncovered in a phone call, that was not communicated in the email thread.  This is a good time for both parties to ask questions, gain clarification, brainstorm, etc.

3. We also touched a little bit on screener development.  What do our panelists always work into their screeners?

  • False, or catch questions. Ask about product usage, and include a few items in a list that do not actually exist.  If a potential respondent answers yes to using any of the false products, TERMINATE!
  • Include your plan B right in the screener! If you anticipate that a question may not work, or may be a sticking point, make your plan B known from the start as to not hold up recruiting.
  • Be careful of the way your questions are worded. It’s easy for a question to be interpreted by different people in different ways.  It’s extremely important to be sure that your questions do not have multiple ways they can be interpreted.  Let someone else on your team put their eyes on it, even take it for a test run if time allows.

4. Touching on recruiting partnerships again, we asked our panelists what some of their must haves are in a recruiting partner.

  • Communication is key. Over communication is even better!  Keeping the client in the loop, and always informed about what is going on with their recruit.  If they are anticipating issues, let the client know, and even come to the table with some suggestions on what can be done to keep the recruit moving right along.
  • Timely updates. A partner who understands that no news makes the client anxious!  All ties in with the above, and if there is an issue, knowing about is sooner than later is best to be able to stay on top of it.

5. Along the same vein, we asked our panelists what the best service is that their recruiting partner can provide.

  • Once a project is kicked off, get started quickly! If recruiting gets started quickly, you can have a gauge early on how the recruiting is going, and be able to identify any issues sooner rather than later.
  • Be honest about feasibility! Work with a partner who does their homework up front, and can let you know, with certainty, if they can recruit the population you are after. If they cannot, they should come to the table with what they CAN do.
  • A solid database. It’s helpful if a recruiting partner’s database holds a lot of preliminary information about potential respondents.  This way, you can focus on the meat of the recruit, and get the demographics and such out of the way up front.

6. One question I think we all ask now and then is how we avoid some of the common issues that may arise with recruiting.  Is there anything that can be done during the design process in order to get the most authentic participants?

  • Blind recruit. Set up your screener to hide the topic, but as mentioned earlier on, include the red herring questions.
  • Re-screen on-site. If someone was not truthful during the screening process, they will likely not remember how they answered if screened again.
  • Work with a recruiting partner who uses technology to track things such as past participation, participant behavior, etc., so you are able to weed out non-qualifying participants early on in the process. Also a partner who is always working to grow their database to ensure fresh participants.

7. New technology and recruiting.  What do our panelists think about it, what do they like, and what are some things that need to be overcome when working with it?

  • Online research. You can reach a lot of people who you may not have been able to reach before, expand your reach. One of the issues with this are bots, and how they can mimic human behavior to answer questions.  Better technology could be put in place to help with that.
  • Webcams can give us some great insights into consumer behavior, and that can work alone as the sole methodology. It’s even better when you can use it prior to groups or interviews to get the conversation started before the respondents even arrive on-site.

We hope you found this summary to be helpful! If you didn’t register for this webinar you can listen to this webinar in its entirety, or download a free, transcribed version by clicking here.

Be on the lookout for our next webinar, which will be this summer. If you can’t wait until then, you can always view our on-demand webinars and learn about the latest technology solutions. Don’t forget to subscribe to our blog so you can keep up with what is happening at L&E!

Until next time!

Your Research Design Engineer at L&E,

Renee Wyckoff

Webinar Recording | 6 Steps to Perfect Qual- Step 2: Qualitative Research Recruitment

6 Steps to Perfect Qual – Free L&E Webinar Series

On April 11, 2018, L&E hosted our second webinar in our “Six Steps to Perfect Qual” webinar series for 2018 with Teressa Johnson, Heather Hall and Brett Watkins as our panelists. The second step in our series focused on qualitative research recruiting and its importance to great qualitative research.

Miss out on this webinar? Not to fear, you can find the on-demand webinar recording here.

And if you haven’t read our next 2 white papers in the 6 step series, you can find those here.

6 Steps to Perfect Qual – Step 2: Qualitative Recruitment

In order to provide true insight, researchers need to guarantee the best possible participants. But for this guarantee, there are some guidelines, and several firm rules, that must be carefully considered.

Our second webinar in our “Six Steps to Perfect Qual” webinar series will guide you through the best methods to get the best people on your qualitative project. Ask questions and get actionable next steps to lead your clients to true insight.

In this webinar you will uncover the best practices for qualitative recruitment:

  • Critical steps and valuable tips in getting the right respondents
  • Leading techniques taking advantage of new (and old) resources
  • Leveraging the best technology in recruitment software
  • Support for recruiting even the rarest hard-to-find people for quality insight