post

Footer About

Footer Get Involved

Footer Links

Mind the Product

General

Product Unplugged Episode 3 with Pierce Healy

Product Unplugged Episode 2 with Lorilyn McCue

Product Strategy

Building Product Teams

Diversity and Inclusion

Digital Transformation

Artificial Intelligence (AI) & Machine Learning (ML)

Product Leadership

Product Management Career

Product Ethics

Minimum Viable Product

Enterprise Product Management

OKRs

Customer Research

Hypothesis and Testing

Business Strategy

User Research

👩‍🚀🚀   Live now for MTP members: <a href="https://mtp2017stg.wpengine.com/membership/#events" style="color:#FFFFFF;text-decoration:underline;">Driving Innovation AMA with Tendayi Viki</a>

Roadmaps: Break the rules without breaking the principles

Got questions about your product career?

Product roadmaps vs data – Jeremy Levy on The Product Experience

From engineering to product management at Google

Mind the Product joins Pendo

Eira is an editor for Mind the Product. She's been a business journalist, editor, and copywriter for longer than she cares to think about.

Eira Hayward

<p>In the first of this 2-part series on product research, we look at how to get started with product research and at some golden rules to makes sure it goes well (read <a href="https://mtp2017stg.wpengine.com/simple-steps-to-effective-product-research-part-1-getting-started/" target="_blank" rel="noopener">Simple steps to effective product research – Part 1: Getting started</a>). I part 2, we look at what commonly goes wrong, how to avoid this, and at best practices for analysing your results.</p>
<h2>Where does research typically go wrong/fall short?</h2>
<p>Product research is a mix of user research, market research and analytics. It means looking into the problems customers have, understanding them in a market context, and then bringing them with analytics to show you how people are using your product.</p>
<h3>You fail to consider all three elements</h3>
<p>In practice, though, teams often focus on just two out of these three elements. According to C Todd Lombardo, VP of Product and Experience at Openly: “Product research tries to bring these three streams together, but a lot of the time they’re talked about individually. You might see teams saying, ‘I&#8217;ve got my UX research, and I&#8217;ve got my analytics’. But they lack the market research and the context that delivers in helping you to describe your product strategy and market.”</p>
<h3>The scope isn’t clear</h3>
<p>If the precise intent is unclear, then people may get stuck in the weeds, so make sure the scope of the research is crystal clear. Nadia Elinbabi, Senior User Experience Designer at Openly, says she once had a three-month research project turn into a nine-month project because the scope just kept expanding. “If you&#8217;re not very clear on the exact answers that you&#8217;re looking for, you can be doing it for the rest of your life,” she says.</p>
<h3>You conflate research and interviews</h3>
<p>People can conflate research questions with interview questions. For example, the research question “what are the best restaurant experiences”, isn’t a question to ask at interviews &#8211; whereas “tell me about the last restaurant meal you had” is.</p>
<h3>Egos and assumptions get in the way</h3>
<p>People’s egos can get in the way of effective research. We might think, thanks to our experience and market knowledge, that we know the right product to build and then fail to conduct proper product research. As C Todd puts it, you need to expect to be wrong, rather than expect to be right. Just because you got the right answer once, doesn’t mean you’ll be right again. This chapter, <span style="text-decoration: underline;"><a href="https://mtp2017stg.wpengine.com/product-research-rules-free-chapter/">Prepare to be wrong</a></span>, from C Todd’s book on product research, looks in more detail at the mindsets that contribute to poor product research</p>
<h2>Tips on effectively analysing your results</h2>
<p>What do you need to keep in mind when it comes to understanding the results of your product research and getting the most from your analysis? Here are a few pieces of advice from our experts.</p>
<h3>Preparation is key</h3>
<p>Effective research and analysis is all in the preparation. You need to be completely clear about the purpose of the research and what questions you want to ask before you start. Determine who to ask questions to, and whose data would be valuable.</p>
<h3>Keep it moving</h3>
<p>You may not always have 100% of an answer. But don’t forget that 80% of an answer may be good enough. As C Todd says: “We want to make sure that we&#8217;re moving fast enough, but also in the right direction.”</p>
<h3>Make sure the team gets involved</h3>
<p>Go through your research with your teammates. The more people involved the better, because the biases you need to be aware of when asking questions also apply to analysing results. Says Nadia: “The more people that you have digging through the research with you and going through the analysis, the more likely you are to get to the real answers.”</p>
<h2>Top resources</h2>
<p>What books, talks, and articles do our experts recommend people refer to?</p>
<ul>
<li><span style="text-decoration: underline;"><a href="https://www.amazon.co.uk/Just-Enough-Research-Erika-Hall/dp/1937557103">Just Enough Research &#8211; Erika Hall</a></span></li>
<li><span style="text-decoration: underline;"><a href="https://www.amazon.co.uk/Interviewing-Users-Uncover-Compelling-Insights/dp/193382011X">Interviewing Users: How to Uncover Compelling Insights &#8211; Steve Portigal</a></span></li>
<li><span style="text-decoration: underline;"><a href="https://www.amazon.co.uk/Deploy-Empathy-practical-interviewing-customers/dp/173744660X/ref=sr_1_1?crid=2GPGV2BHSUBH4&amp;dchild=1&amp;keywords=deploy+empathy&amp;qid=1633074729&amp;qsid=257-1651895-2063461&amp;sprefix=deploy+em%2Cstripbooks%2C190&amp;sr=8-1&amp;sres=173744660X%2C1898059306%2C0141017961%2C1925089088%2CB01FJ5WB0C%2C036725493X%2CB08NMGVRKP%2CB086G2HWM1%2C198902579X%2CB079GMZ1Z6%2C1788165489%2C1137276428%2C1509842020%2C0571208258%2CB00FNHYVFK%2CB07H5MSXDC">Deploy Empathy: A practical guide to interviewing customers &#8211; Michele Hanson</a></span></li>
<li><span style="text-decoration: underline;"><a href="https://www.amazon.co.uk/Talking-Humans-Success-understanding-customers-ebook/dp/B00NSUEUL4">Talking to Humans: Success starts with understanding your customers &#8211; Giff Constable</a></span></li>
<li><span style="text-decoration: underline;"><a href="https://mtp2017stg.wpengine.com/product-research-rules-c-todd-lombardo-aras-bilgen-on-the-product-experience/">The Product Experience &#8211; Product Research Rules – C. Todd Lombardo &amp; Aras Bilgen</a></span></li>
<li><span style="text-decoration: underline;"><a href="https://www.amazon.co.uk/Product-Research-Rules-Foundational-Accelerated/dp/1492049476">Product Research Rules &#8211; C Todd Lombardo &amp; Aras Bilgen</a></span></li>
<li><span style="text-decoration: underline;"><a href="https://mtp2017stg.wpengine.com/qualitative-intelligence-by-mitchell-gillespie/">Qualitative Intelligence by Mitchell Gillespie</a></span></li>
</ul>
<div class="g g-21"><div class="g-single a-79"><a class="gofollow" data-track="NzksMjEsMSw2MA==" href="https://mtp2017stg.wpengine.com/product-management-training/public-workshops/"><img decoding="async" src="https://mtp2017stg.wpengine.com/wp-content/uploads/2021/10/General-Training-Interactive-Courses-FOOTER-scaled.jpg" /></a></div></div>

core/freeform

Product Management Skills

Taming the roadmap circus by Maarten Dalmijn

Design for cognitive Bias by David Dylan Thomas

The role of the first product manager by Andrew Moll

It’s all about the outcome by Georgie Smallwood

Transition from a Feature Factory to Business Impact team by Sandra Hinz

Sharpening your product craft as an internal product manager by Alison Hickson

From burnout to bounceback by Sara Wachter-Boettcher

The importance of EQ for product development teams by Nikkia Reveillac

Owning your story as a leader: Advice from Donna Lichaw

Goal Setting in Product

Simple steps to effective product research – Part 2: Getting it right

ProductTank Columbus

ProductTank Tauranga

ProductTank Edinburgh

Prioritised Member AMA - Perfecting product roadmaps

ProductTank San Diego

Navigating difficult relationships panel

ProductTank Philadelphia

ProductTank Bucharest

ProductTank NoVa

Remote Training Workshops

ProductTank London

ProductTank Birmingham

ProductTank Oslo

ProductTank Astana

ProductTank NoVA

ProductTank Bratislava

ProductTank New York

ProductTank Kansas City

ProductTank Orlando

ProductTank Dallas

ProductTank Tokyo

ProductTank Belgrade

ProductTank Madrid

ProductTank Leeds

ProductTank Zürich

ProductTank Perth

ProductTank Chicago

ProductTank Auckland

ProductTank Richmond

ProductTank Charlotte

ProductTank Reston

ProductTank Washington

ProductTank Sofia

ProductTank Raleigh

ProductTank Ljubljana

ProductTank Kraków

ProductTank Barcelona

ProductTank Dublin

ProductTank Montréal

ProductTank Bogotá

ProductTank Seattle

ProductTank Madison

ProductTank Singapore

ProductTank Portland

ProductTank Budapest

ProductTank Porto

ProductTank Austin

ProductTank Los Angeles

ProductTank Norwich

ProductTank Des Moines

ProductTank San Francisco

ProductTank Helsinki

ProductTank Reading

ProductTank Brighton

ProductTank Valencia

ProductTank Bielefeld

ProductTank Malmö

ProductTank Canberra

ProductTank Manchester

#mtpcon SF+Americas 2022 Conference

#mtpEngage Hamburg 2022 Leadership Forum

#mtpEngage Hamburg 2022 Workshops

#mtpEngage Hamburg 2022 Conference

#mtpcon London+EMEA 2022 Conference

Simple steps to effective product research – Part 2: Getting it right

Eira Hayward

Read more

Comments