post

Footer About

Footer Get Involved

Footer Links

Mind the Product

General

Product Unplugged Episode 3 with Pierce Healy

Product Unplugged Episode 2 with Lorilyn McCue

Product Strategy

Building Product Teams

Diversity and Inclusion

Digital Transformation

Artificial Intelligence (AI) & Machine Learning (ML)

Product Leadership

Product Management Career

Product Ethics

Minimum Viable Product

Enterprise Product Management

OKRs

Customer Research

Hypothesis and Testing

Business Strategy

User Research

👩‍🚀🚀 Live now for MTP members: <a href="https://mtp2017stg.wpengine.com/membership/#events" style="color:#FFFFFF;text-decoration:underline;">Driving Innovation AMA with Tendayi Viki</a>

Roadmaps: Break the rules without breaking the principles

Got questions about your product career?

Product roadmaps vs data – Jeremy Levy on The Product Experience

From engineering to product management at Google

Mind the Product joins Pendo

Sarah Oliver is passionate about building products to solve real business problems. She has 15+ years’ experience in B2B product management across the financial, legal, energy and logistics sectors. She is also a Chartered Marketer interested in the intersect of product marketing and product management and how we effectively launch new products. She is currently leading product for a scaling up Norwegian-based company moving to a product-led approach.

Sarah Oliver

In this MTP Engage Manchester talk, <a href="https://twitter.com/lisavigar">Lisa </a><a href="https://twitter.com/lisavigar">Vigar</a> takes us through the journey &#8211; from launch proposition in September 2018, to winning a prestigious Webby award &#8211; of the <a href="https://www.amazon.co.uk/BBC-MEDIA-APPLICATIONS-TECHNOLOGIES-LIMITED/dp/B07BY9LKLG">BBC Voice for Kids Alexa app</a>. She outlines some of the lessons learned around the challenges of developing voice products and working with children, and highlights the importance of detailed user research to engage and retain a regular audience (especially when your audience includes the complexity of parents and children!)
<h2>Misunderstood MVP</h2>
There is a saying that if you’re not embarrassed by the first version of your product, then you’ve launched too late. We all understand that the intent behind that saying is that you shouldn’t invest too heavily in an initial launch &#8211; an MVP &#8211; which might reveal you’re on the wrong track.
However, the first lesson the team on this product learned was that if you are truly embarrassed by the first version of your product, then there’s a good chance you’ve misunderstood what’s valuable to the audience, and don’t have a clear understanding of what they want.
To quickly test the appetite for a kid’s voice app, the team created one game but didn’t launch it due to lesson number two: if you’re embarrassed by the first version of your product, you’ve possibly misunderstand what’s valuable to both your audience and your business. The team recognised that to find the sweet spot, you need to understand what’s valuable to both.
It turned out that the business stakeholders weren’t comfortable signing off on such a stripped-down product experience, so lesson number two led to &#8216;MVP Take 2&#8217;. The first skills which were launched on the app were actually three games, followed a month later by three stories.
<h2>User Testing</h2>
The team did multiple rounds of user testing &#8211; exploring how the app was being received, and trying to learn what level of complexity kids can handle. It’s worth remembering that the business goal was to have their users (children) regularly returning to the app, and discovering the huge breadth of content available in the Cbeebies library. They quickly learned a few valuable lessons about presenting children with options for what they’d like to do:
<ul>
<li>Children are generally capable of cognitively handling (making a meaningful choice between) just two options.</li>
<li>Children tend to enthusiastically shout out answers before hearing the full question, so the team needed to invert the questions. Instead of asking “Who do you want to play with? Andy or Justin?” they would need to give the options first; “Andy and Justin are here – who do you want to play with?”.</li>
</ul>
The initial testing was insightful, but the initial wave of usage data was highly unexpected; the app was being used, but people weren’t coming back and listening regularly. Over 70% were only using the skill once a week, and quantitative data wasn’t telling them enough, so they started to dig into other sources of data:
<ul>
<li>Skills store reviews &#8211; to see what feedback people were leaving</li>
<li>In-home diary studies &#8211; they asked users to complete these in their home environment</li>
</ul>
From these data sources, they realised there were three key problems:
<ol>
<li>Users didn’t know how much content there was</li>
<li>Users only picked from the two options presented (they didn’t know how to go “off-menu”)</li>
<li>Users are unable to find the content they want</li>
</ol>
<h2>How the team iterated the MVP</h2>
Considering that one of the team’s goals was to help more users to access the wealth of CBeebies content, this initial wave of usage data was troubling. Thankfully, they had the insights and the capability to dig in, iterate, and learn more.
<h3>Challenge Statements and Discovery</h3>
The team worked in challenge statements framed by “how might we…” questions so, based on the user insight above, they asked themselves:
<blockquote>How might we increase the breadth of content discovered and consumed by our audience?</blockquote>
This is all about Discovery, but discovery is very hard in the voice space with no imagery or physical interfaces! The next step was a workshop, bringing the multidisciplinary team together to look at research data, listening to the skill, and brainstorming &#8211; they came up with lots of post-its and ideas.
<h3>Prioritisation</h3>
Pulling together everything they generated, the team went on to do a traditional impact/effort analysis to prioritise the top three ideas:
How might we…
<ol>
<li>Tell users how much content we have</li>
<li>Allow users to “scroll” through our content</li>
<li>Support any content title (brand or character)</li>
</ol>
Taking what they learned into consideration, and thinking about the problems they were trying to solve, they also developed the following design principles:
<ol>
<li>It must make sense that only two options are presented</li>
<li>If there is a question, end the sentence with it</li>
<li>Be as precise as possible</li>
</ol>
While having those requirements was a great step forward, trying to solve for all of them simultaneously felt impossible. That was, until the team realised they could solve the problem by completely removing the “question” component of the voice interface:
<ul>
<li>They could tell the children how much content there was to play with, introduce the scrolling functionality (choose one or ask for more),</li>
<li>support any title without tying the content to a single character,</li>
<li>and lastly, be suggestive by asking “how about this option”, instead of “choose A or B”.</li>
</ul>
The navigation became instructional without a question, and this was all done in 18 words. The team tested the functionality with a group of children using a lo-fi prototype and it worked incredibly well. The children said “more” a lot, and both frequency and retention increased, although interestingly more from the stories and songs than the games.
If you’re curious about where this commitment to research and iteration led, as of February 2020 (the time of this talk), the BBC Kids Skills App has won awards, has five games and 31 stories, and the team continued to release new content every month including song playlists.
<div class="g g-21"><div class="g-single a-73"><a class="gofollow" data-track="NzMsMjEsMSw2MA==" href="https://community.mindtheproduct.com/c/general/"><img decoding="async" src="https://mtp2017stg.wpengine.com/wp-content/uploads/2021/10/Membership-Circle-banner-ad-scaled.jpg" /></a></div></div>

core/freeform

Prioritised Fireside Chat: Make better product decisions with JTBD

Connecting to your customers in a remote world by Anna Lee Anda

MTP Panel: Using discovery and research to influence key product decisions

Capturing Customer Context for Cross-Channel Experiences by Cheryl Platz

Here Be Dragons – Product and Discovery, by Randy Silver

Iterating Your Voice Product, by Lisa Vigar

Qualitative Intelligence by Mitchell Gillespie

Building Consumer-Grade Experiences for the Enterprise By Ciara Peter

Imaginary Research – How to Design More Human Stuff by Kate Nightingale

Using Research in Material Design by Elizabeth Churchill

ProductTank Columbus

ProductTank Tauranga

ProductTank Edinburgh

Prioritised Member AMA - Perfecting product roadmaps

ProductTank San Diego

Navigating difficult relationships panel

ProductTank Philadelphia

ProductTank Bucharest

ProductTank NoVa

Remote Training Workshops

ProductTank London

ProductTank Birmingham

ProductTank Oslo

ProductTank Astana

ProductTank NoVA

ProductTank Belgrade

ProductTank Leeds

ProductTank Zürich

ProductTank Perth

ProductTank Tokyo

ProductTank Chicago

ProductTank Auckland

ProductTank Richmond

ProductTank Charlotte

ProductTank Reston

ProductTank Washington

ProductTank Sofia

ProductTank Raleigh

ProductTank Ljubljana

ProductTank Kraków

ProductTank Athens

ProductTank Barcelona

ProductTank Dublin

ProductTank Montréal

ProductTank Bogotá

ProductTank Seattle

ProductTank Madison

ProductTank Singapore

ProductTank Portland

ProductTank Budapest

ProductTank Valencia

ProductTank Porto

ProductTank Los Angeles

ProductTank Austin

ProductTank Norwich

ProductTank Des Moines

ProductTank San Francisco

ProductTank Helsinki

ProductTank Reading

ProductTank Brighton

ProductTank Bielefeld

ProductTank Dallas

ProductTank Malmö

ProductTank Canberra

ProductTank Paris

ProductTank Manchester

#mtpcon SF+Americas 2022 Conference

#mtpEngage Hamburg 2022 Leadership Forum

#mtpEngage Hamburg 2022 Workshops

#mtpEngage Hamburg 2022 Conference

#mtpcon London+EMEA 2022 Conference