The Transformational Impact of a Scrappy Research Practice

In this excerpt we focus on how our practice of Scrappy Research dramatically changes the time-to-value for research and therefore the efficiency of the overall product creation process; making confident decisions quickly and often. For more on how to establish a practice in Scrappy Research, pick up the book!

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. Buy it now from Amazon.

Scrappy research is a practice that turns product managers into great leaders. Let’s talk about some reasons why.

Scrappy Research Prevents a Significant Amount of Rework

How many times a day do you make decisions about a product: feature prioritization, backlog cuts, design decisions, strategy decisions, and so on? Product people make scads of decisions every day based on intuition and whatever data they have (which can be none, depending on how big or how new the product or business is). Is it the best-kept secret that product people probably make most of their daily decisions based on gut feelings? Nope. That is our life as product people. Take this example:

Product Team A decides to build one feature instead of another based on what they think is the right direction. They build it with tracking so they can get usage data in real time. Within 6 weeks of releasing the functionality, they learn that the feature isn’t used as much as they expected, and the desired business outcome isn’t being achieved. The team reworked the functionality and relaunched within 12 weeks.

On the surface this may look fantastic: They implemented tracking, they learned within 6 weeks, and had a new version out in three months. These are huge accomplishments for some companies, but we’re here to tell you that this is an unacceptable cost of time and rework.

Keep this quote by Thomas Gilb, famous for improving an organizations’ delivery capability through systems engineering, cemented in your mind: “Once a system is in development, correcting a problem costs 10 times as much as fixing the same problem in design. If the system has been released, it costs 100 times as much relative to fixing in design.”

Scrappy research combined with a clear hypothesis is a catalyst for reducing work. To drive faster success at a significantly lower cost, make scrappy research an ongoing habit instead of a special occasion.

Scrappy Research Enables Durable Decisions

Every product manager experiences an overturned product decision at least once in their career. We’ve all been there. It’s frustrating. In some cases, we’ve seen that when product decisions are consistently overturned, it ends a career. Here’s an example: 

Product Manager A proposes a direction for a product to his leader and cross-functional partners. The product manager bases the logic behind his proposed direction on some big hypotheses, but he feels confident the hypotheses will prove correct, given what his customer service team has told him. In the proposal meeting, the cross-functional team seems a bit skeptical, but they all walk out of the room nodding and the development team gets to work. Two weeks later his leader calls him and says, “We need to pause work on this because your cross-functional counterpart isn’t supportive of the direction and expects a different direction instead…and I think I might agree. Let’s change direction.”

Replace the word “direction” here with “feature,” “design change,” or “product trade-off.” We’ve all been through a similar scenario at one time or another. Other people’s opinions start to take over and you’re stuck in the middle. For those of you who experience this as a norm, which it is in some business cultures, listen up—conducting scrappy research as a practice is for you. Whenever you need to change direction, implement a new feature, update prioritization of initiatives, or anything that you know may differ from the expectations your product team holds today, communicate your logic through customer-backed reasoning.

Scrappy research allows the customer to speak in lieu of anyone’s opinion. Practicing ongoing customer research, albeit scrappy, builds customer-backed logic that your team can understand and commit to. You may not get a consensus on your decision, but you’ll get commitment because they understand the logic behind it. We call that shared vision. Yes, it sounds like bogus corporate jargon. We learned it early on in our careers from Steve Bennett, a former CEO of Intuit, whom we both worked under. And it’s one of the only corporate jargon terms we embraced. We love the term because it represents something more powerful than “consensus.” Shared vision is our way of driving commitment. We could write an entire book on the importance of shared vision, but the point here is to get away from opinion and use customer-backed logic to communicate and gain commitment to proposed decisions.

Scrappy Research Keeps You Close to the Customer

This isn’t a goal of scrappy research in and of itself, but it sure makes you a far more effective product person. You can make faster product decisions, gain the trust of your entire team and your cross-functional stakeholders, and feel more confident in your day-to-day operating role. It’s win-win-win.

We can’t tell you how many times we see product managers deferring customer understanding to others—researchers, business analysts, UX designers. Deferring is convenient and allows you to pile other stuff on your plate. And yes, it looks like you’re making the right work prioritization decision initially, but you’re probably not.

People distance themselves from their customers and spin their wheels with decision vacillation because the loudest opinion in the room generally wins. They can’t effectively prioritize the backlog, they add a constant barrage of shiny objects, and they have no way to justify tradeoffs with confidence. All in all, the other stuff that you pile on your plate becomes significantly more time consuming. Scrappy research is not a full-time job, but it’s a fundamental practice that makes or breaks a product person’s career over time.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

3 Steps to Identifying Where Hypothesis Testing is Critical

As a follow on to our last blog post, we wanted to provide an excerpt that revealed how to identify the areas of the business for which you need to formulate hypotheses in order to test and build confidence in your product direction or pivot where you need to earlier rather than later. Check this out.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

As product leaders, we spend a lot of time in meetings sharing opinions when we review customer research. We make a lot of assumptions, and we tend to hear what we want to hear. We’re sure you’ve been in more than one meeting like this. Many companies are so execution-focused that they move from one activity to another, without taking the time to help teams align, ask the right questions, and facilitate real collaboration.

Instead of just providing feedback on a hypothesis (or rejecting it outright), we’ve created three easy steps to help you coach your team to getting to a strong hypothesis: 

1. Identify What You Don’t Know

The best way to avoid some of the pitfalls we described earlier is to think about what you truly don’t know about the customer or problem. 

  • What are you guessing at or making assumptions about, with regard to their behaviors, their needs or the problem they’re facing? 
  • What conditions would have to be true for a new feature to work? 
  • If this is a new market, then what conditions need to be true for you to launch? 
  • If this is for a physical product, what conditions must exist for a customer to successfully use it?
  • What assumptions are you making about your persona, that if proven false, would dramatically change your course of action? 
  • Have you accurately translated what a customer has told you they wanted into a need?

Each of these questions represent the types of assumptions we make every day. Most of the time we jump straight from idea or insight, right into development. This stage requires you to painstakingly face everything that might go wrong. We often start with asking ourselves the question “What would make this idea fail?”

Now write down everything you don’t know as a question. Here are two assumptions we made based on our fitness app Melanie Persona:

● Melanie loves to try new forms of exercise.

● Melanie won’t care if she can’t go to the same studio more than three times a month.

Those assumptions matter. We believe them to be true because we spent a lot of time talking with her, to develop our Actionable Persona. Both of these assumptions were driving major design decisions. We’re taking this head-on, leaning into the biggest assumptions that will impact our business model. What we learn will help us make an important product decision.

2. Prioritize Assumptions.

If you do step one thoroughly, you’re going to end up with a lot of assumptions. Not all of the assumptions are critical and you want to know which will have the most impact on your business. We turn to a design thinking technique called a “bullseye diagram” to help sort through and classify all these assumptions. We like to make this a visual exercise that the entire team can participate in. On a large whiteboard draw three concentric circles, each one bigger than the last. Write each of your assumptions on separate Post-it Notes so you can move them around easily. Now it’s time to prioritize.

You can place one assumption in the innermost circle. In the next circle, you get to place three assumptions, and in the outermost ring, you get a choice of five assumptions. As you pick up each assumption, ask “how important is it to know this?” You can also set up multiple bullseye diagrams and have each member of your team run through the prioritization process individually, and then gather to compare results. 

We’ve even invited key stakeholders in our business to participate so that we get to hear their thoughts and concerns. Consider what different perspectives you may want as you try to understand what’s most important for you to learn. As an added benefit, it keeps everyone on the same page and increases commitment to, and interest in, the research you’re about to start. With this exercise, you’ll have a list of prioritized assumptions—and a clear winner. This winning assumption is used for the first hypothesis you write.

3. Convert Assumptions to Hypotheses

This step converts the prioritized assumption into a hypothesis. Here’s a hypothesis format you can use:

If… [specific, repeatable action]

Then… [expected, measurable outcome]

Because… [clearly stated assumption]

The easiest way we’ve found to create a strong hypothesis is to start with your desired outcome. What needs to be true to resolve your assumption? 

  • Do you want 10% more sign-ups to your site? 
  • Do you want 25% fewer customer calls? 
  • Do you want to increase your NPS by 5 points? 

Whether it’s 5 points or 10 points of NPS you’re trying to impact, or 25% less customer contacts; pick a figure that is meaningful to the business and will make a difference. Start with your desired outcome and then pick the appropriate measurement.

Next, move to the clearly stated, highest-priority assumption. This is where you can rewrite and reshape your assumption. If you truly believe you can’t make a significant difference by addressing this assumption, then move to your next ring of assumptions. There is no point in trying to create a test for an assumption that you don’t believe you can tackle. This is where you need a strong understanding of your business, your customers, and your market. Know what is important, and drive to make an impact where it counts.

Finally, consider the test itself. What action do you believe will create a significant result? Do you need to make a change to how people sign-up for your service? Do you need to introduce a new offering? Do you need to increase loyalty with existing customers?

Going back to the Melanie persona, share your highest prioritized assumption. One that we believe is critical to our business is: Melanie loves to try new forms of exercise.

We believe that Melanie will love to try new forms of exercise. If that is true, we’re going to give her many different classes to choose from. This will dictate how quickly we need to bring on new partners and it will dictate the design of our application. We want to make sure the assumption is true, so let’s turn this into a hypothesis that we can test given what’s important for our business: 

1. Desired Measurable Outcome: We want Melanie to love trying new exercises so much that she will purchase at least one class a week. That will give us enough revenue based on our projected number of customers.

2. Clearly Stated Assumption: Choice is the primary driver of purchase.

3. Specific, Repeatable Action: We will display different classes every week to keep her interested and engaged. 

This creates a hypothesis we can test:

If…we offer different classes per week to choose from

Then…we’ll get at least one purchase

Because…choice is the primary driver of purchase

After developing this hypothesis, we created three different prototypes on paper to test the different ways that the Melanie persona could choose classes and our hypothesis was validated. Remember, your assumption is always derived from something you don’t know and your hypothesis is based on your belief that a specific action will deliver the outcome your business is looking for. We told you to start with the measurable, desired outcome. When you start with what matters most for the business, whether that’s retention, or growth. Perhaps it’s revenue. Home in on the metric you most want to impact.

Like any practice, getting results requires constant feeding and nurturing. Starting to build a hypothesis-driven organization is going to be ugly and painful at the beginning. At first, you won’t get hypotheses that are elegantly formed and perfectly clear. A lot of them will be quite confusing and badly written and that’s okay. Pretty soon you’ll find yourself in a hypothesis-driven culture, with a team that’s always focusing on the riskiest assumptions, ready to make the biggest business impact.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

Make Customer Research Matter by Avoiding These Common Mistakes

This excerpt is for any leader looking for ways to infuse customer learning into everything they’re doing.  We shed a little light on how companies lose focus and go on autopilot with research; where process overshadows actual customer insights and action. Take a look.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Everything we espouse as professionals is based on understanding the customer. It’s hard to find a company that will tell you that they don’t want to hear from customers. And that makes it hard to develop good hypotheses about who they are and what they need. But companies can demonstrate a big failure point in execution when they conduct customer research. These companies will say they talk to customers all the time but what we see is a big gap in understanding what customers are saying. Let’s talk a bit more about what this may look like:

Company A is a large consumer business. They have a research facility that conducts customer research like clockwork every two weeks, putting every feature of their product through some sort of customer testing. They have a dedicated customer research analyst who talks to customers and develops reports. All the reports go to a shared storage where anyone in the company can access them.

That scenario might sound like magic to some of you, but we hear the slasher sound from the movie “Psycho.” We see three red flags: 1) A dedicated research team, someone outside the product team, does all the research; 2) Research is a stage of the development process; 3) Reports don’t have a clear recipient. 

Let’s examine each red flag a bit more to understand why this is a nightmare-inducing situation for us.

A Dedicated Research Team

Large companies can afford separate research departments. This is great—having people with the right skills and knowledge to do all sorts of deep research is a gift we would never turn down. However, when external research departments want to control all customer research, as often happens, it’s a problem. Most specialized departments end up wanting control, which is not necessarily a bad thing. A specialized department can manage its work more efficiently, force a company to prioritize, and can see connections between the different products and user experiences the company offers. But when a product team loses all ability to do their own customer research, it creates a chasm that is not easily crossed. A dedicated research analyst should, at the very least, be dotted lined into the product team, they should know exactly what the product is designed to do and why, and they should take their direction from a product manager. If these steps are in place, then the centralized research department becomes a benefit and not a curse.

Research as A Recurring Process

Whenever we hear that research is done regularly, we dig a bit deeper. What drives the cycle of research activity? Is the research focused around a hypothesis, or is it happening because it’s an activity to check off the to-do list? While we encourage frequent research, it should always be attached to something that the product manager needs to learn in order to make a decision; the research should always be done with an actual target or goal in mind. All research should start with a hypothesis. If you consider research as a regular occurring activity, go back and review what the inputs and outputs are. Ask yourself if you’re getting value from the work that’s being done.

Zombie Reports

What does your research report look like? Is it updated from a template? How much is customized? Does it include quotes, pictures, and videos? Ask yourself: Does it provide insight? We both have had the experience of having dedicated research groups added to our department. These researchers would present the team with PowerPoints of their research every two weeks, like clockwork. Those reports provided a lot of colorful images of customers who the researcher had spoken to, a lot of background information, and summaries of their discussions. Our teams would dutifully listen to the presentation, some would read the report and every person would file them away and they’d never be referred to again. When you receive a research report, are you doing anything with it? Does it live after the meeting? Does your team use the research results to shape their work? Were you able to make a product decision on the basis of the research? If not, stop the madness, cancel the report, save time and effort. Ask your team to provide a hypothesis, and then leverage your research resources to learn and validate or invalidate the hypothesis. Every research activity should produce results that the team needs.

Most companies conduct some sort of customer research, and we see over and over again that it’s not optimized to give them actionable results, partly because they don’t start with a solid hypothesis. We’re determined to fully persuade you about the value of hypothesis testing!

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

A 6-Part Formula for Developing a Customer Problem

Okay product leaders, this excerpt sheds some light on how to create a problem statement that works to focus the team and allow for you to say ‘no’ confidently. Take a look.

The following has been excerpted from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Let’s examine what goes into a Convergent Problem Statement. As a reminder, a convergent problem statement clearly describes the most relevant difficulty the customer is dealing with and is stated with no attempt to address possible solutions. We want to clearly define the problem in detail so that anyone reading the problem statement can immediately understand the situation. Every problem statement should address the following six questions.

1. Who Does It Impact?

You need to be able to imagine the person impacted by the problem. Start by defining a real human being—someone you can relate to. Developing a sense of the person who has the problem immediately creates a sense of empathy. This empathy allows you to better understand the problem. Don’t focus on demographics; think about a specific person in a particular role. You don’t need to name them, but you do want a sense of who they are, where they work, and what their day-to-day life might look like.

2. What Are They Trying to Do?

You want to understand the context in which the person is operating. Here you’ll think in more depth about where they live, work, or play. Their surroundings matter. You need to know what they have access to, what their environment looks like, and what options are available for them. You start to build a picture of what they have access to, and the workarounds or options they may consider to naturally approach the problem.

3. How Do They Want to Feel?

We love this question. Yes, it’s touchy-feely, but it goes to the core of why someone will care about the problem being solved. And for all you super-analytical types, this will be a cornerstone as you think about marketing. Understanding the emotional toll of the problem will help you sell the benefits of using your product. Every problem in your life leads to an emotion.

When the person you envision experiences the problem at hand, do they feel annoyed? Grumpy? Frustrated? Angry? Exhausted? 

This is one of the hardest questions to answer, so keep exploring different adjectives until you find the one that resonates. When you land on the right emotion, it will feel like an “aha!” moment. Understanding how your customer feels can reveal whether the problem is a serious or a trivial one. Asking these emotion questions help you determine the list of features needed to solve the problem, develop the solution, and price it. But let’s not jump ahead of ourselves; there’s still more to learn about the problem.

4. What’s Getting in the Way of Just Addressing the Problem?

When customers have problems, they’ve usually tried to address them in some way if it’s important enough. Have they tried alternative solutions? Did anything partially work? Have they created workarounds, whether that’s through supplementary software or manual steps? Have they tried to reduce the impact of part of the problem? What are the biggest barriers to resolving their problem? Is it lack of awareness? Budget? Time? This question asks you to both ask direct questions, and also to closely observe behavior and actions.

5. When Does This Problem Occur?

This question is about timing. Is this a recurring problem? Is it a daily or a weekly problem? Does it only occur at the end of a fiscal quarter? Or does it occur once, but when it occurs, is it extremely painful? Understanding the frequency of the problem gives you a sense of the scale and size of the problem. This question pushes innovative thinking; understanding what’s happening for the customer at different points of time allows us to consider alternatives.

6. Why Does This Problem Exist?

As you complete the problem statement, start to develop a hypothesis about why this particular problem exists for your customer. What gets in the way of just going about their day and avoiding this problem? Are there any alternative solutions or products that are just not viable, or is there no solution and they are creating a set of workarounds? Try not to go straight to willingness to pay for a solution as the answer, after all, people will pay a lot to solve an important problem. Instead, consider other factors that might be causing this problem. 

Remember, it’s for the particular person that you imagined in the first question (who does the problem impact?). Don’t generalize across a population to determine why the problem exists.

The answers to these six core questions paint a picture of your customer and their problem.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth. Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

4 Things Every Product Manager Needs to Think About Before Development

For you product leaders that are struggling to make the tough tradeoffs. Our book’s definition of the Convergent Problem Statement can help. This excerpt references some strategies in establishing just that with your team in order to make product decisions much more efficient and durable.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

The Convergent Problem Statement is just as useful for new products as it is to prioritize features for existing products. We love starting ideation with a couple of the most compelling problem statements, helping us to explore and ultimately prioritize which customer problem our business is best positioned to address. 

As a reminder, a convergent problem statement clearly describes the most relevant difficulty the customer is dealing with and is stated with no attempt to address possible solutions.

For product leaders, the best way to support your team is to be deeply involved and invested at this early stage. When you help your product manager (PM) work towards a Convergent Problem Statement, you set the Groundwork for a successful product. Here are some strategies to working with your PMs: 

  • Insist that every “idea” is framed as a problem statement. In our work, we’ve even created mini templates and asked anyone in the company to share product ideas as long as they write the ideas in the form of a problem and not a solution. This helps cut down the noise of new product ideas since there is the small hurdle of entering it as a well-formed problem statement. This practice helps our team source new ideas, and highlights people in the organization who are passionate about solving customer problems.
  • Share the iterations that helped you converge to the chosen problem. You want to show by example that no one gets it right the first time. By showcasing examples, you provide a roadmap for how you want your product team to think. Many problem statements start with a lot of guesses, and then you refine them through learning. Show that journey for your teams to emulate.
  • Highlight “failures” or problem statements that ended up abandoned because you proved there wasn’t actually a problem! We’ve all been captivated by new product ideas or solutions that we thought were so obvious. When we do the work we uncover that customers had a simple workaround, or felt lukewarm toward the idea, or discovered the problem wasn’t important enough to want to pay for a solution. We’ve shared when a customer’s “good-enough” solution was sufficient or the pain wasn’t high enough for them to choose an alternative. By highlighting examples, you demonstrate the rigor that brings a product or feature onto the roadmap. You’ll see all the teams you work with gain confidence knowing that customers are waiting for their solution.
  • Never assign development resources unless you are satisfied that there is a genuine Convergent Problem Statement. This can feel painful when there are engineers available and both you and your product manager feel the urgency to create work. You have to stay strong! You’ll avoid much pain and suffering (which can manifest as bad customer reviews, rework, and unhappy teams).

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

An Outline for an Effective Customer Learning Review

Well, year end is around the corner. We just talked about strategy, but what about the nooks and crannies of strategy? What we mean is one of the most critical inputs of strategy. Customer Insight!

Many product leaders fail at providing a well rounded review of customer learning. They move straight to the actions and implications to stakeholder (e.g. UX, development, marketing, operations) without the insights that drove those proposed actions. We see product managers cherry pick the data they believe supports the decisions they’re proposing. Regardless of whether the decision is right and how true your intentions are, cherry-picking breeds skepticism and a lack of trust from those who may have other data that leads them to favor a different decision. The whole discussion gets derailed and your reputation as a customer advocate and unbiased business leader begins to tarnish.

We recommend, after every major research study, you circle back to your cross functional partners (dev, ops, marketing, etc.) to discuss your customer learning. And we have a good outline for those reviews that we offer to our clients’ product managers that works every time. What do we mean when we say it works? We mean that durable decisions can be made, teams can commit to executing against those decisions, and trust in you as an unbiased leader is maintained.

Here’s the outline we recommend for most research studies:

Customer Research Review Outline

  1. Hypotheses: What were the goals of the research? What did you want to learn and how did you intend on using the data?
  2. Profiles targeted and research logistics: Provide context for who you talked to, how you conducted this research, and why it’s relevant. How many did you talk to (for qualitative research) or survey (for quantitative research.)
  3. Resulting themes & insights: These are the big Aha’s of the research. They should represent what you learned (factual observations) and how it addresses (proves or disproves) any given hypothesis (your conclusions). These shouldn’t be one-offs or interesting tidbits. That comes next.
    • For qualitative studies with low sample sizes (we believe in scrappy research, so many of our customer learning reviews are summaries of interviews with a small sample – five to seven – of participants,) report on anything mentioned across participants more than two times.
    • For bigger samples or quantitative research, these are important, statistically valid themes in the data.
    • Include any additional important themes you uncover that might not directly address your hypotheses. Just try and focus on the goals before bringing these in.
    • Bring all this to life by using the customers’ voice. Use actual quotes, pictures, or even a video from the sessions. Hearing directly from customers amps up your presentation substantially.
  4. Interesting tidbits: You can include anything mentioned that wasn’t a theme but could be a thread to tug on later through additional research. This might be a surprise finding, or a potentially new problem or segment you might explore. Tidbits don’t have to yield a conclusion or action, but they may be worth exploring later, and therefore, you want to highlight the information.
  5. Recommended actions: This is the most common thing missed if and when product managers present research findings. Recommended actions help the team with the “So now what?” question. Do we stop the dev effort? Do we pivot our design direction? Do we add that feature? Do we have to think differently about our persona? What does all this mean in terms of what I do tomorrow? Tell your audience explicitly what you plan to do based on what you (and they) just learned. If you don’t know, throw a little design thinking exercise in there to collaborate on the next steps!

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kickass customer experiences.    We have a passion finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook.

Take a look at our very practical training courses and coaching programs that give you tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

And stay tuned for our new book.  Sign up for updates on our new book “Groundwork. Get Better at Making Better Products”

Skills of Product Leaders Required in Unprecedented Times (Part I)

COVID-19 has changed us all in irreversible ways.  On a personal level, I don’t think any of us will ever be the same.  On a business level, if we are still lucky enough to be employed, the interrelated effects are numerous. As leaders we are trying to keep our employees and customers safe, re-orienting our day to day operations to a virtual norm, and navigating our way through the unknown to keep our businesses on solid ground, let alone driving growth.

Vidya spoke about making product decisions in crisis mode a couple weeks back which was really helpful.  I’m going to take a different look at this.  Focusing more on the skills of product leaders that are required to address some of the categories of product impact resulting from COVID-19.

Beyond the obvious impacts of COVID-19 we’re finding that the product impacts are exposing skills gaps among PM leaders and product managers alike.  Today I’m going to focus on the required skills of PM leaders in addressing the broad categories of impact COVID-19 is having on businesses. 

All businesses have been impacted in some way, but we see a few broad themes of impact to businesses that kick the product management function into a relatively higher gear.

ImpactExamples
Irrelevant ProductAirBnB, Hotels
Irrelevant Business ModelNon-essential Retail, Gyms, Theme Parks
HypergrowthZoom, Doordash

Today I’ll talk about the irrelevancy related impacts. 

Well talk about hypergrowth in a subsequent blog post. 

What does irrelevancy mean? 

  • Product irrelevancy is probably the most challenging.  The problem you were solving no longer exists. AirBnB is an example we’ll talk about later.  This could be temporary until normalcy is regained.  If you do nothing, it’s a race between your cash on hand and the return to operational and income normalcy.  
  • Business model irrelevancy is when the channels and ways you are selling your products/services aren’t relevant, even if your products/services are still desired or needed.  It’s more of an opportunity than product irrelevancy if the costs to change the ways in which you offer your product are not prohibitive.  And if you can do this quickly and can regain some of the lost revenue, it dramatically slows the race down until a new norm can be established.

Irrelevancy is a situation that we all may find ourselves in at some point in our career due to the common product lifecycle.  There is a launch period, a period of rapid growth, and established period, and decay.  Decay usually means that your product or business model is becoming irrelevant in some way.  Most tenured product leaders have gone through each of these periods at some point in their career.  With COVID-19, some of us are going from any one of the early stages into decay (or irrelevancy) within days versus what we usually see in months or even years.  This leaves some leaders exposed if they haven’t flexed those muscles in a while, if at all.   

You wouldn’t be a product leader had you not excelled in the basics.  So I’m not going to rattle off a bunch of standard leadership principles.  However, there are a few skills/practices that are critical for product leaders in these clutch moments:

  • MOVE – Driving Through the Fog
  • CREATE – Seek new ideas
  • LEARN – Continuous scrappy research

MOVE – Driving through the Fog

In crisis, we see many leaders become paralyzed.  It’s scary.  This kind of impact, at this pace, is unprecedented.  We probably don’t have the data and it’s hard being comfortable making any decision or taking action in fear of making the wrong decision.  But…in these cases, no action means decisions get delayed and usually get taken over by opinion.  Teams spin their wheels for weeks or even months.  In these times, we don’t have the luxury unnecessary delays. 

“More is lost by indecision than wrong decision. Indecision is the thief of opportunity. It will steal you blind.”  -Marcus Tullius Cicero

Driving through the fog is the ability to define a product path in the midst of cloudy or complete lack of data, overwhelming competing opinions, and numerous ideas.  It’s defining that path in spite of this and getting commitment from the rest of the organization that matters.  We, as product leaders, make a path out of what seems like no path at all. 

It’s a lot easier when we’re not under duress like now. Let’s face it, these are unprecedented times for product leaders and the time we have to act is extreme.  Moreover, optimistic estimates show that a vaccine (or when things go back to some semblance of normal) will take a minimum of 18 months.  Again, optimistic.  But this means we need a path to survive (and even thrive) in this new (albeit somewhat temporary) norm.

So how do we drive in the fog in time of crisis? 

First, breath. 

Then act … Using these principles

Use Educated Hypotheses to Start:  We will never have all the data we need as fast as we need it.  In lieu of this, set hypotheses by leveraging what you do know. Use proxy data to help triangulate on hypotheses where possible.

 Some areas where hypotheses might be helpful:

  • Product Irrelevancy:
    • How has the problem your product is solving changed? Why?
    • How has your target persona changed?  Why?
    • Are there new problems your team might be able to solve?  Why?
    • Are there new markets your team might be able to address?  Why?
  • Business Model Irrelevancy:
    • How has the problem your product is solving changed? Why?
    • What part of the business model has been affected the most?  Why?

Establish some key hypotheses and build an action plan as though they were true.  In parallel, work on proving/disproving those hypotheses with scrappy research practices.  Well talk about this later.   

Build a simple plan:  Instead of building a list of product efforts, help people understand your logic, not just the actions you’re taking.  As you learn and prove/disprove your hypotheses, you will certainly update your course of action.  These updates can be confusing and disconcerting to people if they don’t understand your logic initially and what you’re learning that might be changing your course of action.  A simple plan outline that I often use:

  • Summarize what you know…Key data points and customer learnings that matter
  • Translate those data points into insights or hypotheses and what it means to the business.
  • Summarize what action and/or product path(s) should be taken as a result
  • Articulate next steps and who owns what

Pretty simple stuff, I realize.  But I often find, in a crisis. that leaders jump straight to actions without insight-driven logic beyond those actions.  Then the organizational churn begins….time, we don’t have, is wasted.

Communicate Early & Often:  Your teams need more communications, not less, during times of crisis.  And they don’t need “business as usual” or the “We will live on…” speech from the movie Independence Day.  They need confidence that their product leader has a logical plan forward (even if it might not be 100% right,) and will learn and pivot where necessary to get to the right product path.  The best product leaders (and even CEOs) I know, say things like…“We don’t have all the answers, but here’s what we do know and what we’re going to do about it.  And we’re going to learn as fast as we can along the way.”   

The other misstep I see is the lack of communicating what the team is learning and how it’s changing the original course of action.  In crisis, things can change daily as you learn more.  There is a high likelihood that you confuse people not close to the action and create unnecessary churn (there’s that word again.)  Through my own misstep here I have heard things like:

“I thought we were doing this?” 

“Why is product changing the plan again?”

“That doesn’t make sense?” 

“We should do this instead!” 

…All of which can be avoided by a regular interval of communicating what the product team is learning (Learning is progress!) and how it impacts your plan.  This provides the continuity people need and allows them to continue to see the path forward.  Remember you’re serving as the driver through this fog and your passengers need reassurance.

Tip:  Use the “simple plan” we discuss above; hopefully the one you presented at the beginning of this process.  Show what’s changed and the logic behind any change in your course of action. 

I could go on here.  There are a ton of books on crisis leadership.  But product leaders have a uniquely tough job.  Many CEOs expect us to lead the thinking on a product path in times of crisis.  We are expected to find a path quickly when there seems to be no path at all.  It’s navigating through this fog effectively that enables survival, if not success.

CREATE – Seeking New Ideas

Okay saying you need to innovate quickly is an understatement.  We usually think about innovation in terms of a multi-month, clearly-outlined processes including approvals, research studies, and experts.   That is not the innovation I’m talking about here. 

We need to facilitate extremely fast discovery and definition of big problems and the identification and testing of their solutions.  This takes some solid design thinking practices and a comfortability with speed.

Design thinking isn’t some super-secret set of rituals practiced by master designers at companies the likes of Apple or Tesla. 

I like the definition that the Interaction Design Foundation has for design thinking:

Design thinking is a non-linear, iterative process which seeks to understand users, challenge assumptions, redefine problems and create innovative solutions to prototype and test.

Wouldn’t we all say this is part of our job as product leader?  Can I get a ‘YUP?’

There are more than 1,000 design thinking methods out there.  All have their value.  The goal for us is to leverage the necessary methods in facilitating the following:

  • Definition of the problem and who you’re solving the problem for.  This could be redefining the problem you are already solving or the target market you have been focusing on.  It could also mean discovering a new problem or target market that has arisen out of this new norm with COVID-19.   
  • Ideating ways to solve the problem
  • Rapidly prototyping & testing your way to the most viable solution…turning prototypes within days not weeks.

Let’s look at AirBnB.  They experienced up to 80% declines in reservations in Europe and over 50% in some parts of the US; all within a few weeks.  They had to offer blanket cancelations for travelers, put their founders’ salaries on hold, and slash salaries of top executives by half.  They even set up a fund to compensate hosts for up to 25% of their lost income.  While this helped with regaining goodwill with hosts and travelers, the pressure is on to solve the bigger problem.  What do they do now if travel is impacted for years, not just these weeks while we’re in quarantine?  You could argue that their product is irrelevant or close to it as the perceived risk of the virus stays high. 

They mobilized and innovated quickly.  Within weeks they’ve been able to release two new product ideas.

Frontline Stays:  This is a program offering pandemic frontline healthcare workers a place to stay.  As the pandemic worsens healthcare workers are traveling to hotspots and need a place to stay.  Their continuous exposure is also presenting high risk to their families at home.  So AirBnB quickly moved to leverage the large base of unused inventory to solve the problem.  And while initially they offered the stays free, many healthcare organizations and government agencies are supporting the effort.  New big problem solved for a new market segment.

Online Experiences:  Debuting in mid April, 2020, AirBnB began offering Online Experiences.  Their travel Experiences offering was halted with the pandemic but they quickly identified another new problem to be solved; Recovering hosts’ income. They’re doing this by offering a platform for hosts to offer intimate, online cultural experiences through AirBnb. Online “tourists” can enjoy everything from discovering the rhythms of Puerto Rico to Cooking with a Moroccan Family.  These experiences range in price from a few dollars per person for an hour experience to $40 per person. 

Will these be successful?  Jury is still out.  That’s not the point.  The point is not that AirBnB has nailed the winning product decision, the point is that they are testing and learning quickly.  They launched both of these within weeks of the announcement of a pandemic.  It’s this continuous, rapid innovation that enables quicker recovery in times of crisis. 

LEARN – Continuous scrappy research

We tend to go heads down into problem solving mode immediately.  Action is good.  The goal is to take informed action wherever possible and as fast as possible.  That’s why we talk a lot of about scrappy research.  How do we define scrappy research?

A small number of structured customer or stakeholder interactions to test your most pressing hypotheses within 5 working days.

Vidya talked about scrappy research briefly a couple weeks ago in one of our blog posts. It’s one of the foundations we teach at Product Rebels.  Instead of going into all the tactics of scrappy research, let’s focus on one of the biggest challenges product leaders are facing in operationalizing scrappy research in this particular crisis.  They are not having the same access to customers and stakeholders as they once had and are struggling to get timely feedback as they are trying to move quickly.

And to add salt to this wound, many feel like they have to reach sample sizes of 50+ to be able to make decisions.  That’s a daunting task in the best of situations.

What we need to focus on here is enough to educate your hypotheses so that you can move forward.  Don’t worry, you’ll continue to test those hypotheses; this isn’t one and done.

Experts, like Nielson Norman Group, say that 5-7 interviews are enough to develop rough actionable themes.  Yes, only 5-7 interviews!!  After that you start to hear repetition.      

Feeling like scrappy research is more doable now?    

Here are some ideas on getting access to participants for your scrappy research:

  • Proxies:  There are two types of proxies.
    •  Internal:  Your sales teams, implementation teams, customer service teams and any other frontline employees can be great resources
    • External:  Many of us have partners and vendors that may have easier access to our customers.  VARs, distributors, eCommerce partners, etc.  Even if they were hit by this crisis, they hold different perspectives and potentially rich insights about your customer.  They may have an easier way to connect and may be open to partnering in gathering additional insights if it can help them as well.
  • Webinars:  There are a lot of companies turning to webinars and other online mediums to offer content and stay relevant.  It’s also a great way to learn.  Work with your marketing team in creating ways during those webinars for your customers to offer feedback and insights.  There are some great tools out there for polling, questionnaires, etc. during presentations.  Don’t miss this touchpoint to learn.
  • Virtual “Focus Groups”: Okay, not a fan of focus groups, but we gotta do what we gotta do in these times.  Similar to webinars that you might already be doing, can you test less-formal ways to get your targeted customers on a virtual call to gather feedback?  Is there value in bringing customers together to share challenges and best practices in dealing with the crisis?  What are ways you can bring people together and learn online while adding value?
  • Social Media & Other Digital Gathering Points: Most companies have social media or other digital channels where customers will post issues, questions, bugs, etc.  Can you use polls, questionnaires, or just posts to gather feedback?  Again, can you partner with your marketing team and other operational teams to field questions in the current touchpoints or channels you are already in?
  • Surveys:  Let’s be clear, surveys are great for quant views at the market but not totally actionable beyond sizing or high-level trends.  That’s because we don’t get the “why” behind any given answer.  The “Why” is where we can define the problem and take action from a product perspective.  But in times like these, surveys may be all we got.  Using open-ended questions may get you to some educated starter hypotheses where no other data exists.  Surveys are also great for finding people that are open to chat more.  Asking the question “Would you be willing to spend a few minutes with us so we can learn more about your answers?” helps you quickly identify folks you can talk to.
  • Recruiter: Recruiters are expensive, no doubt.  An average cost for finding one recruit is $135+ and higher for the more niche profiles.  But a lot of recruiters are fully digital using phone and survey methods to recruit.  If you have the budget, recruiters can be a saving grace. 

The point here is to help your teams get creative in getting access to customer insights as quickly as possible and in sustainable ways.  If you have other ideas on ways to do this, please share with your fellow product people below! 

In summary, product leaders are under some serious stress right now.  The buck stops here when it comes to defining the product path to get through these unprecedented times, especially in rapid, even if somewhat temporary, irrelevancy situations.  It takes a few very special skills to get through this.  It’s the ability to find and communicate a logical path where no path seems to exist, the ability to practice extremely rapid innovation, and have your entire team continuously learning and informing that innovation that will enable the best chance for company survival when your product or business model has abruptly become irrelevant.

Are you a product leader Interested in talking about this more?  Our next Product Rebels forum on May 8 at 10:00am PST we will discuss these skills and answer any questions or challenges you are having.  Get the deets by Joining our Product Rebels Community on Facebook

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies small and enterprise level in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences.    We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

And stay tuned for our new book.  Sign up for updates on our new book “Groundwork. Get Better at Making Better Products”

4 Lesser Known Traits of Successful PM’s

During this pandemic, I’m reading a lot about the tough situations people are in in terms of losing their job. Many have decide to move into PM from other functions like dev, UX, customer support, and business analyst roles and are asking for advice on what they can do to make themselves and their resumes more marketable in the PM space.

I felt compelled to offer up some thoughts on what it takes to be a successful product manager. These aren’t just for those transitioning to PM…they’re skills and behaviors that are critical whether you are new to the function or polishing up your skills during the downtime this pandemic has forced upon us.

Much of the advice I see in the communities I’m engaged in center around the ability to gather requirements, ability to understand technology, domain expertise, strategic thinking, analytics, communication skills, and time management. All good skills to have in most functions within a company, don’t you think? I mean, I should be strategic, analytical, manage my time, know my business space, etc. as a development leader or an ops leader.

The point is, I see a lot of very high level, generic skills being thrown out there for product managers. And yes, they are all good skills to have. But I like to focus on the skills that a lot of PM training and books don’t cover.

Below are 4 behaviors/traits that you probably don’t hear as much about that are just as critical, if not more, to your success, long term. I’ve also added tips on what you can do today to begin building muscle in each one of these.

Empathy.

Merriam-Webster defines empathy as:

“the action of understanding, being aware of, being sensitive to, and vicariously experiencing the feelings, thoughts, and experience of another of either the past or present without having the feelings, thoughts, and experience fully communicated in an objectively explicit manner”

You probably have heard of this one. If you’re a seasoned PM, this should be a NO DUH and practiced in all forms; listening to your developers; your leaders; your customers; your team mates. The best product managers I know demonstrate the ability to listen and understand what is being said in a way that focused action can be taken. It’s not just about listening, it’s listening for understanding vs. listening until you can respond.

Empathy doesn’t come naturally for everyone.

Ask yourself. Do you often have a rebuttal to what someone is saying before they are finished saying it? Are you working to form a solution to what you think is their problem before they finish explaining it so you can look intelligent? Do you ever need to be the first to speak? If you answered yes to any of these, you might want to step back and reflect.

There are a ton of books on this topic that can help. We have a quick way to begin practicing this now and building some muscle if it doesn’t come naturally to you.

Tip: Pressure test for your own understanding

Next time you have a conversation with someone and they are communicating an experience or challenge they are having…Listen to what they are saying, then ask…

  • “Let me see if I translated what you said correctly……is that what you meant?”
  • “Correct me if I misunderstood, but this is what I heard…Is that right?”
  • “You feel X, because of Y? Is that right?”

….Find whatever words that feel natural and that politely validate you understand.

This does 2 things:

  1. It forces you to listen with the goal of understanding vs. the goal of responding.
  2. It helps the person feel heard

I will never hire a product manager unless they have demonstrated an ability to listen and empathize. If you’re breaking into PM, your resume better have a project or two that demonstrates your ability to listen to others, understand what they have communicated, and translate what you understood into some sort of action. This can be internal projects, team process improvement, a community project, etc.

I look for the same in the interview. Are they listening to me and do they understand the question/case I’m communicating instead of being poised to respond before I finish?

Curiosity.

This one can be considered a follow on to empathy, but I call it out here because I’ve seen product managers give lip service to empathy and immediately assume they have the solution to what they heard…without truly understanding the problem. Curiosity is what inspires us to ask “why.” It’s what helps us to discover the root-cause of a problem. It’s where innovation “rubber hits the road.” Building a solution to solve for a symptom is okay, but solving the root cause of a problem is where transformation occurs.

TIP: Practice the “5-Why’s”

Next time you are in a customer interview or in a meeting with a leader or a cross-functional partner, try practicing the “5-Why’s” technique. Much content is written about the 5-Whys, but essentially it’s asking “why” 5 times in response to the first answer someone gives you to a question. It’s a technique developed by Sakichi Toyoda, a Japanese inventor who’s son went on to establish Toyota Motor Corp. The technique was used within Toyota as a way to get to root cause of production issues within manufacturing.

For the best product managers, curiosity comes naturally. It’s part of their passion for solving problems and much of why they entered into the field of product management in the first place. They are naturally inquisitive when they hear a pain point or challenge from a customer, a leader, or a team mate.

Does that mean you can’t learn this behavior? Absolutely not. But it takes practice and refraining from assumptions before taking action. So take the time to ask why before jumping to an answer or solution.

Athleticism.

This is hugely valuable in smaller firms. Larger enterprises usually have very clearly scoped roles and rarely reward going outside the lines. But because 99% of companies in this country have 50 or less employees, I’m going to talk about athleticism here.

I define athleticism :

The courage to step up and go beyond the traditional product management lines and support the team and business anywhere that’s necessary. Learning quickly along the way and being resourceful where resources may not be available.

As a product leader in multiple start-ups, after my career in big corp, I realized, really quickly, that there is a huge hurdle product managers face if they grew up in big corporate and are transitioning to a much smaller firm. They find themselves paralyzed when asked to do something outside their comfort zone because they don’t have data, cross-functional “coverage,” or a known process for getting from point A to point B. In smaller companies, especially startups, we have no choice but to wear multiple hats. This is where athleticism kicks in. You identify what needs to be done, volunteer to get it done, then learn how or be creative on how to get it done…in spite of a lack in skill, process, or resources. It could mean covering things like financial modeling, writing a moderator script, designing part of the product, developing a product demo, researching and recommending a particular technology, creating a marketing plan, etc.

Every product organization is different. Some of those things may already be included in your role. Others may not. The point is not being afraid to step up and learn outside your comfort zone and demonstrate resourcefulness. The smaller the company, the more I look for indications of athleticism in potential PM hires’ resumes. And I grill hard for indication of paralysis in certain situations where they might asked to do a task they’ve never done before.

For those of you wanting to try your hand at a startup or forced to make a career move, be ready and open to discovering your new talents and getting creative on solving problems without big data, big teams or big process.

TIP: Take on at least 1 “Stretch project” per year.

When was the last time you branched out? Talk to your leader and ask to take on an impactful challenge you see in the org. Identify a project that will stretch your skills and make an impact on the customer, your team mates, or the organization as a whole. The point is to get our of your comfort zone where you are forced to learning something quickly and improvise with minimal resources.

Getting Commitment.

I saved the best for last.

A product person’s job is to lead AND execute.  It’s a unique skill mix that only a few functions within a business are required to master.  As a product person you must influence and gain commitment across multiple functions and leaders; and usually, none of them report directly to you.  It’s partly what makes our job so fun! (and exhausting at times.) So I would be remiss if I didn’t talk about the practice of gaining commitment as one of the most critical skills.  Whether you are a CPO or new product manager, this practice is critical to your success.

Getting commitment is what’s required as the first step in implementing any strategy or product decision; big or small.  Without commitment, agreement is moot. Commitment is something that many people in life, and in business, don’t understand and are caught off guard when they realize they never had it.  How many of you have recently had a decision overturned or delayed significantly? Did you diagnose what happened?

Most of the time we find one of two things happened:

  1. A stakeholder had different data and believed the decision should have been something different than the one you proposed.
  2. A stakeholder didn’t have the necessary resources (time, money, people, etc.) to execute against the decision and decided to push back after the decision was made.

As product managers we need to build a skill in getting commitment…not just facilitating decision making.

Our definition of getting commitment:

A state in which the decision maker(s) and critical stakeholders intend on and follow through on making the necessary accommodations to implement the decision made while holding themselves accountable for their part in the success of the project regardless if they agree with the decision or not.

What do I mean by critical stakeholders?  These are the folks that will be significantly impacted by the decision. These could be operational partners, your development team, your manufacturing partners, your support team, etc.  

What do I mean by necessary accommodations?  This could be anything required to execute; be it funding, human resourcing, operational or technical trade-offs, etc. 

That last part is important.  We want to be in a situation where people may not agree with the decision, but they are committed to it as they understand how the decision was made and why. 

Tip 1: Make sure everyone has the same data

Don’t cherry pick the data people! I realize it’s easy to do. There are 2-3 key data points that support your decision and that’s all you present. Commitment doesn’t work that way. Everyone has a different perspective and many are working with different sets of data. It’s up to you to level the playing field. Ninety-nine percent of the time, when people are presented with the same set of data, they usually come to the same conclusion. They may not like the decision, but because they see the data and the logic behind the decision…AND can’t provide different data that would lead to different conclusions…they will commit.

So democratize the data. Show ALL RELEVANT data to the decision and the logic that led you to your proposed decision. It may take a couple extra slide, but it’s worth it.

Tip 2: Always know what your key stakeholders need and how they will react to a particular decision BEFORE you present it.

Always ask these questions:

  1. “How are you feeling about this proposed decision?” –> I ask my most influential potential naysayers and my biggest stakeholders because I want to make sure I’m not missing anything. I also want to identify things that I might be able to address early so that they are already committed before THE decision meeting.
  2. “What would inhibit you from executing against this decision?” –> Most successful PM’s learn the impact of a decision by asking this early in the process.
  3. “What do you need to be successful?” –> Like the last question, I ask this as early as possible.
  4. “How can I help?” –> I ask this any chance I get. If I’m asking a lot of a particular stakeholder, I want them to know that I’m not throwing crap over the fence in the hopes they can suck it up. (oh yeah, that’s where the empathy skill comes in!)
  5. “When can your team have this done?” –> This is where we put stakes in the ground to drive accountability. Let’s face it. Stuff happens. So dates are still a bit soft and you aren’t nailing someone’s feet to the floor here, but you are setting the stage for accountability discussions going forward. Date’s will move, but holding folks accountable ensures progress.

These feel like common sense, I realize. But many product managers I see, present a decision without understanding the impact a decision has or who the decision impacts. They end up leaving THE decision meeting with a bunch of frustrated people rolling their eyes, delaying the decision, and backtracking with multiple people to do the homework they should have done in the first place. The secondary effect of all this could be career altering; looking tone deaf and lacking the business or organizational savvy necessary to be an effective product management leader.

So if you’re faced with the unfortunate situation of looking for a new job or just wanting to polish your product management skills during this quarantine period, be aware of the lesser talked about, but also critical skills of successful product managers.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies small and enterprise level in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences.    We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

And stay tuned for our new book.  Sign up for updates on our new book “Groundwork. Get Better at Making Better Products”

How to Avoid Opinion-Based Decision-Making… Do this Tomorrow

I’m sitting in a room (virtual) and facilitating a strategy session for a product leadership team. This is a very dedicated and hard working team who are also overwhelmed by a very log list of initiatives and shiny objects that have been handed down from the broader company leadership team. The discussion is centered around “I think” and “I believe” and we go round and round on what other leaders and company SME’s have conveyed to them…some completely divergent from one another. No one feels comfortable that they can propose a path forward.  Sound familiar?

I see a lot of companies struggle with this. We’d all love to say that we look at reports daily, we save time for strategic thinking each week, we stay close to our customers through ongoing, regularly scheduled interactions (be it interviews or observational sessions, etc.) But let’s face it. Most teams have a hard time just keeping up with the day to day operations.

Now, if you can shift the mindset and operations of the team to do more insight and feedback gathering as a regular practice, more power to you. We recommend it! And we have all sorts of advice and tools to help you make that transition. But let’s talk about what you can do tomorrow to be more effective at decision making and getting commitment as a bridge to this transition.

Let’s go through 3 tips you can do tomorrow in avoiding the data free zone of decision making. 

 

Tip 1:  Identify who the decision maker is vs. people that have an input

Decisions are constantly derailed by folks that feel they have a say in a decision. We’ve all been there. Someone that once was in your organization or knows the code or is a leader of a big functional organization or is influential with the leadership team…Organizations are full of folks with great intent but create massive churn in the product creation process. There is a great decision making framework called RACI. Many of you have probably heard of it.

  • R = Responsible – The person responsible for facilitating closure to the decision. That’s usually you, the product person.
  • A = Approver – There should only be 1, sometimes 2, but never more. Get clarity with your leaders and force the decision on who is the approver. And make it known to everyone involved.
  • C= Consulted – This is an important group. These are the SMEs or people that are significantly impacted by the decision. Sometimes these folks think they are decision makers. Make it clear, they are an important source of input into the final decision, but not approvers.
  • I = Informed – this could be a long list. These are all the folks the might need to know.

Action Item 1: Does your decision have a clear approver? And are your C’s clear on who that person(s) is? If not, establish this now. Put the RACI roles at the top of every decision-related communication going forward. Every deck should have the RACI in the appendix for reference. Start now. Better late than never.

 

Tip 2:  Agree & document the problem you are solving AND the criteria by which you are going to make a decision

Be clear on what you are solving for and how you will evaluate your options. Are you solving for Time to market? Cost to develop? Revenue impact? NPS impact? And please don’t say “all of the above.” No way! Prioritize. Without clear prioritization of your criteria and getting agreement on that prioritization, you’ll end up where you started; Everyone with different opinions and no one wanting to commit to a decision. Or even worse…giving you the “nod” only to overturn the decision later.

It’s always good to articulate what you are solving in terms of a business or customer problem or as an opportunity with a clear definition of success. In addition to this, I always list the criteria by which the options will be evaluated. Define what they mean and show which are most important and why. Help bring your audience along so you start the discussion at a level playing field, so to speak. If you don’t have agreement on this, then there’s no sense in continuing the conversation.

Action Item 2: Does your approver AND your C’s have a consistent definition of the problem you are solving and the most important criteria by which you will be evaluating your options? If not, establish this now. Document it and bring it to your next decision meeting…start the meeting with this. First page of the deck should always be a reminder of what you are solving and how you are deciding.

 

Tip 3: Gather the data you do have…Put stakes in the ground where data is missing.

I can’t tell you how many times I see teams paralyzed by “lack of data.” Let’s be clear…YOU WILL NEVER HAVE ENOUGH DATA. The idea is to use what you have and clearly call out hypotheses where data is lacking. Then build (and communicate) a plan for validating/disproving your hypotheses. We use “proxy” data a lot to triangulate on a solid hypothesis. For example: If you don’t know what the usage is in terms of user sessions by day, look for indicators like backend transactions or records created by day and develop a hypothesis for usage based on what you do have. Or how about this one? You don’t know the top drivers of churn in your business, then find out the task drop out rates using the system logs and understand the top support team contact drivers and make some hypotheses about what part of the experience is creating the most pain. It’s not fool proof, but it’s better than thrashing around in the data-free zone of opinions. You have to start somewhere. And data is the best place to start.

Another way to use data is to try understanding the worst or best something could be based on what you have. “The best our penetration could be in this market it 40% because 60% of this market is comprised of vertical a, b, and c which we’ve learned can’t use our product or have higher on-boarding costs, or….” Provide the starting points for deductive reasoning.

Instead of being paralyzed or attempt an opinion-based discussion, find what you can to put a solid stake in the ground or put some guardrails around the decision, so your team can confidently move forward. Be clear on where you are hypothesizing and what data you are using to make those hypotheses.

NOTE: Don’t forget to provide the team with a plan for how you will prove/disprove each hypothesis. This gives your most vocal naysayers comfort in committing to a decision (that they may not agree with, but understand how you got there) while knowing you are going to prove/disprove the hypotheses with actual data. In their minds, it means that if you are wrong, you’ll let them know and they won’t be left expending a ton of effort against a direction that is fruitless.

Action Item 3: Are you in the middle of an opinion-based decision process where you feel you don’t have enough data? Identify alternative data points and hypotheses that can help with putting some stakes in the ground that provide guardrails on the debate and guide your team to a more efficient, confident decision. I always have a page in my deck or a set of bullets in my email that talk about key hypotheses or helpful data points that minimize unnecessary debate.

 

Opinion-based decisions are painful and costly to the organization.  These are a few really quick changes you can make in your process that make a world of difference in terms of efficiency and durability of decisions.  Happy decision-making!

 

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies small and enterprise level in the skills and frameworks that help product management leaders and product managers deliver kickass customer experiences.    We have a passion finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

And stay tuned for our new book.  Sign up for updates on our new book “Groundwork. Get Better at Making Better Products”

Following Tail Lights into a Ditch

Okay, dumb metaphor but I gotta say, a lot of the training for product managers out there is pretty misleading and doesn’t get at the heart of what product management is all about. And having more and more aspiring product managers following the suggested training that I’m seeing, feels very much like following tail lights into a ditch.

I just got done reviewing another training program and found it totally disheartening. Why? Well because it seems to be touting skills that, yes are important, but that completely overshadow what’s required to be successful in your job as a PM. For all you aspiring and new product managers (and even for some experienced PMs that have gone through some of these less-meaningful training programs) listen up! Here are 3 foundations that if you aren’t well versed or don’t have a natural inclination to set before any project you embark upon, then your projects will experience constant decision delay, unnecessary rework, and customer dissatisfaction.

#1: DEFINING THE PROBLEM

Most decision overturns & delays, excessive re-work, or just plain unhappy customers are driven by a lack of shared vision around the problem. Each person on the team has a slightly different take on what the customer problem is and therefore a different take on what it means to solve it. Most training programs don’t tell you this nor do they help you build muscle to avoid this situation.

Without actually documenting the problem you’re solving in a way that clarifies what you are and are NOT solving for, slight variations in understanding will creep in and cause major havoc on the team. Vidya and I have often asked product teams to individually write down the problem for which the team is solving given a feature, a new product, or change in an existing product. Most of the time, we find that there are at least 2 people on the team that have different definitions of the problem and therefore have been advocating specific features, design elements, tradeoffs, etc. as a result.

For instance: What if you worked for a hand tool manufacturer trying to redesign your hand drill. You’ve been solving for a quarter inch drill. But guess what…The problem is not a quarter inch drill, it’s solving for a quarter inch hole. And what if it was for a quarter inch hole for hanging a 20 pound canvas? Or a 20 pound canvas on a concrete wall. Imagine if each of your team members believed you were solving for a different problem in this list. Getting agreement on functional and design prioritization would be troublesome to say the least.

Our point? As a product manager, your goal in every project is to start with a clearly defined problem that your entire team (including your leaders) has shared vision around. If not, you’re going to experience challenges every step of the way. So make sure any training you choose makes a point of helping you get to the root of the customer problem, effectively communicating that problem, and getting to shared vision with your key stakeholders around said problem. This encompasses research techniques, effective problem definition, hypotheses testing, and communication and influencing skills that many programs don’t spend a lot of time on.

#2 Defining the Target Customer

NO DUH! But I have to be honest. A lot of product management training curriculums breeze through defining the target customer or building a persona. Too often we see the target customer (persona) defined with demographics, with job descriptions, and with a couple likes or dislikes. They go into a lot of depth on market sizing, and analytics, but not in building an actionable persona.

Defining your target customer takes extreme empathy and should be enlightening and ongoing. Bringing that target customer to life, with day to day activities, but also with the relevant beliefs, attitudes, and the relevant traits that make product decisions possible.

For instance: Here are some ‘trait spectrums’ that I purposefully listen for and consider when I’m defining a target customer for software applications.

  • Organized <–> disorganized
  • Analytical <–> creative thinker
  • Tech savvy <–> tech phobia
  • Quick learner <–> slow learner
  • Confident in his/her ability to complete the task <–> no confidence
  • Patient <–> impatient
  • Extravert <–> Introvert

Depending on where your target customer sits in these spectrums will you would choose different design approaches and make different tradeoffs and even choose different vernacular in the experience.

There are many other traits that can and should be considered across different experience types (retail experiences, consumer packaged goods, etc.) The point is, it has nothing to do with demographics.

So make sure you find a training program that spends time on defining your target users in ways that are actionable in product and design decisions. This includes research techniques, actionable persona development practices, testing practices, and UX partnership skills.

#3 Contextual Customer Needs

This one is a little more elusive than the other two, I realize. So I’m going to jump right in with an example.

You are a wagon manufacturer. And there are a ton of design elements that need to be considered. Wagon size, turning radius, wheel size, wagon material, etc. The list goes on. In order to make the right design/feature tradeoffs, you’d need to know a little bit more than the problem and who you’re solving the problem for. So…

Customer Problem: I often have to make many trips carrying loads of stuff from my apartment to my car in the parking structure, which is a total hassle, can be painful, and often makes me late; especially when it comes to groceries and weekend recreational activity stuff.

Target User: People that live in urban environments that are weekend warriors (This is the short version, you’d define the intimate details now that you’ve learned a little more about how to define your target ;-))

You say, great! I know what I’m building. Hold on a minute. What if your research surrounding the problem yielded the following needs in this order of priority:

  • My parking spot isn’t close to the elevator so I have to carry my load a ways
  • Parking spots in my garage are tight; I need to be able to maneuver around my car and between cars
  • I have to store this in my closet because I use it so often and don’t have storage living in an apartment building
  • I’m usually carrying at least 20lbs+ of odd sized stuff including groceries, ice chest (that is sometimes wet,) big water containers, camping equipment
  • I’m often carrying my stuff on the sand and dirt and gravel to get to my destination “spot” (campsite, park site, beach site, etc.)
  • I have to maneuver in and out of my elevator with lots of people

Okay, now tell me if those needs don’t help you better define the solution! Clear tradeoffs emerge…right?

Without the relevant needs surrounding the problem, how do you prioritize features or make design decisions? Most product management training programs struggle to address the importance and art of these 3 foundational elements to product management..

There are some great UX programs that get at this but I’m a bit old school and believe that the product manager is just as much responsible for intimately understanding the customer and problem space as is the UX person…if not more… because the product manager must evangelize and get commitment from the organization on the resulting product roadmap and requirements. Without having that intimate understanding, getting shared vision by cross-functional organizations is almost impossible.

Bottom line here: Make sure the program you choose comes from successful product management leaders that have demonstrated their ability to define a kick-ass customer experiences that drives business growth. Make sure they enable you to set the most important foundations to any great experience. Without that, I’m sorry to say, you’re following tail lights into a ditch.

Check out our product management bootcamp if you’re interested in learning how to build the muscle around these foundational elements of product management. http://productrebels.com/