3 Ways to Address Internal Naysayers

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Let’s face it, we all have naysayers in our organizations. Naysayers are strong influencers who object no matter what, think they have a better idea, or believe an alternative option is the right path. And sometimes that alternative path won’t be one of the primary options already being considered and analyzed. It happens. And some of these influential naysayers can derail the decision process. These folks have to be addressed to get broad commitment.

But there’s hope. We use the following list of good practices:

1. Identify any highly influential naysayers who could derail the decision-making process. 

They may or may not be a person who must be primarily consulted, but they hold strong influence in the company. We’ve seen tenured engineers, senior leaders of non-impacted organizational functions, board members, and investors be naysayers. They could have the ear of the CEO, your executive leader, or your CTO.

2. Understand their point of view. 

A simple feedback gathering session might be in order. Trial ballooning a proposed decision is a good way of getting their point of view. Understand what their objection or their desired path is and why.

3. Use data. 

When possible, to do a quick thought exercise on what the path they suggest looks like, asking these questions:

  • How does their idea or path measure up to the criteria you are using to decide? Evaluate it with any data you have available.
  • What are the critical dependencies (e.g., technical, manufacturing, political, resourcing) in executing their idea or path?
  • What would you have to prioritize in the product (e.g., features, infrastructure, roadmap items) to make their path successful and how does that differ from the proposed decision path?
  • Are there other, possibly unforeseen, operational requirements for their path (e.g., marketing, support, operations)?

These are questions you should already be asking of the obvious options in your decision, but they are important to ask as they relate to the strong naysayer’s path as well. Don’t make this a huge, time-consuming expedition. We don’t usually spend more than a 30-minute discussion and a 30-minute thought exercise fleshing through their desired path to understand the implications it has, building a case as to why it isn’t the right thing to do considering the criteria at hand. Or maybe it is? There have been times when their perspectives bring new thinking to the table that must be considered.

Always anticipate who your most influential naysayers will be and gather the information you need to understand their perspective. Do quick due diligence to understand what it would take to execute their presumed path so that you can confidently speak to it. It not only ensures you haven’t missed anything, but it also shows the naysayer that you are thinking broadly and considering all options, not just what you are proposing, makes them feel heard, and sets you up for a much higher probability of commitment.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

Consensus Does NOT Mean You have Commitment

This is for any product person that has felt the frustration of overturned or unnecessarily delayed product decisions. We’ve all been there. Check it out.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. Buy it now from Amazon.

Your job as a product person is to be a thought leader and to execute effectively. It’s a unique challenge that only a few functional roles within a company experience. As product leaders, we must influence and gain commitment across multiple functions and leaders; and usually, none of them report directly to you. 

This unique aspect of our job is partly what makes being a product person so fun (and exhausting at times)! So, we would be remiss if we didn’t discuss gaining commitment across complex organizations as one of the most critical practices a product leader should master. Whether you are a chief product officer or new product manager, proficiency in this practice dictates your success.

Getting commitment is required as the first step when implementing any strategy or product decision, big or small. Without commitment, agreement is moot. Commitment is something that many people in business, and in life, don’t understand and are caught off guard by when they realize they never had it. We define Commitment as:

A state in which the decision-maker(s) and critical stakeholders intend to and follow through on making the accommodations necessary to implement a decision while holding themselves accountable for their part in the success of the project, regardless of whether they agree with the decision.

Let’s break this down.

What do we mean by critical stakeholders? 

These are the business people who will be significantly impacted by the decision; not customers—you’ve already done the Groundwork to propose a product decision that meets your customer’s needs. Stakeholders are people like operational partners (internal and external), your development team, your manufacturing partners, your support team, and so on. These are the folks who have to take action in order to ensure success of the project.

What do we mean by the necessary accommodations? 

This could be anything required to execute, such as funding, human resources, operational or technical tradeoffs. 

The last part of our definition of commitment is important. 

We want to get to a situation where people may not agree with the decision, but they are committed to it because they understand how the decision was made and why. In this section, we talk about the elements involved in giving you the best chance of getting commitment on decisions: collecting the data required, presenting your case, and pressure testing commitment.

Getting commitment is very different from getting a head nod in the meeting where you propose a product decision. Many times, the head nod of agreement is taken as a “go.” But we all know that a lot happens after people walk out of a meeting. People are bombarded by inputs from others, conflicting priorities, and shiny objects that potentially change a head nod to an eventual head shake.

Sometimes getting commitment doesn’t mean you’ll get a consensus. If you strive for consensus, you could be waiting a long time. Some cultures require consensus. And to those of you working in those cultures, our hat’s off to you. We respect anyone that perseveres through consensus-building even at the cost of progress. There is a better way.

Instead of consensus, strive for a shared vision (we touched on this earlier in the book) of the data and in light of the decision, get a commitment to the actions required to be successful. Shared vision sounds like corporate jargon, we realize. But as you already know, it’s a concept that has stuck with us in our careers, because of how powerful it is. We strive for everyone impacted by a decision to understand how we got to a decision, versus just telling them what the decision is. We do this by communicating compellingly clear logic, data, and customer insight, all of which we obtain through the Groundwork and Practices we’ve explained up to this point.

The next time you see a lot of head nods in a meeting, do a double take and make sure you actually have a shared vision and a commitment on the actions that will result from the decision.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

The Transformational Impact of a Scrappy Research Practice

In this excerpt we focus on how our practice of Scrappy Research dramatically changes the time-to-value for research and therefore the efficiency of the overall product creation process; making confident decisions quickly and often. For more on how to establish a practice in Scrappy Research, pick up the book!

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. Buy it now from Amazon.

Scrappy research is a practice that turns product managers into great leaders. Let’s talk about some reasons why.

Scrappy Research Prevents a Significant Amount of Rework

How many times a day do you make decisions about a product: feature prioritization, backlog cuts, design decisions, strategy decisions, and so on? Product people make scads of decisions every day based on intuition and whatever data they have (which can be none, depending on how big or how new the product or business is). Is it the best-kept secret that product people probably make most of their daily decisions based on gut feelings? Nope. That is our life as product people. Take this example:

Product Team A decides to build one feature instead of another based on what they think is the right direction. They build it with tracking so they can get usage data in real time. Within 6 weeks of releasing the functionality, they learn that the feature isn’t used as much as they expected, and the desired business outcome isn’t being achieved. The team reworked the functionality and relaunched within 12 weeks.

On the surface this may look fantastic: They implemented tracking, they learned within 6 weeks, and had a new version out in three months. These are huge accomplishments for some companies, but we’re here to tell you that this is an unacceptable cost of time and rework.

Keep this quote by Thomas Gilb, famous for improving an organizations’ delivery capability through systems engineering, cemented in your mind: “Once a system is in development, correcting a problem costs 10 times as much as fixing the same problem in design. If the system has been released, it costs 100 times as much relative to fixing in design.”

Scrappy research combined with a clear hypothesis is a catalyst for reducing work. To drive faster success at a significantly lower cost, make scrappy research an ongoing habit instead of a special occasion.

Scrappy Research Enables Durable Decisions

Every product manager experiences an overturned product decision at least once in their career. We’ve all been there. It’s frustrating. In some cases, we’ve seen that when product decisions are consistently overturned, it ends a career. Here’s an example: 

Product Manager A proposes a direction for a product to his leader and cross-functional partners. The product manager bases the logic behind his proposed direction on some big hypotheses, but he feels confident the hypotheses will prove correct, given what his customer service team has told him. In the proposal meeting, the cross-functional team seems a bit skeptical, but they all walk out of the room nodding and the development team gets to work. Two weeks later his leader calls him and says, “We need to pause work on this because your cross-functional counterpart isn’t supportive of the direction and expects a different direction instead…and I think I might agree. Let’s change direction.”

Replace the word “direction” here with “feature,” “design change,” or “product trade-off.” We’ve all been through a similar scenario at one time or another. Other people’s opinions start to take over and you’re stuck in the middle. For those of you who experience this as a norm, which it is in some business cultures, listen up—conducting scrappy research as a practice is for you. Whenever you need to change direction, implement a new feature, update prioritization of initiatives, or anything that you know may differ from the expectations your product team holds today, communicate your logic through customer-backed reasoning.

Scrappy research allows the customer to speak in lieu of anyone’s opinion. Practicing ongoing customer research, albeit scrappy, builds customer-backed logic that your team can understand and commit to. You may not get a consensus on your decision, but you’ll get commitment because they understand the logic behind it. We call that shared vision. Yes, it sounds like bogus corporate jargon. We learned it early on in our careers from Steve Bennett, a former CEO of Intuit, whom we both worked under. And it’s one of the only corporate jargon terms we embraced. We love the term because it represents something more powerful than “consensus.” Shared vision is our way of driving commitment. We could write an entire book on the importance of shared vision, but the point here is to get away from opinion and use customer-backed logic to communicate and gain commitment to proposed decisions.

Scrappy Research Keeps You Close to the Customer

This isn’t a goal of scrappy research in and of itself, but it sure makes you a far more effective product person. You can make faster product decisions, gain the trust of your entire team and your cross-functional stakeholders, and feel more confident in your day-to-day operating role. It’s win-win-win.

We can’t tell you how many times we see product managers deferring customer understanding to others—researchers, business analysts, UX designers. Deferring is convenient and allows you to pile other stuff on your plate. And yes, it looks like you’re making the right work prioritization decision initially, but you’re probably not.

People distance themselves from their customers and spin their wheels with decision vacillation because the loudest opinion in the room generally wins. They can’t effectively prioritize the backlog, they add a constant barrage of shiny objects, and they have no way to justify tradeoffs with confidence. All in all, the other stuff that you pile on your plate becomes significantly more time consuming. Scrappy research is not a full-time job, but it’s a fundamental practice that makes or breaks a product person’s career over time.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

3 Ways to Build Team Productivity Through Access to Customer Insight

This excerpt provides a little glimpse into how we’ve gotten our extended teams working in unison by expanding the access and participation in customer research. There’s lots more where this comes from! Take a look.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Your job as a product leader is to infuse customer insights into the broader team’s work, not just present the personas. As a reminder, a persona is a user archetype created based on your research that represents how someone might use your service, product, site, or brand. It’s about your ability to help the team get to know the persona as a person and to enable them to stand in the shoes of this person while doing their job. We’ve observed, through years of experience, that the deeper our extended team’s understanding of the customer, the less we have to rehash requirements for the project and the less rework we see.

Back in the late 1990s, when both of us were at Intuit, Heather was on the QuickBooks team and Vidya was on the TurboTax team. We were just implementing the concept of Follow Me Home across the company. This was a form of ethnographic research where we conducted onsite observational research sessions. We’d go to our customer’s place of work or place of filling out their taxes and quietly observe the process of managing finances or taxes.

The QuickBooks team conducted a bunch of these Follow Me Home sessions with small businesses and invited our engineers to observe. There was an interesting side effect of this. We found these engineers going home on a Friday after seeing and hearing these customers firsthand, and coming back on Monday having fixed an issue they observed in one of the sessions. They were so excited (and frustrated) by what they saw during the observational session that they couldn’t help but try and make the users’ experience better. We were seeing things like this across the company. The point is that seeing and hearing your target customer is by far more valuable than reading any documented persona. 

There are a couple of things to consider in achieving this kind of intimacy and motivation:

Get your extended team participating in the research whenever possible. 

Observing everything firsthand is far superior to waiting to get the CliffsNotes version. It’s not always possible, but you’ll get the best outcomes if the majority of your extended team has seen and heard your target users through observation or interaction. If they can’t participate, then organize ways for them to view or listen to the recordings of your interactions. Brown bag lunch, anyone?

Debrief the team on what you all learned through the research before putting pen to paper to write the persona. 

Make them feel just as much ownership over the persona as you do. The more ownership they feel, the more they will utilize personas; ensuring consistency and delight in the user experience they are all working hard to develop. 

Share what you learned first. 

When you learn something new through research that leads to an evolution of the persona, make sure you share the learning before reposting a new version of the persona. Focus on the infusion of learning about the persona and the implication of that learning on what the team is working on. Focus on this more than on presentation of the persona.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

3 Steps to Identifying Where Hypothesis Testing is Critical

As a follow on to our last blog post, we wanted to provide an excerpt that revealed how to identify the areas of the business for which you need to formulate hypotheses in order to test and build confidence in your product direction or pivot where you need to earlier rather than later. Check this out.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

As product leaders, we spend a lot of time in meetings sharing opinions when we review customer research. We make a lot of assumptions, and we tend to hear what we want to hear. We’re sure you’ve been in more than one meeting like this. Many companies are so execution-focused that they move from one activity to another, without taking the time to help teams align, ask the right questions, and facilitate real collaboration.

Instead of just providing feedback on a hypothesis (or rejecting it outright), we’ve created three easy steps to help you coach your team to getting to a strong hypothesis: 

1. Identify What You Don’t Know

The best way to avoid some of the pitfalls we described earlier is to think about what you truly don’t know about the customer or problem. 

  • What are you guessing at or making assumptions about, with regard to their behaviors, their needs or the problem they’re facing? 
  • What conditions would have to be true for a new feature to work? 
  • If this is a new market, then what conditions need to be true for you to launch? 
  • If this is for a physical product, what conditions must exist for a customer to successfully use it?
  • What assumptions are you making about your persona, that if proven false, would dramatically change your course of action? 
  • Have you accurately translated what a customer has told you they wanted into a need?

Each of these questions represent the types of assumptions we make every day. Most of the time we jump straight from idea or insight, right into development. This stage requires you to painstakingly face everything that might go wrong. We often start with asking ourselves the question “What would make this idea fail?”

Now write down everything you don’t know as a question. Here are two assumptions we made based on our fitness app Melanie Persona:

● Melanie loves to try new forms of exercise.

● Melanie won’t care if she can’t go to the same studio more than three times a month.

Those assumptions matter. We believe them to be true because we spent a lot of time talking with her, to develop our Actionable Persona. Both of these assumptions were driving major design decisions. We’re taking this head-on, leaning into the biggest assumptions that will impact our business model. What we learn will help us make an important product decision.

2. Prioritize Assumptions.

If you do step one thoroughly, you’re going to end up with a lot of assumptions. Not all of the assumptions are critical and you want to know which will have the most impact on your business. We turn to a design thinking technique called a “bullseye diagram” to help sort through and classify all these assumptions. We like to make this a visual exercise that the entire team can participate in. On a large whiteboard draw three concentric circles, each one bigger than the last. Write each of your assumptions on separate Post-it Notes so you can move them around easily. Now it’s time to prioritize.

You can place one assumption in the innermost circle. In the next circle, you get to place three assumptions, and in the outermost ring, you get a choice of five assumptions. As you pick up each assumption, ask “how important is it to know this?” You can also set up multiple bullseye diagrams and have each member of your team run through the prioritization process individually, and then gather to compare results. 

We’ve even invited key stakeholders in our business to participate so that we get to hear their thoughts and concerns. Consider what different perspectives you may want as you try to understand what’s most important for you to learn. As an added benefit, it keeps everyone on the same page and increases commitment to, and interest in, the research you’re about to start. With this exercise, you’ll have a list of prioritized assumptions—and a clear winner. This winning assumption is used for the first hypothesis you write.

3. Convert Assumptions to Hypotheses

This step converts the prioritized assumption into a hypothesis. Here’s a hypothesis format you can use:

If… [specific, repeatable action]

Then… [expected, measurable outcome]

Because… [clearly stated assumption]

The easiest way we’ve found to create a strong hypothesis is to start with your desired outcome. What needs to be true to resolve your assumption? 

  • Do you want 10% more sign-ups to your site? 
  • Do you want 25% fewer customer calls? 
  • Do you want to increase your NPS by 5 points? 

Whether it’s 5 points or 10 points of NPS you’re trying to impact, or 25% less customer contacts; pick a figure that is meaningful to the business and will make a difference. Start with your desired outcome and then pick the appropriate measurement.

Next, move to the clearly stated, highest-priority assumption. This is where you can rewrite and reshape your assumption. If you truly believe you can’t make a significant difference by addressing this assumption, then move to your next ring of assumptions. There is no point in trying to create a test for an assumption that you don’t believe you can tackle. This is where you need a strong understanding of your business, your customers, and your market. Know what is important, and drive to make an impact where it counts.

Finally, consider the test itself. What action do you believe will create a significant result? Do you need to make a change to how people sign-up for your service? Do you need to introduce a new offering? Do you need to increase loyalty with existing customers?

Going back to the Melanie persona, share your highest prioritized assumption. One that we believe is critical to our business is: Melanie loves to try new forms of exercise.

We believe that Melanie will love to try new forms of exercise. If that is true, we’re going to give her many different classes to choose from. This will dictate how quickly we need to bring on new partners and it will dictate the design of our application. We want to make sure the assumption is true, so let’s turn this into a hypothesis that we can test given what’s important for our business: 

1. Desired Measurable Outcome: We want Melanie to love trying new exercises so much that she will purchase at least one class a week. That will give us enough revenue based on our projected number of customers.

2. Clearly Stated Assumption: Choice is the primary driver of purchase.

3. Specific, Repeatable Action: We will display different classes every week to keep her interested and engaged. 

This creates a hypothesis we can test:

If…we offer different classes per week to choose from

Then…we’ll get at least one purchase

Because…choice is the primary driver of purchase

After developing this hypothesis, we created three different prototypes on paper to test the different ways that the Melanie persona could choose classes and our hypothesis was validated. Remember, your assumption is always derived from something you don’t know and your hypothesis is based on your belief that a specific action will deliver the outcome your business is looking for. We told you to start with the measurable, desired outcome. When you start with what matters most for the business, whether that’s retention, or growth. Perhaps it’s revenue. Home in on the metric you most want to impact.

Like any practice, getting results requires constant feeding and nurturing. Starting to build a hypothesis-driven organization is going to be ugly and painful at the beginning. At first, you won’t get hypotheses that are elegantly formed and perfectly clear. A lot of them will be quite confusing and badly written and that’s okay. Pretty soon you’ll find yourself in a hypothesis-driven culture, with a team that’s always focusing on the riskiest assumptions, ready to make the biggest business impact.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

6 Elements of a Strong Hypothesis

In this excerpt we change the way you think about the formulation of hypotheses to expedite your product creation process. Where we used to think of hypotheses as scientific fodder, our book transforms the definition and formulation of hypotheses into something we can use in our day-to-day product efforts; proving and disproving our assumptions so we can make quick product decisions and continue our forward momentum. Check it out.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

We are constantly inspired with new product ideas—whether that’s through customer observations, the competition, or an “aha!” moment in the shower. Every idea has the potential to be formed into a hypothesis. The way to ensure you have a strong hypothesis, one worthy of testing, is by reviewing that they conform to these six characteristics:

Logical

This seems obvious, but think about the number of times someone has a good idea on the team. Good ideas are a dime a dozen, sadly. We’ve seen multiple teams become overwhelmed with new ideas entering the system because they see a competitor launch a new feature, or because an investor or senior leader gets inspired by the latest shiny object. Being logical means that there is clear, sound reasoning connected to the hypothesis. The idea doesn’t come from left field; you can point to evidence to suggest the outcome will be promising.

Testable

Making sure a hypothesis is testable is one of the hardest aspects of generating a great hypothesis. Often, teams feel like they need to fully build and launch their product to get actionable data so they forgo hypothesis testing altogether. While your results may not be statistically significant, think about how you might, with minimal resources, prove that you’re heading in the right direction. With practice, writing a testable hypothesis becomes easier—teams get very creative and quickly adapt to creating small tests with minimal resources.

Precise

How you put together a hypothesis counts. Using deliberate words that indicate a specific outcome is important. Otherwise, any given outcome can be seen as either confirming or falsifying. Being precise means being crystal clear on what you’re testing and why, and documenting the rationale for what it means to run the experiment, what resources you’ll need to experiment, how long it will take, and when you’ll know the results.

About Something Measurable

You need to understand which numbers matter before you do the research. If your hypothesis is that more visitors will see your webpage when you make a certain change, then you need to know exactly how many more must visit for the change to be meaningful, and thus, for the hypothesis to be confirmed. An increase of 1% may mean nothing to one company, and it may mean millions in incremental revenue to another. Understanding what measures are important gives you a good indication of whether the experiment or test should even occur. If the results can’t confirm or falsify your hypothesis, why do the research? This is a hard characteristic to pin down, but it’s critical to ask both if you know what the measurement is, and whether the measurement is meaningful.

Has an Expected Outcome

We want you to be able to explain with a logical, clear reason what outcome you expect. The line gets tricky here—if you already know the outcome, then go get the data to prove how you already know this. Why spend time testing things you already know? We see teams share hypotheses with us all the time about things they already know. They do this because it’s comforting to be proven right. On the other extreme—if you don’t know what outcome to expect, then how will you plan the precise experiment that could achieve that outcome and how could you know what to measure? Make sure your hypothesis specifies an outcome and that the outcome will address your hypothesis.

Falsifiable

The last of the characteristics is making sure that you can invalidate your hypothesis. The way to think about this is to make sure you don’t set your research up in such a way that the results are subjective, or that you’re not capturing the right data to be able to have a clear result.

These six characteristics are intended to help you coach your product managers. Instead of just providing feedback on a hypothesis (or rejecting it outright), point to one or more of the guidelines and discuss how their hypothesis may miss the mark. It’s a teaching moment and a much more productive conversation at the same time.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

Make Customer Research Matter by Avoiding These Common Mistakes

This excerpt is for any leader looking for ways to infuse customer learning into everything they’re doing.  We shed a little light on how companies lose focus and go on autopilot with research; where process overshadows actual customer insights and action. Take a look.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Everything we espouse as professionals is based on understanding the customer. It’s hard to find a company that will tell you that they don’t want to hear from customers. And that makes it hard to develop good hypotheses about who they are and what they need. But companies can demonstrate a big failure point in execution when they conduct customer research. These companies will say they talk to customers all the time but what we see is a big gap in understanding what customers are saying. Let’s talk a bit more about what this may look like:

Company A is a large consumer business. They have a research facility that conducts customer research like clockwork every two weeks, putting every feature of their product through some sort of customer testing. They have a dedicated customer research analyst who talks to customers and develops reports. All the reports go to a shared storage where anyone in the company can access them.

That scenario might sound like magic to some of you, but we hear the slasher sound from the movie “Psycho.” We see three red flags: 1) A dedicated research team, someone outside the product team, does all the research; 2) Research is a stage of the development process; 3) Reports don’t have a clear recipient. 

Let’s examine each red flag a bit more to understand why this is a nightmare-inducing situation for us.

A Dedicated Research Team

Large companies can afford separate research departments. This is great—having people with the right skills and knowledge to do all sorts of deep research is a gift we would never turn down. However, when external research departments want to control all customer research, as often happens, it’s a problem. Most specialized departments end up wanting control, which is not necessarily a bad thing. A specialized department can manage its work more efficiently, force a company to prioritize, and can see connections between the different products and user experiences the company offers. But when a product team loses all ability to do their own customer research, it creates a chasm that is not easily crossed. A dedicated research analyst should, at the very least, be dotted lined into the product team, they should know exactly what the product is designed to do and why, and they should take their direction from a product manager. If these steps are in place, then the centralized research department becomes a benefit and not a curse.

Research as A Recurring Process

Whenever we hear that research is done regularly, we dig a bit deeper. What drives the cycle of research activity? Is the research focused around a hypothesis, or is it happening because it’s an activity to check off the to-do list? While we encourage frequent research, it should always be attached to something that the product manager needs to learn in order to make a decision; the research should always be done with an actual target or goal in mind. All research should start with a hypothesis. If you consider research as a regular occurring activity, go back and review what the inputs and outputs are. Ask yourself if you’re getting value from the work that’s being done.

Zombie Reports

What does your research report look like? Is it updated from a template? How much is customized? Does it include quotes, pictures, and videos? Ask yourself: Does it provide insight? We both have had the experience of having dedicated research groups added to our department. These researchers would present the team with PowerPoints of their research every two weeks, like clockwork. Those reports provided a lot of colorful images of customers who the researcher had spoken to, a lot of background information, and summaries of their discussions. Our teams would dutifully listen to the presentation, some would read the report and every person would file them away and they’d never be referred to again. When you receive a research report, are you doing anything with it? Does it live after the meeting? Does your team use the research results to shape their work? Were you able to make a product decision on the basis of the research? If not, stop the madness, cancel the report, save time and effort. Ask your team to provide a hypothesis, and then leverage your research resources to learn and validate or invalidate the hypothesis. Every research activity should produce results that the team needs.

Most companies conduct some sort of customer research, and we see over and over again that it’s not optimized to give them actionable results, partly because they don’t start with a solid hypothesis. We’re determined to fully persuade you about the value of hypothesis testing!

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

Why Your Product Should Be Needs First, Features Last

As product leaders, the number one issue we see is with the concept of uncovering needs. We all have a tendency to proceed straight to features or solutions because as product leaders, we are problem solvers. But we’re here to ask you to please refrain from this tendency. Instead, pause and take time to articulate a need before jumping to solutions.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Earlier in our work, we worked on developing a fitness app and created the persona (a persona is a user archetype created based on your research that represents how someone might use your service, product, site, or brand) Melanie who “won’t travel more than 2 to 3 miles from work or home to work out at a studio.” That’s the need. We could have said, “We need our app to show only fitness classes or studios within 3 miles of the user’s location in the search results.” Which is a possible solution for the need. Sort of. But it shortchanges the wide-sweeping impact of the need we identified.

Instead, if we focus on Melanie’s need, we learn that she needs classes that are close to her home or work. Focusing on her need forced us to change our studio recruiting strategy in the target county to ensure a critical mass of fun fitness classes where the persona (Melanie) lived. It narrowed our studio lead-generation efforts to specific boroughs in the county. Even more specifically, it prioritized our studio recruitment efforts within each borough. If instead we had merely worked to narrow our search results by default, the search results might never have revealed enough classes. We would have had great search tech, but not enough classes in the results to drive usage.

Let’s take it one step further. What if the root cause behind the persona’s need for a 2 to 3-mile limit on distance was that the average traffic patterns in the county meant that a 2 to 3-mile distance equated to a 20 to 30-minute commute during the 5:30-6:30 p.m. rush hour time, a popular exercise time for the Melanie population. And that the 20 to 30-minute commute made it almost impossible to take classes during that hour, unless Melanie left work early. Those search result filters don’t look so great anymore, do they?

The point is, you must explore different ways to address the persona’s need and its root causes before presuming a solution. If you document and communicate needs as features, you’ll defeat yourself before even getting out of the starting gate.

Needs Aren’t Benefits

This mistake is very similar to translating needs directly into solutions. Before we jump into the feeling or benefit the persona wants to achieve, we must look without bias at the insight or need. Don’t get us wrong—the benefit helps you understand what the persona is trying to achieve, but the underlying reason for not being able to achieve that is what facilitates focus and enables action. Focus on the underlying insight or root cause of what you are observing or hearing before jumping to a solution or end benefit.

Why Individualized Needs Are Important

How do you know what to work on first for any given problem–persona combination? Can you and your team agree on a path and stick to it without overturning decisions later? Defining the Problem Statement and the Persona is your north star. That’s your starting point. The prioritized

set of needs corresponding to a specific problem–persona combination gives you the path to a solution that delights the customer, and provides the guardrails for the areas to focus on or avoid when solving for that problem and that persona. It ensures your focus for ideation and feature tradeoffs, whether it be your first version or your next product release.

Needs Enable Confidence in Early Feature Tradeoffs

Doing the Groundwork to identify and prioritize needs surrounding a specific problem for a given persona allows you to quickly say no to certain features or exploration. You can easily justify to leadership why you didn’t pursue a particular feature area with a statement like, “Melanie’s primary needs are X and Y, which is why we focused more on these features and tabled these other features for now.” It keeps the tradeoff discussion out of “opinion land” and solely in “customer-data land.”

Needs Enable Clear Prioritization of Your Time

When you know and agree upon the prioritized set of needs for your persona(s) your team has the permission to focus their time on what matters most. Providing focused ideation time, testing, and iteration around the most important aspects of the solution. Which said a different way, you aren’t spending time on random, broadly scoped aspects of the solution that are less likely to drive delight. It’s the other side of the “saying no” coin.

Needs Enable Faster Time to Market

Because you can confidently make tradeoffs early and test and iterate on only what’s most important to your persona(s) you’re able to avoid the delays that come from endless feature debate, overturned decisions, and designing or testing things that don’t impact the delight of your primary persona(s). This dramatically reduces your cycle times and your overall release cycle.

Needs Minimize and Potentially Eliminates Costly Rework

Finding that you didn’t hit the mark on the most important needs of your persona after you’ve built and released your shiny new experience is painful. Doing all the Groundwork reduces the pain of rework after you release. We’ve all spent a lot of sleepless nights agonizing over something learned soon after release that seemed so obvious and could have been identified early on had we just done the needs investigation and prioritization.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

6 Common Mistakes to Avoid with Customer Personas

This excerpt is great for any product leader or product manager trying to make more customer-driven decisions that won’t be overturned at the next meeting. One artifact that helps in this plight is the persona. Don’t roll your eyes! There are ways to develop effective personas that drive action for your teams and not just collect dust on a shelf. This excerpt from our book introduces some pitfalls that teams fall into in the development and use of personas. The full book expands on this and more!

The following has been excerpted from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

We once walked into our client’s building (name not mentioned to protect the innocent) and as part of the kickoff for the project, we asked for any documentation they had on their target customer. “You mean personas?” they asked. Yes! Exactly! 

They tapped out a message on Slack and minutes later, the UX designer walked into the conference room and placed three laminated, full color, 20” x 30” flip charts on the table. Each had four pages of detail, including pictures and text. Our eyes widened for just a second. As we started to thumb through the beautifully produced flip charts, we started asking questions. 

PR: How are these used?

Client: We use them when we design or redesign areas of the UX.

PR: Does the extended development team have copies of these? 

Client: No. They don’t need them.

PR: When was the last time you used them? 

Client: About three months ago, when we redesigned the onboarding experience.

PR: How were these developed? 

Client: We hired a design firm to research and produce these for us.

They had big, beautiful, professionally created personas they could hang on the wall, and could even spill food and water on without issue! And the research team used them. So, what’s the problem here? There were a few things:

It’s Not a Contest to Write the Longest, Most Detailed Persona

Don’t be fooled. Less is more here. You want the entire organization to know the personas, use them, and refer to them in all aspects of the product planning and creation process. They need to be simple, easily communicated, and constantly referenced.

It’s Not a Broad Persona

Too often we see wide swaths of the population depicted as the target market because they all experience the problem we’re solving. Hence, we create a broadly scoped persona. That may include solving it for someone who has the problem but doesn’t feel enough pain to act on that problem. This is a huge pitfall to avoid. Your target personas are only those willing to take the action you want them to in exchange for solving their problem; be it open their wallet, donate their time, respond to your communication, and so on.

One question we recommend asking during persona-related research is, “What would you be willing to pay to have this problem solved?” or “What would it take for you to open your wallet to pay for this solution concept we’re showing you?” or “What would you expect to pay for a solution like this?” Choose your own words to help you understand whether or not the research participant would be willing to take the action you want them to take. 

This is not meant to be a pricing discussion. We don’t recommend interviews for pricing research. To be clear, you should be focusing on people who have expressed a willingness to pay, donate, or act to have their problem solved and not those that show a mere interest in solving the problem. Your persona will become clearer as you understand who is willing to pay and who isn’t.

It’s Not About Outsourcing

Taking ownership of your customer is your job. This is the Groundwork you and your team must do with your own hands. Interacting with customers, discussing what you learned with the team, and coming to a shared vision on your target persona is a requirement for creating products that customers love. Don’t get us wrong—we do outsource research, but there is a time and place for outsourcing. For this aspect of the Groundwork, you need to learn from your customers firsthand.

It’s Not A Laundry List of Demographics

Our client didn’t make this mistake—they did a great job of deeply understanding the archetype and bringing each of these personas to life. But we frequently see personas represented as a list of demographics and a couple of attitudes, rendering the personas one dimensional and not actionable. Demographics are good for marketing in terms of buying direct mail lists, filtering within social media campaigns, and calculating available market sizes. But they are bad for making product and design decisions. You need to understand attitudes, behaviors, goals, a day-in-the-life, and similar information.

It Isn’t A Job Description

Many B2B personas we see describe a job and the daily tasks within that job. A list of job responsibilities is very helpful when you’re trying to understand where your problem space fits into the world of that persona and when you’re identifying relevant needs that must be addressed to solve the problem well. However, just knowing a person’s daily job tasks tells you nothing about who the person is or how you should build an experience that delights them. So, in other words, a job description is helpful in describing the “what” you’re going to do, but it doesn’t give you any guidance on “how” you’re going to do it. There are many ways to design a feature depending on the traits of your user. The feature addresses the task at hand but the design approach (the aesthetic, placement of buttons, vernacular used, types and number of steps to complete the task, etc.) will vary widely depending on who you are building that feature for. Avoid just focusing on what could turn into features (job tasks and responsibilities) and focus more on the inputs to your design approach (this person’s aspirations and how they go about their daily life).

It Isn’t “One-And-Done”

Personas are always evolving. Most of the time, you start with hypotheses about who your target user is. You’re never right the first time. For example, you may assume your persona is focused on accuracy given that they are an accountant and spend a lot of time playing the role of “accuracy police” with their staff. But as you conduct more research to investigate their needs you find that, yes, accuracy is important, but they actually view themselves as a coach that helps their staff build good data hygiene. 

Think about how differently you might design an accounting software experience for someone who views themselves as a coach to help others with their accuracy checking instead of someone who views themselves as the “accuracy police.” The former might have the product team prioritizing data reconciliation functionality for the staff roles, while the latter might prioritize the ability to check their staff’s work. It doesn’t mean you can’t do both, but it certainly would dictate your prioritization of the two areas of functionality.

As you conduct more research you will learn more about your target customer, proving or disproving your hypotheses and refining the persona. Without this refinement, personas get shelved and become out of touch with reality.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

4 Things Every Product Manager Needs to Think About Before Development

For you product leaders that are struggling to make the tough tradeoffs. Our book’s definition of the Convergent Problem Statement can help. This excerpt references some strategies in establishing just that with your team in order to make product decisions much more efficient and durable.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

The Convergent Problem Statement is just as useful for new products as it is to prioritize features for existing products. We love starting ideation with a couple of the most compelling problem statements, helping us to explore and ultimately prioritize which customer problem our business is best positioned to address. 

As a reminder, a convergent problem statement clearly describes the most relevant difficulty the customer is dealing with and is stated with no attempt to address possible solutions.

For product leaders, the best way to support your team is to be deeply involved and invested at this early stage. When you help your product manager (PM) work towards a Convergent Problem Statement, you set the Groundwork for a successful product. Here are some strategies to working with your PMs: 

  • Insist that every “idea” is framed as a problem statement. In our work, we’ve even created mini templates and asked anyone in the company to share product ideas as long as they write the ideas in the form of a problem and not a solution. This helps cut down the noise of new product ideas since there is the small hurdle of entering it as a well-formed problem statement. This practice helps our team source new ideas, and highlights people in the organization who are passionate about solving customer problems.
  • Share the iterations that helped you converge to the chosen problem. You want to show by example that no one gets it right the first time. By showcasing examples, you provide a roadmap for how you want your product team to think. Many problem statements start with a lot of guesses, and then you refine them through learning. Show that journey for your teams to emulate.
  • Highlight “failures” or problem statements that ended up abandoned because you proved there wasn’t actually a problem! We’ve all been captivated by new product ideas or solutions that we thought were so obvious. When we do the work we uncover that customers had a simple workaround, or felt lukewarm toward the idea, or discovered the problem wasn’t important enough to want to pay for a solution. We’ve shared when a customer’s “good-enough” solution was sufficient or the pain wasn’t high enough for them to choose an alternative. By highlighting examples, you demonstrate the rigor that brings a product or feature onto the roadmap. You’ll see all the teams you work with gain confidence knowing that customers are waiting for their solution.
  • Never assign development resources unless you are satisfied that there is a genuine Convergent Problem Statement. This can feel painful when there are engineers available and both you and your product manager feel the urgency to create work. You have to stay strong! You’ll avoid much pain and suffering (which can manifest as bad customer reviews, rework, and unhappy teams).

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

10 Tips to move Strategy Sessions Online

We’ve written this article to help you plan a focused and effective strategy session when you’re all online/virtual. This is targeted towards product strategy sessions, but these 10 tips will work as effectively for bigger company strategy sessions. Just a note – moving your session online takes work. At the very minimum you need 3 weeks of pre-planning. Start soon!

  1. Design for outcomes. Remember a strategy is the plan by which you achieve your company/product objectives. A strategy meeting is the means by which you collectively create the plan on which you’ll execute. This might seem obvious – but it’s easy to lose sight of the reason you’re bringing people together. We’ve been in lots of in-person strategy offsites that end up more as information sharing sessions – or team bonding, or an excuse to talk about loads of new ideas (shiny new object syndrome!).  Then all the decisions get made at the post-offsite strategy session. Virtual strategy sessions need to be designed carefully. Start by getting really clear on what you want at the end of the virtual sessions and what information is needed to achieve the results you’re looking for.  Are you looking to refresh your strategy entirely, or are you looking to validate existing strategy? Has your business set new growth targets because of the pandemic, do they have a new set of objectives for the coming year? What factors will you have to consider – COVID impact, competitor analysis, market research, customer learnings, sales & finance updates, technology needs – what has changed and what is relevant?  Now write down what success looks like – share them with your peers so that you’re on the same page. Here’s an example: We need to update 2 out of 4 of our existing strategies in order to meet the new growth target (list the two). A successful strategy session means that we have produced a draft set of product strategies that are aligned to the company objectives and strategy, and each team is positioned to create a set of initiatives that are driven by strategy.
Pin by Amanda Dykman on Ahhh...The Work Life | Work humor, Work ...
  1. Break it up: We’ve all been on all-day offsites where we immerse ourselves in strategy and so the urge to replicate the process is strong. But you just can’t possibly do an all day strategy online – it’s painful even thinking about sitting in front of your screen for that long for one meeting! We’ve learned that 2 hours is the ideal time to have the team fully engaged, energized and effective. We’ve tried longer periods and it’s hard to keep everyone focused. 1 hour isn’t quite enough – people are getting warmed up and you’ll find yourself going long anyway. Some teams have insisted that we work in 4 hour sessions – but we see fatigue set in, then we take longer and longer breaks – it just doesn’t work. We recommend a series of 2-hour sessions spread over a week. With the right planning, this set of sessions can be even more effective than an in-person offsite.
data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wCEAAkGBxAQEBAPEhISDw8PDw8PDw8PEBAPDw0NFREWFhURFRUYHSggGBolHRUVITEhJSkrLi4vGB8zODMtNyktLisBCgoKDg0OFxAQGi0dHR8tLS0tLS0rLS0rLS0uLi0tKy0tLS0tLS0tLS0rLS0tLy0tLS0rLS0rLS0tLSsuLS0tK//AABEIALABHwMBEQACEQEDEQH/xAAcAAABBQEBAQAAAAAAAAAAAAADAQIEBQYABwj/xABGEAACAgECBAQDBAYHBAsBAAABAgADBAUREiExQQYTUWEUIjIVQnGBBzNSgpGhNFNiY7HB8BcjQ3IkNTZEkqKztMLD4Rb/xAAaAQADAQEBAQAAAAAAAAAAAAAAAQIDBAUG/8QAPBEAAgIBAgQDBQcCBQMFAAAAAAECEQMEEhMhMUFRYXEFIjKRoRRSgbHB0fBi4SMzQnKSFTTxJDVEgtL/2gAMAwEAAhEDEQA/AKRWlGAQERDHhREIetULAk1URCJlNQiGT6alMlsZIGKIrHQjYIMNwqI9ml7x7hbRE0j2hvDaSV0P2i4g9gp0P2hxA2A30P2j4gtgBtFYR70Lazk0lob0G1kynS2ic0Paywo01pDmUoE6rTGkOaLUGWGNpZkPIWoE5MIiQ5FpB1qIk2MduREMMj+sBUV2q6/RjrxWWV1Jvt5l1i1oT6DcjeeTl9qTlPh6WG9rvzf0X5lrGkrk6O0jxBRkjirtquTfYvTYtig+h2J2lYfamSE+Hq4cNvo6aXyf5ieNNXF2W3FPY3oyoQuIbx0Na0esncFAbMoCFMORFbUNo9gtyHrqg7x0xWgq6ihh7w+QT4hT3kOxoq8/CVue00jNomUbKptIHpNeIZ8M8iV51mYQPAAiWwoCTVcJNASUvEVCDpdEAZcnaFBZJrz9u8W0LJFWaDE4jsm1ZCmQ4sqybRYslplJljWyzMtMf8sAHqFi5j5D/JQwthyFXHSFsdIkV46SW2OkSq6UktsrkHVFiAKu0BCwEdtHQCFREOyg8W60MSndV82+xlqopB2a+9+SVj09SeygmedrMnEl9ni65XN/dj3/ABfRf3LjyVlDpvhSrf4jMC5ua/N7bVD10/3dFZ5Ig6ep6k854eb2jOuHg/w8a6Jcm/OT7t/I1UF1lzZF1nwgFcZmnFMLNQdFULjZa96rkHLY/tD/APRrp/aVx4OrvJjf/KPmn+gpY+8eTJ/hfxcMktjWqcXOp/XYln1Db79Z++h67j1HsT3Rlk0Ci74mCXSS7eXl6fLwIfv+TLuzJee5ilDJFSg7TOeTadMjvmP6TZRRO5gviGPYx0hbmMdmMdCBbNGIcoaIZIpdxJaQ02S0taTSLthlsMmh2eBgz0zlF44gHB4APWwwAMthiAMl5hQBRcTFQDlcwEHrcwAl13MIqAmUZbSWh2WFWefWS4j3BxqHvJ2D3ijUz6w2BvCpqRhsHvJNeoGTsHvDrqJi2D3kivUDJ2FKYX7RMWwe8euqGLhhxAyamYuGPeHTUZOwe4dZqQVWYkBVBZmJ2CqBuST2E5tVmWDHufN9EvF9kXH3mZDQ1bOvOqWg+WAyabWwIK0Hk+UQfvWc9vRNvUz5zXZXii8F3Nu8j8X2j6R/P0N4K+fyNJPJNToAUnibw1VmqjcTUZVJ4sbLq5W0P/8AJfVf8J3aLXz0zardCXxRfR/38yJwUvUrdC8UW03Lp+pKtWUeVGQPlxtQXfYFT0WzmN19T23Anqxi8MXqdC92P/VB9Y/zs/nZk+fuz6+JuasVHG4/MdwZ62m1kNRDdB+q7ozlDb1CjT0nTbJpC/Z6QthSO+zk9I7YUjvs9IrYUhwwU9IcwpCjDWHMYvwiw5gfOvBPTOM7ggAoSAD1SABVSABFSIAqrAQatYgJVYEQg6gQAMqxAEAiAeFjAItW8VgSKqImxpEpE2klBkiGGDRUAvFCgO3hQDg0Qwi2ROkrY0ys1RTm3fZ6k/D1cFmpOp+ocmrwgf7XIt/Z5fenzWp1n/yfVY19HP8A/Pn6HbCFe78/2NOoAAAGwA2AHIAegnzj8zoFiA6AHQAga3o1GbS1F6CytuY7MjdnRvusPWdGm1WXTZFkxOn+fkyZRUlTMth6zlaNYlGazX4DEJjalsS1P7NWSB/Di/x+77UIx1T4+j9zKvih2fi4/t+XfJ3HlLmvE3/2uOEONmVgCHUhlYHoQR1E9HQ62Oo9yXuzXVft+3VGWRbOfYYutrPS4bMuIgo1lItjHvRx1lYbGG9DftpYcNhvQ062sfDYuIhV1tYcNhvR4iK53mA8UQsDjjwsRwphYBFrgId5cQChYAPUQEGVoAFRogJNdkQBlcQAKtgiAMtwhQBBkiKh2L8TCgsUZEKCxwyIUFjlyIUFjxkxbR2PGRCgsZm5z01qawHyshzThVN9LXbEm1/7tBuxPt7ieL7RzxnJ4LqEVeR+C7RXnL+dzpwQ/wBXy/cutD0tcWkVAl2Jay61vrvvY7va3uT/AAGw7T5TU6h58jm1S6Jdkl0R3RjSJ85yjoAdEB0AOgAPJx0tRq7FWytwVdHAZWU9QQZcJyhJSi6a6MTV9TC24mTohL0h8zSCSbcUnjvwAer1k/VX6g/n3M92GbF7Rre1jzrpLopevg/55GLTh5ouqmqyKlysVxdQ43HDuSvqNuoI7g8xPT0ftKUJ/Z9Yts137P8AT8ejObLh5boc0RxaZ7lHLYvmn1ioLO80woLF8wx0FnCwxUFmC4psMItkKAf5kQheKMBQYgCCACgRCHbRiHARAPAgA9YAFQGABlQxAEWowsB4paKxhBQ0LAeKDCwHCswEO4IAOFcLGFStAGssYJTUpsusPIJWo3J/lOPW6p4Mfuq5y5RXi/2Xc0xY978u5K8N4jWu2oXKUe1PLxKWGxxMHfdVI7O/1N+6O0+O12bauBF7qdyf3p936Lovxfc9OEe/y9DQzzTQ6AHQA6ICn1/Ub62x6MdamvynsVWvLiqmuusuzsF5t2AA269Z16bDjkpzyt7Y106u3SXMmTapIifYefZzu1O1d/uYePj0Iv4M4dj+Zmv2nTx+DCn/ALm3+VIW2XdjW8M5K869UzlbsbRi3pv7qaxD7bifxYIV5bl+obH4gqNay8O2ujUBW9VziqnUKAUrNp6V31n9Wx7EfL/lctNhzwc9Naa5uD614xff8xbmnUiJqvhvIwrWztLABY8WVpxO1GUO7Vj7j/h+XcHowa7Fqcawa3t8M+8fXxX881MoOL3Q+RK0nUcbUq2txya7kO2RjWfJbTZ3DL25g8+h29d56OLV5/Z8lh1XvQfwzXPl+q+q80c+TDHJ70OT8DjWQdiNiOoPafQxmpJSi7TONprkzuCMBeCADgkAMN5BmtgKKDCwHrTCwCLRFYBVxoWId8ORCwOFUBDhVAB4qhYDhXFYD1rgAZEiAk1rEBLqURMpElEEkoKK1gAjIIACauMVDTXGKhVqJIAG5PIe5kznGEXKTpLmxpNukDXGGXf8MOeHh2K+W33crOXZkx/dE+Vm9Twj1nyms1sued8pTVQX3YdHL1lzS8vwPQx46W35+pq2O3M8h3J5AT586SDqer4+NQcm6xUoXbewcTrzOw24ASdz6TbFp8mXJw4K5eHT8xOSStlFpH6RdMyshMaq1vMtPDWXqdEsb9kEjry77ek7M/sjVYcbySjyXXmQssW6KNPGmrZl2TRgYVPDjXvRZffcCFIZgGI3Xrw9BvOx+ztJghCeoyP3laSX/n9Cd8m/dRudDGSMer4oo2Vs3nGr9XxcR2C8h93hH5Tx9RwnkfCvb2vqaxuuZR+JM9cfUMK10uetcbOAFFFt7Nc7UALsgPPhDdZ2aXE8umyRi0m3Hq0uS3ePnREnUkGPii36hpmolfXy8dWI9Qht3kfYodHmhfq/zoe9+DLPRNapzKzZUW3RjXbXYjV3UWjqliHmpnPqNNkwS2z7801zTXimOMk+g7XtNTKxr8Zxut1Tpz7Nt8rD3B2P5RabNLDljkj2Y5K1RH8H5zZGn4dznd7Maoux+84XZm/MgmXrsax6nJBdE2KDuKK3xP4UN1gzcOz4TUax8to/V5A/q7l22IO3XY9t99ht16L2iscOBnW/E+3decf58iZ475rkwOheIUzHbEya/g9TqHz0N0tH7dR++vtudu245z0YvL7PSy4XxdPL6fs/o+9MxlFZeT5SLVsNh2nv4NTjzwU8btfzqccsbi6Ynw59JtZNCjHMLAxKqJqIKtYgA4UiFiHLTCwD11RWAU48VgM+Fj3CHDGhYUP+GhYUd8PCwoUY8LCh4xzCwoKlEVhQZaTFY6CpWYWMeKzABwqMLGPFUVgPWqKwIurXvWEoo2Gbl8SUHbcY1QH+8ymHogPId2KjvPE1+pjOThL/AC8dOf8AU+0F69/Beh1Ycdc+76fuXWlafXjUpRWCEQdSd2did2dj3Ykkk+pny2fNLNkeSfV/xJeS7HalSpGV/Ss5fFowVOz6jm42KCOoTjDM34Ahf4z0PY625ZZn0xxb+hnl6V4mIycsnwzlYrE+ZgZoxW368IyAyn8PmI/dnrxgl7UhkXScd30M7/w2vAl4eoV6xnaRRj1NWNMFWRkXWhK2KoKjwou+5UsoH72/TnM54paHT555HfEtJLn1vr/OwJ72kuwDwdpGoZOTqoxc34GoZ1gt4aw9ljF7NiDy22G/eVrtRp8WLBxce97VXPl0X86BCMm3To9c0nEamiql7WvetAjXWbl7WHVm3JO/5z5nNNZMkpJbU30XRHQlSJe8xGdADOaSobVNRsQfIKMGm0jo2UBYx/EhHrB/ET0Mza0mGMutya9OX6pkL4mWXiPUhi4l+Qf+HW3AB1e0/LWg9SWKj85z6XC82aMF3f07/QcnSsTw3p5xcPFxj9VOPVW+3TzAo4v57w1WVZs88i6Nt/sEVSSLKc5RSeKPDFGei8e9V9XzY+VX8t1D9iCOo37fw2POd2i1+TSye3nF9YvoyJwUio8PeI8mjITTdSUfEMD8Llr+oz1Hbts/+uW439OWNQi9ZoH7q+KD/wBPr4rz7dn1rLr7k/megU41dg3A27Eehnr6PWLU498eXivBmU8W10O+zknXuZGxHkgqnZZzBFQxWA8CMAqGIQZGEQyQm0QB1USbGFWoRWOgi0CG4KHriiLcOgyYYi3D2hlwRDePaFTBEW8NoZcAekW8e0IuAPSG8Ng4YAhvHsF+zhDiBsEOnQ3i2EPU2rxqnvtPDXWpZthuT6Ko7knYAdyROXV6mUEoY+c58o/q35LqXDGm7fREPw7gWDzMzIG2XlBd06/CYy7mvGB9tyWPdmPtPlNZmi6w43cI9/vSfWT9e3kdsI92XU4CzzXxphWajrOJhVXPjDExbMp76t+Oqx22HDsRs2wTY7/eM9/Q5I6XRTzSipbpJU+jr+Mwmt00jP6l4J1Co6phUV3ZdOWMS6vIsZB5l62K7l2YgcXzWfwE7sXtHTz4ObI1Bx3JpdlVKq7dCXjkrS5mw1jwbc1um52M6Y2birj1ZLN9FlC1hX32+ogbr7g7bjYTysHtCChmw5VuhK2vW+Xp4+TNHB8mupTU+AqW+My/tW34Z7b771wW4a123chiGYMVVvSdcvak1w8XAW5JJbuvh4Lr6k8Nc3Zs/AvwnwFIw3e3GU2hLLQRY7G1mcncA/UW7TyfaHG+0SeZJS5Wl06KvoaQrbyL+cRZV+ItVONTxIvmX2utGNV/W5L8lB/sjmxPYKZ0aXAs06k6iubfgl/KXmyZOkP8P6UMWhai3mWktbkXEbHIynPFZafxJOw7DYdotTn42Ryql0S8EuiCMaRUg/aGZ64OnW9fu5epL6eqVc/xc/2Z0/8Aa4f68i/4x/eX5epPxPyRp55xodADoAY39LNIOmWX/Tbi20X0WfertFqryP4H/Ce17Bm/tih1jNNNeKpmWZe7ZvdHcnn04kUkeh/0TNfYVrNkiulfry/UWboizn0lM5zyOqozqs5SSlHtJsKHfDe0VhQvw0dhQ4Y3tCw2hq8c+kW4e0OtEncOgyURWOgnlkRWFDqzAETKRvJZSJddJMmykgoqIisdDhuI7AIpMQwi7xDDJEMc2wG56CZ5MkccXKTpIaVmJ4/tHL8zrhYNpFQ6rlZy9bPdKjyHq+5+6J4Gr1EoRcnyyZF/xh2XrLq/L1Noxv0X5mhnimx0AMhb4kux9X+CyBWuJk45uxbVUq3Gi7utjE7EgK/p931npx0cMmj42O3KLqS9elfT6me5qdMxD6/n5oqVMiyoa1n2U43CSBi6ZS2zMgHRiWIJ6ngI7z1lpdPgtuKfBim/OT8fL9zLdJ/iSm0b7F1XDroutfG1Gu+u6u1g3FaF24zsACd2Q77b9exmf2j7fpMkskUpY2mmvD+WPbskq7hf0bf9nc78M/8A9usn2r/7li/+v5hj+Bmg/Q5/1Pj/APPkf+s04fbn/ez9F+ReH4TazyTUzuIPidSutPOrTkGNSO3xdqLZdZ+IQ1oP+Z53T/wdLGK65Ob/ANq5Jfi7f4Ihc5ehI8X51lWNw0nhyMq2vEx2/YutO3H+6od/3ZGhxRnlufwxTk/RdvxdL8Qm6XIsNL0+vGpqx6hw10oEUdyB1Y+pJ3JPqTMM2WWWcsk+rKSpUSpkM6AHQAxPiS37Ty69Lq+fHx7a8jU7OqKFO6Yo9WYjn6bexnt6OP2LBLVT5SknHGu/PrL0XbxMZe+9q/E9NwMfhXc/U3M+w7Ce37G0D0+Jyn8Uuvkuy/cyyz3PkStp7OxGR5/TggzlcyFEmV6eJDmWoB104Rbx7AqaWIuIPhhl0ke0XEHwwi6WIuIGxCtpoj4gtgwYQEN4bDjhAx7xbATYO0amS4D6q9o2wSLLH2mTNEGYiIZHbaWiWOQCJjQdUEQx4EaQGa8c5VgpTHqY12Zd1WMLFOzViwnjsX3WtXI99p5esyp5lCXOMIubXi18KfldX6lxXK/HkGwsWumtKa1CV1KERB0VQOQnzWTJLJNzm7b5s6EqVINIGdADzz9N2Ej6aLzuLMe5PLYcjtZ8jr+BG38BPb9gZHHU7O0k7/DmjHMvdsgeNKV086DmqhOLg8NNoUblEdE+b8SA/wCJ/GbaGT1K1WFv3p81+F/2FP3dr8BV1FNb1jDsxgzYenV2vbkOrIDbYvJVB9wnX0Y9uZwpaDRZI5fjyNUvJfx/QL3zVdEUejNquDiZejLp1tz3PcqZI4hSqWIELb8PCRsNweIdefSdedaTUZoat5kkqtd+XPxv6ErdFONHp3gfQ2wMDHxXIaytWawrzXzHcuQD3A4tt/afPa/UrUaieRdH09FyN4R2xoubL0UqGdVLHZQzBSx6bAHrOVRk02lZVlH4LO9eYT9Z1TUePfqCMggD/wAIX8tp16/4sfhsh+X7kQ7+o3xceG3SnP0jVKlPsXx71U/xP849FzhnX9D+jiE+q9TRTgLOgB0AMt4o1q5rV0zCI+NtXiuu6pp2Metrf2zv8o/P039XRaXHGD1Wp/y49F3m/D08WZzk72x6mo8H+GacGhKqwdh8xZudl1p+q6w92P8ALlPd0WmyajJ9s1K5/wCmPaK7f2+fV8sZyUVtiaKe4ZHSkxHntOZtORxM1ImV6hIcC95ITURFsHxAo1WTwyuIPXV4cMOIPGsCHDDiIVtXEOGHEQE6nK2E8QemoxbA4gQ5u8Nobxhu3lUTY5bjCgsf57QpBbOFhhQWFS0woaZJryJLiVuDi4RUVZl/HSuK6sqtTYcO+rJNajdnqTiW1VHduB2IHqJ4+qx/+pqTqOWO2+yl1V/jX1NYv3eXYm4eVXdWltbCyuxQ6Op3DKe8+dyY5Y5OE1TXVG6dq0GkDMtr36QdOwrnx7rXF1fDxolVjcPEoYc9tuhB6z0dP7K1OeCnBcn5ozlkinTKzxh4twHxcXfHfU6c9z5FVRK8dtbLsrD6uLiO223UTfRaDURyz97huHVvwf0FOcaXey08Na1kZS3DK09sDHrqUqL28zzVG/ECrINgAB1E59Vp8eFx4WXiSb7cq+rHGTfVUUn6MvGdmddfjvVTj1qgvxEprNfHR5hRiQSdz9PMbdDOv2r7Pjp4RnGTk+krd86snHO3RndOy9f1EZtuPmrWuLfZWtPCiM/DuQoIT0Hc9Z3Zcfs7S8OOTHe5J31/UhOcrpkWjxRlMmna21jstOQ2DqNSMwqbl8t3lj5QTW/PtxKvrNJaLEpZdGkla3Qff0vr1XyFufKRpvDm2qa1k6iDx4mnqMXDYfS9pB4rB69XP7yek8/VXo9DDT9J5Pel6eH5fJmkfenfgW2q4+VhvmXrl4uHh5FyXmy2my++u41JWyInEFYkpuOpO/Sc2GeLPHHB45TnFVSaSq27b5vlY2nG3dIqsfLx0srycwavetbrZXlZlD14VTjpb5NewQc+RZeU6ZY8kovHg4cW+TUXcn5W+v4MlNdXZ6HRcrqrowdHUOjqQyuhG4YEdQRPClFxbjJU0bj5IGd8VeIHoNeJjKLtRyQRRWfopTvkW+iD+e34z0dDo45U82Z7cUOr8X91eb+hnOdcl1LfwT4WTDqJZjdda3m5GQ/15V56ufRRudh/o+3pcT1uRajKqxx+CHav58/RGUnsW1de5q95728xO3hvA7ePeB5ktRmdnPQRajFY6CLWYrAcKjHYCikw3CoXyjDcFDhWYrAItRhYUHSqKx0HSuTZSRISuKyqJCVRWOg60ydxW0eKIbh7R3w8Nwtoooj3BtHCswsdCmrflMs2OGWDhNWmNNp2jDahQ2kXteoJ0y9+LJrUf0C5jzyUH9U3317H5vWeLn07zf4E/wDNivcf34/df9S7fLwNoyrmunfyNMrggEEEEAgg7gg9CD3E8Fpp0zc8h1nxMmna1q9z02ZAfFxq9kA4FJqq281j9Kk7DfY9Z9Pg0b1Wh08VJRqTfn1fTzOdy2zkVOTpOTjY3h5ENYyrcy2+niPHSllr1GoEjfcbcJO2/UzphnxZcurcr2qKT8eSdktNKJsPEuTqWHpWoW519Nz3V14+OmOhQVtYSj89gT8rb/uzy9LDS59Xijgi0k23fO65r6/maS3KLsyWgamcfUdFsONk4la0Jp1r5FTVpkM/F8y7jpx2BvyE9PU4Vl02ojvjN3vVO2q/sqM4upRLT9H3iTEwadVa+5K3+NtdKiw823YEAKvU8+W85vaejzaieBY4traufZfiVCSinZ3hHS9vDOe1q7jIXLyUDDpwVqEcfvVbj8Ia3PftTEoP4dq+b5/RhFf4bs1H6Ha1Gj4xAALvkMxH3m8513P5KB+U872429bO+1fkjTF8JZV1DJ1S0v8AMmnU0ChD9IycgM7XbftBFVQe3E0wb4Wkjt65G7flHkl8+b/AfWXoaIjfcHmCNiDzBHoZwFmb8DJ5aZmOv6nF1HKpx/Raflfyx7Kzsv5Tv9oPdLHkfxShFv16X+KVmePuiV4p8QLh1oFQ35eQ3l4mKv132+vsg6k9pOh0T1Mm29sI85S7Jfu+yHOe31DeCfC7UceTkN52bkkNk3die1NfpWvT32/h7GPGtbKNR24IfDH73m/1+XiZN7PVmynuWZHQsR0AFjAyw0w+ky4hGweNNPpFxA2jxpp9Ibw2C/Zx9Ibw2CHAPpDeGwYcM+kN4bThiGG8W0IuIfSG8e0KuEfSG8e0MuEYt4bQq4cW4e0MuLCx0EFQisoeEjXMB20dCO2hQHR8gFhyAFk462KUYAgggggEEEbEEdx7TDU6eGeG1un2fg/EqMqZ5/RxaTeMWwk6bc4XFtbc/AXMf6M7f1TH6GPTmp7TxdTgep3Nqs0PiX3195efj49etmsXt9H9BlHhRm1HUsm7y3xc/GqxxWC3mbCtFbiG2w+k7bH0nPLXJabDjhalBt326srZ7zb7lF/s1yWoxqDn+X8Dk324li0l7K6WZSi8XEvMFeL2LbdBOz/rGJZJz4V70lJXyb79mRwnS59CZ/s2NhX4nUczKVbEsNdjDy2ZDuOTcW3fp6zL/rG2+FijHlVrrz+RXC8WanxBoGPnLWl4Yim1bqyjlGWwAgcx25/yE87TarJp23j7qnfPkXKKl1Kmr9HWkhzYcUWOzFybbLbAWJ3JILbfynS/a+scdu+l5JL9CeFHwNK2MhTyiimrh4PL4RweXttw8PTbbltPP3yUt18+t9zShcfHStQlaLWg32RFCKNzudgOUUpym7k7YVRn9Yovxsr4+ipslLKUozMasqLmVCTXfUDsGZeJlK78weXSd2CWPLi4GSW1p3Fvpz6p+T62RK07Qy3xNfcDXh4WV57DYWZtD4uNQf2nL822/ZXcn2jjoseN7s2SO3wi1Jv0rp6sW9voh7306Ngr5jNc/Eeg/wB9n51rFm4V/aZieXYfhCOPJ7Q1D2ravpGK8fRfMLUI8w3g3w5a1jahm7HNuUDhHNMKjqMav3/aP+j6UccdTWDDywQfN95vx/nRfhUXt959X9DdDYDboBPbThCKjHkkY82Buy0XqZLy+A6I41aonbeLisORLquDdDvLjlXcVBd5tuQqK46jUO4nm7yxg1Ss94bxEqrIVuhEFkXcdBC4lPJEKBm9fUSHkAUMp9IuIgodsI1OIUKNpSnEKF3Ee+IUJxiHFiKhpvUdx/GHGQA3zax94Q4ouRBu12tTtvDc2FoJRrFbd9oLI0Fo67Wa17w4jYWiDb4iHbaFsneR28R+8LFvOXxEYWPcSatbYxbx2JqDVZVT03IHrsUo6kcmU9R/rpOXURc6nB1OPNP+di4yrk+hntEzLMO5dOyXNiNv9nZb9cioD+j2H+uX/wAw277zzNXhjng9RiVNfHHwf3l/S/o/I2i691/gaeeUanQA6AHQA6AHRAdACHq+p04lL5FzBKqxuSepPZVHdj0Am2n0+TPkWPGrbFKSirZmtFxHuuXVM5eC0gjAxG/7jjt95h/WsNtz26ew9pxW16PTP3V8c/vPwXku3z9cbr3pdeyNousIF5DoOQnfjSxxUI8kjNu+ZT6j4kI5CbJWS5GdzNfdu/8AOaKBO4j0amd9+KDQrNFpetHluZnJUWmafG1AMJnvaLqzy0as5+9K20TQerPb9qS0KizxdYZe8ycSkHv11yOsSiDZDTV33+qaUieZPp1qwDrIcUx8xX8SOO5jWNBbE/8A6R/Uw4aJ3Ma/iCw9zGoIVsGdasPcx7UK2BfVLD94x0hcyNdnWEdTKVCplZZdaT1mtoKZY4TvtzMxnJDpkrgY9yZHEDaw9WETIeah7A32cfSRx0UsYejTCT0kS1CKWMt8fAA9Ji9QWoE1KEEh52PaQtf0WrLoah9wDsVdDw2VWDmtqN2ZTzBmfGljyLLj+JduzXdP1KSTVMpfDuq2h2wMsj4ypeJLQOFM/GHIXoOzdmXsfaY6vTwcVqMHwPqu8X4Py8H3RUJP4X1NBPONDoAdADogOgALLyq6a3tsYV11qXd2Oyqo6ky8eOWSShBW30Qm65sxmMGz7F1PJQriUni0zDbkbW7Zdq+pH0g9Bz/H3HH7PF6TA/fl/mS8P6V+vi/pi3fvPp2QmTfbY5sc8z2HRR2A9p3YYQxQUIdDnk3J2zmynA7zVUIz+pNYSeZ2nTBoRUEWb9TNrQUGp8wSW0MtdPyrAeczkkBrtO1fYbTknA1izyxNQPrPSeJEWSatUPrIeEdkyrVfeZPCOySmpyHhCwteesl42OySuePWRw2A5Lwe8TTQEtLkmbUh0h6unrF7wqQ8WLFzCkJ5qw5hSHC1IuYUjjw9do7YUg9LqJErHROpsX2mMrKSJtVo9pi7K5EyplPcTFtlJIkoQO8htjpDnb0MlMKIzO2/Wa2qEHrczNsZV+I9IXLrUK5oyaW8zFyV+vHvHQ+6noy9wZWHM8E3Kt0ZcpR7Nfv4PsxSVoZ4c1prw9NyinOxtlyaQeXP6bqz96tuoPbpMdZpVianje7HL4X+j80OEr5PqXU4izogOgAjuFBYkAAEkk7AAdST2EaTbpAYkn7XsF1m66Pj2b1IeX2pkKeVjDr5KkHYfePX29yMXoY8OHPPJc39xPt/ufd9jFvfzfT8y7yLuM7kchyA7KPSLFjWKNImTsCaVPabb2TQhwlPaHFaDaR7tJrM0WokGxFbk6QoPITeOobHtB/ZyiXxrIcSHkYxB5GaxnZDQTGVu0UpIaPOhPVJHBogCrbJoYQZB9YtoDlyj6xbAsMmYZLgOySmd7yHjCyRXqHvIeIdkuvUPeZvEOyQueDM+EFiNnD1j4YWErzAeW8TxgSUt37zNxGHRjIaAlV3MJm4oaZKrytusycPAdhTqYHpJ4DY9werV/aZy049xNq1VTMZadlKaJIz0PpM+FIrcg9eakh45Dsc1lZ5xJSDkUfiHSzea8nGYVahjAmhz9N9fVsa31Rv5HmJtgyrCnjyq8U+q8H2kvNfXoTJXzXUneH9ZTLq4wDXbWxryKH/AFmPePqRv8Qe42nHq9LLTz2t2nzTXRrxX85FRluRZzlKOgBi8+5tWtfHRimlY78OZepKnPtU/wBGrI/4YP1MOvQT28MFoYLJJXml8K+6vvPz8F26mLe/l2LTKP0qoCVVqFrrUAKigbAAD2hhhttvnJ9X4ikyOts3aJsILZNDHrdFQBVuU8uUlpoY80gyd7QxDiLGsjFtRDt0tTNo52iXA6vT1WU8zYtp4+9Bn0KkZUNFMe4KGskdgN4THYjtjABNzAB62GKgHC0xUARcg+sTiAYZR9ZOwBjZZ9Y9iCxVziO8OGgskVaqR3kPDZW4nVa37zJ6cNxYU6yvrMZadj3Bjqw9ZHAHuB/aG/eVwqFZJx8vbuCJnLGNMmJnTN4wsJ8f7yeEOxa9RI7xPCCkH+1PeRwCtwM6qd+pB6ggx/Z010FuH3F3s+0cQf8ATalC5eMCFXUsUf8A2L91vbboROZwjCP2bP8A5cvhl9yX7Puvx6lp37y6/maHS/E2Hk1+Yl9a7fXXa61W0sOqOjHdSJ5mfQajDLbKD8mlafmmjRTiyj1TVzqLth4lnBiJudQ1FTsiV98eh+jOe7DkBO7Bplo4rNnjc38EO9/ekvBdl3ZEpbuS6d2Hx9Sx0RKKAtePSAlaLy5Dv+fXnz5+s1Wmy7nky85y6sW9dF0D/EBhHsaFYz5ZXMQ9awZLbQUJdgnbcQjl58worrMewdN50KcWTTJmI9oExmoMasltksB7zNQRVkZ88iarEidwF9UA7S1hDcYxtPnp8QVAHwtu0pTFREsw5opioAcaXvFQNsePcKgLUyrEd5ENwCeVHYCGqFgN2jAQrCwGmMQJ32joBK7INASFt2k0AVcg+sW0AgyzFsGFXPI7yXjCwy6ifWS8SCwg1L3i4QWOGpe8XCQWOGpn1i4KHY9dSieILJOHq7VutiHhZTuD/kfUTLJpo5IuMlaY1KnZb53ifSbB52ZgK924VnWim0ud9h8zEE/gek5I+ydfiSWnzVF9rar8EmvkacaD+Jcyo1zxd8TUKMeoYmGjbCpQql+HpuqfKo3+6N/X8N9N7M+z5Hkyy35H3/8APP8AEiWXcqXJFViZJB6kTtnBEJl9jamwHWcksKKsSzWnB6/zgtOgslYHiBt+fSZ5NKuw1I0uFr1ZHP8Axnn5NLLsaKZYJm0P2EwePJErcmGU19pL3dx8gd4T1G8qO4pQsrrKgZ1RbNFiTKzMr5zpgzKeOiq80ETXaZWNZxHQiPYV9JasCJaqmaJsQBqhKsRGsq9JakKgTSgBEmUIY1kdCGFhHQDWYR0ICzSgBuu8YDUBEYBeKIBpeFCG+bChjTbHQHDIhQUL8TCgHrcTFQg1auekKAmUYNjSXSAnpplgHOZuSGW3ibwhwafTlBv1ho4l9GZlH+c9DHzivQlmb+FNRes8+F2nNnXvsa6CGwCY7RifHbd4uGFke/MPrLUAsHXnMO8bgmBYY+qsO8ylhTHZZ068w7zCWmTHZY4/iMzCWlRcWSG18nvIWlo6osJRqxPeDw0bKQDJ1HfvNI4znySKT4udGw5rH/FRbAsQ5BhsCzi8dADNu0dBYN7t49orBcQMqmATyge8VjI99AlJiaIrptLJAPLQA2BjEBNu0dAd8QIUAxsiOgoj2ZEY6BjKhQCNkwAA2VHQx9eVCgJ2NeIhMu8HIUSZIRdUapWsxeNsLCW68npJWELNx4ms4tBxG/aOIf42JPQxKkl5EvoeZa1cBfcP7w/4CZZl74LoVtj7zNIYEKYwDpiEyXJIdB00smRxEPaO+zG9IcRD2EnH0lyeQkyyxRSgy1x9BfqROeWeJtHEyYmiN6SHmRsoA3xSse6yJciK6S0zCTs//9k=
  1. Set mandatory pre-workTo make the most of 2-hours together, you need to set pre-work. As you determine success outcomes – you’ll naturally uncover the most relevant topic areas (competitor analysis, market/economy, customer success, etc.). Two-three pages of pre-reading for each area is recommended. Summarize each of main points:  clearly list market & customer insights that are most critical to the discussion, articulate each of the major problems that need to be addressed. Write these down  in a paragraph or two, providing key data and backup links for anyone wanting to dive deeper means that everyone coming to the sessions is prepared. You can send all the pre-work together a week before your session, or set your sessions to be 3 hours, with the 3rd hour individual time for the team member to do the pre-work each day. This isn’t easy – but it’s invaluable for having great sessions. And we recommend asking people not to attend if they haven’t done the pre-work, don’t let your sessions devolve into opinion-sharing. Keep discussions focused on facts/data.
  1. Assign Champions. Share the workload and assign champion to each of the major sections of work. This is a great opportunity to highlight your team, or to even ask important peers at your strategy sessions to lead. When you engage others in leading the pre-work research, or summarizing the data points – you take the burden off being the sole facilitator, and all the research coming from one voice. You want everyone at these sessions to feel ownership over the strategy that’s developed, and one of the best ways we’ve seen to achieve this, is by starting with ownership right from the start.
How to Lead Better Virtual Meetings - Duarte
  1. Write down assumptions. When doing the pre-reading, have the team write down their assumptions. This way, each team member is coming in prepared with a set of notes that lend themselves to a discussion. The pre-reading is not just for information, but to help form product strategies (remember #1, outcomes!). The reason we recommend this approach is that it helps provide the rationale for the opinion.  It’s much easier to invalidate a stated assumption, rather than argue opinions. We really don’t like opinion-based discussions if that isn’t already obvious. When the team can’t readily invalidate an assumption – this can easily be turned into a hypothesis that can be tested after the meeting. We know exactly what information we need to help us make sense of the data.
  1. Address the elephants. Don’t bury bad news in the pre-reading or avoid it altogether. Some of the teams we’re working with are losing their funding, others have seen their customers disappear or put purchase decisions on an indefinite hold. This is critical information, and it’s not business-as-usual. You want the most out of these strategy sessions – you want your teams to armed with all the data. The impact of the elephants are pretty significant in terms of how the company will respond – perhaps the growth targets have doubled, or the retention goal has increased significantly. Make sure the pre-reading provides the “why” and the context – and don’t avoid those big, hard problems.
3 lessons learned when developing a new product with the Minimum ...
  1. Standalone Ideation. It’s really easy for each of these 2-hr strategy sessions to devolve into ideation sessions. Once people have their pre-reading done, and they understand what the business is trying to achieve – they’ll want to solve problems – it’s natural. We’re all full of product ideas, and asking people not to share them can be painful (and derailing). But you don’t want to continually talk solutions before you get a full understanding of all the areas that need to be reviewed. We suggest having a shared whiteboard to capture all the ideas generated. Don’t have this as a shared screen, you don’t want it visible and distracting – you just want a place where people know that they can add their ideas/solutions. Once you’ve finished the information sessions, you can move into ideation for product strategies. This is towards the end, and a 2-hr focused session on strategy ideation is ideal. Having your list of whiteboard ideas is a perfect input for this. Your team can self-select which ideas move forward, and which go away now that they are fully armed with all the background.
  1. Small Discussions. We design our strategy sessions to be about 5 minutes together as a large team, then 15–20 minute sessions with a small team. By small team, we mean about 3–4 people, a group where everyone has a voice. We move in and out of this format — so that we’re constantly regrouping, sharing updates, and then going back into real discussions. Consider if you want random groups so that different people are constantly reviewing data. This is good when you have a close working team, and the groupings are less important. Perhaps you want to deliberately create cross-functional breakouts if you have invited others in the company — you’ll want to design each small groups to have a voice from all the functions that are represented. This is an important part of pre-planning, looking closely at putting the right people together.
  2. Document Collaboration is a must. Zoom, or teams, or whatever video software you use is insufficient. You want to be virtually around a working board where the pre-reading is loaded, the assumptions are listed – everyone can see and have access to the documents and be able to write their own thoughts/comments. We have been using the in-built notepad on zoom, and then Mural to share all documents. We pre-build our boards with stickies – color-coding for teams, and sometimes individuals – so that we can make sense of all the notes at the end of the session. Avoid a facilitator writing down other people’s ideas – it’s nowhere near as effective as enabling everyone to have control over exactly what and how much they contribute.
No! No! Not Another PowerPoint! (BoomerBlix)
  1. Lose the PowerPoints. Hopefully this goes without saying given the first 8 tips – we want the strategy sessions to be all about working together, discussions and making decisions. Feel free to create PowerPoints for pre-reading if that fits with your company culture. But by no means spend any time (not even 1 minute) sharing a PowerPoint deck. You’ll set the tone and expectation for this session if you avoid PowerPoints altogether. Let’s be clear – we’re still asking you to make sure that everyone understands the pre-reading. You should still start each session by recapping or highlighting the relevant facts, check in for understanding and questions and then jump into the assumptions that people have written down. Work through the data in a structured way. We just don’t want you reading slides!
Zoom party tips: Virtual hangout ideas for a fun night in - Los ...
Celebrate!

Bonus tip!: Don’t lose the happy hour. Last, consider how you can celebrate together at the end of the strategy session. Maybe it’s a separate hour after every session is complete – but it’s important to acknowledge the end of this hard work. Here are some ideas that we’ve experienced or seen work. Send everyone a bottle of wine, or their favorite beverage a few days in advance, so you can open it all together at the end of the session. It’s always fun getting a surprise in the mail! I took part in a chocolate tasting by an expert a few weeks ago – I was sent a package of 4 bars (yes, it was hard not opening those) and couldn’t wait for the event. It turned out to be a really fun experience, as we all opened packets and tasted together while the expert shared the history and taste notes of each bar. A month earlier, I was part of a sommelier experience, and the prep for that was to bring in the bottle of wine that you’d always been saving for a special occasion – so the only company expense was providing the expert. Hopefully these ideas get your creative juices flowing – whatever you do, mark the end of the session with something fun and a way to connect and have a shared experience.

A 6-Part Formula for Developing a Customer Problem

Okay product leaders, this excerpt sheds some light on how to create a problem statement that works to focus the team and allow for you to say ‘no’ confidently. Take a look.

The following has been excerpted from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Let’s examine what goes into a Convergent Problem Statement. As a reminder, a convergent problem statement clearly describes the most relevant difficulty the customer is dealing with and is stated with no attempt to address possible solutions. We want to clearly define the problem in detail so that anyone reading the problem statement can immediately understand the situation. Every problem statement should address the following six questions.

1. Who Does It Impact?

You need to be able to imagine the person impacted by the problem. Start by defining a real human being—someone you can relate to. Developing a sense of the person who has the problem immediately creates a sense of empathy. This empathy allows you to better understand the problem. Don’t focus on demographics; think about a specific person in a particular role. You don’t need to name them, but you do want a sense of who they are, where they work, and what their day-to-day life might look like.

2. What Are They Trying to Do?

You want to understand the context in which the person is operating. Here you’ll think in more depth about where they live, work, or play. Their surroundings matter. You need to know what they have access to, what their environment looks like, and what options are available for them. You start to build a picture of what they have access to, and the workarounds or options they may consider to naturally approach the problem.

3. How Do They Want to Feel?

We love this question. Yes, it’s touchy-feely, but it goes to the core of why someone will care about the problem being solved. And for all you super-analytical types, this will be a cornerstone as you think about marketing. Understanding the emotional toll of the problem will help you sell the benefits of using your product. Every problem in your life leads to an emotion.

When the person you envision experiences the problem at hand, do they feel annoyed? Grumpy? Frustrated? Angry? Exhausted? 

This is one of the hardest questions to answer, so keep exploring different adjectives until you find the one that resonates. When you land on the right emotion, it will feel like an “aha!” moment. Understanding how your customer feels can reveal whether the problem is a serious or a trivial one. Asking these emotion questions help you determine the list of features needed to solve the problem, develop the solution, and price it. But let’s not jump ahead of ourselves; there’s still more to learn about the problem.

4. What’s Getting in the Way of Just Addressing the Problem?

When customers have problems, they’ve usually tried to address them in some way if it’s important enough. Have they tried alternative solutions? Did anything partially work? Have they created workarounds, whether that’s through supplementary software or manual steps? Have they tried to reduce the impact of part of the problem? What are the biggest barriers to resolving their problem? Is it lack of awareness? Budget? Time? This question asks you to both ask direct questions, and also to closely observe behavior and actions.

5. When Does This Problem Occur?

This question is about timing. Is this a recurring problem? Is it a daily or a weekly problem? Does it only occur at the end of a fiscal quarter? Or does it occur once, but when it occurs, is it extremely painful? Understanding the frequency of the problem gives you a sense of the scale and size of the problem. This question pushes innovative thinking; understanding what’s happening for the customer at different points of time allows us to consider alternatives.

6. Why Does This Problem Exist?

As you complete the problem statement, start to develop a hypothesis about why this particular problem exists for your customer. What gets in the way of just going about their day and avoiding this problem? Are there any alternative solutions or products that are just not viable, or is there no solution and they are creating a set of workarounds? Try not to go straight to willingness to pay for a solution as the answer, after all, people will pay a lot to solve an important problem. Instead, consider other factors that might be causing this problem. 

Remember, it’s for the particular person that you imagined in the first question (who does the problem impact?). Don’t generalize across a population to determine why the problem exists.

The answers to these six core questions paint a picture of your customer and their problem.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth. Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com