6 Elements of a Strong Hypothesis

In this excerpt we change the way you think about the formulation of hypotheses to expedite your product creation process. Where we used to think of hypotheses as scientific fodder, our book transforms the definition and formulation of hypotheses into something we can use in our day-to-day product efforts; proving and disproving our assumptions so we can make quick product decisions and continue our forward momentum. Check it out.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

We are constantly inspired with new product ideas—whether that’s through customer observations, the competition, or an “aha!” moment in the shower. Every idea has the potential to be formed into a hypothesis. The way to ensure you have a strong hypothesis, one worthy of testing, is by reviewing that they conform to these six characteristics:

Logical

This seems obvious, but think about the number of times someone has a good idea on the team. Good ideas are a dime a dozen, sadly. We’ve seen multiple teams become overwhelmed with new ideas entering the system because they see a competitor launch a new feature, or because an investor or senior leader gets inspired by the latest shiny object. Being logical means that there is clear, sound reasoning connected to the hypothesis. The idea doesn’t come from left field; you can point to evidence to suggest the outcome will be promising.

Testable

Making sure a hypothesis is testable is one of the hardest aspects of generating a great hypothesis. Often, teams feel like they need to fully build and launch their product to get actionable data so they forgo hypothesis testing altogether. While your results may not be statistically significant, think about how you might, with minimal resources, prove that you’re heading in the right direction. With practice, writing a testable hypothesis becomes easier—teams get very creative and quickly adapt to creating small tests with minimal resources.

Precise

How you put together a hypothesis counts. Using deliberate words that indicate a specific outcome is important. Otherwise, any given outcome can be seen as either confirming or falsifying. Being precise means being crystal clear on what you’re testing and why, and documenting the rationale for what it means to run the experiment, what resources you’ll need to experiment, how long it will take, and when you’ll know the results.

About Something Measurable

You need to understand which numbers matter before you do the research. If your hypothesis is that more visitors will see your webpage when you make a certain change, then you need to know exactly how many more must visit for the change to be meaningful, and thus, for the hypothesis to be confirmed. An increase of 1% may mean nothing to one company, and it may mean millions in incremental revenue to another. Understanding what measures are important gives you a good indication of whether the experiment or test should even occur. If the results can’t confirm or falsify your hypothesis, why do the research? This is a hard characteristic to pin down, but it’s critical to ask both if you know what the measurement is, and whether the measurement is meaningful.

Has an Expected Outcome

We want you to be able to explain with a logical, clear reason what outcome you expect. The line gets tricky here—if you already know the outcome, then go get the data to prove how you already know this. Why spend time testing things you already know? We see teams share hypotheses with us all the time about things they already know. They do this because it’s comforting to be proven right. On the other extreme—if you don’t know what outcome to expect, then how will you plan the precise experiment that could achieve that outcome and how could you know what to measure? Make sure your hypothesis specifies an outcome and that the outcome will address your hypothesis.

Falsifiable

The last of the characteristics is making sure that you can invalidate your hypothesis. The way to think about this is to make sure you don’t set your research up in such a way that the results are subjective, or that you’re not capturing the right data to be able to have a clear result.

These six characteristics are intended to help you coach your product managers. Instead of just providing feedback on a hypothesis (or rejecting it outright), point to one or more of the guidelines and discuss how their hypothesis may miss the mark. It’s a teaching moment and a much more productive conversation at the same time.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

Why Your Product Should Be Needs First, Features Last

As product leaders, the number one issue we see is with the concept of uncovering needs. We all have a tendency to proceed straight to features or solutions because as product leaders, we are problem solvers. But we’re here to ask you to please refrain from this tendency. Instead, pause and take time to articulate a need before jumping to solutions.

The following excerpt is from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

Earlier in our work, we worked on developing a fitness app and created the persona (a persona is a user archetype created based on your research that represents how someone might use your service, product, site, or brand) Melanie who “won’t travel more than 2 to 3 miles from work or home to work out at a studio.” That’s the need. We could have said, “We need our app to show only fitness classes or studios within 3 miles of the user’s location in the search results.” Which is a possible solution for the need. Sort of. But it shortchanges the wide-sweeping impact of the need we identified.

Instead, if we focus on Melanie’s need, we learn that she needs classes that are close to her home or work. Focusing on her need forced us to change our studio recruiting strategy in the target county to ensure a critical mass of fun fitness classes where the persona (Melanie) lived. It narrowed our studio lead-generation efforts to specific boroughs in the county. Even more specifically, it prioritized our studio recruitment efforts within each borough. If instead we had merely worked to narrow our search results by default, the search results might never have revealed enough classes. We would have had great search tech, but not enough classes in the results to drive usage.

Let’s take it one step further. What if the root cause behind the persona’s need for a 2 to 3-mile limit on distance was that the average traffic patterns in the county meant that a 2 to 3-mile distance equated to a 20 to 30-minute commute during the 5:30-6:30 p.m. rush hour time, a popular exercise time for the Melanie population. And that the 20 to 30-minute commute made it almost impossible to take classes during that hour, unless Melanie left work early. Those search result filters don’t look so great anymore, do they?

The point is, you must explore different ways to address the persona’s need and its root causes before presuming a solution. If you document and communicate needs as features, you’ll defeat yourself before even getting out of the starting gate.

Needs Aren’t Benefits

This mistake is very similar to translating needs directly into solutions. Before we jump into the feeling or benefit the persona wants to achieve, we must look without bias at the insight or need. Don’t get us wrong—the benefit helps you understand what the persona is trying to achieve, but the underlying reason for not being able to achieve that is what facilitates focus and enables action. Focus on the underlying insight or root cause of what you are observing or hearing before jumping to a solution or end benefit.

Why Individualized Needs Are Important

How do you know what to work on first for any given problem–persona combination? Can you and your team agree on a path and stick to it without overturning decisions later? Defining the Problem Statement and the Persona is your north star. That’s your starting point. The prioritized

set of needs corresponding to a specific problem–persona combination gives you the path to a solution that delights the customer, and provides the guardrails for the areas to focus on or avoid when solving for that problem and that persona. It ensures your focus for ideation and feature tradeoffs, whether it be your first version or your next product release.

Needs Enable Confidence in Early Feature Tradeoffs

Doing the Groundwork to identify and prioritize needs surrounding a specific problem for a given persona allows you to quickly say no to certain features or exploration. You can easily justify to leadership why you didn’t pursue a particular feature area with a statement like, “Melanie’s primary needs are X and Y, which is why we focused more on these features and tabled these other features for now.” It keeps the tradeoff discussion out of “opinion land” and solely in “customer-data land.”

Needs Enable Clear Prioritization of Your Time

When you know and agree upon the prioritized set of needs for your persona(s) your team has the permission to focus their time on what matters most. Providing focused ideation time, testing, and iteration around the most important aspects of the solution. Which said a different way, you aren’t spending time on random, broadly scoped aspects of the solution that are less likely to drive delight. It’s the other side of the “saying no” coin.

Needs Enable Faster Time to Market

Because you can confidently make tradeoffs early and test and iterate on only what’s most important to your persona(s) you’re able to avoid the delays that come from endless feature debate, overturned decisions, and designing or testing things that don’t impact the delight of your primary persona(s). This dramatically reduces your cycle times and your overall release cycle.

Needs Minimize and Potentially Eliminates Costly Rework

Finding that you didn’t hit the mark on the most important needs of your persona after you’ve built and released your shiny new experience is painful. Doing all the Groundwork reduces the pain of rework after you release. We’ve all spent a lot of sleepless nights agonizing over something learned soon after release that seemed so obvious and could have been identified early on had we just done the needs investigation and prioritization.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

6 Common Mistakes to Avoid with Customer Personas

This excerpt is great for any product leader or product manager trying to make more customer-driven decisions that won’t be overturned at the next meeting. One artifact that helps in this plight is the persona. Don’t roll your eyes! There are ways to develop effective personas that drive action for your teams and not just collect dust on a shelf. This excerpt from our book introduces some pitfalls that teams fall into in the development and use of personas. The full book expands on this and more!

The following has been excerpted from Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin. 

We once walked into our client’s building (name not mentioned to protect the innocent) and as part of the kickoff for the project, we asked for any documentation they had on their target customer. “You mean personas?” they asked. Yes! Exactly! 

They tapped out a message on Slack and minutes later, the UX designer walked into the conference room and placed three laminated, full color, 20” x 30” flip charts on the table. Each had four pages of detail, including pictures and text. Our eyes widened for just a second. As we started to thumb through the beautifully produced flip charts, we started asking questions. 

PR: How are these used?

Client: We use them when we design or redesign areas of the UX.

PR: Does the extended development team have copies of these? 

Client: No. They don’t need them.

PR: When was the last time you used them? 

Client: About three months ago, when we redesigned the onboarding experience.

PR: How were these developed? 

Client: We hired a design firm to research and produce these for us.

They had big, beautiful, professionally created personas they could hang on the wall, and could even spill food and water on without issue! And the research team used them. So, what’s the problem here? There were a few things:

It’s Not a Contest to Write the Longest, Most Detailed Persona

Don’t be fooled. Less is more here. You want the entire organization to know the personas, use them, and refer to them in all aspects of the product planning and creation process. They need to be simple, easily communicated, and constantly referenced.

It’s Not a Broad Persona

Too often we see wide swaths of the population depicted as the target market because they all experience the problem we’re solving. Hence, we create a broadly scoped persona. That may include solving it for someone who has the problem but doesn’t feel enough pain to act on that problem. This is a huge pitfall to avoid. Your target personas are only those willing to take the action you want them to in exchange for solving their problem; be it open their wallet, donate their time, respond to your communication, and so on.

One question we recommend asking during persona-related research is, “What would you be willing to pay to have this problem solved?” or “What would it take for you to open your wallet to pay for this solution concept we’re showing you?” or “What would you expect to pay for a solution like this?” Choose your own words to help you understand whether or not the research participant would be willing to take the action you want them to take. 

This is not meant to be a pricing discussion. We don’t recommend interviews for pricing research. To be clear, you should be focusing on people who have expressed a willingness to pay, donate, or act to have their problem solved and not those that show a mere interest in solving the problem. Your persona will become clearer as you understand who is willing to pay and who isn’t.

It’s Not About Outsourcing

Taking ownership of your customer is your job. This is the Groundwork you and your team must do with your own hands. Interacting with customers, discussing what you learned with the team, and coming to a shared vision on your target persona is a requirement for creating products that customers love. Don’t get us wrong—we do outsource research, but there is a time and place for outsourcing. For this aspect of the Groundwork, you need to learn from your customers firsthand.

It’s Not A Laundry List of Demographics

Our client didn’t make this mistake—they did a great job of deeply understanding the archetype and bringing each of these personas to life. But we frequently see personas represented as a list of demographics and a couple of attitudes, rendering the personas one dimensional and not actionable. Demographics are good for marketing in terms of buying direct mail lists, filtering within social media campaigns, and calculating available market sizes. But they are bad for making product and design decisions. You need to understand attitudes, behaviors, goals, a day-in-the-life, and similar information.

It Isn’t A Job Description

Many B2B personas we see describe a job and the daily tasks within that job. A list of job responsibilities is very helpful when you’re trying to understand where your problem space fits into the world of that persona and when you’re identifying relevant needs that must be addressed to solve the problem well. However, just knowing a person’s daily job tasks tells you nothing about who the person is or how you should build an experience that delights them. So, in other words, a job description is helpful in describing the “what” you’re going to do, but it doesn’t give you any guidance on “how” you’re going to do it. There are many ways to design a feature depending on the traits of your user. The feature addresses the task at hand but the design approach (the aesthetic, placement of buttons, vernacular used, types and number of steps to complete the task, etc.) will vary widely depending on who you are building that feature for. Avoid just focusing on what could turn into features (job tasks and responsibilities) and focus more on the inputs to your design approach (this person’s aspirations and how they go about their daily life).

It Isn’t “One-And-Done”

Personas are always evolving. Most of the time, you start with hypotheses about who your target user is. You’re never right the first time. For example, you may assume your persona is focused on accuracy given that they are an accountant and spend a lot of time playing the role of “accuracy police” with their staff. But as you conduct more research to investigate their needs you find that, yes, accuracy is important, but they actually view themselves as a coach that helps their staff build good data hygiene. 

Think about how differently you might design an accounting software experience for someone who views themselves as a coach to help others with their accuracy checking instead of someone who views themselves as the “accuracy police.” The former might have the product team prioritizing data reconciliation functionality for the staff roles, while the latter might prioritize the ability to check their staff’s work. It doesn’t mean you can’t do both, but it certainly would dictate your prioritization of the two areas of functionality.

As you conduct more research you will learn more about your target customer, proving or disproving your hypotheses and refining the persona. Without this refinement, personas get shelved and become out of touch with reality.

 

If you like what you see, there’s more where that came from. Pick up Groundwork: Get Better at Making Better Products by Vidya Dinamani and Heather Samarin from Amazon.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies, small and enterprise level, in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences. We have a passion for finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …and that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

Virtual conferences create delight

Like you, we’ve were disappointed and sad to see all the in-person conferences cancel one after another. In the early days of the pandemic, some brave conference organizers decided to switch to virtual experiences , but these first few experiments were mostly pretty painful. Trying to recreate the excitement of an in-person experience was so daunting, most didn’t even try. We watched webinars, and gave presentations had no interaction with anyone else other than through a chat box, or moderated through a host. Luckily, there’s been a lot of experimenting in the last six months, and now we’re starting to get delightful online experiences. In the last month, we’ve attended three amazing virtual conferences which have exceeded expectations. They’ve transformed expectations of conferences and they created delight. We want to share three examples of these experiences with you because they’ve re imagined their offering and we hope it inspires you to think differently about your product and customer experience.

  1. Personal Connection. Networking can be hard at in-person conferences. They can be awkward affairs where it’s hard to make a meaningful connection. I have tons of business cards from various conferences, but no memories of their owners. In the Product Leader Summit conference last week, the organizers offered up three virtual networking sessions starting a week before the conference. There are multiple networking apps, but the better experience was that there were multiple chances to connect in six minute chunks, which is enough to have a real conversation when it’s just 2 people. You get to sample a personality, make a connection and then decide if you want to continue the discussion. There are multiple apps that offer networking, but consider the experience. The networking portion was received so well, there were requests to continue these post-conference.
  2. Shared Experience. It’s hard to create a shared physical experience when we’re all sitting at our own desks. However, the Women’s Venture Summit, offered a happy hour get-together in between their 2 day conference. This event asked the audience to purchase a set of ingredients a week prior to the conference (with lots of reminders so that we were ready). The maker of the featured cocktail, Emily Josenhans of Domain Sante, made a new beverage (crafted by her team) online. She took us all step-by-step through the process, and we created a cocktail (or mocktail) together. I’ve been to many happy hour events online, but creating something together made the experience much more delightful.
  3. Insights & Learning. Zoom breakouts are a good way to break up any large group and have people able to talk to each other. In two conferences, rather than a random distribution, we were told why we were put together in the groups. This information about who would be in the room with you was shared a few days in advance, so we could look up (linedin stalk) the people we would be meeting with. This act of forethought made the breakout room immediately more active, because there was a sense of knowing the other attendees were. They also helped much better attendance, knowing that a group was expecting you to show up. There were better conversations because we felt accountable to prepare to share thoughts with a team we’d never even met. We all use breakout rooms, but consider designing an experience instead of hoping for the best, so that attendees have a significantly better chance of learning from each other.

Each of these examples elevated and improved the conference experience because the conference organizers deeply thought about the attendee (customer) needs. They knew what in-person conferences promised, and they worked with existing technology (not developing a single new feature or product) to not just improve, but create delight. How can you go back to your core customer needs and given the new way in which we all live and work, deliver an experience that delights?

10 Tips to move Strategy Sessions Online

We’ve written this article to help you plan a focused and effective strategy session when you’re all online/virtual. This is targeted towards product strategy sessions, but these 10 tips will work as effectively for bigger company strategy sessions. Just a note – moving your session online takes work. At the very minimum you need 3 weeks of pre-planning. Start soon!

  1. Design for outcomes. Remember a strategy is the plan by which you achieve your company/product objectives. A strategy meeting is the means by which you collectively create the plan on which you’ll execute. This might seem obvious – but it’s easy to lose sight of the reason you’re bringing people together. We’ve been in lots of in-person strategy offsites that end up more as information sharing sessions – or team bonding, or an excuse to talk about loads of new ideas (shiny new object syndrome!).  Then all the decisions get made at the post-offsite strategy session. Virtual strategy sessions need to be designed carefully. Start by getting really clear on what you want at the end of the virtual sessions and what information is needed to achieve the results you’re looking for.  Are you looking to refresh your strategy entirely, or are you looking to validate existing strategy? Has your business set new growth targets because of the pandemic, do they have a new set of objectives for the coming year? What factors will you have to consider – COVID impact, competitor analysis, market research, customer learnings, sales & finance updates, technology needs – what has changed and what is relevant?  Now write down what success looks like – share them with your peers so that you’re on the same page. Here’s an example: We need to update 2 out of 4 of our existing strategies in order to meet the new growth target (list the two). A successful strategy session means that we have produced a draft set of product strategies that are aligned to the company objectives and strategy, and each team is positioned to create a set of initiatives that are driven by strategy.
Pin by Amanda Dykman on Ahhh...The Work Life | Work humor, Work ...
  1. Break it up: We’ve all been on all-day offsites where we immerse ourselves in strategy and so the urge to replicate the process is strong. But you just can’t possibly do an all day strategy online – it’s painful even thinking about sitting in front of your screen for that long for one meeting! We’ve learned that 2 hours is the ideal time to have the team fully engaged, energized and effective. We’ve tried longer periods and it’s hard to keep everyone focused. 1 hour isn’t quite enough – people are getting warmed up and you’ll find yourself going long anyway. Some teams have insisted that we work in 4 hour sessions – but we see fatigue set in, then we take longer and longer breaks – it just doesn’t work. We recommend a series of 2-hour sessions spread over a week. With the right planning, this set of sessions can be even more effective than an in-person offsite.
data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wCEAAkGBxAQEBAPEhISDw8PDw8PDw8PEBAPDw0NFREWFhURFRUYHSggGBolHRUVITEhJSkrLi4vGB8zODMtNyktLisBCgoKDg0OFxAQGi0dHR8tLS0tLS0rLS0rLS0uLi0tKy0tLS0tLS0tLS0rLS0tLy0tLS0rLS0rLS0tLSsuLS0tK//AABEIALABHwMBEQACEQEDEQH/xAAcAAABBQEBAQAAAAAAAAAAAAADAQIEBQYABwj/xABGEAACAgECBAQDBAYHBAsBAAABAgADBAUREiExQQYTUWEUIjIVQnGBBzNSgpGhNFNiY7HB8BcjQ3IkNTZEkqKztMLD4Rb/xAAaAQADAQEBAQAAAAAAAAAAAAAAAQIDBAUG/8QAPBEAAgIBAgQDBQcCBQMFAAAAAAECEQMEEhMhMUFRYXEFIjKRoRRSgbHB0fBi4SMzQnKSFTTxJDVEgtL/2gAMAwEAAhEDEQA/AKRWlGAQERDHhREIetULAk1URCJlNQiGT6alMlsZIGKIrHQjYIMNwqI9ml7x7hbRE0j2hvDaSV0P2i4g9gp0P2hxA2A30P2j4gtgBtFYR70Lazk0lob0G1kynS2ic0Paywo01pDmUoE6rTGkOaLUGWGNpZkPIWoE5MIiQ5FpB1qIk2MduREMMj+sBUV2q6/RjrxWWV1Jvt5l1i1oT6DcjeeTl9qTlPh6WG9rvzf0X5lrGkrk6O0jxBRkjirtquTfYvTYtig+h2J2lYfamSE+Hq4cNvo6aXyf5ieNNXF2W3FPY3oyoQuIbx0Na0esncFAbMoCFMORFbUNo9gtyHrqg7x0xWgq6ihh7w+QT4hT3kOxoq8/CVue00jNomUbKptIHpNeIZ8M8iV51mYQPAAiWwoCTVcJNASUvEVCDpdEAZcnaFBZJrz9u8W0LJFWaDE4jsm1ZCmQ4sqybRYslplJljWyzMtMf8sAHqFi5j5D/JQwthyFXHSFsdIkV46SW2OkSq6UktsrkHVFiAKu0BCwEdtHQCFREOyg8W60MSndV82+xlqopB2a+9+SVj09SeygmedrMnEl9ni65XN/dj3/ABfRf3LjyVlDpvhSrf4jMC5ua/N7bVD10/3dFZ5Ig6ep6k854eb2jOuHg/w8a6Jcm/OT7t/I1UF1lzZF1nwgFcZmnFMLNQdFULjZa96rkHLY/tD/APRrp/aVx4OrvJjf/KPmn+gpY+8eTJ/hfxcMktjWqcXOp/XYln1Db79Z++h67j1HsT3Rlk0Ci74mCXSS7eXl6fLwIfv+TLuzJee5ilDJFSg7TOeTadMjvmP6TZRRO5gviGPYx0hbmMdmMdCBbNGIcoaIZIpdxJaQ02S0taTSLthlsMmh2eBgz0zlF44gHB4APWwwAMthiAMl5hQBRcTFQDlcwEHrcwAl13MIqAmUZbSWh2WFWefWS4j3BxqHvJ2D3ijUz6w2BvCpqRhsHvJNeoGTsHvDrqJi2D3kivUDJ2FKYX7RMWwe8euqGLhhxAyamYuGPeHTUZOwe4dZqQVWYkBVBZmJ2CqBuST2E5tVmWDHufN9EvF9kXH3mZDQ1bOvOqWg+WAyabWwIK0Hk+UQfvWc9vRNvUz5zXZXii8F3Nu8j8X2j6R/P0N4K+fyNJPJNToAUnibw1VmqjcTUZVJ4sbLq5W0P/8AJfVf8J3aLXz0zardCXxRfR/38yJwUvUrdC8UW03Lp+pKtWUeVGQPlxtQXfYFT0WzmN19T23Anqxi8MXqdC92P/VB9Y/zs/nZk+fuz6+JuasVHG4/MdwZ62m1kNRDdB+q7ozlDb1CjT0nTbJpC/Z6QthSO+zk9I7YUjvs9IrYUhwwU9IcwpCjDWHMYvwiw5gfOvBPTOM7ggAoSAD1SABVSABFSIAqrAQatYgJVYEQg6gQAMqxAEAiAeFjAItW8VgSKqImxpEpE2klBkiGGDRUAvFCgO3hQDg0Qwi2ROkrY0ys1RTm3fZ6k/D1cFmpOp+ocmrwgf7XIt/Z5fenzWp1n/yfVY19HP8A/Pn6HbCFe78/2NOoAAAGwA2AHIAegnzj8zoFiA6AHQAga3o1GbS1F6CytuY7MjdnRvusPWdGm1WXTZFkxOn+fkyZRUlTMth6zlaNYlGazX4DEJjalsS1P7NWSB/Di/x+77UIx1T4+j9zKvih2fi4/t+XfJ3HlLmvE3/2uOEONmVgCHUhlYHoQR1E9HQ62Oo9yXuzXVft+3VGWRbOfYYutrPS4bMuIgo1lItjHvRx1lYbGG9DftpYcNhvQ062sfDYuIhV1tYcNhvR4iK53mA8UQsDjjwsRwphYBFrgId5cQChYAPUQEGVoAFRogJNdkQBlcQAKtgiAMtwhQBBkiKh2L8TCgsUZEKCxwyIUFjlyIUFjxkxbR2PGRCgsZm5z01qawHyshzThVN9LXbEm1/7tBuxPt7ieL7RzxnJ4LqEVeR+C7RXnL+dzpwQ/wBXy/cutD0tcWkVAl2Jay61vrvvY7va3uT/AAGw7T5TU6h58jm1S6Jdkl0R3RjSJ85yjoAdEB0AOgAPJx0tRq7FWytwVdHAZWU9QQZcJyhJSi6a6MTV9TC24mTohL0h8zSCSbcUnjvwAer1k/VX6g/n3M92GbF7Rre1jzrpLopevg/55GLTh5ouqmqyKlysVxdQ43HDuSvqNuoI7g8xPT0ftKUJ/Z9Yts137P8AT8ejObLh5boc0RxaZ7lHLYvmn1ioLO80woLF8wx0FnCwxUFmC4psMItkKAf5kQheKMBQYgCCACgRCHbRiHARAPAgA9YAFQGABlQxAEWowsB4paKxhBQ0LAeKDCwHCswEO4IAOFcLGFStAGssYJTUpsusPIJWo3J/lOPW6p4Mfuq5y5RXi/2Xc0xY978u5K8N4jWu2oXKUe1PLxKWGxxMHfdVI7O/1N+6O0+O12bauBF7qdyf3p936Lovxfc9OEe/y9DQzzTQ6AHQA6ICn1/Ub62x6MdamvynsVWvLiqmuusuzsF5t2AA269Z16bDjkpzyt7Y106u3SXMmTapIifYefZzu1O1d/uYePj0Iv4M4dj+Zmv2nTx+DCn/ALm3+VIW2XdjW8M5K869UzlbsbRi3pv7qaxD7bifxYIV5bl+obH4gqNay8O2ujUBW9VziqnUKAUrNp6V31n9Wx7EfL/lctNhzwc9Naa5uD614xff8xbmnUiJqvhvIwrWztLABY8WVpxO1GUO7Vj7j/h+XcHowa7Fqcawa3t8M+8fXxX881MoOL3Q+RK0nUcbUq2txya7kO2RjWfJbTZ3DL25g8+h29d56OLV5/Z8lh1XvQfwzXPl+q+q80c+TDHJ70OT8DjWQdiNiOoPafQxmpJSi7TONprkzuCMBeCADgkAMN5BmtgKKDCwHrTCwCLRFYBVxoWId8ORCwOFUBDhVAB4qhYDhXFYD1rgAZEiAk1rEBLqURMpElEEkoKK1gAjIIACauMVDTXGKhVqJIAG5PIe5kznGEXKTpLmxpNukDXGGXf8MOeHh2K+W33crOXZkx/dE+Vm9Twj1nyms1sued8pTVQX3YdHL1lzS8vwPQx46W35+pq2O3M8h3J5AT586SDqer4+NQcm6xUoXbewcTrzOw24ASdz6TbFp8mXJw4K5eHT8xOSStlFpH6RdMyshMaq1vMtPDWXqdEsb9kEjry77ek7M/sjVYcbySjyXXmQssW6KNPGmrZl2TRgYVPDjXvRZffcCFIZgGI3Xrw9BvOx+ztJghCeoyP3laSX/n9Cd8m/dRudDGSMer4oo2Vs3nGr9XxcR2C8h93hH5Tx9RwnkfCvb2vqaxuuZR+JM9cfUMK10uetcbOAFFFt7Nc7UALsgPPhDdZ2aXE8umyRi0m3Hq0uS3ePnREnUkGPii36hpmolfXy8dWI9Qht3kfYodHmhfq/zoe9+DLPRNapzKzZUW3RjXbXYjV3UWjqliHmpnPqNNkwS2z7801zTXimOMk+g7XtNTKxr8Zxut1Tpz7Nt8rD3B2P5RabNLDljkj2Y5K1RH8H5zZGn4dznd7Maoux+84XZm/MgmXrsax6nJBdE2KDuKK3xP4UN1gzcOz4TUax8to/V5A/q7l22IO3XY9t99ht16L2iscOBnW/E+3decf58iZ475rkwOheIUzHbEya/g9TqHz0N0tH7dR++vtudu245z0YvL7PSy4XxdPL6fs/o+9MxlFZeT5SLVsNh2nv4NTjzwU8btfzqccsbi6Ynw59JtZNCjHMLAxKqJqIKtYgA4UiFiHLTCwD11RWAU48VgM+Fj3CHDGhYUP+GhYUd8PCwoUY8LCh4xzCwoKlEVhQZaTFY6CpWYWMeKzABwqMLGPFUVgPWqKwIurXvWEoo2Gbl8SUHbcY1QH+8ymHogPId2KjvPE1+pjOThL/AC8dOf8AU+0F69/Beh1Ycdc+76fuXWlafXjUpRWCEQdSd2did2dj3Ykkk+pny2fNLNkeSfV/xJeS7HalSpGV/Ss5fFowVOz6jm42KCOoTjDM34Ahf4z0PY625ZZn0xxb+hnl6V4mIycsnwzlYrE+ZgZoxW368IyAyn8PmI/dnrxgl7UhkXScd30M7/w2vAl4eoV6xnaRRj1NWNMFWRkXWhK2KoKjwou+5UsoH72/TnM54paHT555HfEtJLn1vr/OwJ72kuwDwdpGoZOTqoxc34GoZ1gt4aw9ljF7NiDy22G/eVrtRp8WLBxce97VXPl0X86BCMm3To9c0nEamiql7WvetAjXWbl7WHVm3JO/5z5nNNZMkpJbU30XRHQlSJe8xGdADOaSobVNRsQfIKMGm0jo2UBYx/EhHrB/ET0Mza0mGMutya9OX6pkL4mWXiPUhi4l+Qf+HW3AB1e0/LWg9SWKj85z6XC82aMF3f07/QcnSsTw3p5xcPFxj9VOPVW+3TzAo4v57w1WVZs88i6Nt/sEVSSLKc5RSeKPDFGei8e9V9XzY+VX8t1D9iCOo37fw2POd2i1+TSye3nF9YvoyJwUio8PeI8mjITTdSUfEMD8Llr+oz1Hbts/+uW439OWNQi9ZoH7q+KD/wBPr4rz7dn1rLr7k/megU41dg3A27Eehnr6PWLU498eXivBmU8W10O+zknXuZGxHkgqnZZzBFQxWA8CMAqGIQZGEQyQm0QB1USbGFWoRWOgi0CG4KHriiLcOgyYYi3D2hlwRDePaFTBEW8NoZcAekW8e0IuAPSG8Ng4YAhvHsF+zhDiBsEOnQ3i2EPU2rxqnvtPDXWpZthuT6Ko7knYAdyROXV6mUEoY+c58o/q35LqXDGm7fREPw7gWDzMzIG2XlBd06/CYy7mvGB9tyWPdmPtPlNZmi6w43cI9/vSfWT9e3kdsI92XU4CzzXxphWajrOJhVXPjDExbMp76t+Oqx22HDsRs2wTY7/eM9/Q5I6XRTzSipbpJU+jr+Mwmt00jP6l4J1Co6phUV3ZdOWMS6vIsZB5l62K7l2YgcXzWfwE7sXtHTz4ObI1Bx3JpdlVKq7dCXjkrS5mw1jwbc1um52M6Y2birj1ZLN9FlC1hX32+ogbr7g7bjYTysHtCChmw5VuhK2vW+Xp4+TNHB8mupTU+AqW+My/tW34Z7b771wW4a123chiGYMVVvSdcvak1w8XAW5JJbuvh4Lr6k8Nc3Zs/AvwnwFIw3e3GU2hLLQRY7G1mcncA/UW7TyfaHG+0SeZJS5Wl06KvoaQrbyL+cRZV+ItVONTxIvmX2utGNV/W5L8lB/sjmxPYKZ0aXAs06k6iubfgl/KXmyZOkP8P6UMWhai3mWktbkXEbHIynPFZafxJOw7DYdotTn42Ryql0S8EuiCMaRUg/aGZ64OnW9fu5epL6eqVc/xc/2Z0/8Aa4f68i/4x/eX5epPxPyRp55xodADoAY39LNIOmWX/Tbi20X0WfertFqryP4H/Ce17Bm/tih1jNNNeKpmWZe7ZvdHcnn04kUkeh/0TNfYVrNkiulfry/UWboizn0lM5zyOqozqs5SSlHtJsKHfDe0VhQvw0dhQ4Y3tCw2hq8c+kW4e0OtEncOgyURWOgnlkRWFDqzAETKRvJZSJddJMmykgoqIisdDhuI7AIpMQwi7xDDJEMc2wG56CZ5MkccXKTpIaVmJ4/tHL8zrhYNpFQ6rlZy9bPdKjyHq+5+6J4Gr1EoRcnyyZF/xh2XrLq/L1Noxv0X5mhnimx0AMhb4kux9X+CyBWuJk45uxbVUq3Gi7utjE7EgK/p931npx0cMmj42O3KLqS9elfT6me5qdMxD6/n5oqVMiyoa1n2U43CSBi6ZS2zMgHRiWIJ6ngI7z1lpdPgtuKfBim/OT8fL9zLdJ/iSm0b7F1XDroutfG1Gu+u6u1g3FaF24zsACd2Q77b9exmf2j7fpMkskUpY2mmvD+WPbskq7hf0bf9nc78M/8A9usn2r/7li/+v5hj+Bmg/Q5/1Pj/APPkf+s04fbn/ez9F+ReH4TazyTUzuIPidSutPOrTkGNSO3xdqLZdZ+IQ1oP+Z53T/wdLGK65Ob/ANq5Jfi7f4Ihc5ehI8X51lWNw0nhyMq2vEx2/YutO3H+6od/3ZGhxRnlufwxTk/RdvxdL8Qm6XIsNL0+vGpqx6hw10oEUdyB1Y+pJ3JPqTMM2WWWcsk+rKSpUSpkM6AHQAxPiS37Ty69Lq+fHx7a8jU7OqKFO6Yo9WYjn6bexnt6OP2LBLVT5SknHGu/PrL0XbxMZe+9q/E9NwMfhXc/U3M+w7Ce37G0D0+Jyn8Uuvkuy/cyyz3PkStp7OxGR5/TggzlcyFEmV6eJDmWoB104Rbx7AqaWIuIPhhl0ke0XEHwwi6WIuIGxCtpoj4gtgwYQEN4bDjhAx7xbATYO0amS4D6q9o2wSLLH2mTNEGYiIZHbaWiWOQCJjQdUEQx4EaQGa8c5VgpTHqY12Zd1WMLFOzViwnjsX3WtXI99p5esyp5lCXOMIubXi18KfldX6lxXK/HkGwsWumtKa1CV1KERB0VQOQnzWTJLJNzm7b5s6EqVINIGdADzz9N2Ej6aLzuLMe5PLYcjtZ8jr+BG38BPb9gZHHU7O0k7/DmjHMvdsgeNKV086DmqhOLg8NNoUblEdE+b8SA/wCJ/GbaGT1K1WFv3p81+F/2FP3dr8BV1FNb1jDsxgzYenV2vbkOrIDbYvJVB9wnX0Y9uZwpaDRZI5fjyNUvJfx/QL3zVdEUejNquDiZejLp1tz3PcqZI4hSqWIELb8PCRsNweIdefSdedaTUZoat5kkqtd+XPxv6ErdFONHp3gfQ2wMDHxXIaytWawrzXzHcuQD3A4tt/afPa/UrUaieRdH09FyN4R2xoubL0UqGdVLHZQzBSx6bAHrOVRk02lZVlH4LO9eYT9Z1TUePfqCMggD/wAIX8tp16/4sfhsh+X7kQ7+o3xceG3SnP0jVKlPsXx71U/xP849FzhnX9D+jiE+q9TRTgLOgB0AMt4o1q5rV0zCI+NtXiuu6pp2Metrf2zv8o/P039XRaXHGD1Wp/y49F3m/D08WZzk72x6mo8H+GacGhKqwdh8xZudl1p+q6w92P8ALlPd0WmyajJ9s1K5/wCmPaK7f2+fV8sZyUVtiaKe4ZHSkxHntOZtORxM1ImV6hIcC95ITURFsHxAo1WTwyuIPXV4cMOIPGsCHDDiIVtXEOGHEQE6nK2E8QemoxbA4gQ5u8Nobxhu3lUTY5bjCgsf57QpBbOFhhQWFS0woaZJryJLiVuDi4RUVZl/HSuK6sqtTYcO+rJNajdnqTiW1VHduB2IHqJ4+qx/+pqTqOWO2+yl1V/jX1NYv3eXYm4eVXdWltbCyuxQ6Op3DKe8+dyY5Y5OE1TXVG6dq0GkDMtr36QdOwrnx7rXF1fDxolVjcPEoYc9tuhB6z0dP7K1OeCnBcn5ozlkinTKzxh4twHxcXfHfU6c9z5FVRK8dtbLsrD6uLiO223UTfRaDURyz97huHVvwf0FOcaXey08Na1kZS3DK09sDHrqUqL28zzVG/ECrINgAB1E59Vp8eFx4WXiSb7cq+rHGTfVUUn6MvGdmddfjvVTj1qgvxEprNfHR5hRiQSdz9PMbdDOv2r7Pjp4RnGTk+krd86snHO3RndOy9f1EZtuPmrWuLfZWtPCiM/DuQoIT0Hc9Z3Zcfs7S8OOTHe5J31/UhOcrpkWjxRlMmna21jstOQ2DqNSMwqbl8t3lj5QTW/PtxKvrNJaLEpZdGkla3Qff0vr1XyFufKRpvDm2qa1k6iDx4mnqMXDYfS9pB4rB69XP7yek8/VXo9DDT9J5Pel6eH5fJmkfenfgW2q4+VhvmXrl4uHh5FyXmy2my++u41JWyInEFYkpuOpO/Sc2GeLPHHB45TnFVSaSq27b5vlY2nG3dIqsfLx0srycwavetbrZXlZlD14VTjpb5NewQc+RZeU6ZY8kovHg4cW+TUXcn5W+v4MlNdXZ6HRcrqrowdHUOjqQyuhG4YEdQRPClFxbjJU0bj5IGd8VeIHoNeJjKLtRyQRRWfopTvkW+iD+e34z0dDo45U82Z7cUOr8X91eb+hnOdcl1LfwT4WTDqJZjdda3m5GQ/15V56ufRRudh/o+3pcT1uRajKqxx+CHav58/RGUnsW1de5q95728xO3hvA7ePeB5ktRmdnPQRajFY6CLWYrAcKjHYCikw3CoXyjDcFDhWYrAItRhYUHSqKx0HSuTZSRISuKyqJCVRWOg60ydxW0eKIbh7R3w8Nwtoooj3BtHCswsdCmrflMs2OGWDhNWmNNp2jDahQ2kXteoJ0y9+LJrUf0C5jzyUH9U3317H5vWeLn07zf4E/wDNivcf34/df9S7fLwNoyrmunfyNMrggEEEEAgg7gg9CD3E8Fpp0zc8h1nxMmna1q9z02ZAfFxq9kA4FJqq281j9Kk7DfY9Z9Pg0b1Wh08VJRqTfn1fTzOdy2zkVOTpOTjY3h5ENYyrcy2+niPHSllr1GoEjfcbcJO2/UzphnxZcurcr2qKT8eSdktNKJsPEuTqWHpWoW519Nz3V14+OmOhQVtYSj89gT8rb/uzy9LDS59Xijgi0k23fO65r6/maS3KLsyWgamcfUdFsONk4la0Jp1r5FTVpkM/F8y7jpx2BvyE9PU4Vl02ojvjN3vVO2q/sqM4upRLT9H3iTEwadVa+5K3+NtdKiw823YEAKvU8+W85vaejzaieBY4traufZfiVCSinZ3hHS9vDOe1q7jIXLyUDDpwVqEcfvVbj8Ia3PftTEoP4dq+b5/RhFf4bs1H6Ha1Gj4xAALvkMxH3m8513P5KB+U872429bO+1fkjTF8JZV1DJ1S0v8AMmnU0ChD9IycgM7XbftBFVQe3E0wb4Wkjt65G7flHkl8+b/AfWXoaIjfcHmCNiDzBHoZwFmb8DJ5aZmOv6nF1HKpx/Raflfyx7Kzsv5Tv9oPdLHkfxShFv16X+KVmePuiV4p8QLh1oFQ35eQ3l4mKv132+vsg6k9pOh0T1Mm29sI85S7Jfu+yHOe31DeCfC7UceTkN52bkkNk3die1NfpWvT32/h7GPGtbKNR24IfDH73m/1+XiZN7PVmynuWZHQsR0AFjAyw0w+ky4hGweNNPpFxA2jxpp9Ibw2C/Zx9Ibw2CHAPpDeGwYcM+kN4bThiGG8W0IuIfSG8e0KuEfSG8e0MuEYt4bQq4cW4e0MuLCx0EFQisoeEjXMB20dCO2hQHR8gFhyAFk462KUYAgggggEEEbEEdx7TDU6eGeG1un2fg/EqMqZ5/RxaTeMWwk6bc4XFtbc/AXMf6M7f1TH6GPTmp7TxdTgep3Nqs0PiX3195efj49etmsXt9H9BlHhRm1HUsm7y3xc/GqxxWC3mbCtFbiG2w+k7bH0nPLXJabDjhalBt326srZ7zb7lF/s1yWoxqDn+X8Dk324li0l7K6WZSi8XEvMFeL2LbdBOz/rGJZJz4V70lJXyb79mRwnS59CZ/s2NhX4nUczKVbEsNdjDy2ZDuOTcW3fp6zL/rG2+FijHlVrrz+RXC8WanxBoGPnLWl4Yim1bqyjlGWwAgcx25/yE87TarJp23j7qnfPkXKKl1Kmr9HWkhzYcUWOzFybbLbAWJ3JILbfynS/a+scdu+l5JL9CeFHwNK2MhTyiimrh4PL4RweXttw8PTbbltPP3yUt18+t9zShcfHStQlaLWg32RFCKNzudgOUUpym7k7YVRn9Yovxsr4+ipslLKUozMasqLmVCTXfUDsGZeJlK78weXSd2CWPLi4GSW1p3Fvpz6p+T62RK07Qy3xNfcDXh4WV57DYWZtD4uNQf2nL822/ZXcn2jjoseN7s2SO3wi1Jv0rp6sW9voh7306Ngr5jNc/Eeg/wB9n51rFm4V/aZieXYfhCOPJ7Q1D2ravpGK8fRfMLUI8w3g3w5a1jahm7HNuUDhHNMKjqMav3/aP+j6UccdTWDDywQfN95vx/nRfhUXt959X9DdDYDboBPbThCKjHkkY82Buy0XqZLy+A6I41aonbeLisORLquDdDvLjlXcVBd5tuQqK46jUO4nm7yxg1Ss94bxEqrIVuhEFkXcdBC4lPJEKBm9fUSHkAUMp9IuIgodsI1OIUKNpSnEKF3Ee+IUJxiHFiKhpvUdx/GHGQA3zax94Q4ouRBu12tTtvDc2FoJRrFbd9oLI0Fo67Wa17w4jYWiDb4iHbaFsneR28R+8LFvOXxEYWPcSatbYxbx2JqDVZVT03IHrsUo6kcmU9R/rpOXURc6nB1OPNP+di4yrk+hntEzLMO5dOyXNiNv9nZb9cioD+j2H+uX/wAw277zzNXhjng9RiVNfHHwf3l/S/o/I2i691/gaeeUanQA6AHQA6AHRAdACHq+p04lL5FzBKqxuSepPZVHdj0Am2n0+TPkWPGrbFKSirZmtFxHuuXVM5eC0gjAxG/7jjt95h/WsNtz26ew9pxW16PTP3V8c/vPwXku3z9cbr3pdeyNousIF5DoOQnfjSxxUI8kjNu+ZT6j4kI5CbJWS5GdzNfdu/8AOaKBO4j0amd9+KDQrNFpetHluZnJUWmafG1AMJnvaLqzy0as5+9K20TQerPb9qS0KizxdYZe8ycSkHv11yOsSiDZDTV33+qaUieZPp1qwDrIcUx8xX8SOO5jWNBbE/8A6R/Uw4aJ3Ma/iCw9zGoIVsGdasPcx7UK2BfVLD94x0hcyNdnWEdTKVCplZZdaT1mtoKZY4TvtzMxnJDpkrgY9yZHEDaw9WETIeah7A32cfSRx0UsYejTCT0kS1CKWMt8fAA9Ji9QWoE1KEEh52PaQtf0WrLoah9wDsVdDw2VWDmtqN2ZTzBmfGljyLLj+JduzXdP1KSTVMpfDuq2h2wMsj4ypeJLQOFM/GHIXoOzdmXsfaY6vTwcVqMHwPqu8X4Py8H3RUJP4X1NBPONDoAdADogOgALLyq6a3tsYV11qXd2Oyqo6ky8eOWSShBW30Qm65sxmMGz7F1PJQriUni0zDbkbW7Zdq+pH0g9Bz/H3HH7PF6TA/fl/mS8P6V+vi/pi3fvPp2QmTfbY5sc8z2HRR2A9p3YYQxQUIdDnk3J2zmynA7zVUIz+pNYSeZ2nTBoRUEWb9TNrQUGp8wSW0MtdPyrAeczkkBrtO1fYbTknA1izyxNQPrPSeJEWSatUPrIeEdkyrVfeZPCOySmpyHhCwteesl42OySuePWRw2A5Lwe8TTQEtLkmbUh0h6unrF7wqQ8WLFzCkJ5qw5hSHC1IuYUjjw9do7YUg9LqJErHROpsX2mMrKSJtVo9pi7K5EyplPcTFtlJIkoQO8htjpDnb0MlMKIzO2/Wa2qEHrczNsZV+I9IXLrUK5oyaW8zFyV+vHvHQ+6noy9wZWHM8E3Kt0ZcpR7Nfv4PsxSVoZ4c1prw9NyinOxtlyaQeXP6bqz96tuoPbpMdZpVianje7HL4X+j80OEr5PqXU4izogOgAjuFBYkAAEkk7AAdST2EaTbpAYkn7XsF1m66Pj2b1IeX2pkKeVjDr5KkHYfePX29yMXoY8OHPPJc39xPt/ufd9jFvfzfT8y7yLuM7kchyA7KPSLFjWKNImTsCaVPabb2TQhwlPaHFaDaR7tJrM0WokGxFbk6QoPITeOobHtB/ZyiXxrIcSHkYxB5GaxnZDQTGVu0UpIaPOhPVJHBogCrbJoYQZB9YtoDlyj6xbAsMmYZLgOySmd7yHjCyRXqHvIeIdkuvUPeZvEOyQueDM+EFiNnD1j4YWErzAeW8TxgSUt37zNxGHRjIaAlV3MJm4oaZKrytusycPAdhTqYHpJ4DY9werV/aZy049xNq1VTMZadlKaJIz0PpM+FIrcg9eakh45Dsc1lZ5xJSDkUfiHSzea8nGYVahjAmhz9N9fVsa31Rv5HmJtgyrCnjyq8U+q8H2kvNfXoTJXzXUneH9ZTLq4wDXbWxryKH/AFmPePqRv8Qe42nHq9LLTz2t2nzTXRrxX85FRluRZzlKOgBi8+5tWtfHRimlY78OZepKnPtU/wBGrI/4YP1MOvQT28MFoYLJJXml8K+6vvPz8F26mLe/l2LTKP0qoCVVqFrrUAKigbAAD2hhhttvnJ9X4ikyOts3aJsILZNDHrdFQBVuU8uUlpoY80gyd7QxDiLGsjFtRDt0tTNo52iXA6vT1WU8zYtp4+9Bn0KkZUNFMe4KGskdgN4THYjtjABNzAB62GKgHC0xUARcg+sTiAYZR9ZOwBjZZ9Y9iCxVziO8OGgskVaqR3kPDZW4nVa37zJ6cNxYU6yvrMZadj3Bjqw9ZHAHuB/aG/eVwqFZJx8vbuCJnLGNMmJnTN4wsJ8f7yeEOxa9RI7xPCCkH+1PeRwCtwM6qd+pB6ggx/Z010FuH3F3s+0cQf8ATalC5eMCFXUsUf8A2L91vbboROZwjCP2bP8A5cvhl9yX7Puvx6lp37y6/maHS/E2Hk1+Yl9a7fXXa61W0sOqOjHdSJ5mfQajDLbKD8mlafmmjRTiyj1TVzqLth4lnBiJudQ1FTsiV98eh+jOe7DkBO7Bplo4rNnjc38EO9/ekvBdl3ZEpbuS6d2Hx9Sx0RKKAtePSAlaLy5Dv+fXnz5+s1Wmy7nky85y6sW9dF0D/EBhHsaFYz5ZXMQ9awZLbQUJdgnbcQjl58worrMewdN50KcWTTJmI9oExmoMasltksB7zNQRVkZ88iarEidwF9UA7S1hDcYxtPnp8QVAHwtu0pTFREsw5opioAcaXvFQNsePcKgLUyrEd5ENwCeVHYCGqFgN2jAQrCwGmMQJ32joBK7INASFt2k0AVcg+sW0AgyzFsGFXPI7yXjCwy6ifWS8SCwg1L3i4QWOGpe8XCQWOGpn1i4KHY9dSieILJOHq7VutiHhZTuD/kfUTLJpo5IuMlaY1KnZb53ifSbB52ZgK924VnWim0ud9h8zEE/gek5I+ydfiSWnzVF9rar8EmvkacaD+Jcyo1zxd8TUKMeoYmGjbCpQql+HpuqfKo3+6N/X8N9N7M+z5Hkyy35H3/8APP8AEiWXcqXJFViZJB6kTtnBEJl9jamwHWcksKKsSzWnB6/zgtOgslYHiBt+fSZ5NKuw1I0uFr1ZHP8Axnn5NLLsaKZYJm0P2EwePJErcmGU19pL3dx8gd4T1G8qO4pQsrrKgZ1RbNFiTKzMr5zpgzKeOiq80ETXaZWNZxHQiPYV9JasCJaqmaJsQBqhKsRGsq9JakKgTSgBEmUIY1kdCGFhHQDWYR0ICzSgBuu8YDUBEYBeKIBpeFCG+bChjTbHQHDIhQUL8TCgHrcTFQg1auekKAmUYNjSXSAnpplgHOZuSGW3ibwhwafTlBv1ho4l9GZlH+c9DHzivQlmb+FNRes8+F2nNnXvsa6CGwCY7RifHbd4uGFke/MPrLUAsHXnMO8bgmBYY+qsO8ylhTHZZ068w7zCWmTHZY4/iMzCWlRcWSG18nvIWlo6osJRqxPeDw0bKQDJ1HfvNI4znySKT4udGw5rH/FRbAsQ5BhsCzi8dADNu0dBYN7t49orBcQMqmATyge8VjI99AlJiaIrptLJAPLQA2BjEBNu0dAd8QIUAxsiOgoj2ZEY6BjKhQCNkwAA2VHQx9eVCgJ2NeIhMu8HIUSZIRdUapWsxeNsLCW68npJWELNx4ms4tBxG/aOIf42JPQxKkl5EvoeZa1cBfcP7w/4CZZl74LoVtj7zNIYEKYwDpiEyXJIdB00smRxEPaO+zG9IcRD2EnH0lyeQkyyxRSgy1x9BfqROeWeJtHEyYmiN6SHmRsoA3xSse6yJciK6S0zCTs//9k=
  1. Set mandatory pre-workTo make the most of 2-hours together, you need to set pre-work. As you determine success outcomes – you’ll naturally uncover the most relevant topic areas (competitor analysis, market/economy, customer success, etc.). Two-three pages of pre-reading for each area is recommended. Summarize each of main points:  clearly list market & customer insights that are most critical to the discussion, articulate each of the major problems that need to be addressed. Write these down  in a paragraph or two, providing key data and backup links for anyone wanting to dive deeper means that everyone coming to the sessions is prepared. You can send all the pre-work together a week before your session, or set your sessions to be 3 hours, with the 3rd hour individual time for the team member to do the pre-work each day. This isn’t easy – but it’s invaluable for having great sessions. And we recommend asking people not to attend if they haven’t done the pre-work, don’t let your sessions devolve into opinion-sharing. Keep discussions focused on facts/data.
  1. Assign Champions. Share the workload and assign champion to each of the major sections of work. This is a great opportunity to highlight your team, or to even ask important peers at your strategy sessions to lead. When you engage others in leading the pre-work research, or summarizing the data points – you take the burden off being the sole facilitator, and all the research coming from one voice. You want everyone at these sessions to feel ownership over the strategy that’s developed, and one of the best ways we’ve seen to achieve this, is by starting with ownership right from the start.
How to Lead Better Virtual Meetings - Duarte
  1. Write down assumptions. When doing the pre-reading, have the team write down their assumptions. This way, each team member is coming in prepared with a set of notes that lend themselves to a discussion. The pre-reading is not just for information, but to help form product strategies (remember #1, outcomes!). The reason we recommend this approach is that it helps provide the rationale for the opinion.  It’s much easier to invalidate a stated assumption, rather than argue opinions. We really don’t like opinion-based discussions if that isn’t already obvious. When the team can’t readily invalidate an assumption – this can easily be turned into a hypothesis that can be tested after the meeting. We know exactly what information we need to help us make sense of the data.
  1. Address the elephants. Don’t bury bad news in the pre-reading or avoid it altogether. Some of the teams we’re working with are losing their funding, others have seen their customers disappear or put purchase decisions on an indefinite hold. This is critical information, and it’s not business-as-usual. You want the most out of these strategy sessions – you want your teams to armed with all the data. The impact of the elephants are pretty significant in terms of how the company will respond – perhaps the growth targets have doubled, or the retention goal has increased significantly. Make sure the pre-reading provides the “why” and the context – and don’t avoid those big, hard problems.
3 lessons learned when developing a new product with the Minimum ...
  1. Standalone Ideation. It’s really easy for each of these 2-hr strategy sessions to devolve into ideation sessions. Once people have their pre-reading done, and they understand what the business is trying to achieve – they’ll want to solve problems – it’s natural. We’re all full of product ideas, and asking people not to share them can be painful (and derailing). But you don’t want to continually talk solutions before you get a full understanding of all the areas that need to be reviewed. We suggest having a shared whiteboard to capture all the ideas generated. Don’t have this as a shared screen, you don’t want it visible and distracting – you just want a place where people know that they can add their ideas/solutions. Once you’ve finished the information sessions, you can move into ideation for product strategies. This is towards the end, and a 2-hr focused session on strategy ideation is ideal. Having your list of whiteboard ideas is a perfect input for this. Your team can self-select which ideas move forward, and which go away now that they are fully armed with all the background.
  1. Small Discussions. We design our strategy sessions to be about 5 minutes together as a large team, then 15–20 minute sessions with a small team. By small team, we mean about 3–4 people, a group where everyone has a voice. We move in and out of this format — so that we’re constantly regrouping, sharing updates, and then going back into real discussions. Consider if you want random groups so that different people are constantly reviewing data. This is good when you have a close working team, and the groupings are less important. Perhaps you want to deliberately create cross-functional breakouts if you have invited others in the company — you’ll want to design each small groups to have a voice from all the functions that are represented. This is an important part of pre-planning, looking closely at putting the right people together.
  2. Document Collaboration is a must. Zoom, or teams, or whatever video software you use is insufficient. You want to be virtually around a working board where the pre-reading is loaded, the assumptions are listed – everyone can see and have access to the documents and be able to write their own thoughts/comments. We have been using the in-built notepad on zoom, and then Mural to share all documents. We pre-build our boards with stickies – color-coding for teams, and sometimes individuals – so that we can make sense of all the notes at the end of the session. Avoid a facilitator writing down other people’s ideas – it’s nowhere near as effective as enabling everyone to have control over exactly what and how much they contribute.
No! No! Not Another PowerPoint! (BoomerBlix)
  1. Lose the PowerPoints. Hopefully this goes without saying given the first 8 tips – we want the strategy sessions to be all about working together, discussions and making decisions. Feel free to create PowerPoints for pre-reading if that fits with your company culture. But by no means spend any time (not even 1 minute) sharing a PowerPoint deck. You’ll set the tone and expectation for this session if you avoid PowerPoints altogether. Let’s be clear – we’re still asking you to make sure that everyone understands the pre-reading. You should still start each session by recapping or highlighting the relevant facts, check in for understanding and questions and then jump into the assumptions that people have written down. Work through the data in a structured way. We just don’t want you reading slides!
Zoom party tips: Virtual hangout ideas for a fun night in - Los ...
Celebrate!

Bonus tip!: Don’t lose the happy hour. Last, consider how you can celebrate together at the end of the strategy session. Maybe it’s a separate hour after every session is complete – but it’s important to acknowledge the end of this hard work. Here are some ideas that we’ve experienced or seen work. Send everyone a bottle of wine, or their favorite beverage a few days in advance, so you can open it all together at the end of the session. It’s always fun getting a surprise in the mail! I took part in a chocolate tasting by an expert a few weeks ago – I was sent a package of 4 bars (yes, it was hard not opening those) and couldn’t wait for the event. It turned out to be a really fun experience, as we all opened packets and tasted together while the expert shared the history and taste notes of each bar. A month earlier, I was part of a sommelier experience, and the prep for that was to bring in the bottle of wine that you’d always been saving for a special occasion – so the only company expense was providing the expert. Hopefully these ideas get your creative juices flowing – whatever you do, mark the end of the session with something fun and a way to connect and have a shared experience.

Agile is GREAT, but…

Agile is great, but…

Agile is awesome. Nearly every Product Manager we know would agree. But I bet you’d be surprised by how many conversations we have with product leaders around their questions, issues and sometimes not-so-stellar experience with agile development. Questions & comments like:

  • Our product managers/owners feel constantly overwhelmed working day-day with dev, we have no time for innovation!
  • Anyone else have confusion over roles within their agile teams, or is it just us?
  • How are others dealing with technical debt, our seems to just keep growing…
  • Do you need to have both product managers and product owners?
  • We can’t expect our product owners to also be strategic…can we?

Agile is so clear about roles, and ceremonies. Backlogs are groomed continuously to focus on the highest priority. Customer Value is built right into the manifesto. So, why are there so many “we love agile, but…” conversations in the product management community. What’s going wrong? We have a hypothesis on why this is happening, and a proposal for a universal fix across all agile teams. Let’s start with three assumptions that we have about how we believe products should be built.

  1. Before you build…You know what is important to customers. There’s a loaded sentence. We built an entire business helping companies get this right. Anyone can create epics and sets of user stories — that’s easy. That’s how exploding backlogs happen. Because it’s just so easy to create work, and agile is a well-oiled machine designed to keep churning out work in tidy increments. But, as we all know, outcomes aren’t equal to effort. And meaningful business outcomes are those that prove we’re providing value — because customers buy and continue to invest in the products we deliver. All that comes from deeply understanding your customer.
  2. Before you build…You can define the customer problem. That doesn’t mean being able to describe all the incredible features you’re building. It does mean being able to state the customer problem that exists, independent of your product ever being launched in the world. That means, there are lots of ways to potentially solve the problem, but you (team, company), are uniquely positioned to deliver a solution that will win in the market. And btw, the problem should be a big enough pain that the customer is willing to pay to make it go away. When you can do this, you know you’ve got an important problem to solve.
  3. Before you build…You have a vision and a roadmap. A roadmap is not a rolling collection of features — it’s a clear, well-thought out, logical and prioritized map to achieve a vision. Having a vision is what allows you to make tough trade-off decisions, and it’s what keeps the team (and you) energized and motivated to make it happen through all the ups & downs of development. Having a vision starts with #1 & #2 above — knowing what’s important to the customer and what problem you’re solving.

If you buy into these assumptions — then let’s talk about how you can leverage them to make a big impact on how well agile can work for you. This is based on years of experience working as a product leader with with dozens of agile teams, and from our coaching practice improving the ways that product managers and product owners can succeed working within agile development.

You have to know where you’re going. Remember the bad old days of waterfall development? If you don’t, lucky you! For those of you who shuddered when we asked the question — you had flashbacks of writing massive requirements documents. But, the one (and maybe only) good thing was that it forced you to think about where you were going. You had to think about the big picture before you could break it down to endless requirements and (depressingly) writing down every possible exception. We’re not suggesting for a second we go back to the dark ages. However, what we’ve missed in our head-first dive into agile is providing the team with the big picture in a way that’s meaningful. That doesn’t mean one flashy PowerPoint slide of a vision, or some high-level product mockups which makes your CEO happy. We’re talking about providing a real schematic that offers a picture of where you’re going, and enough details that allow the teams working with you to ask great questions, offer alternatives and help improve the overall solution.

Let’s say you were giving the job of building a house, your first step probably wouldn’t have been to assemble a building crew, and say to the foreperson — we’re going to get started and build a room at a time. Let’s see where end up! Before you had a team start to pour concrete, or put up framing, you would have worked with an architect to create a plan. The inputs to that plan are customer needs. Imagine a home for a young couple, mobile, working from home, wants amenities/access such as pool/gym…and then think about a family with 4 kids, one member is in a wheel-chair, they entertain a lot, generally home-bodies. Very different needs, very different home. Your understanding of how the home would be used, the people who live inside, what they would do within their home — all of these are critical elements in understanding the type of building we’d create. We don’t expect a building crew to start building without a plan — and the opportunity to ask questions, and maybe suggest some changes that would make it cheaper to build, or offer additional value elements for the same price. Because they understand what you’re asking them to build — they can have a voice.

The same is true for a product — we need a picture of our customer, what she cares about, her habits and attitudes — and through understanding this, we enable our teams to imagine a real person that we’re building our product for. A product manager’s job is to provide this picture. Agile wants you to know these things -it really does. It just doesn’t give you any time to make it happen. If you forgive agile for not building in a ceremony just for product management, then it changes the way you will look at your development cycle. The way to coach teams to provide this critical information is to develop and share a Product Scope. A Product Scope gives the schematic, the plan for what you’re planning to build, it provides a picture to the team so they can imagine it. They can then connect with you on the plumbing, the electrics, they may even suggest shifting rooms around, or describing a completely different approach which you never imagined. This will happen because you have everyone on the same page, then…you can begin Sprint 0, start planning and happily create epics and write user stories. You all know where you’re going.

Having a Product Scope will change your experience with Agile

We’ll talk more about how to create a Product Scope in a follow-up post and the product work needed before sprint planning. We’ll give you a hint — writing kick-ass Product Scope documents comes from deep customer understanding, which starts with setting up hypothesis, ideating, prototyping, testing — all with customers.

Before we close, just a couple of extra agile tips for kicks. Spikes are not your friend. A lot of the time, we see customer research being placed on a sprint plan as “research spikes”. A spike, technically is something that is not clear to the team, or can’t be estimated well. The whole purpose is to provide an answer or solution so that the team can get going again. Assigning points to research is meaningless — your entire product success rests on your ability to learn from your customers and build that into every sprint. That’s right — you should be learning from your customer EVERY sprint. That doesn’t mean fitting them into research spikes. btw, spikes aren’t great for the team either, it impacts velocity and timelines and all the things your scrum master cares about. Don’t use them.

Build in Time to Watch Customers. Technically this isn’t an actual way to make agile work for you, but it’s just the very best gift you can give your team. It works whatever development method you’re using. It will change the way your team work. We suggest at the very minimum once a quarter, you should provide a way for your team to spend time watching customers. It will dramatically change the customer value your team delivers.

What other agile and product management tips do you have? Share your comments and thoughts.

Product Decisions in Crisis Mode

Are you feeling an urgency to make immediate changes to your product? Or trying to resist the urge to react to this current crisis? Are leaders in your organization bombarding you with ideas about how you should be responding? We’ve talked to dozens of product managers and product leaders over the past 2-3 weeks and we’ve heard many stories: teams undergoing complete pivots – scrapping all their current work and radically changing what they’re working on responding to immediate customer needs…to pulling up products with launch dates that were 6+ months ahead because they now seem to be much more relevant…to staying the course and adopting a wait-and-see attitude.

Now, more than ever, it seems critical to us that teams have to focus on core product principles to make decisions that aren’t just knee-jerk reactions, but based on real understanding. Before you stop reading because you can’t deal with yet one more thing to have to do…this core work can be done easily and quickly – and we believe can make all the difference. At least take 5 minutes to finish reading this before you completely change what your team works on.

Here’s a quick recap on the three steps that we describe as core foundations:

  1. What problem are you solving? Don’t just throw around new feature or product ideas – identify and discuss the actual customer problem. Get your team on the same page what’s the customer experiencing and why. Write it down so everyone is on the same page.
  2. Who is the customer? Is this a current customer, and if so, what’s changed in their attitudes, ability to pay, access in relation to your product. What do you know, vs what’s a hypothesis that can be tested. If this a potential new customer – how much do you understand them? Create a quick persona and build some empathy so that your solution ideas can be tested, before you start building something new.
  3. Validate with scrappy research. We know it’s hard to get to execs right now if you’re b2b, most leaders are completely unreachable. But think about who you might use as a proxy, test your thinking with someone you know who has a similar position – even if it’s in your own company. If you’re b2c, there’s a lot of people staying-in-place who are easy to access for a quick 10-15 chat – especially if you can offer a small stipend. Even if you contact just 5 customers (or prospects) – at least you’re getting out of your own head and testing your ideas.

We feel so strongly about teams needing to go back to basics that we’re offering up our foundations course for free to all product teams. This online course is less than 3 hours, usually people take this over a week, but you can cram it all into a morning. If you pick just one area to check out – refresh on the problem statement. Making radically different decisions can be justified if you have these basics in place.

Even in this crisis, let’s stay true to solving real customer problems that we understand.

Product Rebels is a product management training and coaching firm run by long term product executives for companies like Intuit and Mitchell International. We have trained over 200 companies small and enterprise level in the skills and frameworks that help product management leaders and product managers deliver kick-ass customer experiences.    We have a passion finding efficient ways of infusing customer insight into everything product teams do in pursuit of experiences that customers love …that drive growth.  Join us in the Product Rebels Community on Facebook or the Product Rebels Community on LinkedIn.

Take a look at our very practical training courses and coaching programs that give you practical tools, frameworks, and support you can use tomorrow in becoming a more effective product leader.  www.productrebels.com

And stay tuned for our new book.  Sign up for updates on our new book “Groundwork. Get Better at Making Better Products”

So you want to move into management?

As I write this, I’m thinking about leading two upcoming discussions on how to move into product management leadership. I’ve promoted dozens of people into senior management roles, and I’ve been thinking about what made them standout as potential managers, and what made them successful. The good news is that being a great product manager trains you already with so many of the skills to move into a management role –  being the face of the team, working with many groups, influencing to get the job done etc. So, what does it take to standout from a bunch of standouts? I want to share some interesting patterns of behavior that we implicitly look for when we have those closed room discussions with HR about who’s going to get that precious manager role. I’m going to assume all the basics are already in place: right tenure, consistent high performer, track record of delivery. If you’ve got all that, then there are some intangible ingredients that I want to shed some light on:

  1. Communicating like you’re already a manager. Often, being a great product manager means that you can communicate really clearly to your teams, and to your customers. This is table stakes. You have to be able to break down a vision into a clear roadmap, and then into workable chunks, and then into specific user stories. Product managers have this down – they know how to communicate what they want their teams to build. They’re also great at talking to customers – listening well, asking great questions, translating what they hear into needs. But being a people manager, and working with other senior leaders, entails taking all those skills and creating a different picture. Often PMs go into a ton of detail, they want to explain the work they’ve done, after all it was a ton of effort. But leaders don’t want to hear those – they want someone who can connect the business goals to the work being done in a way that makes sense. To be promotable, you have to be able to do this – it’s not a skill that execs are patient to see you grow into. If you can’t succinctly explain what you do and why it’s important for the business, you can’t get the right resources for your teams, and you can’t succeed. So spend less time explaining all the details, and more about telling a story, and connecting the dots.
  2. Working the strategy Say/Do. This shows up as how you make decisions, and how much time you spend talking strategy and actually backing up what you do with the bigger picture in mind. Product managers are expected to understand the big picture – it should reflect in their roadmaps and customer documents. But how much do you actually follow this? Someone who has “leader” written all over them is the person who asks great questions about prioritization based on strategy. Who constantly starts backlog meetings (yes, backlog!) with the bigger picture in mind. It’s not just a question of knowing the company strategy & goals, it’s how you bring them to life in the way that you work every-day. Knowing that the person you’re about to promote already “gets it” goes a long way in setting them up for a manager role.
  3. Feedback loops.  People who are going to be good managers ask for feedback. A lot. They ask after meetings, they follow-up with senior leaders, they make a point of understanding how they show up. And then they take that feedback, try something new, and then ask for more feedback. You’d be surprised how little people do this. They wait passively for 1-1’s or monthly meetings – or even, worse, their annual performance reviews. When you can see someone is actively understanding how they show up, and are genuinely interested in improving themselves – you know that they will help others do the same – which is what you want in a people manager.

Do you still want to be a manager? Are you doing these things? We want to hear – write to us and share your stories of promotion, or trying to get promoted.

Defining the PM job

We see this picture of PM  in the middle of UX, Tech and Business a lot:

From Mind The Product (https://www.mindtheproduct.com/2011/10/what-exactly-is-a-product-manager/)

We use this graphic as well – it’s been a nice, introductory way to speak at a high-level about the product management function, and it highlights the importance of partnering with these three important peer functions. Product management works with business leaders/marketing teams, engineering teams and UX teams. They sit in the middle often translating from one to the other. But we’ve found this picture hasn’t been sufficient to talk about what the actual day-day job of a product manager should be. When you introduce a graphic that describes the function as this small overlap of a venn diagram – it discounts the sheer amount of work and knowledge that’s required to actually do the job.

So, we came up with a new graphic:

 

This may not be the best drawn diagram, but we want to introduce it as a better way to talk about how a product manager should approach their job. We think this is far more representative of the actual  work that we all do on a year-round basis.

The outer circle goes to business. The product manager has to start with a broad and deep understanding and translating company vision, strategy and business objectives. These are the guardrails of our thinking – and we always need to go back to making sure that the decisions and tradeoffs we make are the right call for the business, industry and environment that we work in. We’ve seen lots of features go into products that customers ignore because they don’t make sense with what the business and the customer is trying to achieve.

The next inner circle is technology. This goes beyond partnering with the engineering or development team. The product manager doesn’t (often) code, but they (should) understand what the technology can/cannot do, understand the technical architecture and be able to ask the right questions, and have an engaged and knowledgeable discussion about alternatives. Without getting deep into the technology, the product manager is at the mercy of whatever technical recommendation is made. We’ve seen far too many product leaders and teams fail because they didn’t ask the right technical questions, because they weren’t prepared and didn’t dig deep enough. Technology is a core part of the job – better get used to getting into the details.

The core of the job is customer. Every part of the job is customer-driven. Whether that’s considering the product roadmap (what’s important to the customer), writing user stories (customer needs), doing customer research (talking to customers) – we could go on and on. Every single piece of work that’s produced is with the customer at heart. The product manager represents the customer at the table – they advocate for the customer, deeply understand their needs and ultimately make product decisions with the customer first, with the optimal technology and meeting business objectives.

When you look at product management this way – we believe you get a sense of how the pieces fit together and a better understanding of the expectations of the job. This isn’t a job for sissies!

Let us know what you think! We’d love to get your comments here, or send an email to vidya@productrebels.com and tell us how you see the PM job.

You want a resolution that guarantees results?

Now that it’s a few weeks past New Year, and we’re back heads-down hard at work – let’s sneak in a new year’s resolution that will make a real difference. Commit to talking to your customers at least once a month. That might not seem like a lot to those of you who are planning customer interviews weekly, building them into your sprints and calendars. However, for many of you, we know months can go by without reaching out. We’ve worked with a lot of company’s last year – some large and some in very early stages, and we’ve been shocked at how many don’t talk with customers regularly. It doesn’t matter how established the company, the attitude towards interacting with customers, getting their feedback and acting on what you learn is a habit that’s formed and established by the product leader. If the discipline isn’t introduced, then customer interaction doesn’t regularly happen and acting on customer feedback becomes an ad-hoc activity, usually something to consider when things go very wrong. The start of the new year is a great time to hit refresh and think about how you’d like to establish new important habits. For your product and team, there’s nothing that will make more of a difference than creating a new practice around regular customer interaction. Whether you’re testing a new idea, building a prototype, or launching a new feature – make sure that a customer test gets built in. Put it into your planning, write it into your calendar, make this a resolution that you can commit to.