Are you asking the right questions?

Similar to the Chief Executive (CEO) of a company, a Product Manager should also question the process that goes into the creation of a product / service. Treating the organization like a living and breathing creature, a Product Manager should have in-depth understanding of the workings of its vital organs that are responsible for the following:

  1. Listening to external and internal business related signals
  2. Analyzing  the impact of the data signals collected from external and internal sources
  3. Taking appropriate actions based on impact analysis
  4. Measuring the effectiveness of the actions

If one or more of these vital functions are broken, then the organization cannot function at its peak capacity and may succumb to the dynamic business environment. One of the most critical questions to ask in any situation is…’What does it mean?’ ‘it’ could be an data point or an event or any other external  / internal stimulus. Then look at ‘it’ from different perspectives such as:

  • What does it mean from business perspective?
  • What does it mean from revenue perspective?
  • What does it mean from process perspective?
  • What does it mean from marketing perspective? Etc…

This line of questioning will help in the impact analysis across organization and take appropriate measure to react to the external stimulus.
This article focuses on ‘Listen’ and ‘Analyze’ aspect that has been shown in the virtuous cycle above.

Listening

A Product Manager should tap into and harvest as many sources of information as possible. Getting external business signals is not only a function of number of sources but also the frequencies with these sources are tapped into. It’s the continuous ‘chatter’ that really matters. Collecting information once in a while is not sufficient and may lead to incomplete information. Here are some of the questions that must be asked when validating the data collected from sources of listening

  1. What sources of data collection were used?

a. Internal

  • i. Customer service
  • ii. Marketing
  • iii. Sales, etc

b. External
      • i. Customers
      • ii. Competition
      • iii. Industry experts
      • iv. Company executives
      • v. Partners, etc

  1. How recent is the data?
  2. How frequently was this data collected?
  3. Which systems were leveraged to pull the data from? (e.g CRM)
  4. How many direct customer inputs does this data include?
        • How valuable are these customers to the business?
        • Which revenue and vertical segments do they belong to?
        • How frequently was the data processed and conclusions from that data refreshed?
        • Who has reviewed this data prior to being getting used in the road mapping process?

Inside Out Data Collection

Product Manager doesn’t necessarily have to wait for signals to come from outside. In order to be on the top of the game the Product Manager can also initiate ‘Inside Out’ process for getting the pulse of the market and business environment. For example during the process of building business case for new feature / product or when conceptualizing solution at the time of writing PRD, the Product Manager can reach out to Customers, partners and internal entities.

These are some of the questions that a Product Manager must ask of him / team in order to ensure inside out approach of data collection:

  1. How many customers were involved in PRD process?
  2. How frequently were the customers contacted?
  3. How many of those customers are expected to use the feature / product after it’s rolled out?
  4. How many customers are holding their breath for the feature to be rolled out?
  5. How many prospects are cancelling deals for the feature?
  6. In which revenue and value bands do these Customers fall under?
  7. How the does the actual customer interactions compare with planned customer interactions?

Other entities within the organization that can use the Inside out approach are Marketing and Sales teams. For example Marketing team can involve Customers in the process of creating case studies and white papers.

Analyze Impact (immediate, medium and long term)

Once the data is collected and processed the next critical activity is to analyze the impact of that on the various aspects of the organization. Understanding only the Product impact is not sufficient. A holistic organization impact assessment should be done. The impact assessment questions that follow can be asked to:

  • Assess the impact of external events such as a competitor make announcements or change in industry regulations, etc.
  • Assess the impact of features on roadmap, etc.

The goal is to really get a thorough understanding of the impact of external and internal events on the business.

  1. What is the revenue impact?
  2. What is the customer acquisition impact?
  3. What is the customer relationship impact?
  4. What is the new vertical (market) impact?
  5. What is the impact on strengthening position in the existing verticals?
  6. Impact on brand value of the company?
  7. What is the impact on employee skills acquisition?
  8. What is the marketing impact?
    1. Case study
    2. White paper
    3. References, etc
    4. How does the roadmap help plug competitive gaps?
      1. Fill gap
      2. Create gap
      3. How does the roadmap help displace competition?
      4. How does the roadmap help create though leadership?
      5. How does the roadmap differentiation from the competition?
      6. What Sales and Support changes need to be made?
      7. What Marketing changes need to be made?
      8. What changes need to be made to the Product development plan?

I’m sure most readers can add to this list of questions and make it even richer and actionable for Product Managers.  Remember the path to the right solutions begin by asking the right questions…

About the author

Aditya Bhelande
  • nitish pandey

    i can’t disagree with the questions that these are the questions need to be answered but i doubt if this is practical. I doubt not
    becauase i inherently disagree but for i have limited (nearly 0) expeirence seeing any
    practicing product manager (myself, my team or in my vicinity) go about
    selecting or pruning the roadmap elements after looking at such an
    exhaustive check list. Most work s based on intution, casual fesibility
    study, intense competition copying etc. Each of the decisions answer
    some of these questions in the positive. I am speaking more for massive
    usage online products rather than enterprise product design (CRM etc.). One of the questions is “Does the CEO approve of it?”. 🙂

    Potentially
    this might be a early stage and mature stage phenonmenon too. Early
    stage will have so much ground to cover that no one really cares about
    these questions. How is it at the silicon value?

    • Aditya Bhelande

      Hi! Nitish,

      Thanks! for sharing your thoughts.

      You are spot on when you say that most PMs work on intuition. But, a PM needs to train him/herself in order to develop that intuition, which most of the time comes with practice. Most of the times the questions I have listed are asked by various entities at different stages in the Product development process. The purpose of me listing these questions was three fold:
      1. Make budding PMs aware of the type of questions they might be asked.
      2. Get in the habit of thinking through from various perspectives.
      3. Make the thought process and the process of analysis faster.

      Whether or not they formally document the answers or not, the key is that they should have thought about it. Cause more of than not, PM will find him/herself in a situation where someone, mostly an executive, will say…’didn’t you think about?’

      The other aspect if that it also depends on the type of problem you are trying to solve. If the impact is small then the exercise is not so exhaustive.

      I feel that for Early Stage Startups, it’s even more critical to ask questions and be through, since the resources are scarce and have to be used wisely. Secondly, like you mentioned there’s so much ground to be covered, that you want to ensure that order in which you are covering the ground gets you the biggest bang for the buck.

      BTW, the question ‘Does CEO approve of it’ always applies everywhere, especially in Startups and SMBs 🙂