KPIs for innovation that go beyond simple R&D budgeting. Use an example of a strategy map for innovation to describe your own strategy for innovations.
- Measuring innovations is a challenge
- Explanatory video
- Innovation funnel and metrics for it
- KPIs for change management
- Strategy map: putting it all together
Measuring Innovations is a Challenge
The Meriam Webster dictionary defines innovation as “the introduction of something new.” In the business context, I like the way Amazon’s CEO Jeff Bezos framed the business vision of innovation:
“Our job is to invent new options that nobody’s ever thought of before and see if customers like them.”
Amazon CEO Jeff Bezos
Before we go ahead, let’s agree that we don’t pretend to measure the creative part of innovation, e.g., we won’t predict here if a certain innovation will be a success or not. What we can do is to make sure that an appropriate innovative environment is created and that the most promising “aha-s” find their way to the commercially successful products.
Why Measure an Innovation?
According to McKinsey innovation is recognized as one of the top three business priorities by 84% of executives.
You might be surprised that the main challenge of innovation is not about generating ideas. The survey data tells the opposite: more than 50% of respondents said that they had some good ideas, but the problem is how to scale and commercialize them – a “robust pipeline” for the innovation ideas is what many organizations want to have.
- The innovation is a priority for many organizations, but it’s not clear how to measure and manage it in an effective way.
Why Old Innovation Metrics Don’t Work
The traditional budgeting approach to measuring innovations doesn’t work. A typical innovation is not a production line that converts ideas into commercial products; it involves many stakeholders, and the measurement efforts should take them into account.
Here are some typical KPIs used for innovation.
- R&D budget or similar budgeting metrics. We cannot expect innovations to happen unless there is a budget for it, or can we? Let’s take any garage-based startup. It would certainly be easier with good funding, but things often happen without any significant investments.
- Metrics like Income from new products or Patents filed might be good to validate certain achievements, but due to their lagging nature, it’s hard to use them in a short-term management loop.
- Metrics that try to quantify the leading part of innovation like Innovative ideas or Number of active projects suggest moving into the right direction (“more ideas -> “more active projects” -> “more income from innovations”), but they don’t suggest a clue to how to get there. The result might be a portfolio of the “innovative projects” that satisfy the annual indicators for innovation, but it doesn’t help an organization to achieve its goals.
Innovation Funnel and Metrics for it
Now, let’s talk about building a measurement and management system for innovations that can address the challenges mentioned above.
A Quick Estimation: Where Are You in the Innovation Landscape?
In the 10 Step KPIs System book, I wrote about the importance of quick estimations. Before building a complex measurement system, let’s find out where we are now and what measurement tool is the most appropriate.
Suggest your team list the hypotheses (innovative ones) that they have tested recently. What situation do you face?
|There were only “boring” ideas.||Probably, you need to look at the list of stakeholders and get more ideas from them.|
|There were some hypotheses, but there was no budget to test/implement them.||Start from basic budgeting metrics.|
|There were some ideas, but they have never been converted into hypotheses and respectively, were never tested.||Look at the innovative process (see more details below). Look at the capabilities of the team. They probably need to pass innovation training first.|
|There were some hypotheses, but they were implemented on a small scale only.||The problem is probably with the sponsorship of the ideas by top managers. We will talk about this below.|
Stakeholders: Who Can Generate Ideas?
Who is involved in the innovations? It’s not just your R&D and Management. Let’s list some of the typical stakeholders and talk about their role in the innovations.
|Stakeholders||Role in the innovations|
|Employees||Generate ideas; make innovations happen|
|Management||Generate ideas; set big goals; allocate resources; lead teams|
|Clients (end-users and internal)||Generate ideas; use the results|
|Business systems||Provide a pipeline for hypothesis testing|
|Culture||Determine the behavior patterns (from ways to grow the idea to document the results)|
|Competitors and Market||The source of competitive and market intelligence ideas|
|Events, networking, books, etc.||Other sources of ideas|
Innovation is Not Just About Listening to the clients
One of the trends in the context of innovation is fanatically focusing on the needs/problems of the clients and building innovation around those needs.
My position on this topic is the following:
- Clients are the stakeholders that help to generate innovative ideas (see the example with Mercadona Co-innovation Centers)
- Clients will finally use and pay for the innovation
- Clients are normally not qualified enough to formulate the innovation hypothesis, but your team is
In this context, it´s appropriate to quote what Henry Ford supposedly said:
“If I had asked my customers what they wanted, they would have said a faster horse.”
Measuring Innovation – the Easy Part
An innovation process exists in any organization. Managers can relatively easily measure the results (lagging part) of the innovations. We can measure:
- Funds spent on innovation
- The number of innovative initiatives that became successful in a certain amount of time
- Revenue generated by innovations
But what about the leading part?
Measuring Innovation – the Hard Part
How can the leading metrics be formulated for the domain of innovations?
- How can we predict that the company will create these innovations?
Let’s formulate the opposite question:
- What is a profile of a company that most likely won’t be able to innovate?
These are the companies where:
- All new ideas are rejected
- The barrier for approving new ideas is too high
- The bureaucracy dominates over common sense
- Where short-term profits are more important than long-term value for the customers
- Where employees are always busy with firefighting and simply don’t have free time to think about something new, and
- Where informational silos limit the exchange of information between the departments
We can go ahead and list more behavior patterns that have negative influence on the innovative potential. My point is that the innovative companies will do exactly the opposite things. Do you need to measure how innovative your company is? Quantify and measure those behavior patterns.
Don’t forget about the stakeholders discussed above:
- Who might suggest an innovation? Employees, partners, clients?
- Are the members of your team using your product or service as end-users?
- How actively can your team experiment?
How Innovative is Your Environment?
The basic metrics might be:
- The number of ideas suggested by the team over a period of time
- The percentage of the ideas turned into experiments
- Dedicated time for the experiments
Where do those ideas come from? What might be the inputs for the innovation?
- Do the members of your team read the books in their domain, visit conferences?
- Can we expect that someone who visited a conference can write down a list of 5 ideas that your team can try later?
That’s easy if someone watched the presentations and networked with colleagues!
Spanish Mercadona is an excellent example of how an effective innovative environment can be organized.
They invest in co-innovation centers, where their “jefes” (the clients) have the opportunity to experience new products. According to the study by Institut Cerdà, the success rate of the products that passed the co-innovation is 82% compared to the industry average 24%.
The success measure, in this case, is defined as:
- Products that stay in the product line after the 1st year, %
This initiative is not a random success, actually, the supermarket chain has a strong innovation strategy that is supported by investment in training of new hires (four weeks of training) and annual training (20 additional hours each year).
See the “Learning and growth” perspective below for the example of how the training initiatives can be aligned with innovation strategy.
Having discussed how the companies innovate (and don’t innovate) we can build an innovation funnel. It will be something like:
- Insight > Idea > Discussion > Experiments > Prototype > Product > Commercial success of failure.
If you ask any entrepreneur about the number of his or her successful projects, you would hear something like 3 of 10 projects fail, 6 of 10 are poor performers, 1 of 10 is where we can achieve excellence. What do these numbers tell us in terms of innovation?
To be able to succeed with 1 project, your team will need to have as many as 9 other projects fail.
And make sure your teams are really trying and not giving away some random projects as failures.
KPIs for Change Management
A particular case of measuring innovations is measurement applied to change management.
The Difference Between Innovation and Change
Let’s discuss the difference between innovation and change first.
|Is primarily focused on…||Unknown/Uncertainty||Known/Certainty|
|It’s about…||Testing hypothesis, e.g. moving from known A to unknown B||Executing plan, e.g. transition (for team and systems) from known A to known B|
|Guided by…||Insights (hopefully related to the mission and strategy) that will become a hypothesis and will eventually be converted into the best practices||Validated best practices that need to be implemented on a larger scale|
|It helps to…||Create something new||Reorganize something that already exists|
|Compared to each other||Innovation is always about change||Change is not necessarily an innovation|
KPIs for Change Management
In contrast to innovation, change is more tangible. We are working in the area of known and are implementing according to the previously tested best practices, such as validated results of innovations.
In simple words, change management is about reproducing previously tested best practices under slightly different conditions (new stakeholders involved, natural changes in the environment, etc.)
We can quantify change management in these phases:
- Phase 1. Preparation phase
- Phase 2. Transition phase
- Phase 3. Outcome phase
KPIs for Phase 1 – Preparation
The main indicator, in this case, is Change readiness, %. The index that can be a combination of:
- Resources availability and allocation, % Use VRIO framework for a formal analysis.
- Systems readiness, % The change might be obvious, but some dependencies might prevent you from starting to work on it.
- Alignment across stakeholders, %. Making sure that stakeholders are on the same page about implementing this change.
- Overall strategy adherence, %. Checking if the suggested change and the way to implement it is aligned with the company’s vision. Ideally, the change initiative should be aligned with a goal on a strategy map, and the goal should be measured by certain metrics.
Let’s take knowledge base improvement as an example. There is an internal knowledge base that customer support specialists use. The change will be about uploading more materials to the knowledge base and involving more support agents.
- In terms of strategy adherence. On our strategy map, we have a goal – Improve customer experience, which is measured by the Customer satisfaction This goal also contributes to the financial goal of Controlling costs.
On the one hand, the updated knowledge base will help customer service specialists to serve clients better as it will include some time-proven response templates and reduce general costs. On the other hand, template-based answers might negatively impact customer satisfaction. We’ll track this metric when analyzing the impact of the change.
KPIs for Phase 2 – Transition
In contrast to innovation (where we deal with a hypothesis), change management is about predictable process. Respectively, we can use process metrics, such as:
- Timeline adherence, %
- Resource usage adherence, %
In most cases, change involves employees and gaining new skills. Respectively, one of the metrics for the transition phase can be:
- Training participation rate, %
In our example:
- We can plan that the whole transition to the updated knowledge base will take 2 months. This gives us a target value for the Timeline adherence
- Once the new knowledge base is released, we have to train all agents to use it. The target for the Training participation rate should be 100%. We plan to achieve this within 2 weeks after the release date.
KPIs for Phase 3 – Outcome
In most cases, change management involves employee training and adjusting certain behaviour patterns. The results of change can be quantified on different levels. For example, on these four:
- Emotional – how your team perceived the change
- Skills – how the qualification of team members changed
- Behaviour – how the actual behaviour of employees changed
- Impact – validate once again, if the change affected overall performance as expected
For the emotional level, we can look at:
- Change awareness, %
- Employee buy-in, % or Change acceptance, %
- Feedback score, %
For the skills level, we can track:
- Qualification level, % (for example, according to the tests relevant to the change)
For the behaviour level, we can look at:
- Change in behaviour, %. For example, after implementation of the internal knowledge base, first line employees are able to answer a higher percentage of questions without escalating them to the engineering team.
For the impact level, we need to track actual business impact:
- Performance improvement or For example, we can confirm that the costs of customer support reduced over a period of time.
Let’s see how we can quantify the results of change for our example:
- We’ll do an internal survey, asking support agents for their opinion about the new knowledge base (emotional level).
- As part of the change training, we’ll do a competence test (skills level).
- Most importantly, we will look at how the actual behaviour of the support agents has changed. For example, we can post random questions and check if/how support agents use the new knowledge base.
- Finally, we’ll plan to review the dynamic of the performance within a quarter to make sure that the new knowledge base actually helps us in cutting costs and improving overall customer satisfaction.
Measurement for Change Management in a Nutshell
Let’s summarize how we can approach measuring a change:
- Change readiness index. Build your change readiness index. Make sure you know the context for the change (a goal on the strategy map), and that context is measurable (by the metrics aligned with the goal). Get the necessary political (stakeholders buy-in) and physical resources.
- Quantify transition phase. As long as change is about moving from known A to known B, the main metrics of the transition phase will be process efficiency. Add training efficiency KPIs if the change implies the need for new skills.
- Validate outcomes. Close the change loop using validation metrics. Makes sure that your team accepted the change emotionally, have the necessary skills, and actually changed their behaviour. The long-term positive impact on performance is implied, but it’s better to track it.
Strategy Map: Putting it All Together
Now, let’s put together all the discussed ideas and create an example/template of a strategy map for innovation.
To achieve financial sustainability (increase market share, increase revenue, cutting costs, developing different revenue sources), an organization needs to innovate for internal clients (business units) and external clients (end users).
What resources do we need to allocate to generate, capture, and test a hypothesis? Here are some possible metrics:
- R&D budget
- Hypothesis testing budget
- Idea generating budget
- Idea testing budget
What return do we expect to get? Here are some possible metrics:
- Royalty income
- Revenue from new projects
Innovation needs to be recognized by the clients (see the Bezos quote in the beginning of the article). We need to create:
- Value for the external clients. What problem of the external clients (end-users) could the innovation solve?
- Value for the internal clients. What problem of the internal clients (business units, partners) could the innovation solve?
How to Measure the Value?
In terms of the measurement, a good question to ask is:
How will the client perceive the value of the new offer?
Is something working faster; or is higher quality provided at a lower cost?
Sometimes, it’s hard to quantify the specific value delivered.
For example, what value does Facebook provide? We can certainly compare the speed of photo publishing to a real-world photo book, but it’s obviously not the major value driver. A great way to socialize or easily contact with your connections might be. If you are interested in this particular example, just search Google for “What problem does Facebook solve?” And I’m sure you’ll find many interesting ideas for the value metrics.
Internal Processes Perspective
To innovate, we need to have certain business processes, such as a pipeline for innovative ideas and resource allocation program:
- How the innovative ideas are generated and collected
- How the ideas are discussed
- How the hypotheses are formulated
- How the hypotheses are tested
- How the successfully tested hypotheses are scaled and implemented
Having this innovation funnel in mind, we can start with conversion rate metrics, e.g., measure the percentage of ideas that move from one level to another:
- Idea to systematic discussion rate, %
- Discussion to hypothesis rate, %
- Hypothesis to tested hypothesis rate, %
- Tested hypothesis to implemented rate, %
Quantifying the process in this way helps to see where the performance bottlenecks are and think about a prevention plan.
Additionally, we can pack these metrics into an “Innovation pipeline index” indicator. The metrics responsible for performance bottlenecks should be counted with a higher weight than those ones responsible for the processes that are running without any issues.
Why Having Metrics for the Process is Not Enough
The metrics for the innovation process are generally well-accepted by the team, but in many cases, this doesn’t give any impulse towards coming up with new interesting ideas. There are two reasons for that:
- The idea pool is still limited to the ideas generated by the team.
- The team follows the innovation process formally but does not adopt the new behavior patterns (or if you prefer “culture”) needed for effective innovation.
Try expressing these two goals explicitly on the strategy map.
Goal: Involve stakeholders in idea generation.
- Possible metrics: The number of touch points where the idea can be obtained from the stakeholder.
For example, clients are more likely to share their ideas in a brief survey or during a personal phone call.
The lagging metric might be related to the diversity of ideas sources in general, or you might want to set a specific target to get at least 10 qualified ideas from the clients each month.
Goal: Develop behavior patterns focused on innovation
A regular review of the behavior patterns is a must:
- Instead of describing how you think you innovate, ask some third party to review your innovation process and describe how it is working in practice.
Such reviews will help to find improvement points. From the viewpoint of metrics, we can quantify:
- The number of improvement points found during the review (leading part) and
- Some behavior change metric (faster idea turnaround, less bureaucracy, information silos broken).
Learning and Growth Perspective
Finally, we need to understand the gap between the current capabilities of the team and the capabilities needed to innovate effectively.
- On the management side, the goal might be to spread innovation culture (allow and support experiments).
- On the line-level, the capabilities gap might be addressed by training innovations as a separate discipline.
We have discussed before the ways to track training effectiveness . The metrics could be:
- % of employees who passed training for innovation
- Training engagement index, %
- Minimal training exam score rate, %
- Innovation training behavior change index
From the leadership perspective:
- Training metrics (similar to ones above)
- Innovation engagement and sponsorship index (basic metrics are: time spent on discussing-promoting hypothesis; tools and funds availability)
Building a Strategy Map
Now, we can build a strategy map that would describe an approach of the organization to the innovations.
It’s a good idea to look at the list of the stakeholders and ask a question:
“What business system (and later capabilities) do we need to have to work with this stakeholder effectively?”
For example, “clients” were mentioned as a stakeholder that helps to generate and validate the ideas. What does it mean for the strategy of your organization:
- Is there a good way to get an idea from the customers? Like, for example, properly implemented surveys?
- Is there a quick way to validate new ideas with customers?
- Does your team have enough capabilities to read “between-line” the needs of the client?
High-Level Business Growth and Innovations Framework
Above, we have discussed examples of some specific metrics to track innovation efforts. If you are looking for a more general framework that would help you to organize thoughts about business growth on the high level, then check out the ideas of the McKinsey’s Three Horizons Framework.
A Road Map to Measure Innovations
Here are some thoughts about a road map for innovation measurement.
- Diagnose the current situation in your organization (see the “quick estimation” section).
- Build an innovation pipeline, visualize the way that an innovation passes from the level of idea to the level of commercial product.
- Build a strategy map for innovations in your organization. The one discussed in this article might be a good starting point, but make sure you customize it according to your needs.
- Make sure that the innovation strategy is not a standalone product but is part of a company’s strategy.
How Such Approach Helps
What can we expect from following this disciplined approach to the innovations?
- Understanding readiness for the innovations on the level of business systems and team capabilities.
- The ability to better justify certain activities
- Switching a focus from lagging financial metrics to the leading capabilities and business system metrics.
- Finding performance problems and fixing them at an early stage.
- Filtering innovations that don´t fit the overall strategy.
- Access templates. Sign-up with a free plan at BSC Designer for immediate access to 23 scorecard templates, including Innovations Scorecard discussed in this article.
- Master skills. Check out free video tutorial for the Balanced Scorecard. Master your strategy planning and execution skills with Strategy Execution training.
- Automate. Learn what Balanced Scorecard software is and how it can make your life easier by automating strategy execution, KPIs, and strategy maps.
Do you know an interesting case about measuring and managing innovations? Feel free to share in the comments!
- ^ Innovation and commercialization, 2010: McKinsey Global Survey results
- ^ 10 Step KPI System, Aleksey Savkin, Lulu.com, 2017
- ^ The value of co-innovation, Institut Cerdà
- ^ Training Scorecard: From Exam Scores to KPI Effectiveness, Aleksey Savkin, bscdesigner.com, 2016