Idea Management Systems in principle are about gathering ideas but also about judging their value and identifying their characteristics in relation to the organisation. In the following page we discuss a lightweight model for classifying ideas and a methodology in which those characteristics can be automatically transformed into metrics that aid idea assessment and knowledge management in Idea Management Systems.

Gi2MO Metrics derived from annotations with Gi2MO Types taxonomy.

1. Introduction
Usually the Idea Assessment phase gets down to providing ratings for predefined metrics and filling evaluation forms by moderator or designated staff with expert knowledge.

Although ideas supplied with such assessment data can be analysed from many angles and filtered out quite well, the problem is that the assessment process requires a lot of effort in terms of both time consumption and human resources allocation.

In Gi2MO project, we have been working on a universal taxonomy for annotation of ideas that would require less expert knowledge and would derive more from idea text rather than specialistic market, product and organisation knowledge. We identify the presented taxonomy as a supplementary tool to currently existing idea metrics and assessment processes.

The main principle and difference of our approach is that ideas are being only classified as opposed to rated. The annotator fulfils the role of judging the facts related to the idea rather than assessing the value of ideas.

This simplification allows to facilitate faster manual annotation and adds to possibility for automatic annotation of ideas with their characteristics because in many cases the annotations can can be inferred from idea text.

2. Idea Characteristics Taxonomy

The taxonomy proposed by us is composed out of four main pillars:

  • idea trigger
  • innovation description
  • proposal type
  • described object

The point of the taxonomy is to define a number of terms which can be applied as idea annotations either manually by idea reviewers or automatically using annotation algorithms.

Idea annotation with the Gi2MO Types taxonomy.

For a full list of all taxonomy terms and an explanation of each please refer to the Gi2MO Types taxonomy specification. Additionally, if you would like to use Gi2MO Types together with our open-source Idea Management System, please see a how-to posted on our blog.

3. Deriving Idea Metrics from Characteristics

While idea characteristics can be a useful way to quickly identify a single idea, it is still quite difficult to analyze many ideas in huge instances with thousands of users. In order to ease the idea comparison we designed metrics that can be automatically generated based on with characteristic annotations that an idea has or doesn’t have.

Gi2MO Metrics visualized on a radar chart.

In addition, the same metrics can be calculated for idea subsets (for example Idea Contests) or for entire Idea Management Systems. The summarized statistics can deliver information on the behavior of the community and tell the idea contest managers how innovators react to new contests.

Taxonomy Branch Metric Name Explanation Scale Max. Scale Min.
Idea/ Idea Completeness How well do the users describe the context of their ideas. Calculated by the amount of taxonomy branches that were covered by an average idea. 1 = complete (has all 14 subtrees) 0 = incomplete ( impossible to describe any taxonomy branch)
Derived From Idea Trigger Annotations
Trigger/ Observation Type Trigger Experience Completeness How complete was the experience with the triggering object 1 = full but could be extended (potential opportunity) 0 = something missing (lack of feature)
Trigger/ Creativity Origin Trigger Situational Dependence How much is the trigger dependence on occurrence of some particular event 1 = dependent (event) 0 = independent (object interaction)
Trigger/ Associated Object Trigger Relatedness How closely related are the object of innovation and the object that triggered the idea 1 = exactly the same (object of innovation) 0 = unrelated (Other Obj, Unrelated, Other Party Offering)
Derived From Idea Innovation Annotations
Innovation/ Dependence Idea Dependability How much is the idea connected to other ideas (how much does it change influence other) 1= high (proceeds) 0= low (non)
Innovation/ Target Audience Idea Adaptiveness How much are the ideas ment for new markets and how much for existing ones 1 = adaptive (existing audience) 0= shifted market, small adaptivness (new audience)
Innovation/ Originality Idea Originality How original is the idea 1 = new (new) 0 = not original at all (none)
Innovation/ Related to Idea Originality Scope How far does the originiality of the idea reach. Is it only the particular element of the organisation, entire organisation or the entire market ? 1 = broad (global market) 0 = narrow (organisation, product)
Derived From Idea Proposal Type Annotations
Proposal Type Community Cooperativeness How well do users formulate and communicate their ideas and the implementation of ideas. 1= rich descriptions (solutions) 0=small descriptions (issue reports)
Derived From Idea Object Annotations
Object/Type Implementation Integrability How tangable is the object of innovation 1= most (product) 0 = least (process)
Object/Type/Product Implementation Applicability Scope How broad is the application of the idea (measured by product offering scope) 1= broad scope (product type) 0=small scope (specific product)
Object/Offering Placement Implementation Constructiveness How much of ideas are creating new products that repleace the old ones and how much are they just improving the old products 1= high (creating new object) 0= low (transforming)
Object/Structure Implementation Scope How much the ideas want to modify of the current state 1= wide scope (complete) 0= narrow scope (characteristics)
Object/History Relationship Implementation Freshness How much are the new ideas related to former products 1= very fresh (all ideas evolutionary) 0= repetitive (regressive ideas)
Object/ Relationships Implementation Dependability How much does the introduction of innovation impact other products 1= high (part of) 0= low (non)
Full list of Gi2MO Metrics derived from annotations with Gi2MO Types taxonomy