FAQ
3D Evaluation – Design
The allocation of a particular criterion to a particular evaluation units characterizes the fact that the criterion is relevant for the unit, and must consequently be evaluated at the unit level. Once the allocation process is complete, all repository items should have been allocated to at least one unit (otherwise that means that the repository was not optimally calibrated during the revision phase, which should be corrected on the program subsequent phase.
Metadata are attributes (aka "tags") that can be associated to individual Repository Excellence criteria. Example of value added usage include: setting criteria level of criticality (high, medium, low) to subsequently guide the weighting process, group criteria by characteristics (as for instance "KPI", "Role" and "Technology" metadata embedded in the Operational Excellence Compass Repository) to subsequently analyze evaluations from different perspectives, group criteria by improvement initiative or working groups, etc.
It depends on the number of units. If less than 5 then you can probably simply use the features available in the "Allocate Criteria to Units" feature. If more than 5 (and especially when using the Evalu+ application for the first time) it is suggested to proceed as follows: 1) Click on the "Export allocation" button, which will automatically generate a table with rows = repository criteria, and columns = units Map the criteria to the units by putting an X (or whichever character you'd like) in the cell located at the intersection between a criterion and a unit ; 4)
No, because this would undermine the integrity of the repository, which is the cornerstone of the whole application.
Within a unit, the weighting should reflect the relative importance of a criterion compared to the other allocated criteria allocated to the unit. Not only does it influence the calculation of the overall unit score, but it also send a clear message to the managers in charge as to what are the primary areas of focus.
Once you have completed the linkages between criteria and unit, you then need to decide who will be in charge of carrying out the evaluation in each unit. The process consists of the following steps: 1) Create your evaluators (either manually or by importing a list from Excel) ; 2) Assign each evaluator to one or more units ; 3) Link the evaluator to one or more criteria allocated in the previous phase to the unit.
Yes, in this case the calculated score will be the arithmetic average of the scores given by each evaluator. Note that by doing this you are actually turning your evaluation into a survey. It is usually not recommended to blend an evaluation with a survey, so if you wish to have multiple evaluators, it is suggested to have them for all criteria in all units.
If you are taking care of the whole evaluation, you are de facto the sole evaluator. If the evaluation runs through multiple units you will need to create yourself as a separate evaluator for each unit.