Scores and Ranking

This post covers the scoring and ranking mechanisms for Taloflow evaluations.

Score and Ranking Calculations

Feature Scores

Each product receives an average Feature Score, calculated using:

• Weighted feature ratings (e.g., Great ≈ 3.8× impact of Poor, Good ≈ 3.4×, OK ≈ 2.6×)

• Priority weights (Critical ≈ 5×, Important ≈ 4× compared to Nice to Have)

Users can override these values by customizing weighting schemes.

Requirement & Dimension Scores

• Calculated in the same manner, but in the case of Dimensions use weights (~/100) instead of priorities

• Aggregated based on their underlying features (unless overridden)

A composite score is then calculated as the average of:

• Feature Score

• Requirement Score

• Dimension Score

Ranking Heuristic

Products are ranked using a tiered filtering system:

1. Products that meet all Critical and Important features are ranked first.

2. Then, products that meet all Important, but not all Critical, features.

3. Finally, remaining products.

This enforces threshold logic:

• Products missing a Critical feature cannot outrank any product that satisfies all Critical features, even if their average score is higher.

• The same logic applies to Important features relative to both Critical and Nice to Have.

---

Dimensions and Requirements as Aggregates

• Features are the atomic units of the evaluation.

• Requirements and Dimensions are not scored directly; they aggregate the weighted scores of associated features.

• Any changes to feature ratings or priorities will propagate upward to affect related requirement and dimension scores.

In the Tables tab, you can customize use case priorities, override feature scores, or directly edit dimension/requirement scores.