Scoring & Analytics
Score Calculation
How the weighted overall score is calculated from individual competency scores.
Per-Competency Scoring
The scorer evaluates each competency independently:
- Reads the transcript
- Matches candidate responses to the competency's 5-level behavioral anchors
- Assigns a score (1-5) with supporting evidence
Weighted Overall Score
weighted_score = Σ (competency_score × competency_weight) / Σ (competency_weights)Example with 3 competencies:
- Problem Solving: score 4, weight 0.4 → 1.6
- Communication: score 3, weight 0.3 → 0.9
- Ownership: score 5, weight 0.3 → 1.5
- Weighted score: 4.0
The weighted score is recalculated server-side — the AI's self-reported weighted_score is overwritten to prevent manipulation.
Integrity Deductions
If integrity flags were recorded, deductions are applied based on the configured weights per flag type. The integrity-adjusted score is displayed alongside the raw score.
Score Reliability
Current limitations:
- Single-rater reliability only (one AI scorer run per interview)
- No test-retest reliability data yet (planned in Phase 13)
- No inter-rater agreement data (would require human scorer comparison)
These are gaps that validity data collection (Phase 13) will begin to address.