Evaluation of Recommendation Systems

CP4285 Modern Recommendation Systems — Week 03 QR code for the Week 03 slide deckScan for the slides
soc-n.us/cp4285-t2610-w03

CP4285 Instruction Team

25 Aug 2026

01 Overview

Week 3: Evaluation of Recommendation Systems

This stub will develop offline protocols, ranking metrics, and their limitations.

Learning outcomes

  • Design evaluation protocols.
  • Compute ranking metrics.
  • Critique metric selection.
  • Explain limitations of offline evaluation.

02 Evaluation Design

Offline evaluation protocols

TODO: introduce splits, candidate sets, and leakage safeguards.

Ethics Thread: What metrics omit

Warning

TODO: examine whose outcomes may be invisible in an accuracy-only evaluation.

Summary

🔑 Evaluation choices define what counts as a good recommendation.

Measure TODO
Ranking quality Add metric and interpretation

Next week: neural recommendation models.