Users versus models: What observation tells us about effectiveness metrics

Moffat, Thomas, Scholer, CIKM 2013

Errata

There is a mistake in Equation 6 on page 3, describing CAP ; the subexpression ri i inside the summations should actually be rj j , in all three places where that subexpression occurs. (Thanks to Ziying Alicia Yang for spotting this.)