The same 8 is not always the same 8
Every scout has their own yardstick. Some give high ratings easily and others rarely go above 7. Until that is visible, comparing reports from two different people means comparing two different scales.
What calibration shows
- Each scout's average rating and their distance from the department's average.
- Who is generous and who is strict, with how many reports behind it so the figure is reliable.
- Disagreements: players seen by several scouts with very different ratings.
Calibration is seen by the sporting director, not by the scout. A scout who knows their bias tends to correct it by hand when rating, and then the figure stops being useful.
