Inter-Rater Agreement and Cohen's Kappa: When Your Labels Are Opinions

Two radiologists agreed on 92 of 100 scans. Cohen's kappa scores that at 0.16 — barely above chance. When labels are judgment calls, raw percent agreement is the wrong check. Here is the right one.

Raccontata dadev.to