Why can't we agree on how to measure agreement? Statisticians spot a widespread blind spot in medical research

Doctors and researchers have been using a popular measuring stick (Cohen's kappa) for decades without realizing it gives misleading answers in certain situations.

This means thousands of studies claiming agreement between doctors on diagnoses might be overstating confidence — and we need to be more careful about what "agreement" really means.