Which statement explicitly defines inter-observer reliability?

Which statement explicitly defines inter-observer reliability?

• A. Consistency of reports across different observers.
• B. Consistency of a measure across time or observers.
• C. The relation to other measures as theory predicts.
• D. The accuracy of predictive validity.

Answer: (A)

Inter-observer reliability measures how consistently different observers rate or report the same thing. That’s exactly captured by saying there is consistency of reports across different observers. It focuses on agreement between people who observe the same event or behavior. The other ideas describe different concepts: consistency across time or observers covers stability over time (test-retest) as well as across observers, so it isn’t limited to observers alone; relating measures to theory is about validity (how well a measure reflects the construct); and predictive validity is about how well a measure predicts future outcomes. In practice, researchers quantify inter-observer reliability with statistics like Cohen’s kappa for categories or the intraclass correlation coefficient for continuous ratings.

Inter-observer reliability measures how consistently different observers rate or report the same thing. That’s exactly captured by saying there is consistency of reports across different observers. It focuses on agreement between people who observe the same event or behavior.

The other ideas describe different concepts: consistency across time or observers covers stability over time (test-retest) as well as across observers, so it isn’t limited to observers alone; relating measures to theory is about validity (how well a measure reflects the construct); and predictive validity is about how well a measure predicts future outcomes. In practice, researchers quantify inter-observer reliability with statistics like Cohen’s kappa for categories or the intraclass correlation coefficient for continuous ratings.