What is intra-observer reliability?

What is intra-observer reliability?

• A. Consistency of reports by the same observer across time.
• B. Consistency of reports across different observers.
• C. Consistency of a measure when repeated at two points in time.
• D. The relation to other measures as theory predicts.

Answer: (A)

Intra-observer reliability focuses on one person being consistent in their judgments when rating the same thing on different occasions. If the same observer scores a symptom, behavior, or observation in the same way on two separate visits when nothing has changed, that shows high intra-observer reliability—that the observer isn’t drifting in their judgments over time. This is different from inter-observer reliability, which asks whether different observers would produce similar scores, and from test-retest reliability, which considers whether a measurement yields similar results when repeated over time regardless of who does the measurement. Validity, on the other hand, concerns whether the measurement actually measures what it’s supposed to measure, not the stability of one observer’s ratings.

Intra-observer reliability focuses on one person being consistent in their judgments when rating the same thing on different occasions. If the same observer scores a symptom, behavior, or observation in the same way on two separate visits when nothing has changed, that shows high intra-observer reliability—that the observer isn’t drifting in their judgments over time. This is different from inter-observer reliability, which asks whether different observers would produce similar scores, and from test-retest reliability, which considers whether a measurement yields similar results when repeated over time regardless of who does the measurement. Validity, on the other hand, concerns whether the measurement actually measures what it’s supposed to measure, not the stability of one observer’s ratings.