The system has been criticized for having poor inter-rater reliability.

Not surprisingly early inter-rater reliability scores were in the range of 86.25%.

There are a number of statistics which can be used to determine inter-rater reliability.

Inter-rater reliability was established using two raters for 280 cases.

Inter-rater reliability measures how much one examiner agrees with another.

Some sources claim the inter-rater reliability to be well established, while others report a high variability.

Computing inter-rater reliability and its variance in the presence of high agreement.

Inter-rater reliability was evaluated and differences were resolved by consensus.

Having established good inter-rater reliability data collection for the research subjects commenced.

Validation and inter-rater reliability are signs of good, accurate tests.

Inter-rater reliability for data coding will also be established.

This test does not use subjective judgments of ability, and inter-rater reliability will be virtually perfect.

This inter-rater reliability was found to be 0.88, which is high enough for results to be considered reliable.

However, according to research human raters typically agree 79% of the time (see Inter-rater reliability).

Its content validity and inter-rater reliability have been established.

We have not directly assessed inter-rater reliability because of logistical and cost constraints.

Inter-rater reliability might, however, be expected to be low.

Both inter-rater reliability and internal consistency were good across all behavioral areas investigated in the interview.

Extensive training given to four raters of outcomes to enhance inter-rater reliability.

Third parties could be used to avoid this problem, but the Rorschach's inter-rater reliability has been questioned.

On many other items, correlation results approached commonly accepted criteria for inter-rater reliability.

Further testing is required to determine inter-rater reliability.

This allows inter-rater reliability to be ruled out.

• Inter-rater reliability checks were performed on two occasions.

Inter-rater reliability of physical signs in eating disorders.