9.9 Reliability and Validity Confusion

The archery targets below are the classic examples many statistics textbooks use to explain validity and reliability.

There are three different targets and three archers. The first archer fires all their arrows, and none of them hit the bullseye they were aiming for, but they are pretty consistent in where they hit the target. They cannot be considered valid since they do not hit the mark they strive for. But, since they are consistent, they can be regarded as reliable. This means that we could be bad at something but be bad consistently, and we would be considered trustworthy.

Let’s take a look at the second target. Here, the archer hits the bullseye once but is pretty spread out with the rest of the arrows. They likely hit the bullseye once by chance alone, and since the arrows are pretty spread out, we can’t say they are reliable. If they aren’t trustworthy, they aren’t valid either.

On the 3rd target, the archer hit the bullseye with every arrow. Since they consistently did this, they are reliable. Since they hit the mark they were aiming for, they are trustworthy and valid.

Using valid and reliable selection tests will help you make better hiring decisions when properly applied.

By using various assessment tools as part of your selection process, you can more fully assess the skills and capabilities of your applicants while reducing the effects of errors associated with any tool on your decision-making.

“Reliability and Validity” from Quantitative Analysis in Exercise and Sport Science by Chris Bailey, PhD, CSCS, RSCC is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, except where otherwise noted.—Modifications: Used section Reliability and validity confusion, edited, added HR application.