1.2 Definitions of Statistics, Probability, and Key Terms

LEARNING OBJECTIVES

  • Recognize and differentiate between key terms used in statistics.

The science of statistics deals with the collection, analysis, interpretation, and presentation of data. We see and use data in our everyday lives.  In this course, we will learn how to organize and summarize data.  The organization and summation of data is called descriptive statistics. Two ways to summarize data are by graphing and by using numbers (for example, finding an average). After we have studied probability and probability distributions, we will use formal methods for drawing conclusions from “good” data.  These formal methods are called inferential statistics.  Statistical inference uses probability to determine how confident we can be that our conclusions are correct.

Effective interpretation of data (inference) is based on good procedures for producing data and thoughtful examination of the data. You will encounter what will seem to be too many mathematical formulas for interpreting data. The goal of statistics is not to perform numerous calculations using the formulas, but to gain an understanding of the data.  The calculations can be done using a calculator or a computer.  The understanding must come from you.  If you can thoroughly grasp the basics of statistics, you can be more confident in the decisions you make in life.

Probability

Probability is a mathematical tool used to study randomness.  It deals with the chance (or likelihood) of an event occurring.  For example, if we toss a fair coin four times, the outcomes may not be two heads and two tails.  However, if we toss the same coin 4,000 times, the outcomes will be close to half heads and half tails.  The expected theoretical probability of heads in any one toss is 50%.  Even though the outcomes of a few repetitions are uncertain, there is a regular pattern of outcomes when there are many repetitions.  After reading about the English statistician Karl Pearson who tossed a coin 24,000 times with a result of 12,012 heads, one of the authors tossed a coin 2,000 times. The results were 996 heads, or 49.8% heads. This is very close to the expected probability of 50%.

The theory of probability began with the study of games of chance such as poker.  Predictions take the form of probabilities.  To predict the likelihood of an earthquake, of rain, or whether you will get an A in a particular course, we use probabilities.  Doctors use probability to determine the chance of a vaccination causing the disease the vaccination is supposed to prevent.  A stockbroker uses probability to determine the rate of return on a client’s investments.  You might use probability to decide whether or not to buy a lottery ticket.  In the study of statistics, we use the power of mathematics through probability calculations to analyze and interpret the data.

Key Terms

In statistics, we generally want to study a population.  A population as a collection of persons, things, or objects under study.  To study the population, we select a sample.  The idea of sampling is to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population.  Data are the result of sampling from a population.

Because it takes a lot of time and money to examine an entire population, sampling is a very practical technique.  If you wished to compute the overall grade point average at your school, it would make sense to select a sample of students who attend the school.  The data collected from the sample would be the students’ grade point averages.  In presidential elections, opinion poll typically sample between 1,000 and 2,000 people. The opinion poll is supposed to represent the views of the people in the entire country.  Manufacturers of canned carbonated drinks take samples to determine if a 16 ounce can actually contains 16 ounces of a carbonated drink.

From the sample data, we can calculate a statistic.  A statistic is a number that represents a property of the sample. For example, if we consider one math class to be a sample of the population of all math classes, then the average number of points earned by students in that one math class at the end of the term is an example of a statistic.  The statistic is an estimate of a population parameter.  A parameter is a number that is a property of the population.  Because we considered all math classes to be the population, then the average number of points earned per student over all the math classes is an example of a parameter.

One of the main concerns in the field of statistics is how accurately a statistic estimates a parameter.  The accuracy really depends on how well the sample represents the population.  The sample must contain the characteristics of the population in order to be a representative sample.  We are interested in both the sample statistic and the population parameter in inferential statistics.  In a later chapter, we will use the sample statistic to test the validity of the established population parameter.

A variable, notated by capital letters such as [latex]X[/latex] and [latex]Y[/latex], is a characteristic of interest for each person or thing in a population.  Variables may be numerical or categorical.  Numerical variables take on values with equal units such as weight in pounds and time in hours.  Categorical variables place the person or thing into a category.  If we let [latex]X[/latex] equal the number of points earned by one math student at the end of a term, then [latex]X[/latex] is a numerical variable.  If we let [latex]Y[/latex] be a person’s party affiliation, then some examples of [latex]Y[/latex] include Republican, Democrat, and Independent.  In this case, [latex]Y[/latex] is a categorical variable. We could do some math with values of [latex]X[/latex] (calculate the average number of points earned, for example), but it makes no sense to do math with values of [latex]Y[/latex] (calculating an average party affiliation makes no sense).  Data are the actual values of the variable.  They may be numbers or they may be words.  Datum is a single value.

Two words that come up often in statistics are mean and proportion.  If you take three exams in your math classes and obtain scores of 86, 75, and 92, you would calculate your mean score by adding the three exam scores and dividing by three (your mean score would be 84.3 to one decimal place). If, in your math class, there are 40 students and 22 are men and 18 are women, then the proportion of men students is [latex]\displaystyle{\frac{22}{40}}[/latex] and the proportion of women students is [latex]\displaystyle{\frac{18}{40}}[/latex].  Mean and proportion are discussed in more detail in later chapters.

NOTE

The words mean and average are often used interchangeably.  The substitution of one word for the other is common practice.  The technical term for mean  is “arithmetic mean,” and “average” is technically a center location. However, in practice among non-statisticians, “average” is commonly accepted for “arithmetic mean.”

EXAMPLE

Determine what the key terms refer to in the following study.  We want to know the average (mean) amount of money first year college students spend at ABC College on school supplies that do not include books. We randomly surveyed 100 first-year students at the college. Three of those students spent $150, $200, and $225, respectively.

Solution:

  • The population is all first year students attending ABC College this term.
  • The sample could be all students enrolled in one section of a beginning statistics course at ABC College (although this sample may not represent the entire population).
  • The parameter is the average (mean) amount of money spent (excluding books) by first year college students at ABC College this term (the population mean).
  • The statistic is the average (mean) amount of money spent (excluding books) by first year college students in the sample (the sample mean).
  • The variable could be the amount of money spent (excluding books) by one first year student. Let [latex]X[/latex] be the amount of money spent (excluding books) by one first year student attending ABC College.
  • The data are the dollar amounts spent by the first year students. Examples of the data are $150, $200, and $225.

TRY IT

Determine what the key terms refer to in the following study.  We want to know the average (mean) amount of money spent on school uniforms each year by families with children at Knoll Academy.  We randomly survey 100 families with children in the school. Three of the families spent $65, $75, and $95, respectively.

 

Click to see Solution
  • The population is all families with children attending Knoll Academy.
  • The sample is a random selection of 100 families with children attending Knoll Academy.
  • The parameter is the average (mean) amount of money spent on school uniforms by families with children at Knoll Academy.
  • The statistic is the average (mean) amount of money spent on school uniforms by families in the sample.
  • The variable is the amount of money spent by one family. Let [latex]X[/latex] be the amount of money spent on school uniforms by one family with children attending Knoll Academy.
  • The data are the dollar amounts spent by the families. Examples of the data are $65, $75, and $95.

TRY IT

Determine what the key terms refer to in the following study.  A study was conducted at a local college to analyze the average cumulative GPA’s of students who graduated last year.  Fill in the letter of the phrase that best describes each of the items below.

  1. Population ____
  2. Statistic ____
  3. Parameter ____
  4. Sample ____
  5. Variable ____
  6. Data ____
  1. all students who attended the college last year.
  2. the cumulative GPA of one student who graduated from the college last year.
  3. 3.65, 2.80, 1.50, 3.90.
  4. a group of students who graduated from the college last year, randomly selected.
  5. the average cumulative GPA of students who graduated from the college last year.
  6. all students who graduated from the college last year.
  7. the average cumulative GPA of students in the study who graduated from the college last year.
Click to see Solution
  1. f
  2. g
  3. e
  4. d
  5. b
  6. c

EXAMPLE

Determine what the key terms refer to in the following study.  As part of a study designed to test the safety of automobiles, the National Transportation Safety Board collected and reviewed data about the effects of an automobile crash on test dummies. Here is the criterion they used:

Speed at which cars crashed 56 kilometers/hour
Location of “drive” (i.e., dummies) Front seat

Cars with dummies in the front seats were crashed into a wall at a speed of 56 kilometers per hour.  We want to know the proportion of dummies in the driver’s seat that would have had head injuries, if they had been actual drivers.  We start with a simple random sample of 75 cars.

Solution:

  • The population is all cars containing dummies in the front seat.
  • The sample is the 75 cars, selected by a simple random sample.
  • The parameter is the proportion of driver dummies (if they had been real people) who would have suffered head injuries in the population.
  • The statistic is proportion of driver dummies (if they had been real people) who would have suffered head injuries in the sample.
  • The variable X = the number of driver dummies (if they had been real people) who would have suffered head injuries.
  • The data are either: yes, had head injury, or no, did not.

EXAMPLE

Determine what the key terms refer to in the following study.  An insurance company would like to determine the proportion of all medical doctors who have been involved in one or more malpractice lawsuits. The company selects 500 doctors at random from a professional directory and determines the number in the sample who have been involved in a malpractice lawsuit.

Solution:

  • The population is all medical doctors listed in the professional directory.
  • The parameter is the proportion of medical doctors who have been involved in one or more malpractice suits in the population.
  • The sample is the 500 doctors selected at random from the professional directory.
  • The statistic is the proportion of medical doctors who have been involved in one or more malpractice suits in the sample.
  • The variable X = the number of medical doctors who have been involved in one or more malpractice suits.
  • The data are either: yes, was involved in one or more malpractice lawsuits, or no, was not.

Attribution

“1.1 Definitions of Statistics, Probability, and Key Terms in Introductory Statistics by OpenStax is licensed under a Creative Commons Attribution 4.0 International License.

License

Icon for the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License

Introduction to Statistics Copyright © 2022 by Valerie Watts is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, except where otherwise noted.