Direction and Strength of Linear Correlation
Suppose we record two numerical variables for the same observations, such as a student's study time and exam score or a car's age and selling price. A scatter plot displays the paired values and any pattern they form. Correlation analysis summarizes the direction and strength of a linear, or straight-line, pattern.
Correlation answers a descriptive question: how do the two variables vary together? It does not yet tell us why the pattern exists.
The Correlation Coefficient
Pearson's correlation coefficient is denoted by . The sign of r describes direction, while its distance from zero describes the strength of the linear pattern.
| Value | Interpretation |
|---|---|
| Larger values of one variable tend to occur with larger values of the other. | |
| Larger values of one variable tend to occur with smaller values of the other. | |
| The points lie close to a straight line. | |
| The measured linear association is very weak or zero. |
Whenever both variables have nonzero variation and is defined, the coefficient lies in this interval:
- means a perfect positive linear correlation.
- means a perfect negative linear correlation.
- means no linear correlation.
A value near zero does not rule out every relationship. Points may follow a clear curve while their linear correlation remains small. The scatter plot and the context must therefore be read together with .
Swapping Variables and Changing Units
Correlation treats the two variables symmetrically. Swapping the horizontal and vertical variables does not change its value:
Changing a positive unit scale also leaves unchanged. Measuring height in centimeters or meters produces the same coefficient. This differs from regression, where one variable is deliberately used to predict the other.
The Coefficient of Determination
The square of the correlation coefficient, , is called the coefficient of determination. In simple linear regression with an intercept, it gives the proportion of variation in the response that is accounted for by the fitted linear model.
If study time and exam score have , then:
The linear association accounts for of the observed variation in scores in that data set. The remaining is not accounted for by this linear relationship. This percentage describes how well the model fits the data. It cannot show that study time alone caused the score differences.
The coefficient of determination satisfies:
Correlation and Causal Relationships
A strong correlation does not establish that one variable causes the other. Several explanations can produce the same pattern:
- the first variable may influence the second.
- the second may influence the first.
- a third variable may influence both.
- sampling, measurement, or an unusual observation may distort the pattern.
For example, ice cream sales and drowning incidents may both rise during hot weather. The correlation does not mean that buying ice cream causes drowning. Summer weather and increased swimming activity affect both observations.
Use correlation to describe a linear pattern. A causal conclusion needs additional evidence from the study design, temporal order, plausible mechanisms, and alternative explanations.
Check Your Interpretation
Suppose a data set has . This indicates a strong negative linear relationship: larger values of one variable tend to accompany smaller values of the other. It does not, by itself, identify a cause or guarantee that every point lies on the same line.