Correlation and Regression

topicmedium9 MCQ

What is Correlation and Regression?

A statistical measure that expresses the extent to which two variables are linearly related (i.e., they change together at a constant rate).

Key formula / rule: Pearson's Correlation Coefficient (r)

Define correlation and regression and differentiate between them.
Interpret the Pearson correlation coefficient (r) and its implications.
Understand the concept of a scatter plot and its use in visualizing relationships.
Formulate and interpret a simple linear regression equation (Y = a + bX).

Assuming causation from correlation alone.

Term: Correlation
Meaning: A statistical measure that expresses the extent to which two variables are linearly related (i.e., they change together at a constant rate).

Term: Regression
Meaning: A statistical method used to model the relationship between a dependent variable and one or more independent variables, primarily for prediction.

Term: Independent Variable
Meaning: The variable that is changed or controlled in a scientific experiment to test the effects on the dependent variable (predictor variable).

Term: Dependent Variable
Meaning: The variable being measured or tested in an experiment, whose value depends on that of another variable (response variable).

Term: Scatter Plot
Meaning: A graph in which the values of two variables are plotted along two axes, the pattern of the resulting points revealing any correlation present.

Term: Coefficient of Determination (R-squared)
Meaning: A statistical measure that represents the proportion of the variance for a dependent variable that's explained by an independent variable or variables in a regression model.

Term: Pearson's Correlation Coefficient
Meaning: A measure of the linear correlation between two sets of data, ranging from -1 (perfect negative correlation) to +1 (perfect positive correlation).

Define correlation and regression and differentiate between them.
Interpret the Pearson correlation coefficient (r) and its implications.
Understand the concept of a scatter plot and its use in visualizing relationships.
Formulate and interpret a simple linear regression equation (Y = a + bX).
Calculate and interpret the coefficient of determination (R-squared).
Identify the independent and dependent variables in a given problem.
Recognize the limitations of correlation and regression analysis.

Name: Pearson's Correlation Coefficient (r)
Note: Measures the linear relationship between two variables X and Y. X̄ and ȳ are the means of X and Y respectively.
Expression: r = Σ[(Xi - X̄)(Yi - ȳ)] / √[Σ(Xi - X̄)² Σ(Yi - ȳ)²]

Name: Simple Linear Regression Equation
Note: Ŷ is the predicted value of the dependent variable Y, X is the independent variable, 'a' is the Y-intercept, and 'b' is the slope.
Expression: Ŷ = a + bX

Name: Slope of Regression Line (b)
Note: Sy and Sx are the standard deviations of Y and X respectively. The first formula is often used for calculation, the second shows its relation to correlation.
Expression: b = Σ[(Xi - X̄)(Yi - ȳ)] / Σ(Xi - X̄)² OR b = r * (Sy / Sx)

Name: Coefficient of Determination (R-squared)
Note: Represents the proportion of the variance in the dependent variable that is predictable from the independent variable(s). Ranges from 0 to 1.
Expression: R² = r²

If the two regression coefficients, b_yx and b_xy, are 0.8 and 0.5 respectively, what is the value of the correlation coefficient (r)?…
medium
The value of the Pearson product-moment correlation coefficient (r) always lies between which of the following ranges?…
easy
If the regression equation of Y on X is Y = 2X + 5, and the standard deviation of X (sigma_x) is 3, and the correlation coefficient (r) between X and Y is 0.8, what is the standard deviation of Y (sigma_y)?…
hard