MVDA -multiple regression analysis

Multivariate Data Analysis

Week 1: Multiple Regression Analysis

Multivariate means exploring the dynamics between 3 or more variables.

Multiple regression analysis (MRA) can be done when all variables are interval level (e.g. weight, height, IQ score).

The research question for MRA is: can Y be predicted from X1 and/or X2?

What are the linearity, homoscedasticity and normality of residuals?

Linearity: the relationship between the independent and dependent is linear. Can be tested with scatterplots.

Homoscedasticity: variance of residuals is constant across values predictors. Can be seen on the scatterplot.

Normality: approximate straight line on P-P plot.

What does multicollinearity mean?

That there is a high intercorrelation between predictors. There is multicollinearity when the tolerance is higher than 0.10 and the VIF is lower than 10.

Are there outliers, inﬂuential points, or outliers on the predictors?

Outliers: on dependent variable Y: Residuals, between −3 and 3.

Influential points: Cook’s distance smaller than 1.

Outliers on the predictors: on independent variable(s) X: Leverage, smaller than 3(k+1)/n

What are the null and the alternative hypothesis to test the regression model?

H_o: b^*₁ =b^∗₂ =···=b^∗_k =0 (No relation between Y and X1, X2)

Ha: :at least one b^∗_j =/= 0

When can the null hypothesis be rejected?

When the hypothesis of no relation between variables can be rejected (no relation would mean all variables equal 0)

What are the null and the alternative hypothesis to test the individual coeﬃcients?

H₀: b₁=0 and H_a= b₁=/=0

H₀: b₂=0 and H_{a =}b₂=/=0

What are the unstandardized and standardized regression equations?

Unstandardized (MRA): b₀+b₁X₁+b₂X₂

Standardized (MRA_st): β₁X_1st+ β₂X_2st

How much variance of Y is explained in total by X1 and X2?

The R² gives the value for the explained data (X₁and X₂).

How much variance of Y is uniquely explained by X1? How much variance of Y is uniquely explained by X2? What is the best predictor?

We look at part coefficient. r²x(1.2) and r²y(2.1) gives the answer. Whichever the highest value is, that’s the best predictor.

Access:

Public

Join: WorldSupporter!

Join with a free account for more service, or become a member for full access to exclusives and extra support of WorldSupporter >>

Check: concept of JoHo WorldSupporter

Concept of JoHo WorldSupporter

JoHo WorldSupporter mission and vision:

JoHo wants to enable people and organizations to develop and work better together, and thereby contribute to a tolerant and sustainable world. Through physical and online platforms, it supports personal development and promote international cooperation is encouraged.

JoHo concept:

As a JoHo donor, member or insured, you provide support to the JoHo objectives. JoHo then supports you with tools, coaching and benefits in the areas of personal development and international activities.
JoHo's core services include: study support, competence development, coaching and insurance mediation when departure abroad.