Lecture 1: Multiple Linear regression (ARMS, Utrecht University)

Studies must be critically reviewed:

  • Is the sample representative?
  • Is it a reliable measure of variables?
  • Is the correct analysis applied and are the results interpreted correctly?

Association does not mean causation!

Does the effect remain when additional variables are included? For this question we use a multiple regression.

Simple linear regression: involved 1 outcome, and 1 predictor.

Multiple linear regression: involves 1 outcome, and multiple predictors.

The relevance of a predictor is determined by:

  1. The amount of variance explained (R2)
  2. The slope of the regression line

A multiple regression model is also called an additive lineair model

There are 4 types of variables:

  • Nominal
  • Ordinal
  • Interval
  • Ratio

We distinguish these in:

Nominal & ordinal = categorical or qualitative

Interval & Ratio = continuous, quantitive, numerical

For MLR we use continuous outcome and continuous predictors. But categorical predictors can be included as dummy variables. Then you’d have to assign numbers to the categorical variables. Dummy variables only have values 0 and 1. 

If you have categorical predictors with more than 2 levels, you will need always 1 variable less than the amount of predictors to create a dummy variable.

Hierarchical MLR: using two or more models. If the first one is accounted for, it the second model better, etc.? You use multiple hypotheses for hierarchical MLR. 

Multiple correlation coefficient: correlation between y observed and y predicted.

The R2 of the sample, is not a good indicator of the R2 of the population. The more predictors, the more biased it is. If you correct the R for this, you call it the adjusted R2. This variable you use when talking about the population.

With the R2 chance you can see if the added predictors improve the prediction. Then after the output, you decide whether you want to continue with the first or second model.

B-coëfficient: tells you what the unique contribution of that variable is, given that all the others are also in the model.

Questions? Let me know in the contribution section!

Follow me for more summaries on statistics!

Page access
Public
Work for WorldSupporter

Image

JoHo can really use your help!  Check out the various student jobs here that match your studies, improve your competencies, strengthen your CV and contribute to a more tolerant world

Working for JoHo as a student in Leyden

Parttime werken voor JoHo

How to use and find summaries?


Online access to all summaries, study notes en practice exams

Using and finding summaries, study notes en practice exams on JoHo WorldSupporter

There are several ways to navigate the large amount of summaries, study notes en practice exams on JoHo WorldSupporter.

  1. Starting Pages: for some fields of study and some university curricula editors have created (start) magazines where customised selections of summaries are put together to smoothen navigation. When you have found a magazine of your likings, add that page to your favorites so you can easily go to that starting point directly from your profile during future visits. Below you will find some start magazines per field of study
  2. Follow authors or (study) organizations: by following individual users, authors and your study organizations you are likely to discover more relevant study materials.
  3. Search tool: quick & dirty - not very elegant but the fastest way to find a specific summary of a book or study assistance with a specific course or subject. The search tool is available at the bottom of most pages or on the Search & Find page
  4. Tags & Taxonomy: gives you insight in the amount of summaries that are tagged by authors on specific subjects. This type of navigation can help find summaries that you could have missed when just using the search tools. Tags are organised per field of study and per study institution. Note: not all content is tagged thoroughly, so when this approach doesn't give the results you were looking for, please check the search tool as back up

Do you want to share your summaries with JoHo WorldSupporter and its visitors?

Quicklinks to fields of study (main tags and taxonomy terms)

Field of study

Quick links to WorldSupporter content for universities in the Netherlands

Follow the author: JuliaV
Comments, Compliments & Kudos

Nice!

Another nice and clear summary, well done Julia!!

Add new contribution

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.
Promotions
Image
The JoHo Insurances Foundation is specialized in insurances for travel, work, study, volunteer, internships an long stay abroad
Check the options on joho.org (international insurances) or go direct to JoHo's https://www.expatinsurances.org