Multiple Regression (12)

12. Multiple Regression

Simple regression (see chapter 11) can predict a dependent variable as a function of a single independent variable. But often there are multiple variables at play. In order to determine the simultaneous effect of multiple independent variables on a dependent variable, multiple regression is used. The least squares principle fit the model.

12.1. The model

As with simple regression, the first step in the model development is model specification, the selection of the model variables and functional form of the model. This is influenced by the model objectives, namely: (1) predicting the dependent variable, and/or (2) estimating the marginal effect of each independent variable. The second objective is hard to achieve, however, in a model with multiple independent variables, because these variables are not only related to the dependent variable but also to each other. This leaves a web of effects that is not easily untangled.

To make multiple regression models more accurate an error termε” is added, as a way to recognize that none of the described relationships in the model will hold exactly and there are likely to be variables that affect the dependent variable, but are not included in the model.

12.2. Estimating Coefficients

Multiple regression coefficients are calculated with the least squares procedure. However, again this is more complicated than with simple regression, as the independent variables not only affect the dependent variable but also each other. It is not possible to identify the unique effect of each independent variable on the dependent variable. This means that the higher the correlations between two or more of the independent variables in a model are, the less reliable the estimated regression coefficients are.

There are 5 assumptions to standard multiple regression. The first 4 are the same as are made for simple regression (see chapter 11). The 5th states that it is not possible to find a set of nonzero numbers such that the sum of the coefficients equals 0. This assumption excludes the cases in which there is a linear relationship between a pair of independent variables. In most cases this assumption will not be violated if the model is properly specified.

Whereas in simple regression the least squares procedure finds a line that best represents the set of points in space, multiple regression finds a plane that best represents these points (as each variable is represented with its own dimension).

It is... Interested? Read the instructions below in order to read the full content of this page.

Access options

The full content is only visible for JoHo members.

  • For information about international JoHo memberships, read more here.
  • Are you already a member? Add your JoHo membership number to your World Supporter account to activate your member access
  • or mail info@joho.org

 

For Dutch visitors

Toegang tot pagina of document:

Word JoHo donateur of abonnee voor online toegang

  • Om online toegang te krijgen kun je JoHo donateur worden
  • Lees hieronder meer over JoHo donateur en abonnee worden

Je bent al donateur, maar je hebt geen toegang?

  • Log in, of maak een account aan als je dat nog niet eerder hebt gedaan.
  • Voeg je JoHo (member) nummer toe aan je account voor volledige toegang. Je kunt dit nummer vinden op JoHo.org/user of in de bevestigingsmail van je JoHo donateursinschrijving. Kom je er niet uit, neem dan even contact op!

Kom je er niet helemaal uit of heb je problemen met inloggen?

-----------------------------------------------

 


 JoHo donateur (WorldSupporter) worden

JoHo donateurschap (€5,- per jaar)

  • Voor wie €10,- korting wil op zijn JoHo abonnement
  • Voor wie JoHo WorldSupporter en Smokey projecten wil steunen
  • Voor wie gebruik wil maken van alle gedeelde materialen op WorldSupporter
  • Voor wie op zoek is naar de organisatie bij een vacature

 JoHo abonnementen

    JoHo abonnement (€20,- per jaar)

    • Voor wie online volledig gebruik wil maken van alle JoHo's en boeksamenvattingen voor alle fases van een studie, met toegang tot alle online HBO & WO boeksamenvattingen en andere studiehulp
    • Voor wie gebruik wil maken van de gesponsorde boeksamenvattingen (en er met zijn pinpoints 10 gratis kan afhalen in een JoHo support center of bij een JoHo partner)
    • Voor wie gebruik wil maken van de vacatureservice en bijbehorende keuzehulp & advieswijzers
    • Voor wie gebruik wil maken van keuzehulp en advies bij werk in het buitenland, lange reizen, vrijwilligerswerk, stages en studie in het buitenland
    • Voor wie extra kortingen wil op (reis)artikelen en services (online + in de JoHo support centers)
    • Voor wie extra kortingen wil op de geprinte studiehulp (zoals tentamen tests en study notes) in de JoHo support centers

    Steun JoHo en steun jezelf door JoHo donateur te worden

    Direct Donateur Worden

     

     

    Contributions, Comments & Kudos

    Add new contribution

    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Image CAPTCHA
    Enter the characters shown in the image.
    Summaries & Study Note of Dara Yapp
    Join World Supporter
    Join World Supporter
    Log in or create your free account

    Why create an account?

    • Your WorldSupporter account gives you access to all functionalities of the platform
    • Once you are logged in, you can:
      • Save pages to your favorites
      • Give feedback or share contributions
      • participate in discussions
      • share your own contributions through the 11 WorldSupporter tools
    Content
    Access level of this page
    • Public
    • WorldSupporters only
    • JoHo members
    • Private
    Statistics
    10