Fundamentals of Multiple Regression

This course provides an introduction to, and the fundamentals of multiple regression, covering enough of the statistical material for the intelligent use of the technique.  The approach is informal and applied rather than emphasising proofs of relevant theorems. 

 
Level 2 - runs over 5 days
Instructor: 
David Gow is a consultant in social sciece research methods.   He has taught in the ACSPRI Summer and Winter Programs for 30 years.
About this course: 

Particular attention is given to the application of multiple regression to substantive problems in the social sciences. By the end of the course, the student will have a knowledge of the principles of multiple regression, and the ability to conduct regression analyses, interpret the results, and to inspect elementary regression diagnostics to test the underlying model assumptions.  This course provides the foundations necessary for progression to ‘Applied Multiple Regression Analysis’, and to subsequent advanced-level courses in structural equation modelling and log-linear modelling.

Course syllabus: 

The  Fundamentals of Multiple Regression  course covers the following 14 topics.

 

Module A:  Fundamentals

1.    Bivariate Regression

2.    Review of Classical Hypothesis Testing  (“Null-Hypothesis Significance Testing”), including the role and un-importance of p-values and the importance of effect size.

3.    Review of Regression Output for SPSS, SAS, Stata and R  -- what it means, how it is calculated, how it is interpreted, and how researchers might use it.

 

Module B:  Multiple Regression

4.    Multiple Regression --  detailed examination of how it works and the interpretation of output.

5.    Multiple Regression with Nominal-Level Variables.  Nominal–level variables (also known as unordered categorical variables) – creating and using "dummy variables" in regression (such as gender, country of birth, suburb of residence, etc).

6.    Multiple Regression with Ordinal-level Variables  -- for example, incorporating responses on a 5 or 7-point Likert-like rating scale in a regression model

 

Module C:  Exensions of OLS: Logistic Regression and Polynomial Regression

7.    Regression with Binary (Dichotomous) Dependent Variables -- an introduction to (binary) logistic regression with binary (dichotomous) dependent variables

8.    Non-linearity with Polynomial Regression

 

Module D:  Regression Diagnostics, Transformations and Polynomial Regression

9.    Variable Transformations to Re-Express Data – transformations towards normality and assessing normality.

10.  Regression Diagnostics & Functional Form – detecting outliers,  non-linearity

11.  Missing Values – treatment of missing values using deletion methods (pairwise and list wise deletion), single and multiple imputation

12.  Multicollinearity -  impact on regression results and measures of multicollinearity

 

Module E:   Applying Multiple Regression

13.  Model Building with Regression – a step-by-step guide to analysing data using regression

14.  Writing up Regression Analyses – presenting your results in theses and academic journals.

Course format: 

This course may run in a computer lab, or you may be advised to bring your own laptop with preferred software.

We will let you know in advance.

Recommended Background: 

Participants should have completed an introductory statistics course covering at least some of the syllabus of Introduction to Statistics. A significant part of the course is the translation of the principles of multiple regression to practical data analysis using a statistical package. Some experience with a statistical package, such as SPSS, Stata or SAS, or the spreadsheet Excel is desirable.

Recommended Texts: 

Nearly all good social statistics texts treat regression analysis and thus constitute suitable reference material.  The following short monographs provide short, clear and technically sound coverage.

 

  • Lewis-Beck, M., Applied Regression: An Introduction, Sage, 1980
  • Achen, C., Interpreting and Using Regression, Sage, 1982.
  • Berry, William and Stanley Feldman, Multiple Regression in Practice, Sage, 1985.
Participant feedback: 

Will help me read & understand research. On my may to being able to conduct my research (Winter 2017)

 

To be honest it opened my mind to contain things that will help throughout my research (Summer 2017)

 

David was excellent. Honestly, I have had many stats teachers in the past and David was so clear great communication skills. (Winter 2016)

 

Gave me a sense of confidence in the statistical methods, and some helpful tips in the procedures to help in my work (Summer 2016)

 

Helps me understand the foundation to build my model and my next phase of study. (Summer 2015)

 

The course was true to label; it covered the fundamentals of regression and provided opportunities to learn how to interpret software outputs. (Winter 2014)

 

David Gow makes learning fun. (WInter 2014)

Program where course next likely to be offered: 
Summer Program 2019
Notes: 

The instructor’s bound, book-length course notes will serve as the course text.