|
Size: 1858
Comment:
|
Size: 2198
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = The EM algorithm and Mixed model approaches to missing values = | = The EM algorithm and mixed (random effects) model approaches to missing values = |
| Line 5: | Line 5: |
| Howell gives a comprehensive overview and illustration of these techniques | Howell gives a comprehensive overview and illustration of all these techniques |
| Line 8: | Line 8: |
| Howell suggests that a better way to estimate missing values on a variable us by using a more complex approach than variable means, namely the EM. This can be used under analyse>missing value analysis from version 13 of SPSS or using PROC MIANALYSE in SAS or stand-alone freeware which can be dowloaded from [http://www.stat.psu.edu/~jls/misoftwa.html here.] All these procedures produce a 'filled in' (or imputed) data set with values estimated using the original data replacing the original missing values. The analysis can then be carried out using this filled-in data set. |
Howell, in particular, suggests that a better way to estimate missing values on a variable us by using a more complex approach than variable means, namely the EM algorithm. This can be used under analyse>missing value analysis from version 13 of SPSS or using PROC MIANALYSE in SAS or stand-alone freeware which can be downloaded from [http://www.stat.psu.edu/~jls/misoftwa.html here.] The EM algorithm produces a 'filled in' (or imputed) data set with values estimated using the original data replacing the original missing values. The analysis can then be carried out using this filled-in data set. |
| Line 11: | Line 11: |
| Howell does point out that there is no 'unique' estimate of missing values and that multiple imputations, namely 3-5 data sets 'filled-in' with the estimates of missing values should be analysed to assess the consistency of the results but doesn't suggest in most cases, notably for analysis of variance, how these results should be combined and, for this reason, prefers using random effects models for missing values in analysis of variance. | Howell does point out that there is no 'unique' estimate of missing values and that multiple imputations are required. In practice this means that multiple 'filled-in' data sets (typically 3 to 5) should be analysed to assess the consistency of the results across missing value estimates. Howell doesn't, unfortunately, suggest in most cases, notably for analysis of variance, how these results should be combined and, for this reason, prefers using random effects models for missing values in analysis of variance. He does notice in his example that the F tests on each of three imputed data sets from a repeated measures analysis of variance are very similar. |
| Line 13: | Line 13: |
| Random effect models use all cases irrespective of whether they contain missing values and, so, have a unique solution. These are available for use in most statistical packages such as SPSS (MIXED), SAS (MIXED) and R (LME). They are useful for analysis of variance where it is wished to generalise results from the factors considered. | Random effect models, unlike the standard 'fixed effects' analysis of variance, use all cases irrespective of whether they contain missing values and therefore have a unique solution. These are available for use in most statistical packages such as SPSS (MIXED), SAS (MIXED) and R (LME). They are particularly useful for analysis of variance where it is wished to generalise results from the factors considered. |
The EM algorithm and mixed (random effects) model approaches to missing values
Multivariate procedures usually only use complete cases giving an accompanying loss of power. There are two ways to address this: estimating missing values using existing data (as used above where we used the variable means) or using random effect models.
Howell gives a comprehensive overview and illustration of all these techniques [http://www.uvm.edu/~dhowell/StatPages/More_Stuff/Missing_Data/Missing.html here.]
Howell, in particular, suggests that a better way to estimate missing values on a variable us by using a more complex approach than variable means, namely the EM algorithm. This can be used under analyse>missing value analysis from version 13 of SPSS or using PROC MIANALYSE in SAS or stand-alone freeware which can be downloaded from [http://www.stat.psu.edu/~jls/misoftwa.html here.] The EM algorithm produces a 'filled in' (or imputed) data set with values estimated using the original data replacing the original missing values. The analysis can then be carried out using this filled-in data set.
Howell does point out that there is no 'unique' estimate of missing values and that multiple imputations are required. In practice this means that multiple 'filled-in' data sets (typically 3 to 5) should be analysed to assess the consistency of the results across missing value estimates. Howell doesn't, unfortunately, suggest in most cases, notably for analysis of variance, how these results should be combined and, for this reason, prefers using random effects models for missing values in analysis of variance. He does notice in his example that the F tests on each of three imputed data sets from a repeated measures analysis of variance are very similar.
Random effect models, unlike the standard 'fixed effects' analysis of variance, use all cases irrespective of whether they contain missing values and therefore have a unique solution. These are available for use in most statistical packages such as SPSS (MIXED), SAS (MIXED) and R (LME). They are particularly useful for analysis of variance where it is wished to generalise results from the factors considered.
