Controlling Error in Multiple Comparisons, with Examples from State-to-State Differences in Educational Achievement

Three alternative procedures to adjust significance levels for multiplicity are the traditional Bonferroni technique, a sequential Bonferroni technique developed by Hochberg (1988), and a sequential approach for controlling the false discovery rate proposed by Benjamini and Hochberg (1995). These pr... Ausführliche Beschreibung

1. Person: Jones, Lyle V.
Weitere Personen: Tukey, John W.
Quelle: in Journal of Educational and Behavioral Statistics Vol. 24, No. 1 (1999), p. 42-69
Weitere Artikel
Format: Online-Artikel
Sprache: English
Veröffentlicht: 1999
Beschreibung: Online-Ressource
Schlagworte: Educational assessment
Hypothesis testing
Multiple comparisons
National Assessment of Educational Progress (NAEP)
Online Zugang: Volltext
Volltext
Tags: Hinzufügen
Keine Tags. Fügen Sie den ersten Tag hinzu!
Anmerkung: Copyright: Copyright 1999 The American Educational Research Association and the American Statistical Association
Zusammenfassung: Three alternative procedures to adjust significance levels for multiplicity are the traditional Bonferroni technique, a sequential Bonferroni technique developed by Hochberg (1988), and a sequential approach for controlling the false discovery rate proposed by Benjamini and Hochberg (1995). These procedures are illustrated and compared using examples from the National Assessment of Educational Progress (NAEP). A prominent advantage of the Benjamini and Hochberg (B-H) procedure, as demonstrated in these examples, is the greater invariance of statistical significance for given comparisons over alternative family sizes. Simulation studies show that all three procedures maintain a false discovery rate bounded above, often grossly, by α (or α/2). For both uncorrelated and pairwise families of comparisons, the B-H technique is shown to have greater power than the Hochberg or Bonferroni procedures, and its power remains relatively stable as the number of comparisons becomes large, giving it an increasing advantage when many comparisons are involved. We recommend that results from NAEP State Assessments be reported using the B-H technique rather than the Bonferroni procedure.
ISSN: 1935-1054

Ähnliche Einträge

Keine ähnlichen Titel gefunden

Privacy Notice Ask a Librarian New Acquisitions