TY - JOUR
T1 - Family-Wise Error Rate Controlling Procedures for Discrete Data
AU - Zhu, Yalin
AU - Guo, Wenge
N1 - Funding Information:
The research of Wenge Guo was supported in part by NSF Grant DMS-1309162.
Publisher Copyright:
© 2019, © 2019 American Statistical Association.
PY - 2020/1/2
Y1 - 2020/1/2
N2 - In applications such as clinical safety analysis, the data of the experiments usually consist of frequency counts. In the analysis of such data, researchers often face the problem of multiple testing based on discrete test statistics, aimed at controlling family-wise error rate (FWER). Most existing FWER controlling procedures are developed for continuous data, which are often conservative when analyzing discrete data. By using minimal attainable p-values, several FWER controlling procedures have been specifically developed for discrete data in the literature. In this article, by using known marginal distributions of true null p-values, three more powerful stepwise procedures are developed, which are modified versions of the conventional Bonferroni, Holm and Hochberg procedures, respectively. It is shown that the first two procedures strongly control the FWER under arbitrary dependence and are more powerful than the existing Tarone-type procedures, while the last one only ensures control of the FWER in special settings. Through extensive simulation studies, we provide numerical evidence of superior performance of the proposed procedures in terms of the FWER control and minimal power. A real clinical safety data are used to demonstrate applications of our proposed procedures. An R package “MHTdiscrete” and a web application are developed for implementing the proposed procedures.
AB - In applications such as clinical safety analysis, the data of the experiments usually consist of frequency counts. In the analysis of such data, researchers often face the problem of multiple testing based on discrete test statistics, aimed at controlling family-wise error rate (FWER). Most existing FWER controlling procedures are developed for continuous data, which are often conservative when analyzing discrete data. By using minimal attainable p-values, several FWER controlling procedures have been specifically developed for discrete data in the literature. In this article, by using known marginal distributions of true null p-values, three more powerful stepwise procedures are developed, which are modified versions of the conventional Bonferroni, Holm and Hochberg procedures, respectively. It is shown that the first two procedures strongly control the FWER under arbitrary dependence and are more powerful than the existing Tarone-type procedures, while the last one only ensures control of the FWER in special settings. Through extensive simulation studies, we provide numerical evidence of superior performance of the proposed procedures in terms of the FWER control and minimal power. A real clinical safety data are used to demonstrate applications of our proposed procedures. An R package “MHTdiscrete” and a web application are developed for implementing the proposed procedures.
KW - CDF of p-values
KW - Clinical safety study
KW - Multiple testing
KW - Step-wise procedure
UR - http://www.scopus.com/inward/record.url?scp=85073824488&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85073824488&partnerID=8YFLogxK
U2 - 10.1080/19466315.2019.1654912
DO - 10.1080/19466315.2019.1654912
M3 - Article
AN - SCOPUS:85073824488
SN - 1946-6315
VL - 12
SP - 117
EP - 128
JO - Statistics in Biopharmaceutical Research
JF - Statistics in Biopharmaceutical Research
IS - 1
ER -