Multiple testing procedures for analyzing stratified comparative clinical trials using odds ratios

K. H. Wu*, Man Lai TANG, K. M. Lee

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review


This article investigates various multiple testing procedures for the testing of unity odds ratios from stratified studies. These procedures compare individual ordered p-values to a series of adjusted nominal levels, and are employed to distinguish between significance and insignificance in stratified studies. Three commonly used approaches for determining p-values are considered: the asymptotic, exact, and mid-P approaches. We focus on two-sided hypothesis testing problems. The empirical performance of various multiple testing procedures is evaluated in terms of their empirical sizes and powers. As expected, multiple testing procedures based on the exact p-value approach are always conservative in the sense that their empirical sizes are always less than or equal to the pre-assigned nominal levels. Interestingly, in some cases we observe that some procedures based on the asymptotic p-value approach are more conservative and less powerful than the associated procedures based on the exact p-value approach. In addition, some procedures based on the mid-P approach are recommended because their empirical sizes are generally close to the pre-assigned nominal level but are the most powerful. General guidelines are provided, and numerical examples are presented to illustrate the methodologies.

Original languageEnglish
Pages (from-to)3324-3342
Number of pages19
JournalComputational Statistics and Data Analysis
Issue number11
Publication statusPublished - 20 Jul 2006

Scopus Subject Areas

  • Statistics and Probability
  • Computational Mathematics
  • Computational Theory and Mathematics
  • Applied Mathematics

User-Defined Keywords

  • Asymptotic test
  • Exact test
  • Mid-P test
  • Odds ratio
  • Single-step test
  • Stepwise test


Dive into the research topics of 'Multiple testing procedures for analyzing stratified comparative clinical trials using odds ratios'. Together they form a unique fingerprint.

Cite this