PASSReviewer 1· 90% conf
Statistical analyses are well-described with named tests, exact p-values (in tables), effect sizes (Cohen's d, confidence intervals), and software identified. The data presentation is appropriate for a clinical trial, with tables showing n, means, SDs, and CIs.
Evidence
direct quote[Methods, Statistical analysis: Data analysis]
“A non-inferiority analysis was performed on the primary outcome by comparing differences in the changes in ISI scores between the two groups at month 3 and month 15.”paraphrase[Tables 2 and 3]
“Tables 2 and 3 report exact p-values for group, time, and interaction effects for all outcomes.”direct quote[Tables 2 and 3]
“Cohen’s d† | Month 3 | Month 15”WARNReviewer 2· 80% conf
Statistical tests are named, exact p-values are reported for key comparisons, and data presentation includes effect sizes and confidence intervals. However, effect sizes (Cohen's d) are reported without confidence intervals, and the per-protocol analysis for non-inferiority uses a one-sided confidence interval, which is appropriate. The paper is downgraded to warn because effect sizes lack CIs, and assumptions for the statistical models (GEE) are not discussed, with no report of how model assumptions were verified.
Evidence
direct quote[Methods, Data analysis]
“We used generalised estimating equations analyses to examine the treatment effects on the quantitative secondary outcomes, adjusting for baseline values.”direct quote[Results, Tables 2 and 3]
“Cohen's d†: Month 3 -1.50, Month 15 -2.33 (for Tai chi, Insomnia Severity Index)”absence[Results, Figure 2]
Individual data points not shown in figures.PASSReviewer 3· 90% conf
Statistical analysis is rigorous with named tests, a pre-specified non-inferiority margin, exact p-values reported, and sensitivity analyses. Assumptions are not explicitly verified, but this is acceptable for a large clinical trial using standard methods.
Evidence
direct quote[Methods, Statistical analysis, Data analysis]
“A margin of 4 points in the ISI (50% of minimally important difference) was adopted to assess whether tai chi was non-inferior to CBT-I.”direct quote[Results, Secondary outcomes]
“The insomnia remission rates differed between the CBT-I and tai chi groups at month 3 (83.3% v 56.1%, P<0.001) but were similar at month 15 (63.4% v 76.5%, P=0.067).”direct quote[Table 2]
“Cohen's d† | Month 3 | Month 15 | | Tai chi | ... | −1.50 | −2.33”