Twenty-Two Years of Spinal Manipulation Trials Were Already Sufficient. The Field Kept Running Them Anyway.
Elliott and colleagues used Trial Sequential Analysis on the same Cochrane data this issue examined two days ago, and quantified the research waste hidden in plain sight: by 2002 for functional status and by 2004 for pain, the SMT-versus-conservative comparison had reached its information threshold. Every trial since has added cost, not knowledge.
Key Points
- Elliott and colleagues applied Trial Sequential Analysis (TSA) to the same Cochrane systematic review of SMT for chronic low back pain that this issue covered two days ago. Co-authors include Rubinstein and de Zoete, the lead authors of that Cochrane review.
- TSA is a meta-analytic method that monitors cumulative evidence over time using Z-curves and information-size boundaries, allowing researchers to identify when sufficient evidence had been gathered to draw a conclusion (or to declare futility).
- For SMT versus other conservative interventions on pain at one month, the futility and information-size boundary was crossed in 2004. For functional status, the boundary was crossed in 2002.
- Translation: every RCT comparing SMT to other conservative care, conducted after those dates, did not add to the understanding of effectiveness. Approximately 22 years of trials, costing tens of millions of dollars and involving thousands of patients, was research waste.
- The authors do not call for fewer trials. They call for trials that ask NEW questions: which patient phenotype responds, which technique works for which mechanism, what is the optimal dose, what is the long-term trajectory.
- This is the quantitative receipt for the de Zoete Cochrane review's methodological challenge: stop running the same kind of trials. TSA shows exactly when "the same kind of trial" stopped being informative.
When researchers want to know if a treatment works, they run randomized controlled trials and pool the results in a meta-analysis. The question this paper asks is unusually honest: at what point was the evidence already sufficient? When did the next trial stop adding information?
Trial Sequential Analysis is a relatively young method that plots the accumulating evidence over time. It draws statistical boundaries that, when crossed, signal that further trials of the same kind will not change the conclusion. For spinal manipulation versus other conservative treatments for chronic back pain, the boundary was crossed in 2002 for function and 2004 for pain.
Every trial of that type since then has been redundant. Patients enrolled, money spent, careers built, conclusions unchanged. The paper is unflinching in calling this research waste. It also offers a path forward: trials with novel research questions, designed to fill gaps that existing evidence has not addressed.
The Question
For most clinical questions, the standard meta-analysis treats accumulating evidence as a single static dataset. The pool is everything that exists, summarized as a single effect with a confidence interval. What this approach hides is the temporal structure of how the evidence accumulated. Did the first ten trials answer the question, with the next forty just ratifying the answer? Or did the question remain genuinely open through trial sixty?
Trial Sequential Analysis (TSA) was developed to address this hidden structure. It is borrowed from interim-analysis methodology used in single trials, where researchers monitor accumulating data and stop the trial early if the evidence becomes overwhelming for benefit, harm, or futility. TSA applies the same logic to a research field over time. As trials accumulate, the cumulative Z-curve is plotted against monitoring boundaries. When the curve crosses a boundary, the question is statistically answered, and further trials of the same design are unlikely to change the conclusion.
Elliott and colleagues asked one of the most uncomfortable questions in chiropractic research: when, if ever, did the evidence base for SMT in chronic low back pain become sufficient to draw a stable conclusion? And what does that mean for the trials that came afterward?
The Methods
The team used data from the same Cochrane systematic review this issue covered two days ago, the de Zoete et al. 2026 update of CD008112. Two of the lead authors of that review, Sidney Rubinstein and Annemarie de Zoete, are co-authors on this Elliott analysis. This is significant: the Elliott team had access to the cleanest possible version of the dataset, and the analytic framework is internally consistent with the Cochrane review's findings.
TSA was applied to the comparison most clinicians care about: SMT versus other conservative interventions, at one-month and longer follow-up. The primary outcomes were pain and functional status. For each outcome, the team plotted the cumulative Z-curve over the chronological order of trial publication, and identified the point at which the Z-curve crossed either the conventional statistical-significance boundary, the futility boundary, or the required information size.
60 RCTs were eligible, with 10,312 total participants. Note that this is fewer than the 76 RCTs in the de Zoete Cochrane review. The 16-trial difference reflects the Elliott analysis being limited to the SMT-versus-conservative comparison and excluding sham and no-treatment comparisons.
What They Found
| Outcome | Year Boundary Crossed | Years of Subsequent Redundant Trials (through 2024) |
|---|---|---|
| Pain at 1 month | 2004 | 20 years |
| Functional status at 1 month | 2002 | 22 years |
| Pain at longer follow-up | Similar dates | ~20 years |
| Function at longer follow-up | Similar dates | ~22 years |
The findings are remarkable in their consistency. Across all four primary comparisons, the evidence base reached its informational ceiling in the early 2000s. From that point forward, additional trials of similar design did not change the answer. The futility boundary, which signals that further evidence is unlikely to demonstrate a clinically meaningful effect or non-effect, was crossed at the same time as the information-size boundary.
Stated plainly: by the time most chiropractors practicing today finished their training, the question of whether SMT outperforms other conservative interventions for chronic LBP was already statistically resolved. The answer, established in 2002 to 2004, is the same answer the de Zoete Cochrane review reports today: SMT and other conservative treatments produce similar outcomes, with a small advantage for SMT on functional status, low certainty.
The trials conducted after the boundary was crossed are not invalid in any individual ethical sense. They were designed and approved with the best intentions. What they failed to do is contribute new information. Patients enrolled, time and resources allocated, careers built around findings that ratified what was already known.
What This Means Clinically and Methodologically
For a practicing clinician, the immediate clinical message is identical to the message from our Cochrane SMT commentary: the evidence supports SMT as a reasonable conservative option for chronic LBP, with effects similar in size to other active conservative interventions. The Elliott paper does not change that bottom line. It strengthens it. Twenty-two years of subsequent trials all ratified the same conclusion. The clinical answer is stable.
The harder message is for the research community, the funders, and the practitioners who consume the literature. If Elliott and colleagues are correct, an enormous amount of research effort has been spent producing redundant evidence. That effort could have been directed at the questions the field actually needs answered:
Which patient phenotype responds best to SMT? The current evidence treats "chronic LBP" as a single homogeneous category, when clinicians know it is anything but. Discogenic, facet-mediated, sacroiliac, central-sensitization-driven, fear-avoidance-mediated. These are different patient profiles and likely respond differently to manual therapy.
Which SMT technique produces the best outcomes for which mechanism? Diversified, Gonstead, drop-table, instrument-assisted, mobilization-only. These are categorically different interventions pooled under one label.
What is the optimal dose? Most trials use four to twelve sessions over four to six weeks. Few have systematically varied dose to identify the inflection point.
What predicts non-response? Identifying the patient profile that does NOT benefit from SMT would let clinicians redirect those patients to other interventions earlier, saving them time and the system money.
The authors of the Elliott paper are not anti-SMT researchers. Two of them are themselves co-authors on the foundational Cochrane review. This is internal critique from the people best positioned to make it.
The Methodological Innovation
TSA as a tool deserves attention beyond this specific application. The method makes visible something that has been hidden in conventional meta-analysis: the temporal structure of evidence accumulation. Every clinical field with a long history of redundant RCTs (acupuncture for various conditions, vitamin supplementation, certain surgical interventions) could benefit from a TSA pass to identify when the question was effectively answered. The Elliott team explicitly advocates for this in their significance statement. Reporting standards from the EQUATOR Network already provide much of the methodological scaffolding for trials that ask new questions instead of replicating old ones.
For chiropractic researchers and journal editors specifically, the implication is more direct: a proposed trial that asks the same question as a 2004 trial, with a similar design, should face a higher publication bar. Reviewers should ask: what does this trial add that 60 prior trials have not?
What I Tell Patients
Patients do not need to know about Trial Sequential Analysis. They need to know that the evidence for chiropractic care for chronic low back pain is mature, stable, and broadly favorable, and that the question of effectiveness is settled enough that the research community is now arguing about which subgroups benefit most. That framing serves patients better than the older "the evidence is mixed and evolving" story, which was true in 1998 and is no longer true today.
When patients ask "is there evidence chiropractic works for back pain," the answer is yes. The evidence reached statistical sufficiency in 2002 to 2004 and has been ratified continuously since. The remaining open questions are about precision (which technique, which patient, which dose), not about whether the intervention works at all.
TSA is sensitive to the assumptions used to define the futility boundary. Different threshold choices for what counts as a clinically meaningful effect produce different boundary-crossing dates. The Elliott team made defensible choices, but reasonable methodologists could disagree at the margins.
The analysis covers SMT versus other conservative interventions specifically. The SMT-versus-sham and SMT-versus-no-treatment comparisons are not analyzed in this paper.
Pooling of heterogeneous SMT techniques and dosing schedules is preserved from the source Cochrane review. If the underlying trials are mismatched in ways that matter, the TSA inherits that limitation.
The findings apply specifically to chronic low back pain. They cannot be extrapolated to acute LBP, neck pain, or other manual-therapy targets without separate TSA analyses.
Funder bias: Martin Underwood, the senior author, has substantial UK NIHR research funding history and is a director of a private research data company. Annemarie de Zoete is a practicing chiropractor. The team is transparent about these affiliations, but the disclosed conflicts of interest are substantial.
The clinical question of whether spinal manipulation works for chronic low back pain was statistically resolved in 2002 to 2004. The 22 years of subsequent same-design trials added cost without adding knowledge. The evidence base is mature and stable. The questions that remain are about which technique works for which patient at what dose, not about whether the intervention works at all. Future trials should be designed to answer the open questions, not to re-answer the closed ones.
Editorial Disclosure
The Forward Review is editorial commentary, not peer reviewed. Written by Jason Forward, DC, a licensed chiropractor at Vanguard Chiropractic in Tulsa, Oklahoma. Commentary reflects clinical interpretation and does not represent the views of the original authors or any institution.
Conflict of interest: Dr. Forward is a practicing chiropractor whose clinical work includes spinal manipulative therapy for low back pain. No financial relationships with the cited authors, the journal, or any party to this work.
Corrections policy: Errors are corrected with a dated correction notice appended to the article. Original text remains accessible via revision history.
Level of evidence: Trial Sequential Analysis applied to a Cochrane systematic review (60 RCTs, 10,312 participants).
- What Actually Helps a Child With ADHD, Ranked by Evidence Instead of PopularityForward Rev. 2026;1(2)
- Hands-On Care for Muscle and Joint Pain: A 2026 Review of ReviewsForward Rev. 2026;1(2)
- Which Neck Exercise Actually Works? A 2026 Network Meta-AnalysisForward Rev. 2026;1(2)
- Exercise or Hands-On Therapy for Low Back Pain? A 2026 Network Meta-AnalysisForward Rev. 2026;1(2)
View Vol. I, No. i and the full archive