In clinical research, the randomized controlled trial (RCT) has been considered the gold standard. Yet in many areas — especially in oncology and rare diseases — running an RCT with a balanced control arm is not always possible. Patients, physicians, and regulators often face a difficult reality: how do we evaluate promising new therapies when traditional designs aren’t feasible?
This is where external control arms (ECAs) come into play. By carefully drawing on existing data sources and applying rigorous methodology, ECAs can help provide the context and comparative evidence needed to make better decisions.
Here, we will explore why ECAs are particularly valuable in oncology and rare diseases, how they support decision-making and study design, what data sources they can rely on, and which statistical methods are essential to reduce bias. We will also introduce the concept of quantitative bias analysis and conclude with why experienced statisticians are key to the success of this methodology.
Why external control arms matter in oncology and rare diseases
Oncology and rare disease research share several challenges that make traditional RCTs difficult:
- Small patient populations: In rare diseases, the number of eligible patients is often extremely limited. Asking half of them to enroll in a control arm may make recruitment impossible.
- High unmet need: In oncology, patients and families are eager for new options. Many consider it unacceptable to randomize patients to placebo or outdated standards of care.
- Ethical constraints: For life-threatening conditions, denying patients access to an experimental therapy can be ethically challenging.
- Rapidly changing standards of care: In oncology, new treatments are approved frequently. A control arm that was relevant when a trial began may become outdated by the time results are available.
In such contexts, single-arm studies (where all patients receive the experimental therapy) are common. But single-arm results alone are not sufficient. Without a comparator, how do we know if the observed survival or response rate truly reflects an advance? ECAs provide the missing context.
Even when a trial includes a control arm, unbalanced designs — such as smaller control groups or cross-over to experimental treatment — can limit the ability to make clean comparisons. External controls can augment these designs, helping to stabilize estimates and provide reassurance that results are robust.
Supporting internal and regulatory decision-making
ECAs serve multiple purposes:
- Internal decision-making:
- Companies developing new therapies must decide whether to advance to the next trial phase, expand into new indications, or pursue partnerships.
- ECAs help answer questions like: Is the observed benefit large enough compared to historical data? Do safety signals look acceptable in context?
- Regulatory decision-making:
- Regulatory agencies such as FDA and EMA increasingly accept ECAs as part of submissions, especially in rare diseases and oncology.
- While not a replacement for RCTs, ECAs can strengthen the evidence package and demonstrate comparative effectiveness in situations where randomization is not feasible.
- Helping the medical community:
- Physicians, payers, and patients need to interpret trial results. An overall survival rate of 18 months in a single-arm study may sound promising, but how does it compare to similar patients receiving standard of care?
- ECAs help put numbers into perspective, allowing the community to better understand the true value of a new therapy.
Designing better studies with ECAs
External controls are not only a tool for analyzing results — they can also improve study design.
- Feasibility assessments: By examining real-world data or prior trial results, sponsors can estimate expected event rates, patient characteristics, and recruitment timelines. This reduces the risk of under- or over-powered studies.
- Endpoint selection: Understanding how endpoints behave in historical or real-world settings helps refine choices for the trial, ensuring relevance to both regulators and clinicians.
- Eligibility criteria: RWD and earlier trial data can reveal which inclusion/exclusion criteria are overly restrictive. Adjusting them can broaden access while maintaining scientific rigor.
- Sample size planning: By leveraging ECAs, trialists may reduce the number of patients required for an internal control arm, easing recruitment in small populations.
In other words, ECAs can shape trials from the start, rather than being seen only as a “rescue” option after the fact.
Sources of external control data
An ECA is only as good as the data it relies on. Broadly, there are three main sources:
- Other clinical trials:
- Prior trials of standard of care treatments can serve as external comparators.
- Individual patient-level data (IPD) is preferred, but often only summary data is available.
- These data are typically high quality but may not perfectly match the new study population.
- Published studies:
- Systematic reviews and meta-analyses of the literature can provide comparator data.
- Useful when IPD is unavailable but limited by reporting standards and heterogeneity across studies.
- Real-world data (RWD):
- Sources include electronic health records, registries, and insurance claims databases.
- These capture routine clinical practice, reflecting the diversity of real patients.
- However, RWD often suffers from missing data, variable quality, and lack of standardized endpoints.
Each source has strengths and weaknesses. Often, the best approach is to triangulate across multiple sources, ensuring that conclusions do not rest on a single dataset.
The value of earlier clinical trials
Earlier-phase trials (Phase I and II) can be particularly valuable in constructing ECAs. These studies often include control arms, detailed eligibility criteria, and well-captured endpoints.
For rare diseases and oncology, earlier trials may be the only available benchmark. By carefully aligning populations and endpoints, statisticians can extract maximum value from these datasets.
The challenge, of course, is ensuring comparability. Patient populations may differ in prognostic factors, supportive care practices may evolve, and definitions of endpoints may shift over time.
This is where advanced statistical methods become essential.
Reducing bias with propensity scoring
One of the key criticisms of ECAs is the risk of bias. Without randomization, patients receiving the experimental therapy may differ systematically from those in the external control.
Propensity score methods are a powerful way to reduce this bias. The idea is simple:
- For each patient, estimate the probability (the “propensity”) of receiving the experimental treatment based on baseline characteristics.
- Match or weight patients in the external control group so that their distribution of covariates mirrors that of the trial patients.
This approach creates a “pseudo-randomized” comparison, balancing measured variables. While it cannot eliminate unmeasured confounding, it greatly improves fairness in comparisons.
Quantitative bias analysis: Addressing the unmeasured
Even with careful propensity scoring, unmeasured confounding remains a concern. Clinical researchers often ask: What if there are factors we didn’t account for?
This is where quantitative bias analysis (QBA) enters. QBA does not eliminate bias but helps us understand its potential impact.
For example:
- Analysts can model how strong an unmeasured confounder would need to be to explain away the observed treatment effect.
- Sensitivity analyses can simulate scenarios with different assumptions about unmeasured variables.
By explicitly quantifying uncertainty, QBA provides transparency. Regulators and clinicians gain confidence that conclusions are robust — or at least, that limitations are clearly understood.
The need for experienced statisticians
Constructing an ECA is not a “plug-and-play” exercise. It requires expertise across multiple domains:
- Data curation: Selecting fit-for-purpose datasets, cleaning and harmonizing variables, and aligning endpoints.
- Study design: Defining eligibility, follow-up time, and analysis plans that minimize bias.
- Statistical methodology: Applying techniques like propensity scoring, inverse probability weighting, Bayesian borrowing, and QBA.
- Regulatory communication: Explaining assumptions, limitations, and sensitivity analyses in language that regulators and clinicians can understand.
In short, ECAs demand both technical skill and strategic judgment. Partnering with experienced statisticians ensures that external controls provide credible, decision-grade evidence rather than misleading comparisons.
Final takeaways
External control arms are rapidly becoming an indispensable tool in modern clinical research — especially in oncology and rare diseases, where traditional RCTs often fall short.
They offer:
- Context for single-arm studies and unbalanced designs.
- Support for both internal and regulatory decisions.
- Guidance in study design and feasibility planning.
By leveraging diverse data sources — from earlier trials to real-world evidence — and applying rigorous methods such as propensity scoring and quantitative bias analysis, ECAs can bring clarity and credibility to difficult development programs.
But the value of ECAs depends on how well they are planned and implemented. Done poorly, they risk misleading decisions. Done well, they empower researchers, regulators, and clinicians to make better choices for patients.
As the field evolves, one thing is clear: the expertise of skilled statisticians is the cornerstone of successful ECAs.
Interested in learning more?
Join Alexander Schacht, Steven Ting, and Vahe Asvatourian for their upcoming webinar, “Beyond the Standard Clinical Trial in Early Development: When and Why to Consider External Controls” on Thursday, October 16 at 10 a.m. ET:
