Introduction to Evidence Synthesis and Bayesian dynamic borrowing
February 18, 2021
In the last few years, there has been a growing interest in historical borrowing or augmented trials. There is an increasing level of comfort in using these methodologies even in confirmatory trials setting. The key challenge in borrowing external information is the selection of appropriate historical studies or external data sources. There are benefits to historical borrowing but also potential risks (for example, Type I error and power can be impacted by the drift).
However, despite the risks, several projects submitted to the FDA’s Complex Innovative Designs (CID) initiative aim at using historical controls in Phase III studies. Many data-sharing initiatives such as, TransCelerate, Project Datasphere and others, are all working towards making clinical trial data available for repurposing and reuse across the industry. There are also several working groups such as, the European EFSPI/PSI Historical Data Special Interest Group and DIA Bayesian Working Group who are interested in this area. This blog aims to introduce the concepts of evidence synthesis and Bayesian dynamic borrowing.
Evidence synthesis
Partial extrapolation, multi-regional clinical trials and bridging studies are all forms of evidence synthesis. In this case, decision-making for the target group (for example, pediatrics, ethnic subgroup or region) is based on the totality of evidence about overall treatment effect in the source population, combined with the consistency of treatment effects across regions/subpopulations and knowledge about intrinsic and extrinsic factors likely to impact treatment effects in different regions/subpopulations. Formal synthesis of data from the source population and the target population using statistical modelling can help inform regulatory decision-making about regional treatment effects.
There are many ways to do evidence synthesis, but Meta-analysis is the most widely used method when there are several subgroups/regions of interest.
Bayesian Inference
Bayesian Inference is a form of evidence synthesis and Bayesian approaches provide a posterior probability distribution for some parameter (e.g., treatment effect), derived from the observed data and a prior probability distribution for the parameter. The posterior distribution is then used as the basis for statistical inference. For one of our clients, Cytel implemented a Bayesian framework of analysis which allowed the data that had been collected during the clinical trials for adults to serve as ‘informed priors’ for the pediatric trial. In Bayesian methodology, empirical evidence already available at the start of a trial is taken as the ‘prior’ and then methodically ‘updated’ throughout the course of the trial. Since Bayesian methods allow the use of data collected before a clinical trial commences, trial time diminishes.
Bayesian Dynamic Borrowing
They key thing to consider for the standard Bayesian approach is that if we use the source study data as a prior distribution then the posterior distribution for treatment effect is based on pooling the source and target study data. The source and target study data may not be entirely similar due to sampling variability or due to differences in inclusion/exclusion criteria between source and new studies, or health care may introduce differences between source and new outcomes. There can also be different populations/baseline risk factors (such as, ethnicity and age) involved in source and new studies.
The idea of dynamic borrowing is to account for the inconsistency between source data and target study population by learning how much information to borrow. The larger the drift, the less we borrow. The smaller the drift, the more we borrow.
Subscribe to our newsletter
Pantelis Vlachos
Vice President, Customer Success
Pantelis is Vice President of Customer Success for our software business and is based in Geneva. Before joining Cytel in 2013, he was a Principal Biostatistician at Merck Serono and a Professor of Statistics at Carnegie Mellon University for 12 years.
His research interests lie in adaptive designs, mainly from a Bayesian perspective, as well as hierarchical model testing and checking, although his secret passion is Text Mining. He has served as Managing Editor of the journal “Bayesian Analysis” as well as on editorial boards of several other journals and online statistical data and software archives.
Pantelis has a PhD in Statistics from the University of Connecticut.
Read full employee bioClaim your free 30-minute strategy session
Book a free, no-obligation strategy session with a Cytel expert to get advice on how to improve your drug’s probability of success and plot a clearer route to market.