πŸ€– ML: Statistical reinforcement learning and multi-armed bandits

How do we learn, while people use an app, take a course or follow a treatment, which option works best for whom, and when? I develop reinforcement-learning and multi-armed bandit methods that are statistically considerate: they optimise outcomes while still allowing valid scientific conclusions, often within a Bayesian framework (e.g. Thompson sampling).

Applications: biostatistics (just-in-time adaptive interventions in mobile health, dynamic treatment regimes, SMARTs); education (adaptive experiments in online courses); finance (sequential decision-making under uncertainty).

Team: Bibhas Chakraborty (Duke-NUS, Singapore); Sofia S. Villar (MRC Biostatistics Unit, University of Cambridge); Joseph Jay Williams (University of Toronto); the Google team behind PEARL, including Amy Armento Lee (PhD student I co-supervise, University of Cambridge); Caroline A. Figueroa (DIAMANTE study); my PhD student Simone Cuonzo (Sapienza).

Where to start: Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions (International Statistical Review, 2025).

Avatar
Nina Deliu
Continuous Learner, Piecewise Lecturer

Continuous Learner, Piecewise Lecturer (Statistics and Data Science)