Research Projects

What I work on, who I work with, and where to start reading.

🤖 ML: Statistical reinforcement learning and multi-armed bandits

How do we learn, while people use an app, take a course or follow a treatment, which option works best for whom, and when? I develop reinforcement-learning and multi-armed bandit methods that are statistically considerate: they optimise outcomes while still allowing valid scientific conclusions, often within a Bayesian framework (e.g. Thompson sampling).

Applications: biostatistics (just-in-time adaptive interventions in mobile health, dynamic treatment regimes, SMARTs); education (adaptive experiments in online courses); finance (sequential decision-making under uncertainty).

Team: Bibhas Chakraborty and former co-supervised PhD students Xueqing Liu and Xinru Wang (Duke-NUS, Singapore); Joseph Jay Williams (University of Toronto); the Google team behind PEARL, including Amy Armento Lee (PhD student, University of Cambridge) and Hulya Emir-Farinas; Caroline A. Figueroa and Adrian Aguilera (DIAMANTE study); my PhD student Simone Cuonzo (Sapienza).

Software: the R package countts for Thompson sampling with count outcomes.

Where to start: Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions (International Statistical Review, 2025).

Publications

(2026). A Personalized Exercise Assistant using Reinforcement Learning (PEARL): Results from a Large-Scale Mobile Health Randomized-Controlled Trial. Journal of Medical Internet Research. DOI: 10.2196/91156

RL & bandits DOI arXiv

(2026). A Latent-State-Aware Framework for Non-Stationary UCB Bandits. In Proceedings of the Statistics and Data Science Workshop 2026, Caserta (in press).

RL & bandits

(2025). Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions. International Statistical Review, 93(3), pp. 385–424. DOI: 10.1111/insr.12583

RL & bandits DOI arXiv

(2025). Thompson sampling for zero-inflated count outcomes with an application to the Drink Less mobile health study. The Annals of Applied Statistics, 19(2), pp. 1403–1425. DOI: 10.1214/25-AOAS2030

RL & bandits DOI arXiv

(2025). Artificial Intelligence-Based Decision Support Systems for Precision and Digital Health. In Frontiers of Statistics and Data Science. Springer, pp. 1–38. DOI: 10.1007/978-981-96-0742-6_1

RL & bandits DOI arXiv

(2025). Platform-based Adaptive Experimental Research in Education: Lessons Learned from Winning a Digital Learning Challenge. In Proceedings of the 15th International Conference on Learning Analytics & Knowledge (LAK25). ACM, pp. 13–23. DOI: 10.1145/3706468.3706471

RL & bandits Education DOI Video

(2024). Platform-based Adaptive Experimental Research in Education: Lessons Learned from Digital Learning Challenge. In Proceedings of the 14th International Conference on Learning Analytics & Knowledge (LAK24). ACM.

RL & bandits Education

(2024). Using Adaptive Bandit Experiments to Increase and Investigate Engagement in Mental Health. In Proceedings of the AAAI Conference on Artificial Intelligence, 38, pp. 22906–22912. DOI: 10.1609/aaai.v38i21.30328

RL & bandits DOI arXiv

(2023). Microrandomized Trials: Developing Just-in-Time Adaptive Interventions for Better Public Health. American Journal of Public Health, 113(1), pp. 60–69. DOI: 10.2105/AJPH.2022.307150

RL & bandits DOI Podcast

(2022). Daily Motivational Text Messages to Promote Physical Activity in University Students: Results From a Microrandomized Trial. Annals of Behavioral Medicine, 56(2), pp. 212–218. DOI: 10.1093/abm/kaab028

RL & bandits DOI

(2022). Dynamic Treatment Regimes for Optimizing Healthcare. In The Elements of Joint Learning and Optimization in Operations Management. Springer, pp. 391–444. DOI: 10.1007/978-3-031-01926-5_15

RL & bandits DOI

(2022). Multinomial Thompson Sampling for adaptive experiments with rating scales. In Book of Short Papers SIS 2022. Pearson, pp. 1065–1070.

RL & bandits Education

(2022). Algorithms for Adaptive Experiments that Trade-off Statistical Analysis with Reward: Combining Uniform Random Assignment and Reward Maximization. arXiv preprint. arXiv: 2112.08507

RL & bandits Adaptive inference Education arXiv

(2021). Adaptive learning algorithms to optimize mobile applications for behavioral health: guidelines for design decisions. Journal of the American Medical Informatics Association, 28(6), pp. 1225–1234. DOI: 10.1093/jamia/ocab001

RL & bandits DOI

(2021). Reinforcement Learning in Modern Biostatistics: Benefits, Challenges and New Proposals. PhD Thesis, Sapienza University of Rome.

RL & bandits


📏 STATS: Uncertainty quantification, from Bayesian inference to conformal prediction

How sure are we? I work on quantifying uncertainty in a principled way, from Bayesian inference to conformal prediction: their interplay and how to get honest coverage guarantees, highest-density regions for complex and multimodal data, and calibration testing with e-values. Recent work brings conformal ideas into sequential decision-making (conformal bandits) and into small-area estimation.

Applications: finance (volatility models, tail risk, decisions under uncertainty); official statistics (small-area estimation and accuracy of register-based statistics with ISTAT; disaster-induced production losses in agriculture with FAO).

Team: Brunero Liseo (Sapienza University of Rome); my PhD students Simone Cuonzo and Emanuele Masillo (Sapienza); Davide Carmelo Di Leonforte; colleagues at ISTAT and at the FAO Statistics Division.

Where to start: The interplay between Bayesian inference and conformal prediction (Philosophical Transactions of the Royal Society A, 2026).

Publications

(2027+; Under review). Conformal Prediction Intervals with Tail-Specific Guarantees. arXiv preprint. arXiv: 2606.18199

Uncertainty arXiv

(2026). The interplay between Bayesian inference and conformal prediction. Philosophical Transactions of the Royal Society A, 384(2327), 20250073. DOI: 10.1098/rsta.2025.0073

Uncertainty DOI arXiv

(2026). Alternative Approaches for Estimating Highest-Density Regions. International Statistical Review, 94(1), pp. 97–120. DOI: 10.1111/insr.12592

Uncertainty DOI arXiv

(2026). Bayesian Conformal Prediction for Small-Area Estimation with Proportion Data. In Proceedings of the Statistics and Data Science Workshop 2026, Caserta (in press).

Uncertainty

(2025). Dynamic testing of volatility models’ calibration using E-values. Statistics & Probability Letters, 226, 110515. DOI: 10.1016/j.spl.2025.110515

Uncertainty DOI

(2025). Using Vine Copulas for Estimating Highest-Density Regions in Multivariate Data. In Statistics for Innovation III, SIS 2025, Short Papers, Contributed Sessions 2. Springer, pp. 488–493. DOI: 10.1007/978-3-031-95995-0_81

Uncertainty DOI

(2025). Conformal methods in official statistics: perspectives and challenges. In The Third Workshop on Methodologies for Official Statistics. ISTAT, pp. 157–173.

Uncertainty

(2023). Computing Highest Density Regions with Copulae. In SEAS IN: Book of Short Papers SIS 2023. Pearson, pp. 1235–1240.

Uncertainty


đź’Š STATS: Inference in adaptive designs

Adaptive designs, such as response-adaptive randomisation and bandit-driven experiments, assign more participants to the options that seem to work better. This is more ethical and often more efficient, but it changes how the data must be analysed: classical tests and estimators can become biased or lose error control. I develop tests with guaranteed error control for adaptively collected data, and study the trade-off between learning and helping participants.

Applications: biostatistics (response-adaptive clinical trials in rare diseases, such as StratosPHere 2 in pulmonary arterial hypertension); education (adaptive experiments in online courses).

Team: Sofia S. Villar and Rajenki Das ( MRC Biostatistics Unit, University of Cambridge); Mark Toshner (Department of Medicine, University of Cambridge, and Royal Papworth Hospital); Joseph Jay Williams (University of Toronto), Anna Rafferty and Audrey Durand.

Where to start: Finite-sample and asymptotic validity of a novel design-based test statistic for response-adaptive randomisation (Biometrics, 2025).

Publications

(2026). Implementing Response-Adaptive Randomisation in Stratified Rare-disease Trials: Design Challenges and Practical Solutions. Statistical Methods in Medical Research (Special Issue on Response-Adaptive Randomization in Clinical Trials). DOI: 10.1177/09622802251380625

Adaptive inference DOI arXiv

(2026). Sotatercept reduces bone morphogenetic protein signaling in patients with pulmonary arterial hypertension. Science Translational Medicine, 18(850), eads5175. DOI: 10.1126/scitranslmed.ads5175

Adaptive inference DOI

(2025). Finite-sample inference in response-adaptive designs: an application to Thompson sampling. In Methodological and Applied Statistics and Demography II, SIS 2024, Short Papers, Solicited Sessions. Springer, pp. 393–398. DOI: 10.1007/978-3-031-64350-7_66

Adaptive inference DOI

(2024). StratosPHere 2: study protocol for a response-adaptive randomised placebo-controlled phase II trial to evaluate hydroxychloroquine and phenylbutyrate in pulmonary arterial hypertension caused by mutations in BMPR2. Trials, 25, 680. DOI: 10.1186/s13063-024-08485-z

Adaptive inference DOI

(2022). Multi-disciplinary fairness considerations in machine learning for clinical trials. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT ‘22). ACM, pp. 906–924. DOI: 10.1145/3531146.3533154

Adaptive inference DOI arXiv

(2022). Algorithms for Adaptive Experiments that Trade-off Statistical Analysis with Reward: Combining Uniform Random Assignment and Reward Maximization. arXiv preprint. arXiv: 2112.08507

RL & bandits Adaptive inference Education arXiv


🎓 APP: Advanced statistics in education

Education is where many of my methods meet real data. With the Adaptive Experimentation Accelerator, winner of the 2023 XPRIZE Digital Learning Challenge, we run bandit-driven adaptive experiments in real online courses; a Sapienza research grant (PI, 2025) now brings these methods into our own statistics courses. With ISTAT, I develop scalable methods to measure the accuracy of education statistics built from multisource registers. And with colleagues at Sapienza, we model students’ careers, for example to understand late graduations.

Team: Joseph Jay Williams (Intelligent Adaptive Interventions Lab, University of Toronto), Anna Rafferty, Audrey Durand, and colleagues at Carnegie Mellon University and North Carolina State University; Piero Demetrio Falorsi, Stefano Falorsi, Diego Chianella and Giorgio Alleva ( ISTAT); Brunero Liseo, Andrea Tancredi and Edoardo Pandolfo (Sapienza).

Where to start: Platform-based Adaptive Experimental Research in Education: Lessons Learned from Winning a Digital Learning Challenge (LAK25, 2025) and Scalable Generalised Accuracy Estimation for Multisource Register-based Official Statistics (JRSS-A, 2026).

Publications

(2026). Scalable Generalised Accuracy Estimation for Multisource Register-based Official Statistics. Journal of the Royal Statistical Society: Series A. DOI: 10.1093/jrsssa/qnag107

Education DOI arXiv

(2026). Modeling Late Graduations: An Hidden Markov Model Approach. In Statistical Science: From Theory to Applied Research IV. Springer, pp. 194–199. DOI: 10.1007/978-3-032-30665-4_32

Education DOI

(2025). Platform-based Adaptive Experimental Research in Education: Lessons Learned from Winning a Digital Learning Challenge. In Proceedings of the 15th International Conference on Learning Analytics & Knowledge (LAK25). ACM, pp. 13–23. DOI: 10.1145/3706468.3706471

RL & bandits Education DOI Video

(2025). Linearisation approach for measuring the accuracy of multinomial outcomes from a statistical register. In The Third Workshop on Methodologies for Official Statistics. ISTAT, pp. 55–64.

Education

(2024). Platform-based Adaptive Experimental Research in Education: Lessons Learned from Digital Learning Challenge. In Proceedings of the 14th International Conference on Learning Analytics & Knowledge (LAK24). ACM.

RL & bandits Education

(2023). Informing Users about Data Imputation: Exploring the Design Space for Dealing With Non-Responses. In Proceedings of the 11th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2023), 11, pp. 14–26. DOI: 10.1609/hcomp.v11i1.27544

Education DOI

(2023). Multiculturality and Interculturality: A Qualitative Analysis of the Perspective of Focus Group Participants. In Education in Multiculturality, Education to Interculturality. Urbaniana University Press, pp. 113–158.

Education

(2022). Multinomial Thompson Sampling for adaptive experiments with rating scales. In Book of Short Papers SIS 2022. Pearson, pp. 1065–1070.

RL & bandits Education

(2022). Algorithms for Adaptive Experiments that Trade-off Statistical Analysis with Reward: Combining Uniform Random Assignment and Reward Maximization. arXiv preprint. arXiv: 2112.08507

RL & bandits Adaptive inference Education arXiv


đź§Ş APP: Advanced Bayesian statistics for doping detection

Athletes’ biological passports are long, multivariate records of blood and urine markers. We build Bayesian copula-based models that look at these markers jointly over time, to flag suspicious profiles more reliably than one-marker-at-a-time tests.

Funding: World Anti-Doping Agency, WADA Research Grant (Co-PI; PI: Brunero Liseo); Sapienza research grant (PI).

Team: Brunero Liseo (Sapienza); my PhD students Emanuele Masillo and Eva Pigi Vyltanioti; Dimitris Karlis (Athens University of Economics and Business); NADO Italia and the World Anti-Doping Agency.

Where to start: A Copula-based Bayesian Framework for Doping Detection (Computational Statistics, 2025).

Publications

(2027+; Under review). Bayesian Computation of Copula-based Multivariate Models with an Application to Doping Detection.

Doping

(2026). Computational Approaches for Bayesian Inference in Copula-Based Hierarchical Models: An Application to Doping Detection. In Proceedings of the Statistics and Data Science Workshop 2026, Caserta (in press).

Doping

(2025). A Copula-based Bayesian Framework for Doping Detection. Computational Statistics, 40(4), pp. 1873–1898. DOI: 10.1007/s00180-024-01579-x

Doping DOI arXiv


Interested in a PhD or a research visit on one of these topics? Get in touch at nina.deliu [at] uniroma1 [dot] it with a short CV and the project that interests you.

đź‘¶ Heads-up: I am on maternity leave until late February 2027, so replies may be slower than usual.