Epistudia’s expert-informed AI-based training (EIAT) is a new approach in continuing medical education (CME), designed to make course creation faster, more affordable, and continuously updated. With over 100 million healthcare professionals worldwide relying on CME, the potential impact is enormous, but how effective is EIAT compared to traditional live expert-led training (LET)?
In an international collaboration, our team conducted a within pre–post intervention pilot study with 17 medical students and professionals. The study has now been published as a preprint.
Key Findings:
- Completion rates were similar: 76% for EIAT and 82% for LET.
- Knowledge improvement significantly increased in both groups. LET participants started with lower pre-knowledge score ( 63 ± 11.4 vs 73.8 ± 11.2 in EIAT)and demonstrated a larger average gain (mean difference 14.2 ± 21.5, p = 0.17), but not significant different and post-exam scores were nearly identical (EIAT: 93.5 vs. LET: 93.3, p-value >0.05).
- Satisfaction was consistently high in both formats, with average ratings of 9.7/10 for EIAT and 10/10 for LET.
- Engagement appeared higher in LET (60% vs. 74%), where more participants described themselves as actively involved.
- Practical knowledge was rated higher in LET, though non significant different and both groups reported similar intentions to apply what they had learned in practice.
- Quality and fairness were rated highly across both formats, with no evidence of commercial bias.
Why it matters:
This pilot study positions EIAT as a promising model for scalable alternative or complement to traditinioal CME learning, supporting healthcare professionals with high-quality, up-to-date and flexible learning. More research is needed to assess the effectiveness of formally integrating this approach into professional training programs
The study is not peer-reviewed and we invite to read the full preprint
here.
We sincerely thank all participants who contributed to this study, our international collaborators, the Embassy of Kosovo and the Albanian Embassy in London for their logistical support, the United Kingdom Albanian Medical Society for organizing and facilitating the training, and KAYAV for sponsoring the event.
