Retrospective Analysis of IPF/ILD CME Outcome Reports

Health Care Problem:

In 2020, Boehringer Ingelheim egaged an independent vendor to analyze outcomes reports from supported activities.  Outcomes of 40 BI-funded ILD CME programs completed during 2018 to 2020 were studied to:

1. Evaluate the change in participants’ knowledge and confidence in epidemiology, pathophysiology, diagnosis, and treatment of ILD and its subtypes, after attending CME programs


2. Identify knowledge gaps, potential areas of focus for future ILD CME programs


3. Evaluate the relative performance of the programs designed for multidisciplinary vs single-discipline target audiences

Educational Strategy: In early 2022, a member of the BI fellows program was selected to present the results of this analysis.  However, upon review of the data, the medical education team identified that data was based on subjective reporting by CME providers and reports often were subpar.   The medical education team worked with the fellow to develop a scoring rubric to evaluate the caliber of questions, relevance of assessment methods to learning objectives, and the overall reliability and robustness of learner change data.

Patient-Level Outcome(s) Measured: Nine (9) outcomes reports from alternative programs were analyzed based on a 5-point Likert scale, from exceeded expectations to did not meet expectations.  The maximum score for each report was 15.  The highest score was a 9.  The average score was a 4.9.  We would like to share the results of this analysis as well as common pitfalls that were identified.