P0723 - Development and Validation of the Pediatric Ethics and Professionalism Assessment Tool (Pedi-EPAT)

Background: Evaluation of applied ethical behavior and professionalism in pediatric and pediatric sub-specialty trainees remains challenging yet crucial, not only for learner growth and development, but for milestones evaluation and effective feedback.

Objective: To develop and validate a pediatric ethics and professionalism assessment tool (Pedi-EPAT) that effectively and reliably assesses pediatric trainee performance, improves milestone tracking and improves trainee feedback.

Design/

Methods: 11 regional/national experts in general pediatrics and sub-specialties, medical education and medical ethics participated in a 2-round Modified Delphi method to develop and finalize the Pedi-EPAT items. Consensus of predetermined criteria was defined as >80% of combined survey scores of ‘quite relevant (score 4)’ and ‘extremely relevant (score 5)’ for each item, with median score >4 (IQR<2). Items were excluded with combined scores of 3).The final version is being validated through interdisciplinary faculty inter-rater comparisons of recorded simulated ethical scenarios involving pediatric trainees, using Fleiss weighted kappa for multiple raters and inter-class correlation coefficient.

Results: During the first Delphi round, 23 of 34 items (67%) in the Pedi-EPAT reached the consensus level criteria; one item was excluded and one was added. The second Delphi round reached consensus for the remaining 11 (100%) revised items. Inter-rater comparisons of 3 simulated scenarios are ongoing. (Figure 1)

Conclusions: The Pedi-EPAT is a novel, competency-based formative assessment tool to effectively evaluate applied ethical behavior and professionalism in pediatric and pediatric sub-specialty trainees. Ongoing work involves tool validation. This tool will also assist in milestones evaluation and provision of effective supervisory feedback to trainees