August 19, 2015
7 PDT/8 MDT/9 CDT/10 EDT/15 BST/Midnight AEST
Call in Number
Please note: the conferencing service will ask you to enter the pound sign. Press # for pound.
To mute, press *6.
- Educational Achievement progress
- xAPI VA project (see bootcamp presentation)
Attending: Rosalyn Scott, Tim Willett, Co-Chairs; Susan Albright, Andrew Allen, Terri Cameron, Steve Clyman, Sascha Cohen, Linda Gwinn, Josh Jacobs, Kevin Krane, and Paul Schilling
Andrew Allen is located in Philadelphia at Elsevier in their clinical solutions division and is Vice-President of Assessment Solutions. They are developing models for their content to encourage interoperability. They have another group looking at Caliper standards to learn about standards and apply to their products. Valerie explained Caliber standards were created by IMS and allow for granular tracking and analytics. Only those institutions that are members of IMS have access to standards. Andrew added the standards will be publically available in a few months.
Valerie provided an overview of the biggest implementation, the AAMC Curriculum Inventory. Several organizations on the call are already participating: Sascha is Director of Strategic Development for Ilios, Paul developed Oasis, Susan leads development of the TUSK curriculum management system. Valerie asked them for feedback on lessons learned during implementation. Susan commented implementation was relatively easy, but they haven’t fully implemented versioning yet. Sascha agreed and mentioned they have a more restrictive model on competency objects than the standard permits. Valerie inquired about specific restrictions. Sascha answered they constrain relationships in the hierarchy in a system specific way; they haven’t wanted to build that into the standards. They are looking forward to extending the model to cover EPA’s. Tim asked if the versioning challenge is due to limitation of the standard or implementation challenge. Susan thought implementation challenge and Sascha agreed. Paul commented they haven’t started yet. They are grappling with modeling of EPA’s.
B Educational Achievement progress
Valerie commented the Educational Achievement specification builds on the Performance Framework and the Competency Framework, conveying individual data on competency achievement. It will be reviewed by the Standards Committee, followed by balloting and public review. Tim asked how Educational Achievement specification will connect to Performance Framework and Competency Framework. Valerie explained assessment scores can be tied to competency and to a performance framework. The milestones developed by ACGME would be represented as performance frameworks with each level of performance having an associated score.
C xAPI VA project (see bootcamp presentation)
Rosalyn explained that the Department of Veterans Affairs is interested in using technology standards to bring together data about learner performance across the health care enterprise. The challenge is how to get data to drive programs for improvement. The American Heart Association Basic Life Support and Advanced Cardiac Life Support certification requires that you show ongoing competence. xAPI can address all of these scenarios. Valerie added the MedBiquitous xAPI interest group’s key scenario was collecting data for code simulation, integrating the competency framework and performance framework. The VA group is working to develop a performance framework for BLS and ACLS, analyze it and create recommendations and guidelines for use by the VA.
3 Review of Competency Framework Implementation Guidelines and discussion of sample XML
Tim raised the issue of including sample XML in the guidelines and asked the group for feedback. Valerie described the guidelines as general; previously they avoided including a sample XML because of the intellectual property issues. They also didn’t want people to think MedBiq was endorsing a single framework. Since 2012 the AAMC physician competency reference has been broadly implemented. Rosalyn suggested using the VA work code competency as an example or do something trivial and neutral. Tim agreed with using trivial example and Rosalyn suggested the process of making an elaborate dessert and the skills needed to create it. Valerie suggested modeling EPA’s as a competency framework. Susan questioned EPA framework as being a super competency framework. Valerie explained EPA is like a really big competency. They would model relationship to existing competency framework using current standard. She provided the example of a healthy newborn.
Josh mentioned the AAMC is working on a simple representation of EPA’s, competencies, and milestones that should be available shortly. It is a high level conceptual piece, not an implementation piece. Valerie asked if that would need separate EPA implementation guidelines. Steve mentioned everyone will be saying yes to that question soon; the biggest challenge is determining whether it’s providing us with information we need. Susan agreed. Josh agreed to share the document with this group as soon as it’s released. Valerie questioned the timeline. Josh replied that the plan is to distribute at the Learn, Serve, Lead meeting in November.
Tim suggested the group start collecting examples of EPA’s. Valerie added it also should include how EPA’s are used in curriculum and assessment. She asked Terri if that was addressed in the document. Terri commented it was at a high level. She suggested looking at thirteen CEPAR EPA’s and how they relate and are documented in curriculum. Susan and Valerie agreed that would be useful. Tim asked the group to send examples of other EPA structures.
Decision: We will hold off on developing EPA guidelines and wait for Terri to share the AAMC document.
4 Discuss developing Performance Framework Implementation Guidelines
Valerie will draft XML example to include in implementation guidelines.