MedBiquitous Metrics Working Group Charter
Document version: 1.0
Date: 6 June 2005
Author: Valerie Smothers (firstname.lastname@example.org)
The mission of the MedBiquitous Metrics Working Group is to develop XML standards and Web services requirements and descriptions for the exchange of aggregate evaluation data and other key metrics for health professions education.
As the Institute of Medicine and others call for reforms to Continuing Medical Education and other types of Continuing Education (CE) for the health professions, there has been an increasing focus on measuring the quality of CE activities. Educators, Accreditors, CE supporters, and government agencies often collect aggregate data on the reach and efficacy of CE activities in order to gauge improvement and identify strong or weak activities. Educators may use this data to evaluate the effectiveness of their educational activities and content or of their overall educational program. Certifiers, accrediters, and supporters may use this data to monitor the success of multiple educational activities and programs as a whole.
Currently, the data these entities collect comes in different formats and often measures different things, making it difficult to compare metrics and determine the efficacy of educational activities. In addition, many educational providers are seeking guidance on the best way to evaluate their programs. These providers would benefit greatly from viewing a core set of educational metrics and sample questions developed by experts in the field. Promoting consistent evaluation measurements will enable many providers to begin measuring the effectiveness of the programs and help them identify ways to improve their programs.
The majority of content providers and supporters have developed proprietary, internal standards for cataloguing and communicating the metrics and metadata associated with an educational activity. Some educators collect comprehensive metrics data, while others offer minimal information on the outcomes related to educational programs. As a result, both providers and supporters often deal with a multitude of programs and relationships, and are required to communicate different sets of data and using different processes for each relationship.
The Metrics Working Group will create XML standards for basic metrics to measure the success of health professions educational activities and streamline reporting those metrics for a wide variety of activities, including eCE activities, traditional CE programming and blended learning activities. In conjunction, relevant program information and provider information will be articulated.
Initially, the group will focus on creating specifications for the exchange of Kirkpatrick Level 1 evaluation data: data describing the learner’s reaction to the learning experience. It is anticipated that the group will continue to build upon this work, adding support for exchanging higher levels of evaluation data and other significant metrics. The XML standards will be developed with the long-term objective of the creation of a suite of Web Services for accessing and integrating metrics data.
Whenever possible, the group will leverage useful specifications developed by other organizations. For example, Healthcare Learning Object Metadata may be used to describe basic information about an educational activity. The MedBiquitous Technical Steering Committee will offer guidance and technical support for approaches requiring Web services descriptions
The Working Group will meet via teleconference on most occasions. Face-to-face working group meetings or barn raisings may be convened upon occasion. Working Group members or staff will perform much of the group’s work independently with member comments submitted to a discussion list.