OBJECTIVE: To measure the effect of duty periods no longer than 16 hours on patient care and resident education.
PATIENTS AND METHODS: As part of our Educational Innovations Project, we piloted a novel resident schedule for an inpatient service that eliminated shifts longer than 16 hours without increased staffing or decreased patient admissions on 2 gastroenterology services from August 29 to November 27, 2009. Patient care variables were obtained through medical record review. Resident well-being and educational variables were collected by weekly surveys, end of rotation evaluations, and an electronic card-swipe system.
RESULTS: Patient care metrics, including 30-day mortality, 30-day readmission rate, and length of stay, were unchanged for the 196 patient care episodes in the 5-week intervention month compared with the 274 episodes in the 8 weeks of control months. However, residents felt less prepared to manage cross-cover of patients (P = .006). There was a nonsignificant trend toward decreased perception of quality of education and balance of personal and professional life during the intervention month. Residents reported working fewer weekly hours overall during the intervention (64.3 vs 68.9 hours; P = .40), but they had significantly more episodes with fewer than 10 hours off between shifts (24 vs 2 episodes; P = .004).
CONCLUSION: Inpatient hospital services can be staffed with residents working shifts less than 16 hours without additional residents. However, cross-cover of care, quality of education, and time off between shifts may be adversely affected.
Wednesday, June 22, 2011
Duty hour recommendations and implications for meeting the ACGME core competencies
OBJECTIVE: To describe the views of residency program directors regarding the effect of the 2010 duty hour recommendations on the 6 core competencies of graduate medical education.
METHODS: US residency program directors in internal medicine, pediatrics, and general surgery were e-mailed a survey from July 8 through July 20, 2010, after the 2010 Accreditation Council for Graduate Medical Education (ACGME) duty hour recommendations were published. Directors were asked to rate the implications of the new recommendations for the 6 ACGME core competencies as well as for continuity of inpatient care and resident fatigue.
RESULTS: Of 719 eligible program directors, 464 (65%) responded. Most program directors believe that the new ACGME recommendations will decrease residents' continuity with hospitalized patients (404/464 [87%]) and will not change (303/464 [65%]) or will increase (26/464 [6%]) resident fatigue. Additionally, most program directors (249-363/464 [53%-78%]) believe that the new duty hour restrictions will decrease residents' ability to develop competency in 5 of the 6 core areas. Surgery directors were more likely than internal medicine directors to believe that the ACGME recommendations will decrease residents' competency in patient care (odds ratio [OR], 3.9; 95% confidence interval [CI], 2.5-6.3), medical knowledge (OR, 1.9; 95% CI, 1.2-3.2), practice-based learning and improvement (OR, 2.7; 95% CI, 1.7-4.4), interpersonal and communication skills (OR, 1.9; 95% CI, 1.2-3.0), and professionalism (OR, 2.5; 95% CI, 1.5-4.0).
CONCLUSION: Residency program directors' reactions to ACGME duty hour recommendations demonstrate a marked degree of concern about educating a competent generation of future physicians in the face of increasing duty hour standards and regulation.
METHODS: US residency program directors in internal medicine, pediatrics, and general surgery were e-mailed a survey from July 8 through July 20, 2010, after the 2010 Accreditation Council for Graduate Medical Education (ACGME) duty hour recommendations were published. Directors were asked to rate the implications of the new recommendations for the 6 ACGME core competencies as well as for continuity of inpatient care and resident fatigue.
RESULTS: Of 719 eligible program directors, 464 (65%) responded. Most program directors believe that the new ACGME recommendations will decrease residents' continuity with hospitalized patients (404/464 [87%]) and will not change (303/464 [65%]) or will increase (26/464 [6%]) resident fatigue. Additionally, most program directors (249-363/464 [53%-78%]) believe that the new duty hour restrictions will decrease residents' ability to develop competency in 5 of the 6 core areas. Surgery directors were more likely than internal medicine directors to believe that the ACGME recommendations will decrease residents' competency in patient care (odds ratio [OR], 3.9; 95% confidence interval [CI], 2.5-6.3), medical knowledge (OR, 1.9; 95% CI, 1.2-3.2), practice-based learning and improvement (OR, 2.7; 95% CI, 1.7-4.4), interpersonal and communication skills (OR, 1.9; 95% CI, 1.2-3.0), and professionalism (OR, 2.5; 95% CI, 1.5-4.0).
CONCLUSION: Residency program directors' reactions to ACGME duty hour recommendations demonstrate a marked degree of concern about educating a competent generation of future physicians in the face of increasing duty hour standards and regulation.
The influence of longitudinal mentoring on medical student selection of primary care residencies
Background: The number of students selecting careers in primary care has declined by 41% in the last decade, resulting in anticipated shortages.
Methods: First-year medical students interested in primary care were paired with primary care mentors. Mentors were trained, and mentors and students participated in focus groups at the end of each academic year. Quantitative and qualitative results are presented.
Results: Students who remained in the mentoring program matched to primary care programs at 87.5% in the first year and 78.9% in the second year, compared to overall discipline-specific match rates of 55.8% and 35.9% respectively. Students reported a better understanding of primary care and appreciated a relationship with a mentor.
Conclusions: A longitudinal mentoring program can effectively support student interest in primary care if it focuses on the needs of the students and is supportive of the mentors.
Methods: First-year medical students interested in primary care were paired with primary care mentors. Mentors were trained, and mentors and students participated in focus groups at the end of each academic year. Quantitative and qualitative results are presented.
Results: Students who remained in the mentoring program matched to primary care programs at 87.5% in the first year and 78.9% in the second year, compared to overall discipline-specific match rates of 55.8% and 35.9% respectively. Students reported a better understanding of primary care and appreciated a relationship with a mentor.
Conclusions: A longitudinal mentoring program can effectively support student interest in primary care if it focuses on the needs of the students and is supportive of the mentors.
Description of web-enhanced virtual character simulation system to standardize patient hand-offs
INTRODUCTION: The 80-h work week has increased discontinuity of patient care resulting in reports of increased medication errors and preventable adverse events. Graduate medical programs are addressing these shortcomings in a number of ways.
METHODS: We have developed a computer simulation platform called the Virtual People Factory (VPF), which allows us to capture and simulate the dialogue between a real user and a virtual character. We have converted the system to reflect a physician in the process of "checking-out" a patient to a covering physician. The responses are tracked and matched to educator-defined information termed "discoveries." Our proof of concept represented a typical post-operative patient with tachycardia. The system is web enabled.
RESULTS: So far, 26 resident users at two institutions have completed the module. The critical discovery of tachycardia was identified by 62% of users. Residents spend 85% of the time asking intraoperative, postoperative, and past medical history questions. The system improves over time such that there is a near-doubling of questions that yield appropriate answers between users 13 and 22. Users who identified the virtual patient's underlying tachycardia expressed more concern and were more likely to order further testing for the patient in a post-module questionnaire (P = 0.13 and 0.08, respectively, NS).
CONCLUSIONS: The VPF system can capture unique details about the hand-off interchange. The system improves with sequential users such that better matching of questions and answers occurs within the initial 25 users allowing rapid development of new modules. A catalog of hand-off modules could be easily developed. Wide-scale web-based deployment was uncomplicated. Identification of the critical findings appropriately translated to user concern for the patient though our series was too small to reach significance. Performance metrics based on the identification of critical discoveries could be used to assess readiness of the user to carry off a successful hand-off.
METHODS: We have developed a computer simulation platform called the Virtual People Factory (VPF), which allows us to capture and simulate the dialogue between a real user and a virtual character. We have converted the system to reflect a physician in the process of "checking-out" a patient to a covering physician. The responses are tracked and matched to educator-defined information termed "discoveries." Our proof of concept represented a typical post-operative patient with tachycardia. The system is web enabled.
RESULTS: So far, 26 resident users at two institutions have completed the module. The critical discovery of tachycardia was identified by 62% of users. Residents spend 85% of the time asking intraoperative, postoperative, and past medical history questions. The system improves over time such that there is a near-doubling of questions that yield appropriate answers between users 13 and 22. Users who identified the virtual patient's underlying tachycardia expressed more concern and were more likely to order further testing for the patient in a post-module questionnaire (P = 0.13 and 0.08, respectively, NS).
CONCLUSIONS: The VPF system can capture unique details about the hand-off interchange. The system improves with sequential users such that better matching of questions and answers occurs within the initial 25 users allowing rapid development of new modules. A catalog of hand-off modules could be easily developed. Wide-scale web-based deployment was uncomplicated. Identification of the critical findings appropriately translated to user concern for the patient though our series was too small to reach significance. Performance metrics based on the identification of critical discoveries could be used to assess readiness of the user to carry off a successful hand-off.
Comparison of surgical operative experience of trainees and practicing vascular surgeons
INTRODUCTION: The Vascular Surgery Board (VSB) of the American Board of Surgery sought to answer the following questions: what is the scope of contemporary vascular surgery practice? Do current vascular surgery residents obtain training that is appropriate for their future career expectations and for successful Board certification? How effectively do practicing vascular surgeons incorporate emerging technologies and procedures into practice?
METHODS: We analyzed the operative logs submitted to the VSB by recent vascular surgery residents applying for the Vascular Surgery Qualifying Examination (QE; 2006-2009) or by practicing vascular surgeons applying for the Vascular Surgery Recertification Examination (RE; 1995-2009). The relationship between reported operative experience and performance of the QE and RE was examined.
RESULTS: There has been a threefold increase in the mean number of primary cases reported by both RE and QE applicants over the past 15 years and the increase in case volume has been driven largely by an increase in the number of endovascular procedures. Endovascular procedures have been broadly incorporated into the practice of most vascular surgeons applying for recertification. The number of major open surgical cases reported by recent QE applicants has remained unchanged over the period of observation. For QE applicants, the number of endovascular aneurysm repairs (EVARs) has reached a plateau at approximately 50 cases, whereas the mean number of open infrarenal aneurysm repairs has decreased for both QE and RE applicants, reflecting national trends favoring EVAR. There was a significant association between case volume and performance on the QE but not on the RE.
CONCLUSION: Over the past 15 years, there has been a significant increase in the total number of operative cases reported to the VSB by both QE and RE applicants. Contrary to popular belief, the volume of major open vascular surgery reported by recent vascular surgery residents has remained relatively stable since 1994. Over the same time period, endovascular procedures have been rapidly incorporated into clinical practice by the majority of vascular surgeons applying for recertification by the VSB. Current vascular surgery residents receive a rich operative experience in both open and endovascular procedures that is reflective of contemporary practice.
METHODS: We analyzed the operative logs submitted to the VSB by recent vascular surgery residents applying for the Vascular Surgery Qualifying Examination (QE; 2006-2009) or by practicing vascular surgeons applying for the Vascular Surgery Recertification Examination (RE; 1995-2009). The relationship between reported operative experience and performance of the QE and RE was examined.
RESULTS: There has been a threefold increase in the mean number of primary cases reported by both RE and QE applicants over the past 15 years and the increase in case volume has been driven largely by an increase in the number of endovascular procedures. Endovascular procedures have been broadly incorporated into the practice of most vascular surgeons applying for recertification. The number of major open surgical cases reported by recent QE applicants has remained unchanged over the period of observation. For QE applicants, the number of endovascular aneurysm repairs (EVARs) has reached a plateau at approximately 50 cases, whereas the mean number of open infrarenal aneurysm repairs has decreased for both QE and RE applicants, reflecting national trends favoring EVAR. There was a significant association between case volume and performance on the QE but not on the RE.
CONCLUSION: Over the past 15 years, there has been a significant increase in the total number of operative cases reported to the VSB by both QE and RE applicants. Contrary to popular belief, the volume of major open vascular surgery reported by recent vascular surgery residents has remained relatively stable since 1994. Over the same time period, endovascular procedures have been rapidly incorporated into clinical practice by the majority of vascular surgeons applying for recertification by the VSB. Current vascular surgery residents receive a rich operative experience in both open and endovascular procedures that is reflective of contemporary practice.
Wednesday, May 25, 2011
A framework to teach self-reflection for the remedial resident
Background: Regardless of the area of deficiency, be it in knowledge, skills or attitudes, residents requiring remediation are rarely self-identified. This illustrates a diminished ability for self-reflection. Self-reflection is a cornerstone of adult education. During the remediation process, the remediation curriculum needs to emphasize self-reflection.
Aims: How can one structure self-reflection in a remediation curriculum?
Methods: This article describes how to adapt and apply environmental scanning for remedial residents.
Results: Environmental scanning is a rigorous and well-developed business approach that can be adapted for personal continuous quality improvement to foster self-reflection in medical trainees. There are often already existing tools which can form the foundation for regular reflection in medical education using an environmental scanning structure.
Conclusions: Environmental scanning can be thought of as a structured approach to internal and external reflections.
Aims: How can one structure self-reflection in a remediation curriculum?
Methods: This article describes how to adapt and apply environmental scanning for remedial residents.
Results: Environmental scanning is a rigorous and well-developed business approach that can be adapted for personal continuous quality improvement to foster self-reflection in medical trainees. There are often already existing tools which can form the foundation for regular reflection in medical education using an environmental scanning structure.
Conclusions: Environmental scanning can be thought of as a structured approach to internal and external reflections.
Modification of an OSCE format to enhance patient continuity in a high-stakes assessment of clinical performance
Background: Traditional Objective Structured Clinical Examinations (OSCEs) are psychometrically sound but have the limitation of fragmenting complex clinical cases into brief stations. We describe a pilot study of a modified OSCE that attempts to balance a typical OSCE format with a semblance of a continuous, complex, patient case.
Methods: Two OSCE scenarios were developed. Each scenario involved a single standardized patient and was subdivided into three sequential 10 minute sections that assessed separate content areas and competencies. Twenty Canadian PGY-4 internal medicine trainees were assessed by trained examiner pairs during each OSCE scenario. Paired examiners rated participant performance independent of each other, on each section of each scenario using a validated global rating scale. Inter-rater reliabilities and Pearson correlations between ratings of the 3 sections of each scenario were calculated. A generalizability study was conducted. Participant and examiner satisfaction was surveyed.
Results: There was no main effect of section or scenario. Inter-rater reliability was acceptable. The g-coefficient was 0.68; four scenarios would achieve 0.80. Moderate correlations between sections of a scenario suggest a possible halo effect. The majority of examiners and participants felt that the modified OSCE provided a sense of patient continuity.
Conclusions: The modified OSCE provides another approach to the assessment of clinical performance. It attempts to balance the advantages of a traditional OSCE with a sense of patient continuity.
Methods: Two OSCE scenarios were developed. Each scenario involved a single standardized patient and was subdivided into three sequential 10 minute sections that assessed separate content areas and competencies. Twenty Canadian PGY-4 internal medicine trainees were assessed by trained examiner pairs during each OSCE scenario. Paired examiners rated participant performance independent of each other, on each section of each scenario using a validated global rating scale. Inter-rater reliabilities and Pearson correlations between ratings of the 3 sections of each scenario were calculated. A generalizability study was conducted. Participant and examiner satisfaction was surveyed.
Results: There was no main effect of section or scenario. Inter-rater reliability was acceptable. The g-coefficient was 0.68; four scenarios would achieve 0.80. Moderate correlations between sections of a scenario suggest a possible halo effect. The majority of examiners and participants felt that the modified OSCE provided a sense of patient continuity.
Conclusions: The modified OSCE provides another approach to the assessment of clinical performance. It attempts to balance the advantages of a traditional OSCE with a sense of patient continuity.
Subscribe to:
Posts (Atom)