|Year : 2021 | Volume
| Issue : 2 | Page : 196-202
Competency-based undergraduate curriculum implementation in anesthesiology–A survey-based comparison of two models of training
Rangraj Setlur, Nikahat Jahan, Nipun Gupta, Kiran Sheshadri
Department of Anesthesiology and Critical Care, Armed Forces Medical College, Pune, Maharashtra, India
|Date of Submission||31-Mar-2020|
|Date of Decision||04-Jul-2020|
|Date of Acceptance||21-Nov-2020|
|Date of Web Publication||15-Jul-2021|
Dr. Nikahat Jahan
Department of Anesthesiology and Critical Care, Armed Forces Medical College, Wanowrie Road, Pune - 411040, Maharashtra
Source of Support: None, Conflict of Interest: None
Background and Aim: Imparting the knowledge and skills of Anesthesiology to undergraduates can be challenging. Competency Based Undergraduate (CBUG) Curriculum for the Undergraduate medical students introduced by the Medical Council of India (MCI) aims to improve the quality of the Indian Medical Graduate (IMG). The Department of Anesthesiology and Critical Care of our college redrafted the training program and brought it in-line with the CBUG Curriculum beginning February 2019. A questionnaire based survey was conducted to assess the efficacy, satisfaction levels and the perception of the students towards the new competency based curriculum. The aim was to assess the students perception of the competency based curriculum and to evaluate two slightly different approaches to the implementation of the curriculum.
Material and Methods: Two groups of undergraduate medical students belonging to the 6th and 8th term, underwent two different models of teaching. The 8th term students had already completed their theory classes based on the older curriculum a year ago when they were in 6th term. However, their clinics and tutorials were modelled as per the new CBUG Curriculum. The current 6th term students had their first exposure to Anesthesiology and their theory, tutorials and clinics were scheduled in the same term, simulation based training was added, the operation theatre rotation was held in the mornings at 0730hrs and the intensive care unit rounds were held in the evenings. There was no difference in the theory classes taken for the two batches, however the clinics were different. After both the batches finished their rotation, they were given the survey questionnaire to assess their perception of the model of CBUG Curriculum that they were exposed to.
Results: The results of the survey revealed that about 80% of the students in both groups preferred that theory classes and practical training should be conducted in parallel in 6th term. About 60% students in both groups felt that early morning clinics 0800hrs were better than mid-morning clinics at 1100hrs as they get to see and do more procedures. 66%-82% students in both groups felt that the practical training in the OT, ICU and skills lab were very helpful or extremely helpful. The most important aspect of Anesthesiology rotation was "learning basic life saving skills and simulation based learning" according to 85% students in both groups. Nearly 80% students in both groups felt that the training in Anesthesiology should be allotted more time and more weightage in undergraduate training. 72% students in 6th term and 63% students in 8th term felt more confident of handling emergencies after their Anesthesiology rotation.
Conclusion: The new curriculum was extremely well received by the students of both groups. The model used for 6th term students comprising of teaching theory and practical in the same term and having early morning clinics, was found to be superior as compared to the model used to teach 8th term students where there was a gap of one year between theory and practical teaching and the clinics were held midmorning.
Keywords: Competency Based Undergraduate Curriculum, Undergraduate training, Anesthesiology
|How to cite this article:|
Setlur R, Jahan N, Gupta N, Sheshadri K. Competency-based undergraduate curriculum implementation in anesthesiology–A survey-based comparison of two models of training. J Anaesthesiol Clin Pharmacol 2021;37:196-202
|How to cite this URL:|
Setlur R, Jahan N, Gupta N, Sheshadri K. Competency-based undergraduate curriculum implementation in anesthesiology–A survey-based comparison of two models of training. J Anaesthesiol Clin Pharmacol [serial online] 2021 [cited 2021 Jul 27];37:196-202. Available from: https://www.joacp.org/text.asp?2021/37/2/196/321396
| Introduction|| |
Recently the Medical Council of India (MCI) has introduced the new Competency-Based Undergraduate (CBUG) Curriculum for undergraduate Medical students that stresses on their acquiring knowledge, skills and attitudes that will make them competent doctors. The CBUG curriculum has been implemented across the country for the new batch of MBBS starting Aug 2019.
CBUGC provides an outcome-based strategy where various domains of teaching including teaching learning methods and assessment form the framework of competencies. CBUGC encourages problem-based learning and deemphasizes compartmentalization of disciplines in order to achieve horizontal and vertical integration. It clearly defines what competencies a medical student is expected to have and what is the expected level of competence; It also defines the domain of learning for every competency—Knowledge, Skill, Attitude or Communication that determines what teaching learning method and assessment method would be most suitable to cover and assess a particular topic. There is introduction of modules on Attitudes, Ethics and communication that were missing in the older curriculum.
Anesthesiology is covered in volume 3 of the MCI document as part of surgery and allied subjects and it has been allotted 10 topics and 46 competencies [Appendix 1]. There are horizontal and vertical integrations with subjects like Anatomy, Physiology, Pharmacology, General Medicine, and General Surgery. The details of the curriculum are available online at https://www.mciindia.org/CMS/wp-content/uploads/2019/01/UG-Curriculum-Vol-III.pdf.
| Material and Methods|| |
This study was performed at the Department of Anesthesiology and Critical Care at a Government Medical College in India after getting ethical clearance from the Institutional Ethics Committee. In order to implement the new CBUG curriculum, the department completely rewrote the training program. Although the new curriculum is to be implemented for the batch joining MBBS from August 2019 this department decided to start early, with the students currently undergoing Anesthesia rotations. The revised training program of Clinics, Theory and Tutorials, along with the competencies covered by each topic, are attached as Appendices 2-4 respectively.
The new curriculum concentrates more on skill acquisition. The time spent in the simulation lab and the ICU was increased accordingly. The OT time was changed for one group of students from 1100 hrs to 0730 hrs in the morning, so they would have a greater chance of witnessing procedures as well as getting the chance to perform simple procedures like starting intravenous lines, inserting nasogastric tubes, mask holding and insertion of supraglottic airway devices and performing intubations under supervision.
The ICU clinics started with a round of all the patients and a brief summary of the clinical history. Then one patient with a paradigmatic disease, such as Acute Respiratory Distress Syndrome or Septic Shock was discussed in detail, with an emphasis on how the imaging and laboratory findings had been used to guide clinical decision-making. Interested students were encouraged to come in the evenings to join the intensivist on detailed rounds. Substantial time (Two and a half hours per session) was spent in the simulation lab. Interested students were given additional time to practice their cardiopulmonary resuscitation and intubation skills.
As this curriculum revision was implemented after the current 8th term had already finished their theory classes about a year ago, while they were in 6th term, we had two groups of students who had different experiences of the new curriculum. One group of students was the senior batch in 8th Term, for whom theory classes and practical rotations were conducted in different terms and OT rotations were held at 1100 hours instead of 0730 hours. The second group of students was the junior batch in 6th Term, for whom theory and practical rotations were conducted in the same term and OT rotations were held instead at 0730 hours instead of 1100 hours. In order to assess which of these models was preferred and to gauge the student's level of satisfaction with the CBME curriculum, an anonymous questionnaire was distributed to both groups at the end of their rotations [Appendix 5].
| Questionnaire Design|| |
The questionnaire was designed by the study authors and was modelled on the pattern of Kirkpatrick model of curriculum assessment which assesses curriculum efficacy on four levels- Reaction, learning, Behavior, and Results. The questions were designed to elicit the satisfaction levels and specific preferences of the students. It was administered after both the batches had completed their anesthesiology rotations. The survey was conducted on the day of an internal examinations in order to ensure maximal attendance in an examination environment. There were 133 respondents in both 8th and 6th term. Our college has an intake of 135 students per year.
| Results|| |
In this retrospective observational study, all data from the questionnaire were tabulated in Microsoft Excel and analyzed using the Pivot Table Function. A Chi Squared Test was performed for merged data. 133 students of 6th term and 133 students of 8th term gave their feedback through the questionnaire (98% response rate). The Summary of the survey is given in [Table 1]. The outcome-based results are given in [Table 2].
The results of the survey revealed that about 80% of the students in both groups preferred that theory classes and practical training should be conducted in parallel in 6th term [Figure 1], [Figure 2], [Figure 3]. About 60% students in both groups felt that early morning clinics 0730 hrs were better than mid-morning clinics at 1100 hrs as they get to see and do more procedures [Figure 4]. 66%-82% students in both groups felt that the practical training in the OT, ICU and skills lab were very helpful or extremely helpful [Figure 5], [Figure 6], [Figure 7]. The most important aspect of Anaesthesia rotation was "learning basic life saving skills and simulation-based learning" according to 85% students in both groups [Figure 8]. Nearly 80% students in both groups felt that the training in Anaesthesiology should be allotted more time and more weightage in undergraduate training [Figure 9]. 72% students in 6th term and 63% students in 8th term felt more confident of handling emergencies after their Anaesthesiology rotation [Figure 10].
|Figure 8: What do you find the most useful part of your training in Anesthesiology?|
Click here to view
|Figure 9: Should more time and weight be given to anesthesia in the UG Curriculum?|
Click here to view
|Figure 10: Has the Anesthesia rotation made you more confident of Handling Medical Emergencies?|
Click here to view
The model used for 6th term students comprising of teaching theory and practical in the same term and having early morning clinics, was found to be superior as compared to the model used to teach 8th term students where there was a gap of one year between theory and practical teaching and the clinics were held midmorning.
Amongst both the groups there was a high degree of enthusiasm for practical hands-on training in the operation theatre and the Intensive Care Unit, as well as simulation-based training. The new CBME curriculum of the MCI in general was extremely well received and the feedback pointed the way towards widespread adoption of the curriculum.
| Discussion|| |
Teaching Anesthesia to undergraduate students has always been challenging. The subject receives much less academic time than many other subjects and its importance in examinations is minimal. This leads to the general feeling among undergraduates that Anesthesia is a subject that one can safely ignore.
Adlakha et al. conducted a questionnaire-based survey amongst 336 undergraduate medical students. They found that 81% of students were not satisfied with teaching methods due to lack of coordination between different departments and lack of problem-based learning. Sixty-five per cent of students did not find the classroom environment conducive to learning due to large sizes of teaching batches and inadequate maintenance of infrastructure.
Some subjects have traditionally, been more difficult to teach to undergraduates, than others and anesthesia has suffered due to pre-formed prejudices., There are, highly effective methods of overcoming these hurdles, including increasing the student's involvement in the practical aspects of patient care in the OT and ICU and increasing time spent in simulator-based training.
One of the striking features that emerged in the survey and in our conversations with students, is the deep hunger which undergraduates have for practical knowledge. Even the simplest procedure performed under supervision such as starting an intravenous line or inserting a nasogastric tube leaves an indelible impression. By moving to the OT, the ICU and the simulation lab, and by stressing the acquisition of practical knowledge and skills more than theory lectures, anesthesia can be made a very exciting subject.
It may also be seen from this study that relatively small changes in the way the curriculum was implemented such as the time of the day for reporting to the OT and conducting theory and practical training in the same term, can make large changes in the efficacy of teaching.
Pedagogy carries its own terminology with it. A review characterized "competence" as referring to the skills and knowledge a person possesses, whereas competency refers to mastery of a subset of knowledge or skills required to perform a job. A competency is divided into a series of milestones that enable the acquisition of the skills to be measured and evaluated. Competency-based knowledge is classically divided into three domains the cognitive domain (intellectual capability); the affective domain (attitude, feelings, emotions, and behavior; frequently emphasized for communication); and the psychomotor domain reflecting manual skills. The emphasis here is on ensuring the achievement of prespecified outcomes rather than just on ensuring minimum attendance. This being the case, to acquire a specific skill such as endotracheal intubation, a medical student would spend as much time as was required in the skills lab practicing on a mannequin till he or she could satisfy the observer.
There has been some criticism of the competency-based training, in that it takes away the agency of a general practitioner or a family physician, but it seems to us that the solution to this is to specifically target those parts of the curriculum which are of greatest relevance to the general practitioner.
In case of Anesthesia, this would include a greater emphasis on teaching resuscitation and handling emergencies and critically ill patients rather than the minutiae of how to give an anesthetic. A study conducted in Australia and New Zealand on developing expert consensus on developing a new curriculum for UG training in anesthesiology also concluded that the focus should be on general perioperative medicine, pain management and critical care skills for which Anesthesiologist are the best faculty.
It is important to be conscious of the drawbacks of this form of learning. One of the points that we received from a number of students, was a perception that the other group, which had rotated before or after them, had more hands-on training or more interesting cases. It is the nature of case based and patient centered learning that there will be some heterogeneity in the learning experience, and this has been reported from other researchers as well.
A review of competency-based Anesthesia education from an American perspective identified certain key challenges for successfully implementing a competency-based curriculum for anesthesiology. These included unpredictable time spent on acquiring a given skill, which would provide logistical challenges. To an extent, this challenge can be overcome by keeping the skills lab open during nonacademic hours, thus giving students the opportunity to practice on their own time. Other options include on-line assessments which do not require all students to be present at the same time. The second challenge which flows from the first challenge is an excessively fluid curriculum, which lacks the structure of traditional methods, and hampers slower learners who may get burdened by an ever-increasing load of assignments not completed in time. Student and teacher acceptance of the new method of teaching may also be a challenge, but in our experience, the levels of enthusiasm from both parties indicated that this may not be a significant factor.
The study has numerous weaknesses. It evaluates satisfaction levels without assessing whether increased satisfaction was accompanied by increased skill acquisition. However, it was felt that evaluating the satisfaction levels of the students for the new course would be valuable, as this curriculum will be implemented all over the country. There was no control group which had been trained by the previous method, so we could only compare differences between two implementations of the new curriculum, not between the old and new curriculum.
As this is a study carried out in a single Medical College, one may not be able to generalize the findings to other Medical Colleges. However, some principles of general importance may be generally true for all Anesthesia departments. These include, but are not limited to:
- Increasing the time spent in practical training in the OT, ICU and simulation lab.
- Limiting classroom time.
- Getting the students to witness and perform basic clinical procedures under supervision, and at the same time emphasizing the importance of patient safety in our daily practice.
- Using the ICU to communicate the broad range of roles Anesthesiologists perform in the hospital.
- Emphasizing the importance of acquiring practical and cognitive skills in handling generic emergencies.
- Preparing a library of Virtual Patients (such as a case of Breathing difficulty, Road traffic accident with Polytrauma, a case of Chest pain, etc.,) for simulation-based training.
Other researchers have also advocated clerkships during Medical College that gives students a much better idea of what a career in anesthesiology entails.
The study has numerous weaknesses. It evaluates satisfaction levels without assessing whether increased satisfaction was accompanied by increased skill acquisition. However, it was felt that evaluating the satisfaction levels of the students for the new course would be valuable, as this curriculum will be implemented all over the country.
| Conclusion|| |
Competency-Based Medical Education undergraduate curriculum was used to impart practical training to two different batches of medical students using two different models of teaching. The new curriculum was extremely well received by the students of both groups.
The new curriculum given by the Medical Council of India has the potential to improve practical training of undergraduate medical students in the subject of Anesthesiology. It has the potential to enable Anesthesiology departments to teach life-saving cognitive and procedural skills, which will be invaluable to the young Indian Medical Graduates. However, it requires faculty development and training for successful implementation of the new curriculum.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| Appendix 1|| |
| The New CBUG Curriculum for Anesthesiology Topics Covered in Anesthesiology as Per MCI Competency-Based Undergraduate Curriculum|| |
The Competency-based undergraduate curriculum of MCI that has been implemented with effect from August 2019, has allotted 10 topics and 46 competencies to Anesthesiology.
The 10 topics are:
- Anesthesiology as a specialty
- Cardiopulmonary Resuscitation
- Pre-operative evaluation and medications
- General Anesthesia
- Regional Anesthesia
- Post-Anesthesia recovery
- Intensive care Management
- Pain and its management
- Patient safety
The details of the competencies, domain and level of expertise are given in the MCIs CBME curriculum document. This document is available online (open access) and Anaesthesiology is covered in Volume III, page No 145-154.
| Appendix 2|| |
| Appendix 3|| |
| Appendix 4|| |
| Appendix 5|| |
| Survey Questionnaire|| |
| Survey Amongst Two Batches Of Undergraduate Medical Students Regarding Training in Anesthesiology|| |
1. Which term do you think the theory classes in Anesthesiology should be held?
2. Which term do you think the Anesthesiology OT and ICU rotations should be held?
3. Do you think holding the theory and clinics in the same term is better than holding it in two different terms?
4. Should the OT and ICU rotations be held at 0800hrs or at 1100hrs?
5. How do you rate the practical training in Anesthesiology in the Operation Theatre based on the new Competency Based Medical Education?
- Extremely helpful
- Very helpful
- Somewhat helpful
- Not so helpful
- Not at all helpful
6. How do you rate the practical training in Anesthesiology in the Intensive care unit based on the new Competency Based Medical Education?
- Extremely helpful
- Very helpful
- Somewhat helpful
- Not so helpful
- Not at all helpful
7. How do you rate the simulation based training in the skills lab for airway management, Basic Life Support and Advanced Life Support?
- Extremely helpful
- Very helpful
- Somewhat helpful
- Not so helpful
- Not at all helpful
8. What do you find the most useful part of your training in Anesthesiology?
- Theory classes
- Simulation based training in BLS, ACLS and airway management
- Learning basic life saving skills in the OT and ICU on real patients
- Understanding practical concepts of patient management in the OT and ICU
9. Do you think Anesthesiology training should be given more time and weight in the undergraduate curriculum? a
10. After completing your Anesthesiology clinical rotation do you feel more confident of handling medical emergencies?
11. Please write any additional comments, suggestions or ideas for UG training in Anesthesiology on the back of this page.
| References|| |
Medical Council of India, Competency Based Undergraduate curriculum for the Indian Medical Graduate 2018;3:145-15.
Adlakha V, Jha T, Sahoo P, Muralidharan A, Bachani D. Students' perception of lacunae in medical education in India, and suggestions for reforms. Natl Med J India 2018;31:29-31.
] [Full text]
Thomas A, Murtaza AN, Michael Spiers HV, Zargaran A, Turki M, Mathur J, et al
. Declining interest in general surgical training-Challenging misconceptions and improving access at undergraduate level. Ann Med Surg 2019;40:3-8.
Harendza S, Pyra M. Just fun or a prejudice?-Physician stereotypes in common jokes and their attribution to medical specialties by undergraduate medical students. BMC Med Educ 2017;17:128.
Liljedahl M. On learning in the clinical environment. Perspect Med Educ 2018;7:272-5.
O'Connor E, Moore M, Cullen W, Cantillon P. A qualitative study of undergraduate clerkships in the intensive care unit: It's a brand new world. Perspect Med Educ 2017;6:173-81.
Bloom BS: Taxonomy of Educational Objectives. Book 1 Cognitive Domain. New York, Longman; 1956
Kumar R. The tyranny of the Medical Council of India's new (2019) MBBS curriculum: Abolition of the academic discipline of family physicians and general practitioners from the medical education system of India. J Fam Med Prim Care 2019;8:323-5.
MJ Overton, NA Smith. Anaesthesia priorities for Australian and New Zealand medical school curricula: A Delphi consensus of academic anaesthetists. Anaesth Intensive Care 2015;43:51-8.
Sidhu NS, Weller JM, Mitchell SJ. Teaching and learning in undergraduate anaesthesia: A quantitative and qualitative analysis of practice at the University of Auckland. Anaesth Intensive Care 2015;43:740-9.
Ebert T, Fox C. Competency-based education in anesthesiology history and challenges. Anesthesiology 2014;120:24-31.
Hoffmann N, Kubitz JC, Goetz AE, Beckers SK. Patient safety in undergraduate medical education: Implementation of the topic in the anaesthesiology core curriculum at the University Medical Center Hamburg-Eppendorf. GMS J Med Educ 2019;36:Doc12.
Leung JY, Critchley LA, Yung AL, Kumta SM. Introduction of virtual patients onto a final year anesthesia course: Hong Kong experience. Adv Med Educ Pract 2011;2:71-83.
Khan FA, Minai FN, Siddiqui S. Anaesthesia as a career choice in a developing country; effect of clinical clerkship. J Pak Med Assoc 2011;61:1052-6.
[Figure 1], [Figure 2], [Figure 3], [Figure 4], [Figure 5], [Figure 6], [Figure 7], [Figure 8], [Figure 9], [Figure 10]
[Table 1], [Table 2]