Year : 2020 | Volume
: 32 | Issue : 4 | Page : 392--397
A qualitative study on negative attitude toward electrocardiogram learning among undergraduate medical students
May Honey Ohn1, Urban D Souza2, Khin Maung Ohn3,
1 Department of Medicine, Faculty of Medicine and Health Sciences, University Malaysia Sabah, Kota Kinabalu, Malaysia
2 Department of Biomedical Sciences, Faculty of Medicine and Health Sciences, University Malaysia Sabah, Kota Kinabalu, Malaysia
3 Department of Surgery, Faculty of Medicine and Health Sciences, University Malaysia Sabah, Kota Kinabalu, Malaysia
Dr. May Honey Ohn
Department of Medicine, Faculty of Medicine and Health Sciences, University Malaysia Sabah, Jalan UMS, 88400 Kota Kinabalu, Sabah
Objective: Negative affect state toward learning has a substantial impact on the learning process, academic performance, and practice of a particular subject, but such attitude toward electrocardiogram (ECG) learning has still received relatively little attention in medical education research. In spite of the significant emphasis in investigating ECG teaching method, the educators would not be able to address ECG incompetency without understanding the negative perception and attitude toward ECG learning. The purpose of this study was to assess the undergraduate students' difficulties in ECG learning and hence help educators design appropriate ECG learning curriculum to instill competent skill in ECG interpretation based on this outcome. Materials and Methods: A total of 324 undergraduate preclinical (year 2) and clinical (year 3–5) medical students participated in this study. The research design used thematic analysis of an open-ended questionnaire to analyze the qualitative data. Results: The thematic analysis detected five major emergent themes: lack of remembering (18.2%), lack of understanding (28.4%), difficulty in applying (3.6%), difficulty in analysis (15.1%), and difficulty in interpretation (17.8%), of which addressing these challenges could be taken as a foundation step upon which medical educators put an emphasis on in order to improve ECG teaching and learning. Conclusion: Negative attitude toward ECG learning poses a serious threat to acquire competency in ECG interpretation skill. The concept of student's memorizing ECG is not a correct approach; instead, understanding the concept and vector analysis is an elementary key for mastering ECG interpretation skill. The finding of this study sheds light into a better understanding of medical students' deficient points of ECG learning in parallel with taxonomy of cognitive domain and enables the medical teachers to come up with effective and innovative strategies for innovative ECG learning in an undergraduate medical curriculum.
|How to cite this article:|
Ohn MH, Souza UD, Ohn KM. A qualitative study on negative attitude toward electrocardiogram learning among undergraduate medical students.Tzu Chi Med J 2020;32:392-397
|How to cite this URL:|
Ohn MH, Souza UD, Ohn KM. A qualitative study on negative attitude toward electrocardiogram learning among undergraduate medical students. Tzu Chi Med J [serial online] 2020 [cited 2021 Apr 14 ];32:392-397
Available from: https://www.tcmjmed.com/text.asp?2020/32/4/392/264005
Electrocardiogram (ECG) is one of the most common, useful noninvasive diagnostic bedside procedures in clinical practice ,,. Misinterpretation of an ECG can lead to morbidity and mortality, especially in the realms of myocardial infarction, heart block, and arrhythmias ,. Despite the importance of correct ECG interpretation in clinical management ,, suboptimal ECG competence was found in medicine residences of various specialties, all of which were supposed to have core skill of daily ECG practice ,,,. Little et al. pointed out that it might be necessary to incorporate formal ECG training and assessment into the undergraduate curriculum, as this improved diagnostic accuracy . Nowadays, ECG interpretation is, therefore, regarded as a crucial learning outcome in undergraduate curricula ,.
Despite ECG interpretation being taught since the 1st year of medical school, several studies have shown that medical students demonstrated lack of confidence and poor ECG interpretation skills as they found it a difficult skill to master and retain ,,,,,. Negative affect state toward learning has a substantial impact on the learning process, academic performance, and practice of a particular subject , but such attitude toward ECG learning has still received relatively little attention in medical education research. The medical tutors appear to have to expand investigation on multitudes of instruction and assessment method in order to improve ECG cognitive knowledge and interpretation skill ,,,. Apparently, Kopeć et al. highlighted that there were qualitative and quantitative deficiencies in teaching ECG interpretation , and it was found that there was no single effective ECG instructional method .
In most disciplines, the students' attitude toward learning a particular subject is considered extremely important . Educators are interested to know the perception and attitude of their students toward learning. Many researches support that students' attitudes toward learning of subjects are important in course outcome, knowledge, and skills . Positive attitude toward learning is vital as it encourages students to get interested in the core knowledge and skills of the study . On the contrary, students with a negative attitude are afraid of the progress of learning, and consequently, their understanding of the subject and their class performance are adversely affected .
In other studies, it was noted that when the students felt depressed and were at risk for failure, they were often highly emotional and could not move forward which then restrained the process of learning ,. Therefore, lecturers frequently face huge challenges when learners lack interest and have negative attitudes toward learning . A qualitative data inquiry conducted among students with negative attitude yielded five categories of responses, which are (1) difficulty in comprehension , (2) not useful in future career , (3) dislike for subject , (4) not part of the major, and (5) dislike for lecturer. These learners showed signs of negative attitudes such as feeling tired when following the course, unable to gain the benefits of the course, incapable to focus in class, tend to interfere during class progress, and absenteeism.
In addition, it was reported that negative expectations influenced the negative emotional conditions and attitudes toward learning . Learners with a negative attitude can be recognized by their class anxiety due to their poor interest in the subject and were not enjoyable in courses . As a result of pervious study, the negative attitude became an obstacle in the learning process . Furthermore, the findings from “bench-mark” studies conducted among graduate and undergraduate students indicated that the subscale marks reveal a relatively negative attitude toward learning in the learners' field of study . Consequently, negative attitude toward course has great influence on student learning processes, thinking, and improvement in their professional life .
Studies have reported a lack of proficiency in ECG interpretation as well as a perceived inadequacy of ECG training among medical students and young doctors ,. Without comprehending the students' negative attitude toward ECG learning, the educators would not be able to address their incompetency in ECG interpretation in spite of putting significant emphasis on ECG teaching method. By understanding students' perceived difficulties in ECG learning, medical teachers are capable to construct a proper ECG undergraduate curriculum based on deficient points in ECG teaching and learning. To date, there is no study done on factors responsible for negative attitude of medical students' toward ECG learning. The purpose of this study was to assess the undergraduate students' difficulties in ECG learning and hence help educators design appropriate ECG learning curriculum to instill competent skill in ECG interpretation based on this outcome.
Materials and Methods
A total number of 324 of 348 undergraduate medical students from different academic years participated in this study, and the response rate was 94%. This qualitative study was conducted at the Faculty of Medicine and Health Sciences in East Malaysia, University Malaysia Sabah. Both preclinical and clinical year medical students at the beginning of the academic year 2017–2018 were selected because ECG theory and its application is taught as one of the major learning outcomes spirally across different academic years. All students were taught by outcome-based education curriculum as it is a single-center study. Ethical approval was obtained from the Institutional Ethical Board (JKEtika 1/17). Consent form was signed and taken before the study after detailed explanation of the study to each participant student.
Nonprobability convenience sampling was applied in this qualitative study. The data collection was conducted through a Google Form online survey which consisted of collecting participants' demographic characteristic data such as age, gender, ethnicity, and academic profile such as the current academic year and cumulative grade point average (cGPA).
The qualitative survey was constructed to gather the required information about the affective states of ECG learning. Those participants who showed negative affective states in ECG learning answered the further open-ended questionnaire “what are the students' perceived difficulties in ECG learning?” in order to explore the motive undermined it.
The thematic analysis was used to identify patterns in the data and uses themes to interpret the data . Qualitative data collection was carried out by an independent researcher. Open coding was used to analyze student responses to open-ended survey prompts. One author reviewed all comments and placed them in categories, and a second author reviewed and verified the categories. The data collected in this study were analyzed using the six-step framework developed by Braun et al. .
Step 1 – The first step in this thematic analysis involved the reading and re-reading of the transcripts. This enabled the researcher to get familiar with the dataStep 2 – This step is concerned with developing initial codes. In this phase, the data collected were organized in a systematic and meaningful way. Based on the fact that this is a theoretical thematic analysis, each segment of the data that were relevant to the research question of this study was coded. An open-coding method was used to code the data. The initial codes were modified and developed during the course of the coding processStep 3 – This step involved searching for themes with similar patterns that capture an interesting or significant fact about the data collected. The codes were examined and collated into an initial theme. At the end of this step, all the codes were organized into broad themes that captured something significant about the research questionStep 4 – This step involved the review of themes. The preliminary themes identified in the previous step were reviewed, modified, and developed. This was done by collating and reading all the data that are relevant to the theme. This was done to determine if each theme truly supports the data or works in context with the entire set of data. In this study, the data set is one extractStep 5 – This step involved the final refinement of the themes to identify the essence of the themesStep 6 – This is the final step in this thematic analysis. It involves writing a report on the results obtained using this method of analysis. The results of this thematic analysis were reported and discussed in this study.
This approach was selected because it provides a usable and clear framework for conducting thematic analysis. During the transcription, all the participants' responses were put as theme and subtheme categories of similar responses together. This enabled the easy interpretation of the thoughts associated with each theme. The participants' identity was made anonymous to ensure that the confidentiality rule of research ethics was adhered to. The detected emergent themes could be used as a foundation upon which medical educators might put an emphasis on addressing such challenges to improve ECG teaching and learning. The Google Form survey data were downloaded to Microsoft Excel (2016 version) and were further processed, cleaned, and analyzed using Statistical Package for the Social Sciences, version 24.0 (SPSS Inc., Chicago, II, USA). Academic year, ethnic groups, and each theme were presented using frequencies (%). Analysis of age and cGPA resulted in a normal distribution and displayed as mean (standard deviation [SD]).
More than half (200/324) of the students had negative attitude toward ECG learning. Majority (55%) were female with mean (SD) age of 21 (1.25) years from different academic study year of preclinical (year 2) and clinical (year 3–5) students (year 2: n = 42, 21%; year 3: n = 52, 26%; year 4: n = 46, 23%; and year 5: n = 60, 30%). The mean (SD) cGPA score was 3.48 (0.23). Extensive thematic analysis of open-ended questionnaire portrayed five major themes which are in align with Anderson and Krathwohl's cognitive process levels: (1) lack of remembering (18.2%), (2) lack of understanding (28.4%), (3) difficulty in applying (3.6%), (4) difficulty in analysis (15.1%), and (5) difficulty in interpretation (17.8%). These cognitive difficulties were also adversely underpinned by different array of knowledge dimensions such as factual, conceptual, and procedural knowledge. The following thematic analysis of students' responses reveals how ECG learning difficulties are perceived at both knowledge and cognitive process levels.
Lack of remembering of factual knowledge
Around 18% of students found difficulties in factual remembering of standard ECG parameters such as calculation formula of heart rate, normal and abnormal duration of different waves, segments, and intervals, so on and so forth. Year-5 students had more difficulty in remembering than other year students. Furthermore, students with low cGPA had more difficulty in remembering than higher cGPA students. However, there was no statistically significant association between academic year, performance, and perceived ECG learning difficulties (Chi-square test = 23.828, df = 15, P > 0.05; Chi-square test = 4.925, df = 5, P > 0.05). The statements below were the summary of students' opinion:
“The normal duration of the waves is difficult to memorize. I forgot what I had learnt after a while as I learnt it by heart” - Memorization technique.
“It is hard to remember. ECG learning is easily forgetful”.
“ECG different pattern is unable to memorize. ECG learning outcome is too many to remember” etc...
Lack of understanding of conceptual knowledge
Majority (28.3%) of students felt that lack of understanding conceptual knowledge is the major cognitive factor that contributes to ECG incompetency. Further analysis of the students' response indicated that they found difficulties in understanding three learning outcomes: (1) basic anatomy and physiology of heart, (2) 12-lead system, and (3) vector. This lack of understanding is mainly due to the complexity of the mechanism underlying ECG that makes them perplexed. In contrast to remembering, high cGPA students found more difficulty in understanding conceptual knowledge. The statements below were the summary of students' excerpts about difficulty in comprehending basic knowledge of cardiology:
“My basic science during preclinical year's knowledge is not good enough. It's either I can't comprehend the things I've learnt or my basic knowledge of cardiology is not good enough.”
“I can't understand the basic concept behind the abnormalities of ECG patterns.”
“I haven't fully mastered the basics but I will try my best to do so.”
“I am very keen to learn but ECG is confusing as the waves look quite the same and we were not thoroughly learnt step by step since the pre-clinical year to read ECG.”
“I am still quite confused with basics of ECG; sometimes the explanation is too fast. I am in need of moderate speed explanation from basic so that I can master more clinical problems regarding ECG.”
“I have a poor understanding in cardiology.”
Second key difficulty that the students perceived was their ability to understand 12-lead system. Clinical year students commented, “It's hard for me to imagine the lead system.” An interesting example was noted by a clinical year student:
“Too many leads to see. It's like too many pots of soups boiling at the same time. I don't know when to see what and which. I need a personal tutor!!!”
In contrast, one preclinical year student perceived that:
“I am not really familiar with the normal waves (especially readings from different leads, aVr, aVl.....); hence hard to see what's abnormal in them.”
“Without knowing the normal 12-lead ECG, definitely there would be problems interpreting a pathological ECG.”
Regarding the difficulty in vector concept, another student pointed out as such:
“It's really hard but if I can understand vector concept, I would be really happy.”
“It's like the joy of solving mathematics question. I cannot really understand if I learn by my own.”
“I cannot understand the particular ways every leads and how ECG works.”
Procedural knowledge: Difficulty in applying, analysis, and evaluating
A minority (3.6%) of students felt that they have difficulty in applying the concept what they had learnt in clinical ECG. Here, the researcher provides the extracted answers in more detail to support this finding:
“Although I had knowledge about ECG interpretation what I had read several times, it's difficult to apply and most often my thoughts got stuck when seeing ECG especially 12-lead.”
Difficulty in analysis and interpretation were somehow animus. The students' inability to analyze and interpret 12-lead ECG was also noted in various comments (33%). A participant mentioned that:
“It is difficult to analyze rhythm, identify waves, recognize abnormalities in especially 12-lead ECG, correlate with patient condition and come up with a correct diagnosis.”
“I took a long time to read 12-lead ECG strip.”
“Everything looks same to me.”
“I struggle to look at which lead to see at the 12-lead ECG paper all the time and decide which diagnosis.”
The clinical year students felt that learning ECG is difficult because there were lots of features to look for in a single graphic paper. It seems may be due, in part, to the negative affective state of learning as the vastness of 12 different leads in a single ECG paper daunted the students to interpret it in three-dimensional view of the heart.
Unclassified negative perceptions
Five percent of the students perceived that there was inadequate exposure and not enough ECG classroom practice to sharpen their skills; as a result, they could not perform well during ECG examination questions. Twelve percent of the participants revealed lack of proper guidance which prevented perceived progressive learning. In addition, lack of contact time with lecturer resulted in fewer hands-on experience and proper guidance on interpretation of ECG. Here is an example of students' comment:
“ECG is a vast topic to learn and requires time and full attention.”
“ECG teaching time isn't adequate in the curriculum.”
“I want more ECG classes in every year to refresh my memory.”
Bloom's taxonomy has been utilized in many fields of studies . It has also been used in the assessment of medical education, but research on the application of taxonomy of the cognitive domain into ECG learning outcome has not been made yet. The research findings of students' ECG learning difficulties were surprisingly found to be in align with Anderson and Krathwohl's Revised Bloom's taxonomy of cognitive domain (2001) ,, such as (1) lack of remembering of standard ECG parameters; (2) lack of understanding of basic anatomy, physiology, and pathology of heart; (3) difficulty in applying ECG knowledge into clinical diagnosis; (4) difficulty in analyzing how different ECG leads interrelate; and (5) difficulty in process of interpreting 12-lead ECG, which appeared to contribute negative perception and attitude in ECG learning. Of great concern, it is alarming for educators to fill the learning gap between those difficulties and ECG instruction curriculum.
Our findings revealed that remembering is the second most perceived difficulties in ECG learning. Similarly, Hurst highlighted that “without contact with ECGs for several weeks or months, he or she may be unable to interpret them.” This failure is predictable because the individual did not learn to interpret ECGs in the first place. The brains of most people are not designed to memorize countless numbers of ECG patterns . People learn and emphasize the difference in memorizing information, thinking, and learning. As a solution, Dong et al. (2015) suggested using a concept map to memorize ECG interpretation method . To note, high cGPA students scored high in the past years utilizing their memory rather than utilizing their understanding power. The reason behind might be a loss of memory retention as the time lapses which primarily results from lack of understanding of conceptual knowledge of 12-lead ECG system in relation to the functioning of different aspects of the heart that was not properly understood. The medical curriculum needs to be reiterated that ECG learning is a topic of understanding, but not by memorizing except for the standard height and width of ECG morphology.
The perceived difficulties in ECG learning were further integrated into the following three levels of knowledge – factual, conceptual, and procedural knowledge. Cracolice et al. studied concept learning versus problem learning in chemistry education . Likewise, in learning ECG, the understanding of basic concepts (conceptual learning) and solving abnormal findings (procedural learning) are very important for accurate ECG interpretation. Conceptual ECG knowledge infers to the understanding of vector concept and basic theoretical knowledge of cardiology, while procedural knowledge refers to the understanding of how to apply the concepts learned in analyzing and interpreting ECG. While pre-clinical year students found difficulty in calculating basic ECG parameters, clinical year students found difficulty to differentiate normal versus abnormal ECG.
Furthermore, it was found that vector analysis and the waveform in relation to the flow of electromotive force along the depolarization and repolarization of different parts of the heart  were not comprehensively understood by the students. Notwithstanding, Hurst encouraged to use the vector concept to interpret each ECG ; it is not widely used to instruct by medical educators nowadays due to its complexity. The clinical year students felt to have higher level of difficulties in consolidating multiple leads to come up with the correct diagnosis. While interpreting the clinical ECG, they failed to visualize the normal patterns and could not detect the abnormalities in vast 12-lead system. This view alarmingly resonates with a quantitative study done by Ohn et al., which revealed that medical students were less competent in interpreting 12-lead ECG compared to single lead rhythm strip ECG correctly . It was also commonly perceived that the teaching and revision time for ECG class was insufficient which resulted in a lack of motivation and confidence. In view of limited student–tutor contact time, online and blended learning method, for an instance, using gamified e-learning platform (GaMED ECG@™)  protects face-to-face contact time while engaging and motivating students in learning ECG. Gamified learning experience also allows medical students to attain the problem-solving skills of ECG interpretation . Ohn et al. (2018) proposed the gamified online active learning theory in which the incorporation of game characteristics takes effect on positive attitude and behavior of learners through engagement .
Our study has several limitations. Generalization of this study result needs to be cautious as this qualitative study used a convenience sampling method. In addition, different curriculum and instruction method might influence students' perceived difficulties. It is suggested to have further studies that could address more comprehensive in-depth interview of students from different universities compared with respective curriculum to find a solution to undermine incompetency in ECG interpretation skill. Future studies with improvement of ECG learning from the negative attitude should also be encouraged.
Negative attitude toward ECG learning poses a serious threat to acquire competency in ECG interpretation skill. The concept of student's memorizing ECG is not a correct approach; instead, understanding the concept and vector analysis is an elementary key for mastering ECG interpretation skill. The critical challenge in learning ECG was a lack of understanding the basic concept of cardiology, ECG wave, morphology pattern, and vector analysis which leads to ECG incompetency. Therefore, by focusing on such students' deficient points, the educators can improve the students' knowledge, confidence, and skill in ECG interpretation. In conclusion, the finding of this study sheds light into a better understanding of medical students' deficient points of ECG learning in parallel with taxonomy of cognitive domain and enables the medical teachers to come up with effective and innovative strategies for innovative ECG learning in an undergraduate medical curriculum.
I would like to thanks to medical students from Faculty of Medicine and Health Sciences, Universiti Malaysia Sabah for participating in the survey.
Financial support and sponsorship
The study was funded by Postgraduate Research Grant (Universiti Malaysia Sabah Great Grant; GUG 0144-1/2017).
Conflicts of interests
There are no conflicts of interests.
|1||Fye WB. A history of the origin, evolution, and impact of electrocardiography. Am J Cardiol 1994;73:937-49.|
|2||Kligfield P. The centennial of the einthoven electrocardiogram. J Electrocardiol 2002;35 Suppl: 123-9.|
|3||Mason JW, Hancock EW, Gettes LS, Bailey JJ, Childers R, Deal BJ, et al. Recommendations for the standardization and interpretation of the electrocardiogram: Part II: Electrocardiography diagnostic statement list a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society Endorsed by the International Society for Computerized Electrocardiology. J Am Coll Cardiol 2007;49:1128-35.|
|4||Eslava D, Dhillon S, Berger J, Homel P, Bergmann S. Interpretation of electrocardiograms by first-year residents: The need for change. J Electrocardiol 2009;42:693-7.|
|5||Raupach T, Hanneforth N, Anders S, Pukrop T, Th J ten Cate O, Harendza S, et al. Impact of teaching and assessment format on electrocardiogram interpretation skills. Med Educ 2010;44:731-40.|
|6||Jayes RL Jr., Larsen GC, Beshansky JR, D'Agostino RB, Selker HP. Physician electrocardiogram reading in the emergency department – Accuracy and effect on triage decisions: Findings from a multicenter study. J Gen Intern Med 1992;7:387-92.|
|7||Salerno SM, Alguire PC, Waxman HS. Competency in interpretation of 12-lead electrocardiograms: A summary and appraisal of published evidence. Ann Intern Med 2003;138:751-60.|
|8||Salerno SM, Alguire PC, Waxman HS; American College of Physicians. Training and competency evaluation for interpretation of 12-lead electrocardiograms: Recommendations from the American College of Physicians. Ann Intern Med 2003;138:747-50.|
|9||Sibbald M, Davies EG, Dorian P, Yu EH. Electrocardiographic interpretation skills of cardiology residents: Are they competent? Can J Cardiol 2014;30:1721-4.|
|10||Berger JS, Eisen L, Nozad V, D'Angelo J, Calderon Y, Brown DL,et al . Competency in electrocardiogram interpretation among internal medicine and emergency medicine residents. Am J Med 2005;118:873-80.|
|11||Little B, Mainie I, Ho KJ, Scott L. Electrocardiogram and rhythm strip interpretation by final year medical students. Ulster Med J 2001;70:108-10.|
|12||Jablonover RS, Lundberg E, Zhang Y, Stagnaro-Green A. Competency in electrocardiogram interpretation among graduating medical students. Teach Learn Med 2014;26:279-84.|
|13||Lever NA, Larsen PD, Dawes M, Wong A, Harding SA. Are Our Medical Graduates in New Zealand Safe and Accurate in ECG Interpretation? – ProQuest. Available from: https://search.proquest.com/docview/1034248287/abstract/79D6AA38A8ED4DAFPQ/1?accountid=44242. [Last accessed on 2018 Mar 31].|
|14||McAloon C, Leach H, Gill S, Aluwalia A, Trevelyan J. Improving ECG competence in medical trainees in a UK district general hospital. Cardiol Res 2014;5:51-7.|
|15||Kopeć G, Magoń W, Hołda M, Podolec P. Competency in ECG interpretation among medical students. Med Sci Monit 2015;21:3386-94.|
|16||Ashaari NS, Judi HM, Mohamed H, Tengku, Wook MT. Student's attitude towards statistics course. Procedia Soc Behav Sci 2011;18:287-94.|
|17||Fent G, Gosai J, Purva M. Teaching the interpretation of electrocardiograms: Which method is best? J Electrocardiol 2015;48:190-3.|
|18||Schau C, Emerita P, Emmioǧlu E. Changes in U.S. Students' Attitudes Toward Statistics Across Introductory Statistics Courses. Available from: http://www. 2011.isiproceedings.org/papers/650335.pdf. [Last accessed on 2018 Mar 31].|
|19||Judi HM, Ashaari NS, Mohamed H, Wook TM. Students profile based on attitude towards statistics. Procedia Soc Behav Sci 2011;18:266-72.|
|20||Ghulami HR, Ab Hamid MR, Zakaria R. Comparative analysis of positive and negative attitudes toward statistics. Am Inst Phys Conf Procee 2015;1643:212-8.|
|21||Bandalos DL, Yates K, Thorndike-Christ T. Effects of math self-concept, perceived self-efficacy, and attributions for failure and success on test anxiety. J Educ Psychol 1995;87:611-23.|
|22||Gal I, Ginsburg L. The role of beliefs and attitudes in learning statistics: Towards an assessment framework. J Stat Educ 1994;2:1-16.|
|23||Khavenson T, Orel E, Tryakshina M. Adaptation of survey of attitudes towards statistics (SATS 36) for Russian sample. Procedia Soc Behav Sci 2012;46:2126-9.|
|24||Hood M, Creed PA, Neumann DL. Using the Expectancy Value Model of Motivation to Understand the Relationship between Student Attitudes and Achievement In Statistics. Available from: https://www.stat.auckland.ac.nz/~iase/serj/SERJ11(2)_Hood.pdf. [Last accessed on 2018 Mar 31].|
|25||Braun V, Clarke V, Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77-101.|
|26||Bloom B. A Taxonomy of Cognitive Objectives. New York: McKay; 1956.|
|27||Wilson LO. Anderson and Krathwohl-Understanding the New Version of Bloom's Taxonomy: A Succinct Discussion of the Revisions to Bloom's Classic Cognitive Taxonomy by Anderson and Krathwohl and how to use them effectively. The Second Principle: The work of Leslie Owen Wilson. Doctoral dissertation; 2001. Available from: http://thesecondprinciple.com/teaching-essentials/beyond-bloom-cognitive-taxonomyrevised. [Last accessed on 2019 May 11].|
|28||Anderson LW, Krathwohl DR, Airasian PW, Cruikshank KA, Mayer RE, Pintrich PR, et al. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives, Abridged Edition. White Plains, NY: Longman; 2001.|
|29||Hurst JW. Methods used to interpret the 12-lead electrocardiogram: Pattern memorization versus the use of vector concepts. Clin Cardiol 2000;23:4-13.|
|30||Dong R, Yang X, Xing B, Zou Z, Zheng Z, Xie X, et al. Use of concept maps to promote electrocardiogram diagnosis learning in undergraduate medical students. Int J Clin Exp Med 2015;8:7794-801.|
|31||Cracolice MS, Deming JC, Ehlert B. Concept learning versus problem solving: A cognitive difference. J Chem Educ 2008;85:873.|
|32||Chodankar NN, Ohn MH, D'Souza UJ. Basics of electrocardiogram (ECG) and Its application in diagnosis of heart ailments: An educational series. Borneo J Med Sci 2018;12:3-22.|
|33||Ohn MH, Ohn KM, Khandaker T, Lansing MG, D'Souza UJA, Arifin Z, et al. Twelve-lead versus rhythm strip electrocardiogram interpretation skills among medical students. Pol Arch Intern Med 2018;128:556-8.|
|34||Ohn MH, Ohn KM, D'Souza UJ, Arifin Z, Pang V, Iswandono Z, et al. Development of novel ECG gamification platform gamed-ECG. Edulearn17 Proceedings. Barcelona, Spain; 2017. p. 6303-6.|
|35||Ohn MH, Iswandono Z, Mchucha I, Ohn KM, Yusof S, Urban D, et al. Gamified Online Learning Design: GOLD for Score in Medical Education. Univ Carnival e-Learning; 2018, p. 274.|
|36||Ohn MH, Yusof S, Lansing MG, Ravindran B, Nisar K, Mchucha I, et al. Gamified online active learning theory. In: 2018 IEEE international conference on artificial intelligence in engineering and technology (IICAIET). IEEE; 2018, p. 1-4. Available from: https://ieeexplore.ieee.org/document/8638463/. [Last accessed on 2019 Mar 14].|