PLACE ll RETURN Boxwmwofltbchodxomfiommm TOAVOID FINES Munonorbdomddoduo DATE DUE DATE DUE DATE DUE LEW LFL: HQ MSU I. An mum Wand Oppommy Inflation M1 HOW MEDICAL STUDENTS ADAPT LEARNING STRATEGIES TO PROBLEM-BASED LEARNING By Inkyung Lee A DISSERTATION Submitted to Michigan State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Department of Counseling, Educational Psychology and Special Education 1996 ABSTRACT HOW MEDICAL STUDENTS ADAPT LEARNING STRATEGIES To PROBLEM-BASED LEARNING By InkyungLee This study investigated how second-year medical students adapt their learning strategies to changes in the instructional context. During the second year of the preclinical program, students in the College of Human Medicine at Michigan State University experience problem-based learning (PBL), while during the first year, they attend large lectures. The researcher interviewed 12 students, including 8 students who participated in a pilot study of first year medical students. The researcher also administered the Learning and Study Strategy Inventory (LAS SI) to a larger sample of medical students. Both interviews and LAS SI data were compared with those of the pilot study (lee, Yelon, Doig, & Smith, 1994) to observe the adaptation of students’ learning strategies. Qualitative analysis showed that exams drove students’ learning-strategy choice more than the curriculum did. Students used PBL classes as an arena in which to discuss exam materials. Demands or conditions of the context, such as amount of material to study and time constraints, also influenced students’ choices of learning strategies. In general, second-year students added only one new strategy - use of computer programs. Instead of adding strategies, they changed the extent to which they used certain strategies. For example, they used more group study, more integration strategies such as making charts, and fewer memorization strategies such as mnemonics. Results of Multivariate Analysis of Variance of LAS SI data indicated, although students changed their learning strategies significantly during their first year, they did not change those strategies significantly during their second year. This could mean that students who are entering a difl'erent instructional context in which a large amount of content must be learned in a limited time may need to adapt their learning strategies more than they needed to change their learning strategies for a difi‘erent curriculum in medical school. In terms of the efi‘ect of PBL, qualitative analysis showed that the PBL curriculum achieved some of its goals. While students thought that PBL classes provided a clinical context for learning, encouraged active learning, and helped develop small-group working skills, they did not think PBL classes provided a model of problem-solving. Copyright by Inkyung Lee 1996 iii Dedicated with respect to my Parents and Husband who always love and support me unconditionally. ACKNOWLEDGMENTS I would like to aclmowledge the committee members, without whose support and help this dissertation would not have been completed. First of all, I can only attempt to express my thanks to Dr. Steve Yelon, my committee chair and advisor. Throughout my study at Michigan State University, and of course during the production of this dissertation, he provided a model of an educator. He provided expertise, intellectual stimulation, and understanding throughout this study. His intellectual insights and care for students provide me with a lifelong goal. I feel lucky to have such a wonderfiil advisor. I would also like to thank Dr. Jack Smith for his critical suggestions for my paper. His intellectual and scholarly advice, which made me work hard and take time, contributed to the quality of this paper. His feedback on my paper and other advice have been invaluable. To Dr. Kathy Doig, I would like to give a special thanks. She helped me to find the subjects of the study, support from College of Human Medicine, and gave intellectual advice regarding the medical context. Without her efi‘ort and generosity, this work could not have been done. I am also grateful for the valuable help and constructive advice of Dr. Betsy Becker. Her statistical expertise and editorial comments have added significantly to the quality of this dissertation. My extensive thanks go to Dr. Betty Werner, who provided help in finding subjects and in inventory administration. Her expertise in the problem-based learning context contributed to my study. I also wish to express my appreciation to medical students at the College of Human Medicine. I especially thank those who participated in interviews for this study. Their cooperation and kindness gave me a major source of data for this study. I also wOuld like to thank my family for their continued encouragement and support. Special thanks go to my parents who always love and believe in me. I thank my parents-in law for encouraging and supporting my study. I am also grateful to my husband, Joonho, who always gave mental and emotional support and gave intellectual advice. Lastly but most importantly, I would acknowledge my lovely daughter Yoojin, who always gives me pleasure and joy in life. TABLE OF CONTENTS Page LIST OF TABLES .................................................................................... x LIST OF FIGURES ................................................................................... xiii Chapter I. INTRODUCTION .............................................................. 1 Statement of the Problem .................................................... 1 Purpose of the Study .......................................................... 3 Assumptions ....................................................................... 4 Rationale for and Significance of the Study ......................... 5 Summary and Overview ...................................................... 7 II. REVIEW OF THE LITERATURE .................................... 9 Introduction ........................................................................ 9 Definitions of Learning Strategies ........................................ 10 General Learning-Strategy Research ................................... 11 Medical Contexts ................................................................ 13 Michigan State University Medical School ............... l3 Problem-Based Learning (PBL) ................................ 15 Research on Problem-Based Learning .................................. 29 Academic Achievement ........................................... 29 Clinical Performance ............................................... 30 Program Evaluation ................................................ 31 The Study Process (Study Habits) ........................... 33 Summary of PBL Research ...................................... 36 Summary of the Literature Review ...................................... 37 Research Questions and Working Hypotheses ..................... 39 METHODOLOGY ............................................................. 41 Introduction ........................................................................ 41 Subjects of the Study .......................................................... 41 Population ............................................................... 41 Sample .................................................................... 42 Instrument .......................................................................... 44 Interviews ............................................................... 44 Learning Study Strategy Inventory (LAS SI) ............ 46 Data Analysis ....................................................................... 51 Interview Data ........................................................ 51 The LASSI data ....................................................... 54 RESULTS .......................................................................... 56 Introduction ........................................................................ 56 Examples of Two Case Studies ........................................... 56 Jim .......................................................................... 57 Laura ...................................................................... 67 Findings Pertaining to the Research Questions .................... 76 Research Question 1 ................................................ 76 Research Question 2 ................................................ 79 Research Question 3 ................................................ 94 Research Question 4 ................................................ 97 Summary ............................................................................ 1 12 DISCUSSION AND CONCLUSION ................................. 113 Introduction ......................................................................... 113 Limitations of the Study ...................................................... 114 Research Question 1 ........................................................... 116 Research Question 2 ........................................................... 118 Research Question 3 ........................................................... 123 Research Question 4 ........................................................... 128 Interview Results .................................................... 128 LASSI Results ........................................................ 132 Conclusions ........................................................................ 136 Implications ........................................................................ 140 Implications for Theory ........................................... 141 Implications for Practice .......................................... 143 Recommendations for Future Research ............................... 145 APPE APPENDICES .......................................................................................... 148 A Consent Form ..................................................................... 148 B. Interview Questions ............................................................ 149 C. Descriptions of LASSI scales and Sample Items .................. 151 D. An Example of the PBL Process .......................................... 155 E. PBL-Sensitive Scale Items Versus PBL-Nonsensitive Scale Items ......................................................................... 158 F. Case Descriptions by Research Questions ........................... 163 REFERENCES .......................................................................................... 226 41 5‘4. 4!. LIST OF TABLES Table Page 2.1. Comparisons of learning tasks between first-year and second-year MSU CHM medical students .......................................................... 27 2.2. Comparisons between general PBL and MSU PBL ......................... 28 3.1. Schedule and number of subjects for interviews and LAS SI administrations ............................................................................... 55 4.1. Key features of Jim’s learning strategies ......................................... 66 4.2. Key features of Laura’s learning strategies ...................................... 75 4.3. Resources students used to study learning issues ............................ 77 4.4. How and what students read ........................................................... 80 4.5. Reasons for doing group study ........................................................ 81 4.6. Integration strategies ...................................................................... 84 4.7. Memorization strategies ................................................................. 86 4. 8. Strategies for selecting main information ........................................ 88 4.9. Reasons for using computer programs ............................................ 90 4.10. Strategies for checking knowledge ................................................. 92 4.11. Influences on students’ learning strategies ...................................... 94 4.12. The ways in which PBL classes helped the students ........................ 96 4.13. Means and standard deviations on each LAS SI scale for students who completed the LASSI at times 1, 2, and 3 ............................... 100 F7. F8 F9 4.14. 4.15. 4.16. 4.17. 4.18. 4.19. 4.20. 4.21. F.1. F.2. F.3. F.4. F5. F6. F.7. F.8. F.9. Univariate F-Tests of Significance of all three LASSIs using the 10 LASSI scales ....................................................................... 102 Univariate E—Tests of Significance at time 1 and time 2 using the 10 LASSI scales ....................................................................... 103 Means and standard deviations on each LASSI scale for students who completed the LASSI at time 1 and time 2 .............................. 104 Means and standard deviations on each LASSI scale for students who completed the LASSI at time 2 and time 3 .............................. 105 Ommbus test ofsignificance at time 2 and time 3 using the 10 LASSI scales .................................................................................. 106 Means and standard deviations on the PBL-related scale and the PBL—unrelated scale for students who completed the LAS SI at all three times ............................................................................. 109 Means and standard deviations on the PBL-related scale and the PBL-unrelated scale for students who completed the LASSI at time 1 and time 2 ........................................................................ 110 Means and standard deviations on the PBL—related scale and the PBL-unrelated scale for students who completed the LAS SI attime2andtime3 ......................................................................... 111 Key features of Mark’s learning strategies ...................................... 168 Key features of Tom’s learning strategies ....................................... 175 Key features of Ann’s learning strategies ........................................ 182 Key features of Mary’s learning strategies ...................................... 188 Key features of Andrew’s learning strategies .................................. 194 Key features of Roger’s learning strategies ..................................... 200 Key features of Nancy’s learning strategies ..................................... 205 Key features of Janet’s learning strategies ....................................... 210 Key features of Cindy’s learning strategies ..................................... 212 F. 10. Key features of Susan’s learning strategies ..................................... 215 F. 1 1. Key features of Kelly’s learning strategies ....................................... 220 F.12. Key features of Jane’s learning strategies ........................................ 225 LIST OF FIGURES Figure Page 4.1. Means on each LASSI scale for times 1, 2, and 3 ............................ 101 4.2. Means on the PBL-sensitive and the PBL-nonsensitive scales fortime 1 and time3 ...................................................................... 107 4.3. Means on the PBL-related scale and the PBL-unrelated scale for times 1, 2, and 3 ............................................................................. 109 5.1. Factors influencing students’ choice of learning strategies ................ 138 5-3316 CHAPTERI INTRODUCTION ment 1' lem Educators do their best to construct instruction so their students will learn what is needed to perform in the real world. For example, educators build professional education programs with real-world-oriented general goals and specific objectives in mind. Although medical educators want students to remember many basic-science facts, concepts, and principles, they also want students to apply that knowledge to solve medical problems. Thus, they design the instruction so that students will learn as much as possible of the necessary knowledge and skill. However, students are not passive recipients of knowledge and skill instruction. They employ learning strategies to make the most of what is provided in the instructional system. In the best of all worlds, educators provide instruction and students use compatible learning strategies so they learn what is needed quickly and accurately. But sometimes the faculty’s instructional system and the students’ learning strategies are not compatible. Students may not have the skills to study in the most effective and eficient manner to complement the instructional methods or to attain the goals and the objectives of the instruction. Or students may study in their own way to an achieve their goals regardless of the instructional goals or objectives. One could argue that the instruction should change, and that is a possibility. However, the reality in most situations is that the students must adapt to the instruction. Of course, all students need to adapt their learning strategies a bit when they take a new class with a new teacher or when they encounter a new subject. But it would seem that students would have to adapt considerably more when the whole curriculum changes- that is, when the mode of instruction and the goals and objectives change. One typical example of an extreme change in curriculum can be found in the variations in each year’s work in the medical schools. For example, at Michigan State University, medical faculty teach according to considerably difi‘erent curriculum plans in the first two years of medical school. The first year, faculty teach mainly in large lectures. Students must learn to recall and understand large amounts of basic science, which they will eventually apply to medical practice. Even in year one, medical educators are concerned with the way medical students adapt their learning strategies fiom the typical undergraduate college classroom to the intensive learning experience of medical school. This concern is magnified for students who have not been as facile as other students in applying learning strategies in college and who may not have as wide a range of learning strategies to use. As medical students enter year two, an even greater adjustment is required. Now they are expected to learn, integrate, and apply knowledge to solve medical problems. Furthermore, they must learn what they need to know to solve the problems on their own and through group discussion with peers and a facilitator. This approach is called ”Y? _ £3 ‘ problem-based learning (PBL). In this context, medical educators are concerned about the student’s ability to switch learning strategies from year one and to adapt to the new mode of instruction and the new outcomes. Instructional designers, curriculum developers, educational psychologists in general, and medical educators concerned about at-risk students and those concerned with planning medical curricula, in particular, want to know how students adapt their learning strategies to changing instructional contexts. Ifthese professionals can understand this process of adaptation, they can advise students about the most efi’ective learning strategies for the instructional system and can build courses in a way that will encourage effective and eficient learning strategies. To expand the understanding of how students in general change their approaches to study, I explored how medical students adapted their learning strategies when instructional contexts changed. Because of the substantial changes that take place in medical school curricula, medical students are ideal people to study to assess adjustment of learning approaches as the instructional context changes. W The main purpose in this study was to examine how second-year medical students adapt their learning strategies to changes in the instructional context. I looked at the learning strategies of medical students who took part in a pilot study during their first year in a large-lecture-based curriculum (Lee, Yelon, Doig, & Smith, 1994). During the second year of the preclinical program, students in the College of Human Medicine at Michigan State University experience the new environment of problem-based learning (PBL). This PBL curriculum, like others that have been adopted by some medical schools, is supposed to encourage students to use approaches that enhance their learning (Vernon & Blake, 1993). Because students’ perceptions of context may afi‘ect their approach to learning (Ramsden, 1984), I also probed students’ perspectives on PBL. The pilot study by Lee et al. (1994) of first-year medical students at Michigan State University showed that students in a traditionally delivered, lecture-based curriculum had enormous study loads and limited time. Through the experience of their first semester of medical school, most of the pilot students became more efi‘ective and eficient in choosing learning strategies. For example, they fiequently used the strategy of selecting important information, focusing on information that was likely to be on their multiple- choice exams. They also became eficient in time-management strategies, and were involved in group study to exchange information or to divide the study load. This finding is consistent with that of Malton and Saljo (1976b), who found that students adopted rote learning or memorizing strategies for what was most likely to be on the exam when faced with large amounts of factual information coupled with limited time. Assumptions This study was based on two assumptions: (a) Learning strategies influence instructional outcomes, and (b) varied instructional contexts require changes in learning strategies. Each of these assumptions is discussed below. One assumption made in this study was that students’ use of learning strategies has a significant influence on their academic success and, perhaps more important, on the quality of the knowledge they acquire. Researchers studying learning strategies have P: a is £2“ :13- found correlations among various aspects of study methods, habits or attitudes, and academic performance (Brown, Bransford, Ferrara & Campione, 1983; Garner, 1990; Paris, 1988). However, these investigators have not considered the complexity and dynamics of individuals’ learning strategies. A second assumption made in this study was that, although approaches to learning are determined partly by an individual’s learning style, learning strategies are also significantly influenced by the instructional context. The combination of learning style and instructional context produces unique approaches to learning that are found in all groups of students, including medical students (Newble & Entwistle, 1986). In a recent study of the learning approaches of medical students, Arnold and Feighny (1995) found that students’ perceptions of the instructional context influenced their learning approaches, which in turn influenced their performance. Students must learn how to learn to meet the changing demands of the learning environment because it is essential that students be flexible in adapting their learning strategies to the demands of the working environment. Therefore, it is important for students to be aware of learning demands and understand how to adjust their learning strategies to particular situations. Researchers have not considered all the aspects of how learning strategies change as instructional context changes. Rati nale for nd i ifi use of the S Although researchers have explored learning strategies and PBL, this study makes several unique contributions to the understanding of both topics. First, researchers have conducted many studies on the learning strategies of children and undergraduate students. However, few researchers have focused on learning strategies of graduate professional students. This study focused on medical students, a unique subset of graduate professional students. Second, whereas most learning-strategy studies have focused on relationships among various aspects of study methods, habits or attitudes, and academic performance (Brown et al., 1983; Gamer, 1990; Paris, 1988), the focus of this study was on how learning strategies change as a function of changes in instructional context. I followed students fiom their first year of medical school to their second year, and examined how their learning strategies changed. Third, in previous research on PBL curricula, findings have been inconsistent across programs in difl‘erent medical schools. Thus, more studies of PBL in various areas are needed to establish the benefits of PBL. Each program is unique in its design, and the problems or cases used in PBL are a major variable (Barrows, 1986). Thus, a synthesis of the advantages of PBL is hard to achieve, and the careful study of each program and its characteristics is necessary. Further, the College of Human Medicine at MSU has its own characteristics which are different fi'om other PBL schools. For example, MSU has different assessment methods than do other PBL programs. Thus, although previous researchers have tended to suggest that students study difi‘erently under PBL, this claim cannot be generalized to the MSU PBL curriculum. No studies have been conducted on learning strategies of students under the MSU PBL curriculum. Thus, this study will contribute to the understanding of the MSU medical students’ approaches to studying under PBL curricula. Further, investigating students’ learning approaches in preclinical years under PBL curricula will enrich the understanding of medical students’ general learning, in which there is a growing interest. Finally, this study explored, in part, students’ perceptions about their use of learning strategies in difi‘erent contexts. As shown in the literature review, observed difl‘erences in approaches to learning are likely to reflect contrasts in the educational environment. However, it is impossible to say which components of the environment are the most influential, as there are substantial difi‘erences between PBL and traditional courses in terms of curriculum, teaching methods, assessment, and stafl-student relationships, all of which are likely to contribute in some way. Thus, it is valuable to understand students’ perceptions of which of these aspects affect their approach to studying in each curriculum so that this information can be used in firture instructional designs in medical school. mm nd 0v rview In this study, I explored learning strategies of second-year medical students at Michigan State University to determine how they adapt their learning strategies to a new curriculumuproblem-based learning. I compared the students’ second-year learning strategies with their first-year strategies. In addition, I studied the medical students’ perceptions of PBL and its influences on their learning. In Chapter 1, I set forth the necessity of studying how students adapt their learning strategies in difi‘erent contexts. The chapter also contained the assumptions made in the study, purposes of the research, and four unique aspects of this study. Chapter 11 contains a review of studies of learning strategies and the definition of learning strategies used in this study. Chapter II also contains an explanation of medical education in general as well as the specific medical context at Michigan State University. For example, I explain and compare the first- and second-year medical students’ activities, curricula, and intellectual tasks. To consider the new context to which the students must adapt, I also review literature related to problem-based learning. From reviewing previous research on learning strategies, medical context, and PBL research, I formulated four research questions with specific working hypotheses. Chapter III contains an explanation of the research methodology. Both qualitative and quantitative methods were used. I conducted interviews and administered a questionnaire called the Learning And Study Strategy Inventory (LAS SI). Chapter 111 contains a description of the subjects of the study, including the population. The interview procedures and LAS SI administration procedures are explained. Also, the data-analysis procedures are described. The findings of this study are presented in Chapter IV in relation to each research question. The findings pertaining to the working hypotheses related to each research question also are provided. In Chapter V, the limitations of this study are set forth before discussing the study findings. The findings are discussed in relation to those from previous studies. I also set forth the conclusions drawn fi'om the findings. Implications and recommendations for future studies also are presented. £811: CHAPTERII REVIEW OF THE LITERATURE Introduction The goal of this study was to examine the learning strategies of second-year medical students who were under the PBL curriculum to determine how they adapted to a PBL curriculum fiom a large-lectrrre-based curriculum. To understand and fulfill the goal of this study, this chapter includes a review of literature based on three purposes. The first purpose of this chapter is to discuss the definitions of learning strategies adopted in previous studies to derive the definition used in this study. Previous studies of general learning strategies also are reviewed. The second purpose of this chapter is to describe the types of medical contexts in which medical students need to adapt their learning strategies. I compare the medical context at MSU to that of other medical schools, and discuss in detail the PBL context in order to understand students’ responses to interviews carried out for this research. In doing this, the first-year and second-year medical contexts in general and at MSU are described and compared. The third purpose of this chapter is to provide the rationale for this study, and also to formulate the research questions and working hypotheses. Thus, previous PBL studies 10 of various topics including study approaches are reviewed in order to derive the research questions and working hypotheses, which are presented at the end of this chapter. Definifions of Learning Strategies Researchers have defined learning strategies in various ways. Weinstein and Mayer's (1986) definition of learning strategies is so broad that it includes all cognitive processes. They defined learning strategies as thoughts and behaviors that a learner engages in during learning and that are intended to influence the encoding process. Nisbet and Shucksrnith (1986) distinguished learning strategies from learning skills. They defined strategies as ”executive processes which choose, coordinate, and apply skills and sequence of activities" (p. 1). In this definition, strategies are rather broad, general, and goal-oriented, whereas skills are more specific or reflective. For example, strategies include monitoring, revising, and checking, whereas skills include note-taking, underlining, and summarizing. According to Nisbet and Shucksrnith, strategies improve with age and experience, even without specific instruction; skills are more task-specific and can be taught easily. Kirby (1984) postulated a division of learning strategies into micro-strategies and macro-strategies. Micro-strategies, such as underlining and summarizing, are more task- specific and thus are closer to performance and more responsive to instruction. On the other hand, macro strategies, such as monitoring and efi‘ort managing, are more pervasive and often are entwined with emotional and motivational factors. Whatever term researchers choose, it seems that learning strategies are executive processes such as 1" I M... 3. .U. 031:, 16:: hr:- h I ll monitoring, planning, and regulating and are related to metacogrrition. They are at a more general level than observable performances such as skimming, note-taking, or outlining. In the present research, strategies were defined as purposefirl mental and physical processes that underlie performance. Learning was defined as changes in either thinking or behavior, including both quantitative and qualitative changes. This definition of learning includes changes in one's thinking process of which one is unaware, and that are potentially available to consciousness. People may be able to infer their use of a strategy alter being queried, even if they were unaware of their processing while performing the task Therefore, learning strategies are tactics that increase the likelihood of efi‘ective and eficient learning, such as helping the learner encode the information, memorize, and learn easily. More specifically, following the definition of Weinstein and Mayer (1986), learning strategies can be considered as thoughts and behaviors that a learner engages in during learning and that are intended to influence the information processing. Learning strategies include basic memory processes as well as general problem solving, and they encompass almost all cognitive processes. d Query Luming-Sggtegy Resgrch Many researchers in the late 1970s and 19805 were interested in results or outcomes such as student achievement or grade changes brought about by using certain learning strategies, rather than the process by which learning strategies resulted in improved student achievement. For example, specific learning Strategies such as note- taking (Norton & Hartley, 1986) and underlining in text (Blanchard, 1986) have been found to influence students' ability to recall information. 12 Many researchers have found that learning strategies can be taught (Chipman, Sega], & Glaser, 1985; Weinstein & Mayer, 1986). Also, it has been found that metacognition can be promoted through direct instruction in classrooms and that increased awareness can lead to better use of learning strategies (Paris, Cross, & Lipsorr, 1984). Paris (1988) indicated that effective learners know when they need to be strategic and when they do not. Lodico, Ghatala, Levin, Pressley, and Bell (1983) supported the relationship between metacognitive knowledge and subsequent strategy use. In their study, they found that instruction in general memory-monitoring principles was sufficient to efl‘ect a change in strategy usage. Investigators have established strong relationships between learning/metacognitive strategies and students' acadenric achievement (Brown et al., 1983; Garner, 1990; Paris, 1988). Recently, scholars have begun to investigate the critical efl‘ect of college students' independent use of learning strategies on their academic achievement (McKeachie, Pintrich, & Lin, 1985; Pintrich, 1989). Pintrich argued that learning strategies facilitate the storage and retrieval of information and, as a result, lead to an increase in students' academic achievement. These studies were predicated on the assumption that academic achievement can be improved by students’ exarrrining the strategies they use while learning. McKeachie, Pintrich, Lin, Smith, and Sharma (1990) suggested that use of learning strategies can vary depending on the situation, and that these strategies can be brought under students’ control. For example, students may choose to study difl'erently for a simple factual recall test than they would for a test that requires application and transfer of 13 the course material. In addition, research on student motivation and personality has indicated that motivational orientation can vary in difl‘erent situations and significantly afi‘ect learning (McKeachie et al., 1990). Most of the studies of learning strategies reviewed in this section focused on the relationships between learning strategies and achievement, and most of them centered on children and college students. The present study was based on the assumptions that learning strategies are changeable and that these strategies can be controlled by the learner. In contrast to previous studies of learning strategies, the present study concerned learning strategies of medical students who are graduate professional students. Further, I examined how students changed their learning strategies in two difl‘erent contexts (lecture verms problem-based learning) instead of focusing on the relationship between learning strategies and academic achievement as most previous researchers have done. Mflig antgxt niv ' M ' ch 1 Michigan State University (MSU) has two medical schools: The College of Human Medicine (CHM), whose graduates become MDs (medical doctors) and The College of Osteopathic Medicine, whose graduates become DOS (doctors of osteopathy). This study was focused on students who were pursuing an MD degree, who were enrolled in the College of Human Medicine. Thus, the description of the medical school structure pertains to that for MD degree students. Information on the MSU CHM Structure was taken fi'om the Mbggk for Premgical Students (1996), which is published by CHM, l4 and from an interview with a professor in MSU CHM who is in charge of the year one curriculum As with most other medical schools in the United States, students who are applying to the medical school at MSU need to have completed the baccalaureate degree requirements. Usually, students who are applying to the medical school have science backgrounds in their undergraduate education, although this is not always the case. Students need to take the Medical College Admission Test (MCAT) before applying to medical school. They also need to submit an American Medical College Application Service (AMCAS) application with transcripts of all their academic work. Then, AMCAS forwards a copy of the student’s application and MCAT scores to the College of Human Medicine. MSU CHM also reconrrnends that students work or volunteer in medically related areas and volunteer in community service areas. After the admissions committee reviews the students’ AMCAS application, grades, and MCAT scores, qualified applicants are asked to continue the application process by submitting a CHM secondary application, in which students relate medically relevant professional experiences, a statement of past or pending disciplinary actions, and plans for completing the CI-IM’S premedical requirements. After these admission requirements are reviewed, students are interviewed. At that time, students need to have three letters of evaluation fiom professionals. Following the interview, the student’s entire application, including letters of evaluation, is carefully reviewed by the Committee on Admissions. Students who are admitted to MSU CHM receive four years of medical education. In the first year, called Block 1, medical students learn fundamental biological, psyche- lemurs: arricu Pears. aware 15 psychological, and sociological science concepts. Block I consists mainly of large lectures. The second year of medical school, called Block 11, consists primarily of a PBL curriculum, which is explained in detail later in this section. The third and fourth years of medical school are called Block 111. Block III clerkships are physician-supervised learning experiences in which students work with patients at community hospitals and in ambulatory settings. These clerkships are completed at one of six Michigan community campuses, including Flint, Grand Rapids, Kalamazoo, Lansing, Saginaw, and the Upper Peninsula. Students who successfirlly complete the four years of medical school are awarded the MD degree. However, to become practicing physicians, they need further training, including a residency program in their choice of one of several medical specialties. Students spend three to seven years in the residency program, depending on the medical specialty they choose. After the residency program, physicians sometimes take part in a one- to three-year fellowship program, doing research and receiving advanced clinical training. This study focused on students in the second year of medical school, which consists mainly of a PBL curriculum. PBL is described in detail in the following section. Pr 1 -B ' B In this section, I discuss problem-based learning including its goals and theoretical basis. Because the adaptation of students’ learning strategies in different instructional contexts was the focus of this study, I also discuss the differences between the first and second year of medical school, including curriculum and intellectual tasks. 16 EM is PBL in ggeral? The PBL approach has its roots in the discovery method of teaching promoted by John Dewey in the 193 OS. The approach reappeared in the 19603 as the inquiry method of teaching science, heavily influenced by the work of Bruner and Piaget (Wilkerson & Feletti, 1989). Recently, PBL has been the subject of much attention in medical education. PBL was developed at McMaster University Medical School in the early 19705 (Barrows & Mitchell, 1975; Neufeld & Barrows, 1974). Currently, more than 70 medical schools worldwide employ PBL (Ravitch, Golub, Altman, & McGaghie, 1994). The crucial components of PBL curricula are the ideas that problems raise compelling issues for new learning and that students have an opportunity to become actively involved in the discussion of these issues, with appropriate feedback and corrective assistance fi'om faculty members. The problems are not viewed as mere supplements to lectures, but are regarded as a major part of the educational experience. PBL can be defined as learning that results fi'om a process of working toward the understanding or resolution of a problem (Alguire & Werner, 1992). PBL uses problems- in this instance, patient cases—as a stimulus for learning, provides an opportunity for problem solving, and allows for student-initiated searching for information. PBL curricula are student centered to the extent that, during the course of discussing a problem, students can identify knowledge deficiencies on their own and, outside class, study to address those deficiencies. Coulson (1983) considered this the process of self-directed learning. As he described the process, students working through a problem will hit obstacles to their progress due to lack of knowledge. Each time they hit an obstacle they make note of what they need to learn and continue with the problem until l7 progress ceases. At this point, students develop a learning “prescription” with help from their tutor, access learning resources to acquire the knowledge they need, and then return to the problem either to start over or to pick up where they left ofl‘. In working with the problems, students are expected to draw on previous learning and experience, to pose questions concerning new issues, to set personal learning goals, to take responsibility for their own learning through independent reading and study, and to teach one another V through student-to-student discussion. However, although the term “problem-based learning” identifies a general approach to learning, there are variations among PBL curricula at different schools. Some medical schools such as McMaster, Maastricht, Newcastle, Hawaii, and Sherbrooke, or “tracks” in such schools as New Mexico, Bowman-Gray, Rush, and Ohio State, have no lectures and have only PBL curricula. Other schools such as Tufis, Harvard, New Jersey, Northwestern, Michigan State, and Medical College of Wisconsin employ PBL as one learning modality within a curriculum that may also include lectures, large-group discussion, and other learning formats. Schools also may difl‘er in their conceptualization of curriculum, structure, expectations of students in PBL, preparation of cases, roles of faculty, and assessment of students (Ravitch et al., 1994). Blumberg, Michael, and Zeitz (1990) in their structured interviews with faculty representing seven North American problem-based learning curricula found that the examination development process varies fi'om school to school. For example, at MSU, Harvard, and Mercer, the faculty-generated learning objectives determine the content of examinations. On the other hand, at Rush and Bowman Gary, student-generated learning issues are collected and used in preparing 18 examinations. Further, Blumberg et a1. (1990) found that at Bowman Gary, McMaster, New Mexico, and Rush, students are evaluated on their ability to generate learning issues. For instance, on the first attempt on some evaluations, students in these schools generate learning issues and study fi'om learning issues for oral exams, which follow. However, at MSU and Mercer, the examinations are closed book and students’ ability to generate and resolve learning issues is not evaluated. At MSU CHM, students and a faculty tutor/preceptor meet for two hours, three times a week The preceptor facilitates problem-based learning discussion. Preceptors are faculty in medical school, both Ph.D.’s and M.D.’s. The principal responsibility of the preceptors is to facilitate the discussion and learning of the small groups in PBL class. They also evaluate the performance of each student in the group and provide feedback to them. At MSU CHM, there is a balance between teacher- and student-centered PBL curricula. For example, MSU PBL classes are very structured in that the learning objectives are defined by faculty and not by students. Also, students focus on specific reading assignments provided by faculty. However, students are expected to participate actively in class discussions. Because each school has unique characteristics within PBL programs, it is important to keep these characteristics in mind when studying a particular school. W In general, PBL is supposed to let students take responsibility for their own learning. Students develop learning strategies and habits that will serve them well for a lifetime of learning, particularly when they encounter unfamiliar problems. Glaser (1984) labeled these strategies and habits self-regulatory or 19 metacognitive skills. They include knowing what one knows and does not know, predicting outcomes, planning ahead, eficiently apportioning time and cognitive resources, and monitoring one's efi‘orts to solve a problem or learn. This approach also is supposed to enhance students' motivation to learn. Active participation in defining, resolving, or managing a problem points up the need to acquire new information, attitudes, and skills. When PBL is implemented across an entire institution, students develop learning styles commensurate with that approach and difl‘erent fiorn the learning styles demonstrated by students in a more traditional curriculum (Newble & Clarke, 1986). PBL also restructures previous learning in an attempt to accommodate new information; new learning is organized for assimilation into existing knowledge structures (Schmidt, 1983). Further, teachers can use PBL to encourage students to assess their own learning. Discussion among peers allows learners to compare their answers to those of other students, to discover errors in their thinking, and to hear how correct solutions were derived. PBL is supposed to promote self-directed learning skills, and the practice of self- directed learning in the context of PBL thus enhances the probability and quality of continued learning once the student has graduated and throughout his or her career. Hence one might assume that the PBL experience allows students to enhance their independent-study strategies. Also, through small-group work, PBL can promote team efforts and the ability to work with others. This led me to believe that second-year medical students improve their small-group skills through the PBL experience. 20 gals of the MSU model of PBL. The goals of PBL at MSU include: 1. To provide a clinical context for learning which will both anchor the learning and motivate the student. 2. To encourage active learning: If students are in a small group and working with a problem, they should be engaged actively in learning, not passive bystanders. 3. To provide a model of problem solving: What is learned will depend upon where the focus is: the student may learn skills in identifying learning needs, or skills for acquiring new information, or some other clinically relevant problem-solving skills 4. To develop small-group skills: Since students work in a small group, they acquire some efl‘ective small-group skills. The PBL group provides a “human laboratory” in which group process can be examined and one’s own group behavior can serve as a focus for learning as well. (Block 11 Preceptor Training, 1993, p. 1) Willi}; PBL has a cognitive-psychology perspective as its theoretical base. As Schmidt (1983) and Norman and Schmidt (1992) suggested, three major principles derived fiom the cognitive-psychology orientation support the rationale and process of PBL: (a) the role of prior knowledge, (b) learning transfer, and (c) elaboration of knowledge. The first principle of PBL is acknowledgment of the role of prior knowledge. Learning, by its very nature, has a restructuring character. It presupposes earlier knowledge that is used in understanding new information. Current learning is affected by past learning. Well-written problems will activate students’ prior knowledge of high school or undergraduate science. As such, a second-year medical student, while reading and interpreting an article, will probably make use of his or her secondary-school or first- year medical school knowledge of biology. Thus, one of the goals of learning is to activate a student’s year-one knowledge. Instructional methods, however, difi‘er in their capacity to activate relevant prior knowledge (Mayer & Greeno, 1972). To be successful, 21 the instructional method must activate the prior knowledge. PBL, by encouraging students’ discussion, questions, and problem solving, is intended to activate students’ prior knowledge for the current learning. Thus, it can be predicted that PBL allows second- year medical students to activate their prior knowledge and hence connect their current learning to their existing knowledge more easily than first-year students. The second principle of PBL is related to learning transfer, which Schmidt (1983) called “encoding specificity.” This principle suggests that the closer the resemblance between the situation in which something is learned and the situation in which it will be applied, the more likely it is that transfer of learning will occur. PBL problems use real- life situations. Well-written problems present situations most commonly seen in practice. Barrows (1985) contended that medical students do not remember or cannot use the knowledge they learned in traditional basic-science courses because that knowledge was structured into mental organizations that are not usefirl in a clinical setting. That knowledge was structured around taxonomies and hierarchies, but not symptoms, signs, or courses of illnesses. Barrows proposed that learning basic science in a PBL format will structure the knowledge in such a way that students will remember it better and will be able to retrieve it when they need it in clinical practice. The third theoretical principle of PBL is the importance of the elaboration of knowledge. Information will be better understood and remembered if there is opportunity for elaboration (Anderson & Reder, 197 9). Examples include engaging in active discussion, answering questions, teaching peers, writing summaries, and formulating and criticizing hypotheses about a given problem (Schmidt, 1983). Providing opportunities for 22 elaboration is one of the main activities of PBL. Elaboration creates redundancy in the memory structure. Redundancy can be viewed as a safeguard against forgetting and an aid to rapid retrieval. Overall, by encouraging students’ active participation in discussion and problem solving, PBL facilitates students’ learning, emphasizing the active role of the learner, in comparison with the more traditional curriculum. CMS of the CHM curriglum. 1. First-Year Medical School First-year medical students take biological-science courses including anatomy, physiology, biochemistry, histology, pathology, neuroscience, pharmacology, genetics, microbiology, and radiology. The instruction is discipline-based and is conducted in a large-class lecture mode. In addition to these basic-science courses, students learn basic clinical science, which is taught in a series of clinical skills courses spanning Blocks I and 11 (three hours per week). From these courses, students learn the dynamics of the doctor-patient relationship, how to interview patients, and how to conduct physical examinations. Also, they take human development courses, which are taught in the summer semester. These courses provide a foundation for domains related to behavioral sciences such as psychology or sociology. 2. Second-Year Medical School The second year of medical school (Block 11) features a required PBL curriculum designed to facilitate the integration of basic sciences with clinically relevant cases. The 23 content domains of the second year include infectious disease, disorders of development and behavior, neurological and musculoskeletal, major mental disorders, cardiovascular, pulmonary, renal, metabolic, endocrine and reproductive, digestive, dermatology/allergy, and hematopoietic/neoplasia. At the beginning of each of these domains, students are given an “unpacked content list,” which defines for them all of the content they are expected to know and understand at the end of that domain. The lists are organized by basic science disciplines, as is the first-year curriculum, although they contain more advanced and sophisticated knowledge. An efi‘ort has been made to relate the content lists to the cases as much as possible in terms of domain content. Each case is designed so that there are pieces of the content list that naturally elaborate fiom that case. In addition to the PBL curriculum, students in Block 11 participate in a year-long serrrinar on medical ethics, health policy, and epidemiology, and learn advanced clinical skills. They also take part in the mentor program, which focuses on the personal development of the physician. ' 'n 'sintheMS PBLclasr rn. Cases are usually discussed and analyzed in two or more successive sessions. As the cases are analyzed, students define learning issues. Learning issues provide the bridge from one session to the next. They are the agenda for learning that the students define for themselves, the homework that students create. They determine what the students will be prepared to discuss and examine at the next meeting. All members of the group then focus on the learning issues in their study between sessions. Preceptors help students to define learning issues in ways that will make it productive for them, and not overwhelming. The analysis of the cases proceeds in three general steps: 1. Define cues: What data are in the case that might be clues about what is going on? 2. Create hypotheses: ideas about what’s happening, what the underlying mechanisms or principles that might be at work in this case. The hypotheses should be in terms of the underlying basic sciences, and not be possible diagnoses. 24 3. Generate learning issues: areas that will be emphasized during independent study, in order to better understand the case. This is a dynamic process. Rather than moving in a linear fashion from cues to hypotheses to learning issues, the preceptor helps the group move back and forth between cues, hypotheses, and learning issues. (Black II Preceptor Training, 1993, p. 7 ) An example of each step of the PBL process is shown in Appendix D. W. l. First-Year Medical Students First-year medical students’ intellectual tasks include (from discussions with the director of Block I curriculum and the pilot study (Lee et al., 1994)): - Mainly reading books, notes, and scribe notes. Scribe notes are notes which other students have taken in the class and are distributed to those students who want them. They are widely used among medical-school students. - Solving assignments to understand the concepts, principles, and diagrams in preparation for classes and exams. - Taking notes during class. - Memorizing the facts, concepts, principles, and so on (using various strategies such as mnemonics, diagrams, and connecting to experiences) for exams. - Discussing and asking questions during review sessions or Supplemental Instruction (SI) sessions (optional). - Studying with tutors (mostly for understanding the concepts)-optional. - Interacting with patients (interviewing skills). 2. Second-Year Medical Students 25 Second-year medical students’ intellectual tasks include (fi'om Black II Preceptor Training, 1993): W 1. Present the initial case 2. Find cues 3. List hypotheses 4. Receive additional information 5. Summarize facts 6. Generate learning issues 7. Discuss resources 8. Learn independently 9. Revise hypotheses based on independent study 10. Review what has been learned Tasks (Skills, Idgs) Listen to or look for the pertinent cues Find and organize cues List hypotheses in terms of principles Reduce the number of hypotheses, seek additional cues Summarize facts, change hypotheses Identify knowledge deficiencies Look for the resources, research skills Independently study the learning issues Apply knowledge to the case Review knowledge, connect new knowledge to previous knowledge In addition to these tasks, second-year medical students’ intellectual tasks include: - Learning basic-science concepts in clinical context. - Actively participating in discussions. - Thinking and identifying the learning issues (rdentifying their knowledge deficiencies). - Doing independent study for the next session, looking for resources. - Integrating concepts and principles for problem solving. - Improving small group skills. 26 - Applying what they have learned in solving simulated problems. - Asking questions. - Interviewing patients. - Studying for exams (multiple choice exams). A comparison of learning tasks of first- and second-year MSU CHM medical students is shown in Table 2.1. A comparison of general PBL and MSU PBL is presented in Table 2.2. 27 Table 2.1: Comparisons of learning tasks between first-year and second-year MSU CHM medical students. First Year Second Year Assessment Multiple-choice exams Multiple-choice exams; essays occasionally Learning Activities Mostly memorization of what will To b; studied (Tasks) in Class be on the exams; selecting main Problem solving - discussion of information; lectures; taking the case; generating learning notes, interviewing skills, etc. issues for the next session, solving Stimulus questions provided by faculty members, asking questions, etc. (It is hypothesized that they also focus on memorization for exams, thus doing difl‘erent things for the class and the exams.) Outside Activities Solving stimulus questions that To be studied are at the end of the course Independent study for learning packet; attending Supplemental issues, research, etc. Instruction (optional), (It is hypothesized that participating in study group, students use more learning tutoring, etc. resources such as library facilities.) Content Basic sciences Basic sciences Methods Mainly large lectures PBL (mainly small-group (Curriculum) discussion), large lectures (optional),etc.; balanced in that PBL has both teacher and student centered; teachers generate testing agendas Note: F irst-year data are primarily from a pilot study of MSU students (Lee et al., 1994). MSU second-year data come from internal documents of the MSU medical school and fi'om interviews with faculty members in the medical school. 28 Table 2.2: Comparisons between general PBL and MSU PBL MSU PBL General PBL Assessment Multiple choice; Usually both essays and essays occasionally multiple choice are required Leaning Activities To be mung Understanding oriented, (Tasks) in Class Problem solving - discussion of problem solving, information the case; generating learning gathering, reasoning, etc. issues for the next session, solving stimulus questions provided by faculty members, asking questions, etc. Outside Activities Mtgtii—ed More library use (information Independent study for learning seeking), self-directed issues, research, etc. learning, doing research of their own, etc. Content Basic sciences Basic sciences Methods PBL (mainly small-group PBL; most other programs (Curriculum) discussion), large lectures have PBL curriculum for both (optional), etc; balanced in that first and second years, varied PBL is both teacher and student depending on program, but centered; teachers generate mostly student centered in that testing agendas students generate learning agendas Note: General second-year data are from literature on various PBL programs. 29 Research 2n Problem-Based Learning Vernon and Blake (1993) conducted a meta-analysis of PBL as compared with traditional methods of teaching. Their study included 25 studies carried out from 1970 through 1992. Albanese and Mitchell (1993) also did a comprehensive review of writings on PBL. They reviewed literature fiom 1972 to 1992 on the efl‘ectiveness of PBL. The diversity of the original studies reviewed, particularly with respect to outcome measures and research designs, enhances the tentative nature of the conclusions they reached. The remlts of both review studies were similar. Based on their research, the present researcher tried to provide a more comprehensive and detailed review of studies in the various areas of PBL. Although students’ approaches to learning were the focus of this study, knowing the efl‘ects of PBL on other areas helps in understanding PBL and how students may respond to it. Thus, the review of PBL research focused on several areas. Wm Researchers evaluating PBL have explored acadenric achievement by using several outcome variables, including the National Board Medical Examination (NBME) Part 1, “other knowledge tests,” and the incidence of academic failure or attrition. Vernon and Blake (1993) analyzed data on the NBME from eight research reports. They found that efi‘ect size (ES) data suggested a significant trend favoring the traditional teaching method. Also, they found that traditional programs had an advantage with respect to other knowledge tests that required factual information. However, analyses of homogeneity among the ES measures have raised questions about the generalizability of the obtained 30 mean ES. For example, Albanese and Mitchell (1993) reported that, although the University of New Mexico program has shown consistently negative ES (favoring the traditional program), Michigan State University’s earlier PBL curriculum showed consistently positive ES favoring PBL (F arquhar, Haf, & Kotabe, 1986). The University of Colorado (N olte, Eller, & Ringel, 1988) and Mercer (Bickley, Donner, Walker, & Tilt, 1990) also showed a positive effect for PBL. Such variations might be the result of difi‘erent emphases in program goals at different schools. For example, the PBL curriculum at McMaster and New Mexico is more student centered, which exposes students to narrower content. Thus, they develop inadequate knowledge scafl‘oldings, which results in inferior performance on basic science examinations as compared to students in a traditional curriculum (Albanese & Mitchell, 1993). Another possibility is that schools may have recruited difi‘erent types of students into their PBL and traditional programs. For example, the MSU PBL program, at the time the research was done, may have recruited students with stronger basic-science backgrounds or interests, as compared with their traditional counterparts because the students self-selected the PBL curriculum track, whereas the opposite pattern may have prevailed at New Mexico (Martinez-Burrola, Klepper, & Kaufman, 1985). W In their meta-analysis, Vernon and Blake (1993) found that PBL increased students' abilities in clinical reasoning, integration of clinical and basic science knowledge, and the independent study of clinical problems. Also, in contrast to results on NBME 1, these data showed a slight, but nonsignificant, trend in favor of students in PBL programs. 31 For example, PBL graduates viewed the quality of their training in humanistic areas and clinical reasoning more positively than did conventional students. Conventional students tended to rate their training in biomedical science more positively (Post & Drop, 1990). Albanese and Mitchell (1993) found that, in all seven studies they reviewed, clinical ratings by faculty supervisors were either more positive for students in the PBL curriculum or nonsignificantly difi‘erent from the ratings for the conventional group. W In their meta-analysis, Vernon and Blake (1993) found that PBL was significantly superior to the conventional approach with respect to students' program evaluation (students' and faculty’s attitudes and opinions about their programs). In addition, distress (Including depression, anxiety, hostility, and somatic complaints) was found to be lower among PBL students than their traditional counterparts (ES = +51) (Moore-West, Harrington, Mennin, Kaufman, & Skipper, 1989). For example, Moore, Block, and Mitchell (1990), using interviews of students in PBL and conventional curricula at Harvard, found that the PBL Students were more likely than conventional students to describe their preclinical years in medical school as being engaging, dificult, and usefirl (p < .05). The conventional students, on the other hand, were more likely to describe their preclinical experience as irrelevant, passive, and boring. Students seem to consistently enjoy the small-group interactions and atmosphere created by PBL. I expected that, through the experience of small-group interactions, students in MSU PBL classes would develop their small-group working skills. 32 Wetzel, Rarnois, Armstrong, and Neill (1989), F eletti and Carver (1989), and Anderson (1989) studied faculty satisfaction with the PBL program at Harvard Medical School. Their findings strongly suggested that faculty found PBL a satisfying way to teach. The personal contact promoted by the small-group format was one of the most commonly perceived benefits of PBL. Moore-West and O’Donnell (1985) reported on the stress levels of second-year medical students. The results indicated that PBL students were substantially less stressed than their conventional counterparts. Moore-West et al. (1989) also surveyed students in the two tracks about their perceptions of other aspects of the environment. The PBL students rated their experience higher in terms of meaningfulness, flexibility, emotional climate, nurturance, and student interactions. However, Moore et a1. (1990) found that PBL students at Harvard thought their preclinical experiences were more stressfirl than did students in the conventional curriculum. Blumberg and Eckenfels (1988) studied students’ levels of satisfaction with the environment in a PBL and a conventional curriculum. The most satisfying aspects identified by PBL students were problem solving, applicability, group discussions, and clinical relevancy. Conventional students identified the balance between individual excellence and group competence as being the most satisfying aspect. PBL students identified the least satisfying aspects of the experience as tendencies to encourage competition and essay examinations, whereas conventional students identified memorization of facts, lectures, and multiple-choice tests as least satisfying. The results of these studies, suggesting that both students and faculty generally perceived the PBL environment as a positive one, are important because perceptions of 33 the curriculum could be a crucial factor to medical schools in deciding to make curriculum changes. WW Very few studies have been conducted on the academic processes associated with PBL. However, some research has been done on the process of learning in PBL, including students’ approaches to learning and their use of various learning resources (e.g., the hbrary). This research is discussed in the following pages. WWW Marton and Saljo (1976a) studied Swedish university students’ approaches to studying. They found that there were qualitative difi‘erences in the processing of learning-deep-level processing versus surface- level processing. Because the following research on students’ approaches to learning focused on this fi'arnework, a detailed explanation of what Marton and Saljo meant by deep- and surface-level processing will be helpful. They defined deep-level processing as when students are directed toward the intentional content of the learning material (what is signified); that is, they are directed toward comprehending what the author is saying about, for instance, a certain scientific problem or principle. The authors defined surface- level processing as when students direct their attention toward learning the text itself (the Sign); they have a “reproductive” conception of learning, which means that they are more or less forced to keep to a rote-learning strategy. Following this framework, Coles (1985) and Newble and Clarke (1986) compared the study approaches of PBL and conventional medical students, using versions of the Approaches to Studying Inventory developed by Entwistle (1981). Both studies indicated 34 that students in PBL programs placed more emphasis on “meaning” (understanding) than on “reproducing” (rote learning and memorization), and that the opposite pattern prevailed among students in traditional programs. The researchers found that PBL students were more likely to use versatile approaches (1; < .01) and meaning-related approaches (2 < .001), and less likely to use reproduction (p < .001). They defined the surface approach as being motivated by a concern to complete the course or by a fear of failure, and intention to reproduce factual material, which promotes rote learning. Students using the deep approach, motivated by an interest in the subject matter, tend to reach an understanding. Those using the strategic approach, motivated by the need to achieve high marks and to compete with others, tend to be successful by whatever means are necessary. Coles (1985) argued that PBL may be creating an educational climate that enables students to learn in what seems to be a desirable manner. In contrast, a conventional curriculum appears to constrain students to adopt poorer approaches to studying, not only in comparison with PBL students but also as compared with their own approaches on entry. Also, in their study of Harvard medical students, Moore et al. (1990) found that PBL students were less likely to engage in memorization and more likely to rely on conceptualization as a learning method as compared to conventional students. Similarly, Mitchell (1992) found that PBL medical students were much less oriented toward memorization, were much more oriented toward studying by reflection on material, and showed a trend toward conceptualization in their studies. 35 Van Langenberghe (1988) carried out research on a physical therapy PBL curriculum. Using the Short Inventory of Approaches to Studying developed by Entwistle (1981), he found that physical-therapy students in PBL in The Hague had more desirable studying approaches than did normative students. More specifically, he found that PBL students showed more drive to achieve, relied less on memorizing, and put more efl‘ort into understanding the subject matter. Thus, based on the PBL studies reviewed above, one might expect that students in PBL curricula develop skill in integrating the materials and focus more on understanding than on rote memorization. W Nolte et al. (1988), Rankin (1992), and Saunders, Northup, and Mennin (1985) studied the efi‘ect of introducing a PBL course on neurobiology into the medical curriculum. They found that library use increased 20-fold and that student attendance at formal instructional sessions increased fi'om 65% to 90%. The researchers found that the PBL group and the traditional group differed in their use of learning resources in ways that were plausible and that favored PBL. Specifically, PBL students (a) placed more emphasis on journals and on-line searches as resources; (b) made greater use of the library; (c) made greater use of self-selected, as opposed to faculty-selected, reading materials; and (d) more fi'equently felt competent in information-seeking skills. These findings led me to believe that students in PBL classes would evidence increased use of learning resources such as the library and self-selected reading materials. Blumberg and Michael (1992) studied PBL as related to self-directed learning. They did not find difi‘erences between groups in terms of study time, but they did find that the PBL group and the traditional group relied on difi‘erent resources for studying. 36 Compared with their conventional peers, the PBL students reported greater use of textbooks, journals and other books, and informal discussions with faculty or peers. They reported significantly less use of cooperative lecture notes (p < .001). In general, the findings from these reports suggest that there is a greater degree of independent study in PBL programs than in traditional programs, as well as greater emphasis on depth of understanding rather than on rote learning and memorization. Most of the studies done in this area had static-group research designs (traditional students’ ratings of their courses were compared with the ratings of nonequivalent PBL students) or relied on questionnaires. Sm of PBL Rmch Most of the PBL research in this area favored PBL over traditional programs. However, there are drawbacks in how the outcomes were measured. For instance, most researchers have used the standardized achievement tests of the NBME, but standardized examinations measure only the exarninees’ ability to recognize the correct answer fi'om a limited list of potentially correct answers and are heavily oriented toward recall. PBL proponents have argued that such measures do not assess study approaches aimed at the deep learning that PBL promotes (Albanese & Mitchell, 1993). Further, not all of the views of PBL are favorable. For instance, in her review of PBL research, Berkson (1993) expressed a pessimistic view of PBL. Although many researchers have suggested that PBL promotes deep approaches to study, which enhance understanding, Berkson argued that most students are flexible in their choice of learning strategy, and PBL can provoke highly strategic rote, or reproductive, learning behavior. 37 She argued that tasks that require comprehension for a successfirl conclusion, whether they occur in PBL or traditional curricula, will encourage the use of a comprehension- directed, or deep, cognitive learning approach. Concerning motivation, Berkson argued that interest (motivation) is important to learning behaviors because it focuses students’ attention, Stimulates deep processing, sustains persistent study, and increases tolerance of fiustration. However, PBL is not unique in its capacity to stimulate curiosity in students or to create satisfying learning environments. Berkson argued that students who feel insecure in guiding their personal learning experiences may lose interest in the subject matter as a result of fiustration or peer performance pressure. Summary of the Dream; Review My purpose in this study was to examine the learning strategies of second-year medical students who were under the PBL curriculum to determine how they adapted to the PBL curriculum from a largelecture—based curriculum. To understand and fulfill this goal, the review of literature and research was based on three purposes—-understand learning strategies, which was the focus of the study; understand difi‘erent instructional contexts-lecture versus PBL; and review previous PBL research on study approaches-in order to derive the rationale, research questions, and working hypotheses. In this study, learning strategies were defined as tactics that increase the likelihood of efi‘ective and eficient learning, such as helping the learner encode the information, memorize, and learn easily. More specifically, following the definition of Weinstein and Mayer (1986), learning strategies can be considered as thoughts and behaviors that a learner engages in during learning and that are intended to influence information 38 processing. Learning strategies include basic memory processes as well as general problem solving, and they encompass almost all cognitive processes. The review of the instructional contexts revealed that medicd Students in MSU CHM experience varied curricula, mainly large lectures delivered by professors during their first year, and small-group discussion of cases or problems in PBL classes during their second year. Further, the review of the nature of PBL in general and in MSU CHM specifically indicated that MSU CHM has a unique Structure for its PBL classes. For example, it was found that MSU CHM focuses mainly on multiple-choice exams as assessment and is more structured in the sense that professors, not students, generate testing agendas and formulate objectives, although they also allow active student participation in small-group discussion. The review of the PBL research in academic achievement area indicated that there is a significant trend favoring the traditional curriculum. However, researchers have found that PBL students evaluated their curriculum more favorably than did conventional students and that PBL increased students’ abilities in clinical reasoning and integration of clinical and basic science knowledge. Further, PBL research indicated that PBL students tended to study difi‘erently fiom conventional students. They are less likely to study for short-term recall and more likely to study for understanding, or to analyze what they need to know for a given task and study accordingly. PBL students also control substantially more of their learning efi‘orts than do conventional students. In addition, PBL students are substantially more likely to use the library and library resources to study. However, the 39 results of the PBL research have not been consistent, so further study is needed to understand how students in PBL curricula approach studying. The research questions and working hypotheses for this study were derived by reviewing previous studies on PBL and difi‘erent instructional contexts at medical schools. Although hypotheses should not constrain what is understood fiom the data collected in a qualitative study, having working hypotheses derived fiom previous studies not only guided the analysis of data fi'om a vast number of interview protocols but also helped in comparing the findings with those fiom previous studies. The research questions of this study and working hypotheses derived from the review of the literature are stated in the following section. March Questions and Working Hypotheses 1) What learning strategies do students use in preparation for the problem-based learning classroom, and why? a) Students will study difi‘erently for PBL classes than for examinations. b) Students will focus more on understanding than on rote memorization in preparing for PBL classes. c) Students will use many learning resources, such as library facilities, for PBL classes. 2) What learning strategies do students use in preparation for examinations (both class exams and the licensing exam), and why? a) Students will use strategies for integrating the materials for exam preparation as a result of their PBL experience. b) Students will use many memorization strategies in preparing for exams. 40 c) Second-year students will use many strategies for selecting main information because of the large study load. 3) What do students think influences their learning strategies (such as goals, assessment of learning, student activity, teaching method, and course content)? a) Students will think that the PBL curriculum afl‘ects their use of learning strategies. b) Students will develop their communication strategies influenced by the PBL experience. 4) Do second-year medical students at MSU CHM report that they study difi‘erently than they did in their first year? Ifso, how and why? a) Second-year students will develop skills in integrating the materials and focus more on understanding the materials as a result of their PBL experience as compared to their first year. b) Second-year students will have improved their strategies for selecting main information because of the large study load as compared to their first year. c) Students will develop research skills and do more independent study as a result of the PBL experience as compared to their first year. d) Students will use more learning resources, such as library facilities, self-selected reading materials, or textbooks than they did in the traditional curriculum. CHAPTERIII METHODOLOGY Introduction This chapter contains a discussion of the methodology used in conducting the study. The population and sample for the study are described first. Next, the instruments used to gather data for the study are discussed. Two data-collection methods were used, personal interviews and the Leaming and Study Strategy Inventory (LAS SI). Data- analysis procedures are explained last. Suhiw of thg Stud! 89mm The population of this study comprised all medical students who experienced PBL curricula. Because the samples were chosen fi'om medical students in the College of Human Medicine at Michigan State University, the accessible population comprised second-year medical students at MSU CHM (during the 1994-95 academic year). Each year, approximately 106 students enter the CHM at MSU. About 15% are underrepresented rrrinority students, and almost 50% are women. During their first two years, students study the basic sciences such as physiology, anatomy, biochemistry, and 41 42 pharmacology. This research focused on education during the second year of this two- year preclinical period, which consists primarily of PBL classes. Medical students were chosen for this research because studying their learning strategies in lecture-based year one and their learning strategies in PBL based year two was consistent with the purpose of this study. That purpose was to examine how second- year medical students adapt their learning strategies to changes in the instructional context. mm mm; Of the second-year medical students, eight students who participated in the pilot study during the 1993 -94 academic year and four other second- year medical students participated in interviews about learning strategies for this research. Because two of the original eight students were not taking PBL classes at all during 1994- 95, the additional four medical students were interviewed to match the responses of the original students who participated in the pilot study. The eight students who had been interviewed the preceding year were matched based on their entrance exam scores (MCAT) to account for preexisting difi‘erences among students in two different groups- students in Supplemental Instruction (81) and students who were not in SI. Supplemental Instruction is an academic support intervention designed not only to help students master course content but also to develop their learning strategies (Martin, Black, & DeBuhr, 1983). Of these eight students, two represented high, five represented middle, and one represented low to middle academic performance levels. Six of the students were females and two were males. 43 To select four additional students for the interviews, I determined second-year medical students’ academic performance and gender so that the total group of interviewees would represent various performance levels and both genders. However, because only those students who agreed to participate in the interviews were selected for the study, the interviewees did not represent various levels of academic performance as expected. For example, most students in the low group did not agree to participate in the study; as a result, only one interviewee represented the low performance level. In sum, of the 12 interviewees (excluding two pilot interviewees) who participated in this study, seven were female and five were male. Six of them represented the middle level of academic performance, whereas five represented the high level of academic performance. Only one student represented the low academic performance level. Thus, although I attempted to match the interviewees by academic performance and gender, in order to represent the population more accurately, the efi’ort did not succeed as planned. LASSI sa_mple. Most second-year medical students were administered the Learning And Study Strategy Inventory (LAS SI), which measures students’ afi‘ective and cognitive processes. However, only those who agreed to participate in the study were included in the sample. Most of these students were the same ones who had taken the LASSI in the 1993-94 pilot study, in which the LASSI was administered to all students. By administering the LAS SI to second-year medical students, I could compare students’ first-year learning strategies at the time of the 1993 -94 pilot study with their learning strategies during 1994-95. mm mm Mgpmfl of m flew questions. I developed the questions for the interviews after consulting with several professors about the appropriateness of the questions for drawing out students’ useiof learning strategies during their PBL classes. The interview questions were intended to gather information to answer the research questions and therefore to discover the students' learning strategies under PBL curricula, how they had changed their learning strategies fi'om what they had used during their first year, and their perceptions of PBL. The final version of the interview questions is included in Appendix B. Some of the questions used in the 1993-94 pilot study concerning learning strategies of first-year medical students were used because they had been successfirl in gathering information on students’ learning strategies. For example, interview question 3-“How did you study for a PBL exam you have taken recently?”-was adapted from the previous year’s questions (except that the word “exam” was changed to “PBL exam”) because this question had elicited the desired information on how students used their learning strategies in studying for exams. Several consultations with professors, as well as pilot interviews with two medical students, were conducted to refine the interview questions. The two medical students were selected through the recommendation of a medical professor, and they agreed to participate in the pilot interviews. As a result of the pilot interviews, I made minor changes in the interview questions and changed the order of some questions to draw more appropriate information from the students and to avoid repetition. For example, fiom the 45 pilot study, I discovered that students did not necessarily study difl‘erently for PBL classes and for exams, as expected. Thus, before asking their approaches to preparing for PBL classes and for exams, I asked “Do you prepare difi‘erently for PBL classes and PBL exams?” Further, I determined the approximate time needed for the final interview from the pilot interviews. I used open-ended questions in the interviews to elicit detailed and clear explanations of students’ use of learning strategies. For example, I asked such questions as “Would you describe what you do during the PBL classes?” in order to learn what students did during the PBL classes. Also, after listening to the interviewees' answers, I asked follow-up questions to ensure that the topics interviewees discussed pertained to the focus of the study. W In February and March 1995, I interviewed the same eight students who had been interviewed the preceding year. Interviewing the same students was important because their learning strategies for the first and second years could be compared, and changes in their learning strategies shown more clearly. I explained to each participating student the purpose of the study, the types of data to be collected, the estimated time their participation might require, and any potential risks and benefits of participating in the interviews. Only those students who signed a consent form (Appendix A) were interviewed. Interviews were scheduled at times and places convenient to the students, such as before or after the class time and in the place where their class met. The interviews were conducted during spring semester 1995. At this time, as a result of their first-semester 46 experience with PBL, the students knew the learning strategies that they used under PBL. Before the interviews, I informed the students that there were no right or wrong answers to the questions, but that I was interested in their approaches to learning under the PBL curriculum. I tape recorded with the permission of the interviewees, and I also took notes. The first interviews took approximately an hour each. After the first interviews, I analyzed the interview content and tried to find some patterns with regard to students’ learning strategies. To obtain more knowledge regarding interviewees’ learning strategies, to answer the research questions, and to clarify responses fi'om the first interviews, I conducted a second interview with each participant. The interview questions for each interviewee were not identical at the second interview. The second interviews took approximately 20 to 30 rrrinutes each. Two students had not taken PBL classes at all that semester”, hence, they were not interviewed a second time. Also, two interviewees could not take the time for another interview, so email was used to clarify certain points. An S Invento AS film is the LASSI? Weinstein, Palmer, and Schulte (1987) developed a standardized self-report measure, the Learning And Study Strategies Inventory (LAS SI), to measure college students’ afl‘ective and cognitive processes. Nine years in the making, the LAS SI appears to be soundly constructed. Weinstein et al. conducted two pilot tests and a number of field tests on the LASSI. According to the LASSI User's Manual (Weinstein et al., 1987), the inventory is designed to measure college students' use of learning and study strategies (p. 2). The authors ensured that the LAS SI could be used (a) for diagnosis and remediation of 47 studying weaknesses, (b) as a pre- or posttest to measure student achievement and to evaluate the success of study-strategies courses, and (c) as a counseling instrument in college orientation courses. The LAS SI measures "both overt and covert thoughts and behaviors related to successful learning . . . that can be altered through educational interventions" (p. 2). The LASSI takes 15 to 20 minutes to complete and 10 rrrinutes to score. It is a self-report instrument; students respond to items on a 5-point Likert-type scale ranging from "not at all typical of me” to "very much typical of me.” Approximately half of the items are numbered fiom 1 to 5 whereas the other half are numbered from 5 to 1. This is because some items are stated in a positive direction, such as “I use special study helps, such as italics and headings, that are in my textbook,” whereas the others are stated in a negative direction, such as “I have dificulty identifying the important points in my reading.” Overall, higher scores on each scale meant that students have better learning strategies on that specific scale. The LASSI has 77 items in 10 scales measuring different clusters of learning strategies and study attitudes. The 10 scales of the LAS SI include Anxiety, Attitude, Concentration, Information Processing, Motivation, Scheduling, Selecting Main Ideas, Self-Testing, Study Aids, and Test Strategies. The evidence for reliability is strong. Coeficient alpha and test-retest correlations (3-week intervals), calculated for each of the 10 scales, range fi'om .68 to .86 and .72 to .85, respectively. The validity of the LAS SI has been examined using several difi’erent approaches. The scale scores have been compared, where possible, to other tests or subscales measuring similar factors. For example, Weinstein, Zirnmerrnann, and Palmer ( 1988) 48 correlated scores on the Information Processing scale of the LASSI with scores on the Elaborate Processing scale of Schmeck, Ribich, and Rarnanaiah's (1977) Inventory of Learning Processes (I = .60). Several of the scales have been validated against performance measures. For example, scores on the Selecting Main Ideas scale have been compared to students' scores on selecting main ideas fiom texts and other readings (I = .40 and above) (Weinstein et al., 1988). A brief description of each LASSI scale and sample items are included in Appendix C. The LASSI was used as an assessment instrument in this study on learning strategies because (a) by using this instrument, comparisons could be made with the same students’ LASSI scores from the previous year, and (b) some scales, especially the Information Processing, Selecting Main Ideas, Study Aids, Self-Testing, and Test Strategy scales, were assumed to be related to the PBL curriculum, as shown in the literature on learning processes under the PBL situation. W. The main reason for selecting the LASSI for use in this study was that subjects’ scores could be compared with their scores fi'om the previous year. The previous year, the CHM had used the LAS SI for administrative purposes for the entry medical students, so it was convenient for the researcher to use this inventory. By having LASSI scores for the same students in two different contexts, I could examine whether and how students’ use of learning strategies had changed in relation to the PBL experience. Because the LASSI originally was developed for undergraduate students, to ensure that the LAS S1 was appropriate for use with graduate professional students in PBL 49 curricula, I inspected each question on each scale in the LASSI with two medical professors who are experts in the PBL curriculum. From the analysis of each question, it was found that the afi‘ective-domain questions, including the Attitude, Motivation, Time Management, Anxiety, and Concentration scales, for the most part included general questions that were not necessarily related to learning strategies that are encouraged in a PBL class. However, the items on the Information Processing scale reflected learning strategies encouraged in a PBL class. I and two medical professors who were experts on PBL curriculum rated the individual items of the LAS SI as being PBL sensitive or not. The professors and I examined each LAS SI item and divided the 77 items into two scales-termed the PBL- sensitive scale and the PBL-nonsensitive scale. Only those items that all three of us agreed were PBL related were included in the PBL-sensitive scale. Because the analysis of the LASSI using the individual items could not be done with all three LASSIs because of missing data on the second LASSI, I created another set of subscores fi'om the original LASSI scales, so that one subscore represented PBL-related scales and the other did not. The authors of the LAS SI suggested that five scales (Motivation, Anxiety, Attitude, Concentration, and Time Management) represented the afl‘ective domain, whereas the other five scales (Information Processing, Self-Testing, Studying Aids, Test Strategy, and Selecting Main Ideas) represented the cognitive domain. By carefirlly discussing the individual items in consultation with the medical professors who were experts on PBL, I noticed that the cognitive domain of the LAS 81 had items related to PBL participation, whereas the afi‘ective domain of the LAS SI did not. 50 Thus, I conducted a MANOVA repeated measures analysis using two subscales (named the PBL-related scale and the PBL-unrelated scale) derived from the original LAS SI scales. The PBL-related scale included the Information Processing, Self-Testing, Study Aids, Test Strategy, and Selecting Main Ideas scales from the original LASSI scales. The PBL-unrelated scale included the Motivation, Anxiety, Attitude, Concentration, and Time Management scales. Overall, most of the scales in the LASSI exemplify the general nature of learning strategies and were desigrned to reflect large—lecture instruction. However, because the second-year medical students also took large lectures in addition to PBL, the LAS 81 could show whether students changed on any of the scales from the first to the second year. Further, the Information Processing scale nnight reveal students’ change in learning strategies in relation to their experience with PBL. However, it is possible that students’ scores on the LAS SI would not reveal sigrnificant changes fiom the first to the second year, even on the Information Processing and Self-Testing scales, which the PBL literature supports, because it was found from the pilot study that the first-year medical students already had very high scores on these two scales (Lee et al., 1994). mm. The LASSI was administered to most of the second—year medical students in early February 1995. Because it was hard to have every second-year medical student at one place at one time, the LAS S1 was adrrninistered after a class that most of the students were required to take. The LASSI was administered for research purposes only. At my request, a medical professor administered the instrument. I notified students of when the LAS SI would be administered, the time needed to 51 complete the instrument, and the purposes of the research. I also assured them that their responses and identities would be kept confidential. Only those students who agreed to participate in the study and signed the consent form giving permission to use their scores for research purposes took the LASSI. Because only 45 out of 109 students took the LASSI when it was first adnninistered, the medical professor contacted students who were not in class that day through e-mail. Ten more students took the LASSI the following week; thus, a total of 55 students completed the LASSI for this study in February 1995. Eta—AME Wt; Most learning-strategy studies have included variables that were theoretical constructions imposed on the phenomenon (Svensson, 1977). Ifone’s understanding is to be close to the phenomenon, then the terms used to describe and understand the phenomenon should emerge fiom arnalyzing instances observed in people in difl‘erent situations or contexts. It is essential to recognize that a student's perception of a situation is as important as the situation itself. Thus, in this study, I analyzed the transcribed interview responses to gain an understanding of the phenomenon (in this case, learning strategies under PBL), rather than using preexisting learning-strategy domains, such as the ' ones that emerged fi'om the 1993 -94 pilot study. Qualitative research is, by its nature, flexible so that the researcher’s original fiarneworks or assumptions do not constrain what can be understood from the data collected. Rather, the intention is to discover patterns during the data analysis. As Tesch (1989) pointed out, "analysis is not the last phase in the research process, rather it is 52 concurrent with data collection” (p. 95). Thus, the analysis of the interview responses was continually modified to fit the verbal data rather than fitting the verbal data to the theoretical Work or the categories that emerged fi‘om the 1993-94 interviews. The overall approach to analyzing the interview responses was drawn largely from the work of Bogdan and Biklen (1992) and Tesch (1989). First, after collecting the interview data, I transcribed all of the interview responses. Then I read the transcriptions, trying to be flexible in finding a new fiamework of learrning strategies rather than being constrained by a preexisting conceptual fiamework. I then read the irnterview transcripts several times to discover possible learning- strategy categories. For example, I looked for similar attributes from each protocol, such as “look at the starred objectives to find what is important information,” and gave names to those attributes, such as “selecting main information strategies.” I coded every learning strategy the students mentioned in the irnterviews and formulated tentative categories of strategies. I then applied these initial categories to the individual interview responses, and modified classifications that did not seem to fit during the process of matching the merging categories with the data set. While doing tlnis, I reviewed any verbal report that was confusing so that it could be placed in any number of categories to which it was related. For example, solving practice quizzes at the end of the coursepack could belong to either checking knowledge or selecting main information for tests, according to how the student used the technique. A coursepack contains articles from the medical literature and material prepared by the 53 faculty. Students purchase a coursepack for each PBL domairn, and it includes some of the conternt that they are expected to learn. I repeated this coding process several times to clarify the definition of each category and to ensure the comprehensiveness of each learning-strategy category. While doing this, I consulted with professors including my advisor several times regardirng the names of the learning-strategy categories and individual learrning strategies that belonged in these categories to increase the validity of the categories. Next, I described each interviewee’s response regarding each learning-strategy category that emerged, based on each interview question, in the form of a case study. I recorded evidence I found in the transcripts for each case description. Then, I reviewed each individual case to check the tentative findings in order to find the pattern of learrning strategies that ran through each case. For example, I tried to clarify common patterns by making charts and counting the numbers of interviewees who mentioned a certain learning strategy. In doing so, I also recorded typical examples from the protocols for each learrning strategy. However, because most of the findings were based on the interviewees’ own reports, there is a possibility that some students did not report using a certain learrning strategy even though they did use it. Because not all of the vast amount of data found through this process could be used for this study, I tried to make key points in each interviewee’s case that essentially answered the research questions of this study. While doing this, I enumerated students’ reported learrning Strategies whenever possible. Thus, the irnterview responses were 54 analyzed “according to the organizing system that is predominantly derived from the data themselves” (T esch, 1989, p. 96). .TLQL_AS_S_LD_§Q Scores were available from three administrations of the LASSI, two fi'om 1993-94 (Year 1, time 1 and time 2) and one for the present study (Year 2, time 3). To compare year one to year two using the entrance LAS SI scores (time 1) as a baseline, 1 used the data fi'om all three LASSIs. I used multivariate analysis of variance (MAN OVA) with repeated measures because there were 10 dependent variables (10 scales from the LAS SI inventory), and I was interested in seeing the changes at tlnree times. Because there were no between-subjects variables for the research, I used only within-subject MAN OVA repeated measures; the within-subject factor was “time.” Further, using MAN OVA instead of 10 single t tests reduced the alpha (the type I error rate). In addition to the MANOVA using three time points, I also analyzed the data from time 1 and time 2, and fiom time 2 and time 3, in order to determine where the difl'erences, if any, existed. This also allowed me to use more data in each analysis because only data completed for two time points is needed. Further, to reflect the efi‘ect of PBL on students’ learrning strategies more clearly, I analyzed the LAS SI data using scales I derived (called PBL-sensitive versus PBL-nonsensitive scales), in addition to analyzing the original scales of the LASSI. The schedule and the numbers of subjects who were irnterviewed and who completed the LASSI for this Study are shown in Table 3.1. 55 Table 3.1: Schedule and number of subjects for interviews and LASSI administrations Time 1 (Entry) Time 2 (Lecture) Time 3 (PBL) Interview August 1993 January 1994 February 1995 (1.1=8) (a=8) (a=12)' LASSI August 1993 January 1994 February 1995 (n=109) (n=91) (n=55) a: n = 14, including pilot interviewees CHAPTER IV RESULTS Introduction There are two sections in this chapter. First, I analyzed each irnterviewee’s responses and described those responses in the form of a case study corresponding to each interview question. Two examples of case studies are featured in the first section of this chapter. The case studies for other interviewees are included in Appendix F. In the second section, I describe the common patterns that emerged fi'om the students’ responses to each interview question. In presenting the findings for the research questions, I evaluated the working hypotheses whernever evidence was available. I drew the findings regarding Research Questions 1, 2, and 3 primarily from the interview data. I drew the findings for Research Question 4 from the interview and LASSI data. Exam I f Two ase Studi In this section I feature two case studies, Jim and Laura, corresponding to each research question. At the end of each case study, I present a summary of key features. I look closely at and comment on these two cases because Jim and Laura are representative of the 14 interviewees (including the pilot_interviewees) in terms of gender and race (Jinn- rrnale and white, Laura-female and black). Further, because these two students 56 I‘—e I1! 57 participated irn the previous years’ study, I could find rich data fi'om their cases regarding their strategies the first and second years in medical school. Further, Jim took Supplemerntal Instruction the previous year, whereas Laura did not. Although I chose these two cases as examples from the 14 case studies, readers can refer to the other irnterviewees learning strategies in Appendix F. Li! W: What learning strategies do students use in preparation for the problem-based learning classroom, and why? It is important to mention tlnat, to Jim, studying for PBL classes was not difl‘erent fiorn studying for exams. The only difi‘erence Jim merntioned was that he studied irrtegratively for the materials in a PBL group, whereas he tried to pick out the information for exarrns, as shown in his statement: PBL helpsmeto irntegateconcepts. For example, we did prrlrnonary, we did cardiovasarlarbeforeChristmasbreak Andthenwejustdidrenal.Andageat munberofthediseaseswillafiectmorethanonesystem. Sothatcertainlyhelps.Alot ofcardiovasarlarpathologycanafi‘ecttherenalsysterrtforexample, ortlnererral systern'sirnvolved. Soleamingitirnsystemshelpstointegatethebodyasawhole. However,theexarnsarenmltiplechoice,and1alwaysrernernberthat. Whernyouget downtotheweekbefore,I'mpicldngoutfactsandl‘mpicldngouttheinforrnationthat willbeontlneexam Yes,l‘mlearningtheinformation,butl‘malsofocusedondoing my best on that exam. So there's sort of a twofold purpose to preparing. You could haveaverygoodunderstandingofthecontentandlmowalotofit,andstillnothave the factsto succeed on amulfiple choice test. You know, it's narrowing downthe edgesandreallypicldngoutthekeyconceptsthatcouldbetested. M85123 As described in the PBL curriculum section, Jim mentioned that his PBL group attempted to find cues fi'om the cases that were provided. He said that his goup tried to look at “abnormal things” fi'om the case or use their past knowledge in 58 order to find cues or to form hypotheses. His PBL goup also questioned what they did not understand irn order to probe for more information, list hypotheses fi'om that informatiorn, and finally raise learning issues. Thus, the learning strategies that Jim used during the PBL class involved drawing information fi'om his past knowledge and trying to find abnormal features fiom the provided cases. The main learning strategy that fun used in order to combine PBL class preparation and exam preparation was matching objectives with learning issues. Learrning issues are the agenda for learning irn PBL classes that the students define for themselves, the homework that students create in their PBL classes. They are the areas that are emphasized during independent study, in order to better understand the case provided during PBL class. Jim mentioned that when his goup raised learning issues, they asked, “Does it fit the objectives?” If it did not, they did not spend time on it. He also mentioned that objectives helped to direct learning issues. For example, if a learning issue was very broad, he tried to narrow it down, based on the objectives. Wehadrecerrtlytriedinmygouptotrytopolicetheobjectives. Likeforinstance, they can throw in a piece of information about a case arnd we say, “OK, we're going to writealearrningissueabouttlnis. Doesitfittheobjectives?” Ifit doesn‘t, wewon't writealearnirngobjectiveaboutit, wewon‘tspendanytimeonit. W: Jim’s main motivation in looking for learrning issues was to participate in class. To study learning issues to prepare for the next PBL class, he usually found books at home and did not go to the library. Jim also used computer progams to find learrning issues. He said that faculty in the department wrote computer progams, and 59 those progams provided “very good insight irnto what's critical to know.” Tun mentioned that PBL classes helped to achieve objectives that were mainly on the exams because the goup process ensured that learrning issues directly responded to the objectives. Also, his PBL small goup discussed, questioned, debated, and pointed out the points they thought were important during the PBL class. 35351: Questigrn 2: What learning strategies do students use in preparation for examinations (both class exams and the licensing exam), and why? Mg: The basic study mode that Jim mentioned was reading materials more than twice. The first time, he read everything critically, looking at pictures, diagarns, and references. He also highlighted about three-fourths of the materials because doing this made him keep track of his reading. When he read the materials a second time, he looked at what he had highlighted and tried to correlate the coursepack and lectures. Then, he highlighted with difl‘erent colors, narrowing down the facts to what he needed to learn. To explain his reading strategy, Jim mentioned, I’ll read the first time through completely. I don’t mind taking that time. Then I’ve got a big picture in my mind. Then when I come back I’ve got a constant reference in my mind. I can come back to the content list and say, “OK, what are the details that I rrnissed?” Or “What is important that I didn’t get out of the reading that I need to search for?” Jim also took notes fi'om everything he read. According to him, taking notes and writing them down in the margins made him build up speed in the next reading and helped him gain mastery of the material. may: Jim studied with two other students. He said he used goup study more the second year than the first year. His goup study was like a small PBL class except before For a pitta: opera: in us prom b helped some} the he; mnfimc Study f Show 50031:} 60 except that they did not raise learning issues. Members of his goup studied on their own before getting together, when they met, they read the objectives and talked through them. For example, when they studied for drug x, they talked about how it acted and where it acted. Then they quizzed each other, correcting their misunderstandings. Jim mentioned that goup study pushed him to go tlnrough the material one more time when he was bored with his own reading. W: Jim said that integation was a broader overview, an overall picture of what’s happening. For example, he said if one explains how the system operates and happens, it is integation. For studying concepts he needed to understand, Jim usually drew flow charts or diagams of what happened. Also, he used computer progams that contained information he needed to integate difl’erent topics, and this helped him see the whole picture. W: Jim thought rote memorization was knowing symptoms of something without krnowing in what system it was occurring. For example, if one knows the heart has two sounds and gets valve closure and memorizes these facts using mnemonics without krnowing how the heart actually operates, it is rote memorization. To study facts, Jim mainly read materials, talked about facts, and made charts and tables showing similarities and difi‘erences. He mentioned that he did less memorization the second year than the first year. Sslecting may} infgrmatign: Jim looked for overlapping information in the objective lists, coursepack and textbook in order to find the main information he needed to know. For example, electronic and mechanical coupling of heart contractions runs seat {0111 L about I .j'gc r .8- Y deJiQLL 61 through all inforrrnation sources because it is the gound level, and he knew this was important information to know. Also, he gained insight into what was important to krnow througln lectures. On the objective lists, Jim knew which objectives were the most important by the number of stars in each objective. For some domains, faculty prioritized the importance of the objectives by providing stars. Ifno stars were given to the objectives provided in a certain domairn, Jim looked for quiz questions in a coursepack because they were formulated by those who wrote the exam questions. This also indicated that Jim cared about information that might be covered on the exam. W: Jim mentioned that when faculty developed computer progams, these progams provided good irnsight irnto what it was critical to krnow. Thus, he used computer progams as a way of selecting the main information to learn. Also, computer progams are interactive because they give immediate feedback on quiz questions, as illustrated by his comment: They [computer progams] provide another source of information from the textbook. That doesrn't make them difi‘erent fiom the textbook but it's another source. They‘re a littlemoreinteractive inthattheyofienhavequizquestions. Becausewhatwill happenisyou'll gotlu'oughaparticulartopicandthey'llbreakitdowninoutlinefonn. Andthenthey‘llgiveyouthedetailsandthey’ll showyou afewpictures. Andthern they'llaskyou, “Whatisthis?” Arndtherntheygiveyouthecorrectanswerand feedback Not all ofthern dotlnat, but some do. But gernerally, they‘re very similarto thetextbookbecausetheyhavethe sarnematerial inthern Jim mentioned that pictures in the computer progarn are better than those in the textbook because they are not restricted by the headings, as those in a textbook are. Also, computer progams integate tlnings from difi‘erent disciplines, such as physiology, pathology, and biochemistry. be tc gent the ll Hm I 111811 checi plan lisrs : inhis 62 thgking kngwledgs stratsgjes: When Jim read materials a second time, he asked himself questions. For example, he asked, “Okay, what is important, what did I learn, whataretherrnainideaslneedtotakeawayfi'omthis, whatwill make me happyifIgeta ‘Now, I know.”’ Also, his study goup used practice quizzes to check their krnowledge. Lecture attendang: Jim went to lectures regularly. Rather than using scribe notes, he took his own notes in the lectures. He thought that lectures were another way of getting a focus on the important information as seen by experts. Lectures provided what the lecturer thought was essential to know and also allowed Jim to ask questions. Also, Jim was paying for his education, which included lectures, so he felt a responsibility to attend them, as shown by this statement: . Whngo . . .IgobecausethosepeoplehaVespenttheirtirneto puttogetheralecture totrytogiveyouinsighttowhat'simportant, whattheythinkisesserntialtokrnow.1t's another source of information. It provides yet another means of getting the information Itpointsmetowhat‘simportantintheirperspective. It allowsmeto ask questions. And I feel like I'm paying for my educatiorn, and that includes lectures. I feel a responsibility to do it. mm: In addition to the strategies mentioned above, Jim also checked his coverage of the objectives. For example, he took major headings in pharmacology from the objectives and read the textbook. Then he looked at the objective lists again to see whether he had covered all of the detailed objectives or important things in his reading. Also, J'un used organization strategies. For example, he said that he wrote down critical points while reading. He categorized things in his mind as he read, and if something fit one of his categories, he wrote it down or highlighted it. For example, for 63 tumors in pathology, he needed to krnow the incidence, gender, and age goup in which they occur. Then he wrote those things in the margins while reading. BMW: Jinn said he planned to take the ArcVentures progarrn, which is a board review course. He also thought that PBL classes would help him study for the board. Resssgh Question 3: What do students think influences their learning strategies (such as goals, assessment of learning, student activity, teaching method, and course content)? In thought that his old study habits influenced the way he used his learrning strategies. He also said the PBL process “directed” his learrning. For example, when he had a case involving a patient with diabetes, instead of reading someone else’s notes, he learned about the disease by looking at related materials and researching the disease. Jim’s goal was “learning the material” rather than passing the exams. He mentioned that he would like to achieve good interaction vndth the goup and prepare for the exam through the PBL classes. In general, he said that he liked PBL, but he did not forget to mention that careful selection of a preceptor is important. Theonlythinglwould liketo seeis, andIknowthisisdificult, amorecareful selectionofthepreceptors. Ithirnktheycanmakeorbreakthegoup. Itcanbea destructive role if there's a difi‘erence betweern the instructor. Right now, I think we‘ve hadmuslnreofgoodpreceptorsandsomeflnatweremediocreandsomethatwa’e exwllent. Jim also mentioned that PBL helped in the following areas: 1. Smlj-gsoup working skills: Jim commented that being in a PBL goup helped him improve his small-goup skills, as illustrated by the following statement: 64 I think naturally in a goup there are pe0ple who talk and people who don’t talk and then somewhere in the middle. I think it makes us very aware and responsible for each other’s learning. I monitor how much I speak. Ifthere’s someone who’s a more quiet person who wants to speak, I’ll hold back. I think that everybody has good points; it teaches us to listen to others. It also teaches me that everyone doesrn’t look at tlnings the way I look at them. So when I say tlnings, sometimes it may help. 2. My: Jim mentioned that PBL classes allowed him to study more than just those topics in the content lists, as shown by the following statement: For instance, now I go and learn, in my goup, we learn about diseases’ pathology and physiology for the sake of learning it, for the desire to have the krnowledge. And then when we look at the content list, we find that we’ve covered a lot of those things. 3. W: Jim noted that, because cases they discussed during the PBL classes required students to integate difi‘erent diseases they learned, being in PBL classes helped him irntegate concepts and helped him use his knowledge, as he pointed out in the following comment: PBL helps me to irntegate concepts. Given the case, we have an individual who has problems, for the renal domain. But we also notice that they have a cardiovascular problem or that they have some type of infection. And that helps us to use our previous knowledge. 4. Wm: Jim said that being in PBL classes helped him prepare for exams because the cases provided during the PBL classes were related to the exams. He stated, “I know that a lot of the information is recurrent in the cases and in the exams and in my textbooks.” 65 W: Do second-year medical students at MSU CHM report that they study differently than they did in their first year? If so, how and why? Jim said that first year, he had more facts to learn and thus used more rote memorization strategies. He stated, “I think last year, we could have gotten away with a lot more rote memorization. Last year, realistically, you could have spent a few days just piling information into your head and then just regurgitating it on the exam.” The content was more conceptual and integative in second year. Last year, it [objective list] was very specific, very factual. If we were to learn anything about diabetes, it was to approach it from a rrnicro level, rather than starting at the macro level and coming down. There wasn’t the irntegation that there is. Everything was a separate science last year. This year, I start reading about the disease and cover all the sciences, all the disciplines. Thus, according to Jim, he used a more “macro-level approach” the second year, which meant starting with broad issues and getting an overview first before narrowing the focus. He mentioned that part of the reason he felt this way was that he had accumulated krnowledge. Also, the way the test questions were asked the second year involved more integative knowledge, according to him. Thus, he used more goup study the second year. He also used computer progams as a learrning resource in his second year because they were visual and presented redundant irnforrnation without being boring. Another difi‘erence between Jim’s first and second years was that he had more confidence the second year. He described the second year of medical school as a “sink or swim atmosphere.” Also, because of the independent studying necessitated by the school environment, he was more confident about his learning strategies in his second year. Table 4.1 contains a summary of the key features of Jim’s learrning strategies. Table 4.1: Key features of Jim’s leanning strategies Ql - Studying for PBL class and exams is the same - Matching learrning issues with objectives - Using books or computers to find learrning issues, no use of library Q2 - Reading twice: taking notes, writing down 1. Get a fiamework, highlighting 2. Narrow down facts, speed up - Group study: check his understanding through quizzing and talking to each other, make him keep studying when he is bored - Integation strategies: draw flow charts and diagarns, use computer proganrs - Memorization strategies: reading, talking, using mnemonics, making charts & tables, drawing similarities & differences - Selecting main information: corresponding information, lectures, stars in the objective lists, quiz questions in the coursepack, computer progams - Use computer progams: as a way of selecting main inforrnatiorn, good picture, interactive - Checking knowledge strategies: quiz in a goup study and self-questions - Lecture attendance: way of knowing what’s important information, opportunity to ask questions - Additional strategies: checking coverage of the objectives, organize materials - categorize what he reads and then write down (or highlight Q3 - Influences: Old study habits and PBL process - Goals: Learrning materials - PBL helps 1. Small-goup working skills 2. Independent study 3. Integation of the materials 4. Preparation for the exam - More goup study in second year: because of the integative contents - More use of computer programs in second year - Macro-level approach: getting overview first: because of the existed knowledge - More confidence about his learning strategies : because of the second-year curriculum 67 Lsura March Question 1: What learning strategies do students use in preparation for the problem-based learning classroom, and why? Studying for PBL classes and preparing for the exams were not two separate things to Laura She primarily prepared for exams, and while doing that, she prepared for the PBL classes. DIE—“8M3 Laura mentioned that her PBL goup read a case, picked out the main information, formulated hypotheses, raised learning issues, and solved stimulus questions. To pick out the main irnforrnatiorn, she tried to find symptoms that were significant to patients and sometimes highlighted the important facts in the provided cases. To raise learrning issues that she needed to krnow for the next session, Laura used her past knowledge and objective lists. Also, stimulus questions included in the coursepack guided what she needed to study for the next session. Laura matched learrning issues with objectives by looking at the learning issues and thinking, “Which objectives are related to learning issues.” Occasionally, some preceptors suggested learning issues to look for. Laura mentioned that her goup spent time on every learning issue early in the semester, but they thought this was a waste of time. So later, if a learning issue was not matched with objectives, her PBL goup did not spend time discussing that issue. mm: Laura studied learning issues by looking at objectives and finding those in the first year’s textbook. She never went to the library to study learrning issues. Usually she read books and articles to study learnning issues, trying to relate them to the exams. Laura mentioned that because PBL class did not cover every objective, she studie Milli al'mi she 51 the broa Colc she ; 68 studied on her own for the exams. Thus, studying for PBL class was part of studying for exams, as shown in her comment: PBL picks certain topics that are listed in the objectives that we do have to know for the exams, but they don’t cover. . .they don’t nearly cover everything we have to know. W: What learning strategies do students use in preparation for examinations (both class exams and the licensing exam), and why? Rm: Laura mentioned that she tried to read everything that was related to the exams at least once because the second year she had a vast volume of materials to study in a linnited time. Further, because the exarrns came from very detailed materials, she thought she should know every rrninute detail in the materials, as illustrated by the following statement: But you can't really say, "Well, maybe this is more important than that," because you don't krnow what's going on in the examiner's head, and so basically you try to know everything. And I know that sounds impossible, and sometimes it feels impossible, but they test details on the exam. General . . . you would think that if you have that volume of material they would focus on general concepts to see if you got the basic stufl. No. I had some of those questions, but most of them test nrinute details or minute difi‘erences between two difi‘erent concepts. And so you have to know those, and since you don't know which are going to be tested on, you try to know everything. IfLaura read the material more than once, she read the first time to understand the material. Laura mentioned understanding is “to get the mairn concepts or to get the broad picture.” She also highlighted the materials when she read them. She used difl‘erent colors for difl‘erent diseases and wrote down notes when she read. By doing this, when she read the materials the second time, she could review and connect the materials better. When Laura read the second time, she flipped through the highlighted parts and focused 69 on memorizing them. She realized that she needed a second reading when she could not explain what she had read the first time. To explain her reading strategy, Laura mentioned, Thus, the first time is for understanding. Understanding means to me getting the main concepts or to get the broad picture, to figure out what they’re trying to tell us. Second reading is for memorization. I mean, I krnow it doesn't work for me to just read it once because the first time I read I'm learrning it. The second time I’m memorizing it. And, I mean, sometimes it works out that I’ll just remember one key word. It’s like, “Okay. That’s that,” just because I happen to remember seeing it that second time, so it’s more of a memorization type thing for that second time around. 5193mm: Laura studied with one other person whom she had worked with since her first year. They read through the charts that she had made and discussed any unclear points. They also asked questions and explained things to each other. Laura mentioned that studying with a fiiend clarified concepts, supported her emotionally, and made her stay awake. W: Laura made charts to integate the materials she studied. For example, she made a flow chart on diabetes and one particular outcome. As she studied firrther, she found diabetes again with another outcome. She then integated those findings and rrnade another chart so that she could see the whole diabetes picture. Also, goup study helped Laura clarify concepts by discussing the information with her partner and listening to her partrner explain the materials she did not understand. Wigs: Laura typed summaries and charts that she made, using a computer. She said that doing this helped her memorize things because She actively thought about what she was typing. Also, reading the materials more than once provided repetition, which helped her memorize what she needed to learn. 70 Selm’ g m infgrmation: Laura said she tried to study every objective because even though professors said certain objectives were not important, they sometimes tested on them nevertheless. With regard to focusing, Laura mentioned that she tried to emphasize the objectives that had the most stars. mum: Laura usually did not use computer progams because she thought this was time consuming and she often got a headache. Only if she heard that a certain computer progam was good for a certain domain and she had time did she look it up. For example, when Laura had trouble learrning about bone disorders because they all sounded alike, the computer progam provided a good way to difl‘erentiate them through pictures. Laura said that because she was a visual learner, pictures in a computer progam sometimes helped her learn the material. Although she seldom used computer proganns, she usually used a computer for typing her summaries and charts. She said it was easier to memorize rnnicro things in this way because when she typed them, she could actively think about them. Qhfiking kngwledgg smatsgies: Through goup study, Laura and her fiiend asked questions and explained things to each other. This helped her clarify concepts and ensure her gasp of the material. WM: Laura was not attending large-goup lectures her second year. She said she had an attention-span problem and that sitting in a lecture made her mind wander. Shel liked the PBL class format better than lectures, as illustrated by the following statement: 71 I thought I was a lecture—oriented person, but about the middle of last year I started to realize that I wasn't getting as much out of lectures as I thought I was, you know. I would faithfully, you know, at the beginning of the year go every day and take notes, but then alter a while I started to realize, okay, the first few hours I'm actively involved taking notes and whatever. The next two hours my mind is somewhere else. I'm like, okay, why am I sitting here if I'm having trouble focusing, concentrating. I'm wasting my time basically when I could either be reading something on my own or sleeping or something, you krnow . . . and reading it later. And so I think this format [PBL] is a lot better because I'm not sitting in lecture and letting my mind just wander. W1 At the beginrning of the second year, Laura made her own agenda for studying. But she could not contribute to the PBL classes because she could not get to the material that would be discussed in class, based on her own schedule. Therefore, she structured what she was going to review herself, based on the cases provided in class, and she combined those cases with objectives. Also, Laura wrote important words or concepts down in the margins of the textbook or coursepack. For example, if she found pages of uniform text without pictures when she read, she wrote down subheadings of her own so that when she looked at it again, she could readily see what the page was about. Also, she used highlights, circles, or underlines as means of organization. For example, she used difi‘erent colors for main headings, subheadings, and subsequent information. To distinguish between males and females when studying general somatic-formation disorders, Laura circled the words “women” and “men” and underlined the concepts related to each gender. mm: Laura said she planned to take a review course for the board exam. At the time of the interview, she said there was no time to study for the board exam separately fi-om the class exams. But she thought that studying for the domains covered in class now would help her in studying for the board exam later. COT. A to”. 'La dt'i llCCE Law I 72 W: What do students think influences their learning strategies (such as goals, assessment of learning, student activity, teaching method, and course content)? Laura mentioned that time constraints influenced her learning strategies the most. Also, the PBL experience had changed her study approach in that she had changed her schedrrling. She made her own schedule at the beginning of the semester but now combined studying for exams and preparing for the PBL class. Laura mentioned that she had two goals: (a) having a good knowledge base for the firture and (b) passing the exams. She said she was giving more emphasis to her first goal during her second year. PBL classes helped her have a good knowledge base because they necessitated independent study and integation of the materials through cases. However, Laura was not sure of the role PBL played in achieving her goal of passing the exams, as shown in the following comment: I think what I can confidently say is it's helping me get a good krnowledge base, which is my ultimate goal. I can't really say it's helping me pass the domain exams ...becausealot oftimesltlninktheexamscome downto howmuchcanyou remember within a short period of time and how many little details can you remember, you know, for the exams. Laura mentioned that although having such different PBL goup members was stressfirl, PBL classes also helped in the following ways: 1. SM-gtoup wgrking skills: PBL helped in terms of goup interaction; it made Laura monitor her talking and try to contribute equally with other goup members. 2. mm: According to Laura, being in a PBL goup helped her study independently. Because PBL classes did not cover the majority of the material, she needed to study on her own, look up material, and search for it by herself. yea She the mat Con: also of 1h 73 3. W: During PBL classes, it was easier for Laura to connect the difi'erent disciplines because students discussed all of the related materials. mm: Do second-year medical students at MSU CHM report that they study differently than they did in their first year? If so, how and why? Laura mentioned that, during her first year, she learned most information from lectures or scribe notes. Thus, she did not have to do much reading. She read books only if she needed clarification. Laura used more charts, tables, and flashcards her first year than her second year because she had more time and less material to study. This second year, she self-checked her knowledge less because of the vast volume of study materials. She said it was important to go through everything at least once and to read more during her second year, as illustrated by her comment: It’s just too much work to try to get through. And I figure it’s best to get through everything once rather than to get through some things and not the others and really screw up on the exam because I didn’t get to the other material. Laura also thought that she was a more efi‘ective learner her second year. Part of the reason for this was that she had previous krnowledge and hence could connect the materials better. Another change is that Laura quit going to the lectures her second year because of her lack of time. She obtained scribe notes to study, however, because sometimes they contained information for the exarrns that was not in her textbook or coursepack. Laura also mentioned that the cases provided in the PBL classes helped her do more integation of the materials. 74 Also, Laura made her own schedule at the beginning of the semester but now combined studying for exams and preparing for the PBL class. She started with her first- year approach to studying and then changed her scheduling during the second year to adapt to the changed instructional context. Well, I found it to be better than what I tried to do the first domain, which was have my own schedule, say, "Okay. I‘m going to do all the micro first, and then I'm going to do all the path next and all the phys next." That just seemed to be in conflict with what I was expected to do with the goup. And I'd say, "Well, rather than fight this, let me work with this," and because I found it to be really fiustrating to come to goup and not be able to contribute or feel stupid because I hadn't gotten to that portion of the material that we were discussing. A sununary of the key features gleaned fiom the interviews with Laura is presented in Table 4.2. 75 Table 4.2: Key features of Laura’s learning strategies Q1 - Raise learning issues: use objective lists, past knowledge and stimulus questions - Match learning issues with objectives: studying for PBL learning issue is part of studying for exams - To find learning issues: use the previous year’s textbooks, no library use Q2 - Reading more than once: 1. For understanding - highlight with different colors; review better, connect better 2. For memorization - Group study: ask questions, clarify concepts, support emotionally, stay awake - Irntegation strategies: make charts, goup study (clarify concepts) - Memorization strategies: read more than once (repetition), type into computer - Selecting main irnforrnation: stars in the objective lists - Computer progams: seldom use computer progams; good picture - Checking knowledge strategies: goup study (ask questions) - Additional strategies: scheduling, organizing materials; writing down her own headings, underlining, highlighting, circling - No lecture attendance; get scribe notes Q3 - Influences: time and PBL experience - Goals: having good krnowledge base and passing exams - PBL helps 1. Small-goup working skills 2. Independent study 3. Irntegation of the materials - More reading in second year - No lecture attendance in second year; use scribe notes, however - Less use of flashcards, charts, tables the second year; lack of time - Less self-checking, more study time the second year: because of vast volume - More irntegation the second year: cases help - Feels she is a more efl‘ective learner the second year: because of previous krnowledge 76 Findin P inin t e R earch uestions The common patterrns that emerged from analyzing each case study, corresponding to each research question are discussed in the following pages. I do not present the results of the common patterns for two subjects, Susan and Cindy, who were not talcing_any PBL classes the semester the study was conducted, although I do present their brief case studies in Apperndix F. m Question 1: What learning strategies do students use in preparation for the problem-based learning classroom, and why? The 12 interviewees who took PBL the second year, including the pilot interviewees, all claimed that they studied by focusing on exams rather than on PBL classes. They said that they studied for exams, and in the process of preparing for exams, they could contribute to class discussions. During the PBL classes, most of the interviewees looked for odd symptoms or symptoms that were significant to the patient that they were studying in order to find cues about the provided case. Also, they used previous krnowledge to generate hypotheses during the PBL classes. Eleven out of the 12 interviewees mentioned that they used objectives for raising learning issues. They also tried to gear their PBL goup discussions toward the objective lists so that they could focus their study on exams. Kelly, who was a pilot irnterviewee, did not mention specifically that she used objectives for raising learning issues. She tried to connect all of the information in the case, and if she could not see the connections, she studied the missing parts after class. However, Kelly also studied for exam preparation and not for PBL classes per se. Interestingly, Ann tried to determine 77 what teachers would think were important as learrning issues. Ann also relied on percerntages of the exam content for raising learning issues. Ann mentioned, Itrytopsycheouttheteachersand sort ofsay, "Giventhiscase, which ofthe objectivesdoyouthinktheyweretryingtoget ustoleamfromthis case." Andthen wetrytomakeleamirngissues. Likethistime, 45% oftlneexamisgoirngtobe pathology. So when a case comes up, one of tlne learning issues will be the pathology ofwhateverthecaseis orthe pathology ofsimilarcases. All of these processes that students were using to raise learning issues were geared to exam preparation. However, Jane mentioned that she studied information for the learrning issues even though they were not on the objective lists. Further, Ann said that she studied learning issues that were not among the objectives if they were interesting and easy to find, but her focus was primarily on exams and not on preparing for classes. Table 4.3 shows students’ use of learning resources to find learning issues. Table 4.3: Resources students used to study learning issues (r_n = 12) Name Books Coursepacks Computer Learning Resource Library Programs Center Jim Laura Mark X x x Ann X X X X X X X X X X X X Jane x Total 12 12 7 Key: x = students' use of the strategy. 78 As shown in Table 4.3, all 12 interviewees reported that they read booksueither textbooks or board review books—to study learning issues. Also, many of them used coursepack notes and computer progams to study learning issues. However, only Jane went to the library to look for information for the learning issues, and tlnree students went to the learrning resource center to find information to study learning issues. In addition to the resources mentioned above, Roger said he read old objectives he obtained fi'om the previous second-year medical students to find pertinent information for the learning issues. Most irnterviewees said they found information for the learrning issues because studying them covered objectives that would be on the exarrns. However, Jim and Janet mentioned that they studied learning issues for participating in goup discussion and asking questions. Interestingly, Ann mentioned that she studied learning issues and made charts or summaries for relating them to the goup, in order to impress the goup and to get “brownie points.” I tried to enumerate resources that the interviewees reported that they used. However, it was dificult to rrnake a clear-cut separation between the resources they used in studying the learning issues for class and those they used to study for the exams because students said they did not necessarily separate their study for PBL classes and exams. Thus, although the irnterviewees did not report resources for the question of where they found information for the learning issues, it is likely that they found information for the learrning issues from the resources they used in studying for exams. 79 Burch Qufl'on 2: What learning strategies do students use in preparation for examinations (both class exams and the licensing exam), and why? The second year, students focused their learning strategy mainly on reading although there were individual difi‘erences in their use of learrning strategies. Also, 10 of the 12 irnterviewees who attended PBL classes said they studied with a partner or in a goup. Interviewees used various strategies for memorizing, integating, and organizing information. As in their first year of medical school, all of the interviewees used many strategies for selecting important information. Because of the vast volume of materials they had to cover in a limited time, students focused on selecting important information. Other than this, all of the students except Jane who took PBL classes used computer progams, although they relied on those progams to varying degees. All of the students said they checked the knowledge they acquired, using such strategies as solving practice quizzes or asking questions. The students went to lectures less the second year than the first year, and 5 of the 12 interviewees had quit going to lectures entirely; however, other interviewees attended lectures as a means of preparing for exams. The data collected regarding how students studied for exams were the richest of all the information elicited through the interviews. Hence, in the following pages, I present the findings for each category of learning strategy that students used during their second year of medical school. Rading: The basic studying approach of most students the second year was reading books, coursepacks, and objectives. The interviewees’ reading patterns are shown in Table 4.4. 80 Table 4.4 : How and what students read Name How and What They Read J'un - First reading. to get a fiamework reads everything In the book, critically highlighting things - Second readirng: goes faster because he reads highlighted things Laura - First reading: to understand materials, highlighting things - Second reading: flips through highlighted things for memorization Mark - First reading: to get a general idea, reads with highlighting - Second reading: reads highlighted ones, makes marginal notes Torn - Reads coursepack, highlighting important points - Reads textbook, looking for overlapping irnformation with coursepack - Reads coursepack again with added information in the margins Ann - First reading: to get an overall fiamework - Second reading: goes faster, comprehends better - Reads old objectives, coursepack, scribe notes, then does computer progams, reads board review books Mary - Reads objectives, books, and coursepack, making charts - Memorizes those charts Andrew - First reading: to understand, highlights testable questions - Second reading: skims materials by making connections of concepts Roger - Reads books sometimes, uses computer progams and goup study Nancy - Reads books and coursepack for understanding: writing, underlining - If she has time, reviews underlined things or writing in the margins Janet - First reading: slowly to understand materials and answer objectives - Second reading: reads highlighted things at a faster pace Kelly - First reading: slowly to get the general concept - Second reading: to memorize better Jane - Reads old objectives to get an idea of test information - First reading: to get a general overview - Second reading: to memorize things 81 As shown in Table 4.4, most students read the material more than once during the second year. In their first reading, most of them focused on understanding the materials, usually highlighting important information or facts. In their second reading, most students skimmed the materials or read only the highlighted parts for memorization purposes. It seems that, by reading slowly and carefully the first time, they had an overall fiamework on which to hang specific facts in their second reading. Because of the vast volume of materials, they tried to understand the materials by reading the same information several times. mm: Of the 12 irnterviewees who were taking PBL classes, 10 mentioned that they studied in a goup or with a partrner to prepare for the exams. The most fiequently mentioned reasons for doing goup study are shown in Table 4.5. Table 4.5: Reasons for doirng goup study (n = 10) Name Check Help Keep Pick Up Important Knowledge Understanding Studying Information Jim x x Laura x x x Mark x x x Tom x x Ann x x Mary x x Roger x x Nancy x x x Kelly x Jane x x Total (10) 9 6 5 2 Note: Because Janet and Andrew did not use goup study to prepare for the exams, they are excluded fi'om the table. 82 As shown in Table 4.5, 9 of the 10 students who used goup study did so to check their krnowledge. Through discussing the materials in a goup, they could ascertain the state of their krnowledge. They checked whether they had stored knowledge by asking questions or quizzing each other. Roger mentioned, “We do that [goup study] because we testeachotherand seeifweknowthefacts.” Also, discussing the materials in a goup helped students integate the materials and understand the concepts. Students said that goup study helped more with conceptual materials than with factual materials because discussing the materials with each other made students see difi’erernt points of view or points related to other materials, which sometimes clarified the material they were studying. In explaining how he used goup study for irntegation purposes, Tom said, Itlninkthattlneconceptualmaterial, annmderstandingoftheconceptualmaterial, comes withdiscussingitbystudyirnginagoupofpeople. ThefactsIlearnwhenI‘msitting therestudyingbymyself. Ialsolearnthefactswhernl’minagoupandlhearthings. BmtheconcepmalnrateialisflnemataiaereaflyseemmcomemgetherwhanI studyinagoupwithotherpeople. Becauseit’shearingsomebodyelseexplainit, arnd hearingthemlooldngatitfiomadifi‘erentangle, thathelpsbringtlningstogether. Further, goup study forced goup members to study more when they were bored or tired of reading the materials by therrnselves. Group study also provided an opportunity to exchange irnforrnatiorn, which enabled students to discover what information was important during discussion. In addition to the aforementioned reasons, a few students said that goup study provided repetition of their study, made them see different points of view, and helped them memorize the materials. Most of the interviewees said they went through the objectives or coursepack notes together by discussing, teaching or quizzing each other, and sometimes sunrrnarizing 83 important points during the goup study. Tom said he met with the goup after studying the material by himselfbecause “Ifyou can come to the goup arnd understand things a little bittlnernwegetthroughtlnennaterialfaster, andwe‘reabletogetthroughitmoretimes.” Intmtign stratsg'es: Most interviewees said they thought understanding meant to krnow how things work, to know how a certain system operates. Ifmey[goupmenbas]makeastatemanmdfl‘lcanguesswhatisconfingnextjust because of the logical progessiorn, arnd I know when this happens then this should happertyoukindoffitittogetherthatway. Youstartpredicting, iftlnishappensthern thisisgoirngtohappen, arndtlrisarndthisandthisisgoingtoresultfi-omit,thernyou start to feel like you're nmderstarnding it. (Andrew) They added that connecting various pieces of irnforrnation and seeing the overall picture helped them understand how things work. Thus, irntegation and understanding of the materials were not two separate things to most of the irnterviewees. To integate materials for better understanding, most interviewees used a “carefirl reading” strategy. They said they read materials slowly, trying to make connections with previous subjects they had studied. For example, Kelly tried to compare and connect texts with pictures, or texts with PBL cases, through reading. Also, reading the materials more than once seemed to help students comprehend. Other than reading materials carefinlly, students used the strategies shown in Table 4.6 to integate materials or to help them understand the materials. Table 4.6: Integation strategies (9 = 12) Name PBL Study in Make Charts! Use Computer Experience Group Diagrams Programs Jim x x x Laura x x x Mark x x Tom x x Ann x x Mary x x Andrew x x Beast x Nancy x Janet X x Kelly x x Jane x x Total (12) 10 6 4 4 Although being in a PBL class was not in itself a purposeful strategy for better understanding of the materials, as shown in Table 4.6, 10 of the 12 students reported that the PBL experience helped their understanding by clarifying concepts and providing contexts with the cases. Also, halfof irnterviewees mentioned that they used goup study for better understandirng. As in PBL class, goup study helped their understanding of the materials tlnrough discussing things with and explaining them to each other. Discussing the materials with each other made them see difi‘erent points of view or points related to other materials that sometimes clarified the material they were studying. Four students reported that they made charts or diagams to integate the materials. For example, Ann said that drawing charts helped her classify similarities and difi'erences and also showed patterrns that aided her understanding. Computer progams 85 also helped students understand the materials by providing visual examples associated with a certain disease, and also by irntegating different topics. In addition to using the strategies in Table 4.6, a few students reported that they wrote down a certain process or an explanation of unclear points in order to help them understand the materials. MW: Most interviewees reported that they used fewer memorization strategies in their second year as compared to their first year. Students had more materials to study the second year as compared to the first year, so they could not spend their time memorizing nninute details. Further, the interviewees reported that, because they spernt more efl‘ort on understanding the materials the second year, memorization followed naturally. Whereas studernts thought understanding meant knowing how things worked and being able to connect various information, they thought rote memorization was leamirng things that had no connection with others without krnowing the process. Nancy called rote memorization “learning random facts.” Roger gave examples of understanding and rote memorization. He said that knowing that “aspirin decreases swelling” is rote memorization Understandirng would be “If one knows the reason thattlnathappernsisbecauseyoublock sometlning calledthecerrtral oxygerric pathway chemically, arnd that produces prostaglarndirns, which irncrease swelling So if you don't have proxyglarndins, you don't have swelling.” To memorize the materials, most students used repetition strategies such as reading the same materials several times, reading difi‘erent materials for the same information, or talking with fiiends severa‘l times. Other than repetition of information, students reported using the strategies shown in Table 4.7 to memorize materials. 86 Table 4.7: Memorization strategies (n = 12) Name Writing Mnemonics Charts/ Imagery Down Organization Jim x Laura Mark Ann Andrew Janet Jane Total 12 Halfof the interviewees reported that writing down facts, important points, and similar things to difl‘erentiate them helped their memorization. They mentioned that writing is a more active process than just reading the materials and thus helps in remembering. Sometimes students recorded information in several places, such as writing it on flashcards or on charts, typing it into a computer, and taking notes of the information they needed to remember; this repetition aided memorization. Four students mentioned that they made up mnemonics or acronyms using stupid and silly stories or songs to aid in memorization. They also reported that drawing charts not only helped understanding, but also aided memorization. Organizing materials into charts enabled students to see clearly the similarities and diEerences of particular topics and thus helped memorization. Andrew and Kelly mentioned that they used imagery for memorization. They reported 87 that using imagery gave context to things, which aided their memorization, as illustrated by the following statement: I guess you'd call me a visual learner. IfI could kind of . . . put in your rrnind what somebody presents with . . . and you can kind of attach things onto that, and that seems to solidify it in my mind a little better... I think it would really help me remember things a lot better just to actually put it with . . . putting a certain problem with a certain face, and that way . . . and the certain ramifications of that person's problem, it would really stick with me, I tlnink, more. (Andrew) Other than the above-mentioned strategies, students highlighted important facts, talked in goups, and used computer progams with visual pictures. These strategies helped them understand and remember the materials. W99: All of the interviewees mentioned that selecting important information was very important for them because they had to cover a vast volume of materials the second year. They used various strategies to select important information. By “main or important information” they meant material that would be on the exam. Students reported that they relied on objective lists in preparing for exams and PBL classes because the contents of objective lists were what would be on the exams. Other than using objective lists as their study guide, students used the strategies shown in Table 4.8 to sort out important information. The most frequently used strategy for selecting important information was using the relative percentages of contents on the exams provided in their coursepacks by professors. Students focused their study on material constituting a large percentage of the exams. Some irnterviewees said they used percentages of contents of the exams as their scheduling guide. For example, they studied the largest percentage content first; then, if they had time, they studied subjects making up a lower percentage of the exam. 88 Table 4.8: Strategies for selecting main information (Q = 12) Name % of Stars in Practice Computer Lectures Old Exam Objectives Quizzes Programs Objectives ' Jim x x x x Laura x Mark x x x Tom x x x x Ann x x x Mary x x x x Andrew x x x x x Roger x x x x Nancy Janet x x x Kelly x x Jane x x x Total (12) 8 6 6 6 6 4 a. Old objectives are objectives fi'om the previous second year, which current medical students obtained fiom former second-year students. In some domains, topics in the objective lists were starred. Topics that were given more stars were more important than those with fewer stars. Thus, students reported that they looked at the number of stars in the objective lists and focused their study on topics with more stars. Students also used practice quizzes as a way of seeing which materials the exam providers thought important, as well as a way of checking their knowledge. Six students said they used computer progams as a way of sorting out important information. When department faculty wrote computer progams, students could see what formation faculty thought was important by using these progams. Further, computer progams contained more condensed and concise information than textbooks, which helped students select important information. Students also used lectures as a strategy for gaining 89 information that might be covered on exarrns. Laura and Andrew reported that they obtained scribe notes fiom lectures even though they did not attend lectures, because scribe notes provided them with test information. Other than the strategies shown in Table 4.8, four students, Ann, Nancy, Andrew, and Torrn, mentioned that they could tell what were “testable questions” fiom their “gut feeling.” According to them, the common diseases or characteristics of a certain disease were likely exam questions. To explain testable questions, Tom said, It’skindofhardtoexplain It'sjustkindofagutfeelingwhenyou‘re studying. Whern I'mreadingoversornethingljust saytonnyself, thatreallysounds likeatest question. Somequestionsarejustreallyhardtoteston, arndso, ifIthinksomethingisreallyhard totestonlwontanphasizehasnmchasdnedungsflnatlflfinkaremoretestable. .. Ilneyliketoaskquestionslike,“Doesthispredisposetocancer?” Sowhenwe're studying, wheneverweseesorrnetlringlike, “Thispredisposesyouto anadernorrna,” you trytorernernbertlnatbecausetlnatseerrnsto comeup onexamsalot. Andrew, Jane, and Janet mentioned that PBL classes helped them sort out irnportarnt information because either the preceptor or classmates mentioned what was important to know during discussions. Along the same lines, a few students mentioned that goup study helped them select main irnforrnation. Three of the 12 studernts also said they realized certain information was important to krnow if it was repeated in various places. For example, Jane mentioned her approach to detecting importance as follows: WhatItryto doisjustreadthroughthatothersomceandthenseehowitmatchesthe objectives that they give us and tlnern all the other sources. Like I say, the overlap betweenalltlnesources,lfigurethat'sgottobeprettyirnportant. Ifallthreesources mention it, it's got to be pretty important. Other than these strategies, many students mentioned that they highlighted, underlined, circled, or wrote things down while reading the materials. Doirng these tlnings helped students focus their attention on information they needed to know. 90 W: Of the 12 students who were taking PBL classes, all but Jane used computer progams. Among them, Janet and Laura used computer programs only when they heard the computer progams were good or followed the coursepack closely, because using computer progams took time. Other interviewees reported that they used computer progams very much their second year. Students’ reasons for using computer progams are shown in Table 4.9. Table 4.9: Reasons for using computer progams (n = l l) Name Provide Good Provide Main Provide Pictures Information Interaction Jim x ' x Laura x Mark x x Tom x Ann x x Mary x x Andrew x x Roger x Nancy x Janet x Kelly x Total (11) 8 6 2 Eight interviewees reported that they used computer progams because the pictures in the progams were bigger and better than those in textbooks, and thus they enhanced understanding. Also, looking at pictures illustrating various diseases made it easier to remember them. For example, although Laura did not use computer progams very much, she thought they helped her in that they provided a good way of difl‘erentiating 91 among similar diseases by providing good pictures. Six students said they used computer progams as a way of selecting important information. Computer progams were condensed and concise, hence saving time and giving only the necessary inforrnatiorn, whereas textbooks were too wordy. Also, quiz questions in the computer progams sometimes helped students find important information. Other than these fiequently mentioned reasons, a few students reported that computer progams provided interaction. For example, students could have immediate feedback when answering quiz questions on computer proganns. Also, computer progams were another source of inforrnatiorn, which repeated the same content, so students used them when they were tired of reading textbooks or coursepacks. For example, Mary said, “Usually when I'll do it [computer progam] is when I‘m sick of reading. And I'll go in there arnd I'll be like, aha, changes.” The programs provided stimulation and a change of pace when students were bored with reading other materials. WM: As they did in their first year of medical school, the interviewees used certain strategies to check their knowledge or understanding of the materials. As shown in Table 4.10, nine interviewees said that goup study provided an opporturnity for them to deterrrnine the state of their knowledge by asking questions and quizzing each other. For example, Roger said, “We do that [goup study] because we test each other and see if we know the facts.” To explain his approach to checking knowledge, Jim commented, Yeah, it's similar to PBL. For instance, we'll take a drug, and we'll say, “OK here's the drug.” Andwe'll say, “Drugx,howdoesitact,wheredoesitact,whatdoesitact like?” Andthernwequizeachother, andwetalkthrouglnitandthernifsomebodysays the wrong answer, or maybe they got something wrong, maybe they misunderstood the 92 corncept. . .whereIthinkitwentup,wheremaybeitwentdown,inreversefeedback orsomethingAndwetalkaboutthosethings. Five students said they solved practice quizzes included at the end of the coursepack or in the computer progams to see how well they understand the material. Table 4.10: Strategies for checking knowledge (g = 12) Name Group Study Practice Quizzes Jim x Laura Mark Ann Jane Total 12 In addition to these strategies, I rm asked lnimself questions when he read the material a second time to see whether he understood it. Andrew said he krnew he understood the material if he could restate what he had read and if he could tell the next stage of something because most systems in the medical area have a logical progession. W: Of the 12 interviewees who were taking PBL classes, 5 reported that they had quit going to lectures because they could spend the lecture time more efl'ectively studying by themselves. Most of students who attended lectures said they did so only if the lecturer was good and let them know what to emphasize in studying for 93 exams. Even those five students who did not attend lectures obtained scribe notes and studied them to see what the lecturer had emphasized. Students who attended lectures gave various reasons for doing so. Lectures gave them an opportunity to ask questions and reinforced what they knew. Also, students thought they should attend the lectures because they had paid for them. W: Some interviewees reported that they used certain strategies to organize materials, check their coverage of the objectives, or schedule their study. (See Appendix F for additional strategies mentioned by interviewees.) Further, a few students mentioned that their motivation and confidence had changed because of their experience in medical school. For example, Roger said that doing well on exams gave him confidence. He noted, “Getting good scores always helps because you feel like you are doing the right thing, and you feel like you can trust your judgnent about what to study and what not to study.” MW: Except for Susan and Cindy, who were not taking the board exam soon because of their extension, all of the interviewees said they would be taking a board review course to prepare for the board exam. Because of their busy study schedule the second year, the students were not yet thinking about starting to prepare for the board . exam. However, most interviewees believed that studying for exams and discussing the materials during PBL classes would help them pass the board exam. Mary noted, “Michigan State students do well above the national average on the boards.” —.\. Ll IILL hi1 .~r,\. hranR_ .hNC NS huh $1.4: E a 94 W: What do students think influences their learning strategies (such as goals, assessment of learning, student activity, teaching method, and course content) ? In the following discussion of the findings for Research Question 3, Susan and Cindy, who were not taking PBL classes when the interviews were conducted, are included because influences on their learning strategies were not related solely to PBL classes. Table 4.11 Shows what interviewees said irnfluenced their learning strategies. Table 4.11: Influences on students’ learrning strategies (r_n = 14) Name Passing Previous Time Being a Good PBL Exams Study Habits Doctor ' Process Jim x x Laura x Mark Ann Susan x Jane Total 14 4 4 3 2 a Students who mentioned having a good knowledge base and understanding of materials were included in this category. As shown in Table 4.11, interviewees mentioned various factors that influenced their studying approach. Having limited time with a vast volume of materials to cover in 95 the second year, the pressure to pass exams, their old study approaches, and the desire to have a good knowledge base and thus be a good doctor were the geatest influence on the ways students studied. fun and Laura said that having the PBL experience in their second year also influenced the way they studied because it gave them the opportunity to integate nnaterials and made them more independent learners. Andrew thought his previous knowledge also directed how he studied. I also asked the interviewees about their current goals because those are integal to what they study and how they study. Most students said that their goals were passing class exams and the board exam, as well as having a good knowledge base and understanding the materials. Some of them mentioned that they would like to balance their studying for exams, their personal life, and having clinical experience for the future. Although most students recognized the importance of having a good knowledge base in the long run, they thought that passing exams was a more immediate goal in order to move to the next step. Table 4.12 shows the ways in which students thought PBL classes helped them. Susan and Cindy are not included in the table because they were not taking PBL classes at the time the interviews were conducted. 96 Table 4.12: The ways in which PBL classes helped the students (9 = 12) Name Understanding Small-Group Indep. Get Exam Checking (Integration) Working Study Info. Knowledge Skills (SMI) ' Tim x x x x Laura x x x Mark x x x Tom x x Ann x x Mary x x x Andrew x x x x x Roger x Nang x x x Janet x x x x Kelly x Jane x x x Total (12) 10 10 6 3 3 2 a. SMI = Selecting main information As shown in Table 4.12, most irnterviewees thought the PBL class experience helped them integate and understand the materials by providirng a context with a case and thus giving a clinical experience. Also, as hypothesized, most students thought that because PBL classes were small, they developed skill in talking and listening to others. Students said they monitored what they talked about and listened to others more carefirlly. Also, they were more tolerant as a result of dealing with a wide variety of personalities in PBL classes. About half of interviewees said that PBL classes encouraged their independent study by letting them search for information on their own instead of giving them all the information, as the previous year’s lectures had done. Some students also mentioned that 97 they could obtain irnforrnation fi'om classmates, such as what material was important to krnow, and they could get different points of view. Also, the PBL class experience helped them check their knowledge through discussion. Whereas most students said PBL classes helped them understand and irntegate the materials, four students said that PBL class helped them prepare for exams through discussion of relevant information. In additiorn, Janet said that PBL classes gave her an opportnrrnity to ask questions. Ann liked PBL classes because she could forrn fiiendships through them. On the whole, students thought PBL classes helped more with their long-term goal, which was integation or understanding of the materials, than with their current goal, which was passing exams. W: Do second-year medical students at MSU CHM report that they study differently than they did in their first year? Ifso, how and why? In the presentation of findings for Research Question 4, both interview and LASSI data are used. Susan and Cindy were not taking PBL classes when the interviews were conducted because of the extension of their progams; thus, they are excluded fi'om the discussion of irnterview findings. Isntervifl findings: One notable change that students reported was that, whereas they focused primarily on lectures and lecture notes their first year, they did more textbook reading and focused on understanding their second year. They mentioned that the knowledge they accumulated during their first year in medical school helped them to see more of the overall picture. Also, whereas year one lecturers gave students the necessary information with which to prepare for exams, in the second year they needed to find resources on their own and study them. For example, whereas students thought that 98 studying scribe notes or lecture notes meant doing well on tests their first year, the second year, they believed they should look for study resources outside of the lectures, such as doing computer progams or reading reconnrnended books. Thus, they focused more on reading the materials, as exemplified by Ann’s comment: Justbecausetlnere'ssorrnuchtlnatmernorizing oneparticularthingisawasteofenergy usually. Usuallyyourbettertoimmerseyourselfinasmuchvohrme ofmaterial and hope you absorb ernough of it to speak to tlne questions as they come up. So you’re betterofi'sperndingtinrereadingittryingtoreadmoreofit, orallofithopefirlly, once. It'dbenicetoreadittwice. Having a geater volume of materials to study the second year in a limited time also made students use fewer memorization strategies because that took time. Instead, they tried to focus on understanding as a goal rather than memorizing the details. Another notable change related to the above fact was that, whereas only Ann had quit going to lectures the first year, more students stopped going to lectures their second year, and those who attended lectures did so less fiequently than their first year. Janet stopped going to lectures the second year; she commented, Idon'tgotolectures,brnIreadsmbeabutIonlyreadthernatterI'vedonemyown studying Ireadthemthedaybeforetheexam Solectureistotallyuselessto me. I don'teverngotothelabs. Allmytimeismyownpersonaltimethatlspendstudying arnd readirng. So Ijust take the objectives list and I go down the objectives and check them ofi‘as I do them Sometimes I do the computer progams. Students attended lectures only when the lecturer was good. The reason students either attended ornly good lectures or quit going to lectures was lack of time. They thought they could spernd time more efi‘ectively studying by themselves. However, even those students who did not attend lectures obtained scribe notes fi'om the lectures so they would krnow what information the lecturer emphasized, for exam preparation. 99 Whereas second-year students said they used computer progams, no interviewees mentioned using computer progams their first year. Students used computer progams more the second year because they contained more condensed information and better pictures than textbooks. Also, when students were tired of reading, doing computer programs provided a flesh approach to their study. As they did the first year, most students in their second year used goup study either to check their knowledge or to understand the concepts. In addition, some students commented on the pressure they had felt the first year as compared to the second year. For example, whereas Ann felt more pressure the second year because of geater study loads, Roger and Nancy said they felt less pressure but more confidence the second year because of their experience in taking exams and receiving good scores on them. This is illustrated by Roger’s comment: Yealn, Ijusttellmysdfflnatrvetakenpmbablyahundredtestssincervebeenha'e arnd Ihavern'tfailedyet, sowhatI‘mdoingisprobablygood. Andiflwantabreakljust takeabreakandl'vestartedtovaluemyfieetimealotmore. Ifeltscaredtotakefi'ee timelastyearjustbecauselwasafi'aidImightfail. Butlhavemoreconfiderncetlnis year. m: The LASSI findings are divided into three parts. The first part contains findings fi'om the LAS SI analysis over three time points (August 1993, January 1994, and February 1995), using the original LASSI scales. The second part contains findings fiom analyses of individual items of the LAS SI, which I and two medical faculty categorized as PBL-sensitive and PBL-nonsensitive. In the third sectiorn, findings fi'om the PBL-related scale versus the PBL-unrelated scale, which I and two medical faculty made from the original LAS SI scales, are reported. 100 1. Findings fmm the original LASSI scale anglysg’ Overall analysis (using three time points). I first used repeated measures MANOVA(Norusis, 1993, p.132), using results from the LASSI administered to medical students at three times (August 1993, January 1994, and February 1995). F orty-four students completed the LAS SI at all three time points. Thus, the repeated measures MANOVA was applied to those 44 cases to see the changes for those students who completed the LAS SI over two years. Because there were no between-subjects variables in the research, I used only within-subject MANOVA repeated measures. The within-subject factor was time. Table 4.13 shows the means and standard deviations for each scale of the LAS SI over time for the 44 students included in the analysis. Table 4.13: Means and standard deviations on each LAS SI scale for students who completed the LASSI at times 1, 2, and 3 (g = 44) Scale I Menusg) E Timel Time2 Time3 Attention :35.9(2.93) 35.4(3.05) 35.3(2.96) Motivation :32.0(3.83) 30.3(4.51) 30.1(4.58) Time Management L26.4(6.35) 26.0(6.28) 24.3(7.06) Anxiety i29.3(6.21) 30.0(6.20) 28.7(6.10) Concentration €29.0(430) 28.7(4.77) 26.7(4.99) InformationProcessing 130.4(4.43) 31.5(523) 30.9(5.16) Selecting Main Information L19.7(3.00) 202(295) 20.0(2.35) Study Aids i26.9(4.99) 27.4(427) 27.2(4.30) SelfTesting L27.7(4.02) 27.5(4.13) 26.4(3.91) Test Strategy 533.2(374) 33.2(3.62) 327(292) 101 manning me .‘llMEl Irma: 10 . .',- .1 ’25? 252‘? 1’]: Ti: :5 if"; - 11MB Ate ”on Ti Anx Co 5e ens 5t sent Te “tin n'Van-meMana 'et ”cent In. Ctr “ more understanding 221 Jge (Lilot Study) gearch Qoosg'on 1: What learning strategies do students use in preparation for the problem-based learning classroom, and why? Jane mentioned that she did no study separately for PBL classes and for exams. She thought that what she learned fi'om PBL classes was what was on the exams because her group stick to the objective lists. Jane did not study much for PBL class per se if the materials were not likely to be on the exam as shown in her comment: I don’t really spend that much time on the PBL things that aren’t on the test. Everydiinglstudiedwasdirectedtowardtheobjectives, soitwasreallygearedtoward the exam W3 Jane’s PBL group discussed cases with each other, and preceptors asked questions. They established a ground rule for their group to stick to the objective lists when they discussed the cases, and the learning issues they raised had to match the objectives. W: To find learning issues, Jane usually read books, taking notes. However, depending on the domain, she looked for materials difl’erently. For example, although the professor gave them good coursepacks that covered everything for physiology class, for cardiology she researched difi‘erent sources or books to look for information. Sometimes Jane went to the library or the learning resource center to find the information for learning issues. When researching books in the library, she tried to find the parts that matched the objectives. However, even though a learning issue might not be related to the exams, if it was interesting, she looked for the information. 222 Research Quosflon 2: What learning strategies do students use in preparation for examinations (both class exams and the licensing exam), and why? R__eodi_r_lg: Jane mentioned that she read the previous year’s objectives with answers to get an idea of what she needed to know for the test. If she found information that she could not understand while reading the old objectives, she read textbooks and took notes. Jane mentioned that she tried to get a general overview during the first week of the domain, and she took notes and tried to memorize things during the second week of the domain. mm: Jane said she studied with her fiiends, and they asked each other questions. Doing this helped her check her knowledge. Jane focused more on group study if the material was conceptual because by writing, drawing things on the board, and talking to fiiends made her think about pathways more actively. MW: Jane integrated the materials through group study. For studying conceptual materials, she mentioned, We found that it really helped us, talking things through together, you know, drawing stufi‘ on the board to figure it out. So, I spent a lot more time studying with pe0ple. W: Jane used flashcards or charts to memorize things. She read one source of information, took notes, wrote the notes on flashcards, and retyped them. She then rewrote them on a chart. Doing this provided repetition of the information, which aided her memorization. WM: Jane said she figured out the important information by solving practice quizzes, as illustrated by her statement: 223 They do give us quizzes, and the same people who write the test questions write the quiz questions. So they usually give us a pretty good idea what’s going to be on the test. Jane used old objectives to see what were in the previous year’s exams. Also, she knew that certain information was important if it was given in several difl‘erent sources, such as lectures, textbooks, and objectives. Sometimes, lectures helped her determine what was important information. And having a physician as a preceptor in PBL classes helped Jane focus on what was important. 9mm: Jane solved quizzes because they gave a good idea of what would be on the test. Through doing quizzes, she also could check how she was doing with her study. Also, her group asked each other questions, which helped her ascertain the state of her knowledge. W: Jane said she went to the lectures and obtained scribe notes because they sometimes made her focus on important information. W: Although Jane was not studying for the board exam yet, she believed that what she was studying now would help her pass the board exam. Also, she planned to attend a board review course to prepare for the board exam. Resoth ngtion 3: What do students think influences their learning strategies (such as goals, assessment of learning, student activity, teaching method, and course content)? Jane said her goal was to be a good doctor. Also, she wanted to learn the material well enough so that she could apply it in the field. She also hoped, that fi'om the PBL class experience, she would be able to integrate the materials better. 224 In general, Jane liked the PBL format better than lectures because it provided integration of the materials and she could learn well fi'om the discussion in PBL classes. Jane also mentioned that PBL classes helped in the following ways: 1. MM: Jane mentioned that PBL classes encouraged and motivated her to look for materials when it was something related to the clinical setting. She said that even though something was not on the objective lists, if the material was interesting, she went to the library and researched it. 2. W: Jane mentioned that PBL classes helped her prepare for the exams in that they focused on important information in discussion. Sometimes the physician preceptors helped her pick out the important material. 3. Woo: Jane mentioned that talking with people during PBL classes and explaining things to each other helped her understand and integrate the materials. She stated, “So I think for me that's how PBL is good because it connects the clinical aspects and the physiology and the pathology, ties them all together.” kgrch Qoostion 4: Do second-year medical students at MSU CHM report that they study differently than they did in their first year? If so, how and why? Because exams were based on lectures the first year, Jane read coursepacks and scribe notes, but she did not read textbooks. Also, the teachers sorted out the information to learn the first year. The second year, she had a greater volume of material to study, and she had to figure out what were the important things to study on her own. Jane said she was big-picture oriented the second year. Also, she said she could focus on one topic at a time the second year because, the exams were scheduled that way. 225 Table F. 12 shows a summary of the key features about Jane’s learning strategies. Table F. 12: Key features of Jane’s learning strategies Q1 - No separate studying for PBL class and exam: studying for PBL class is a part of studying for exams - Matching learning issues with objectives - Studying learning issues if they are interesting. even though they are not on the objective lists - Learning issue study: reads books and coursepacks if they are good, uses library or learning resource center Q2 - Reading: reads old objectives with answers first to get an idea of test information- if she cannot understand, reads textbooks and takes notes - First week of a domain: gets a general overview - Second week of a domain: memorizes things - Group study: asks questions, checks knowledge, focuses on group study for conceptual material - Integration strategies: group study - Memorization strategies: flashcards, charts, repetition (reads- takes notes- writes on flashcards- retypes - rewrites on chart) - Selecting main information: practice quizzes, old objective, lectures, overlapping information, and PBL class - Checking knowledge strategies: practice quizzes and group study - Lecture attendance: focusing information Q3 - Goals: to be a good doctor and learn materials well so that she can apply in the fields - PBL helps 1. Independent study 2. Exam preparation (selecting main information) 3. Understanding and integration - First year: lecture based: read coursepack, scribe notes, no textbook use, teacher selected main information - Second year: more use of textbooks, select main information by herself, more big picture oriented, study one topic at a time REFERENCES REFERENCES Albanese, M.A. & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68(1), 52-81. Alguire, P. & Werner, B. (1992). Preceptor guideka for the problem-based learning groups. Unpublished internal document, East Lansing: Michigan State University, College of Human Medicine. Anderson, AS. (1989). Conversion to problem-based learning in 15 months. In Abstracts of the innovations in medical education exhibits: The 100th Annual Meeting of the Association of American Medical Colleges (p.135): Unpublished compilation. Washington, DC: Association of American Medical Colleges. Anderson, J .R & Reder, L.M. (1979). An elaborative processing explanation of depth of processing. In L.S. Cermak & F.I.M. Craik (Eds), Levels of processing in human memory. Hillsdale, NJ: Erlbaum. Arnold, L. & Feighny, KM. (1995). Students’ general learning approaches and performances in medical school: A longitudinal study. Academic Medicine, 70(8), 715-722. Barrows, HS. (1985). How to design a problem-based curriculum for the preclinical years. New York: Springer. Barrows, HS. (1986). A taxonomy of problem-based learning methods. Medical Education, 20, 481-486. Barrows, H., & Mitchell, D. (1975). An innovative course in undergraduate neuroscience: Experiment in problem based learning with “problem boxes.” British Journal of Medical Education, 9, 223 -230. Berkson, L. (1993). Problem-based learning: Have the expectations been met? Academic Medicine, 68(10), October supplement, $79-$88. Bickley, H., Donner, RS, Walker, A.N., & Tilt, J .P. (1990). Pathology education in a problem-based medical curriculum. Teaching and Learning in Medicine, 2, 38-41. 226 227 Blanchard, J. (1986). What to tell students about underlining. Journal of Reading, 29(3), 199-203. Black II Preceptor Training. (1993). Unpublished internal document. East Lansing: Michigan State University: College of Human Medicine. Blumberg, P., & Eckenfels, E. (1988). A comparison of student satisfaction with their preclinical environment in a traditional and a problem-based curriculum. In Research in Medical Education, 1988: Proceedings of the T wenty-Seventh Annual Conference (pp. 60-65). Washington, DC: Association of American Medical Colleges. Blumberg, P., & Michael, J .A (1992). Development of self-directed learning behaviors in a partially teacher-directed problem-based learning curriculum. Teaching and Learning in Medicine, 4(1), 3-8. Blumberg, R, Michael, J.A & Zeitz, H. (1990). Roles of student-generated learning issues in problem-based learning. Teaching and Learning in Medicine, 2(3), 149- 154. Bogdan, RC. & Biklen, SK. (1992). Qualitative research for education: An introduction to theory and method (2nd ed.). Boston: Allyn & Bacon. Brown, AL., Bransford, J.D., Ferrara, RA, & Campione, J.C. (1983). Learning, remembering, and understanding. In P.H. Mussen (Ed), 17ch of child psychology (pp. 77-166). New York: John Wlley & Sons. Chipman, S.F., Segal, J.W., & Glaser, R (Eds) (1985). Thinkingand learning skills: Vol. 2. Research and open questions. Hillsdale, NJ: Erlbaum. Coles, C. (1985). Difi‘erences between conventional and problem-based curricula in their students' approaches to studying. Medical Education, 19, 308-3 09. Coulson, KL. (1983). Problem-based student-centered learning of the cardiovascular system using the problem-based learning module. Physiologist, 26, 220-224. Elton, L.RB., & Laurillard, D.M. (1979). Trends in research on student learning. Studies in Higher Education, 4, 87-104. Entwistle, NJ. (1981). Styles of learning and teaching: An integrative outline of educational psychology for students, teachers, and lecturers. Chichester, England: John Wiley & Sons. 228 Farquhar, L.J., Haf, J., & Kotabe, K. (1986). Efi‘ect of two preclinical curricula on NBME Part I examination performance. Journal of Medical Education, 61, 368- 373. Feletti, G.I., & Carver, ST. (1989). The new pathway to general medical education at Harvard University. Teaching and Learning in Medicine, 1(1), 42-46. Garner, R (1990). When children and adults do not use learning strategies: Toward a theory of settings. Review of Educational Research, 60(4), 517-529. Glaser, R (1984). Education and thinking: The role of knowledge. American Psychologist, 39, 93-104. [:1ka for Premedical Students: The College of Human Medicine (1996). East Lansing: Michigan State University, College of Human Medicine Ofice of Admissions. Kirby, 1R (Ed). (1984). Cognitive strategies and educational performance. New York: Academic Press. Lee, 1., Yelon, S.L., Doig, K., & Smith, JP. (1994). The effect of supplemental instruction on learning strategies of first year medical students at Michigan State University. In Abstracts of innovations in medical education poster presentations (p. 17). Proceedings of the Central Group on Educational Afi‘airs 1994 Annual Meeting, Chicago, IL. Lodico, M., Ghatala, E., Levin, JR, Pressley, M., & Bell, IA (1983). The efi‘ects of strategy-monitoring training on children's selection of efi‘ective memory strategy. Journal of Experimental Child Psychology, 35, 263 -277. Martin, D., Black, R, & DeBuhr, L. (1983). Supplemental instruction: A model for student academic support. Kansas City, University of Missouri: Student Learning Center. Martinez-Burrola, N., Klepper, D.J., & Kaufinan, A (1985). Admissions into a problem- based curriculum. In A. Kaufman (Ed), Implementing problem-based medical education (pp. 164-179). New York: Springer. Marton, F., & Saljo, R (1976a). On qualitative difi‘erences in learning: I. Outcome and process. British Journal of Educational Psychology, 46, 4-11. Marton, F., & Saljo, R (1976b). On qualitative difl‘erences in learning: [1. Outcome as a function of the leamer‘s conception of the task. British Journal of Educational Psychology, 46, 115-127. 229 Mayer, RE, & Greeno, JG. (1972). Structural differences between learning outcomes produced by difl‘erent instructional methods. Journal of Educational Psychology, 63, 165- l 7 3. McKeachie, W.J., Pintrich, PR, & Lin, Y.G. (1985). Teaching learning strategies. Educational Psychologist, 20(3), 153-160. McKeachie, W.J., Pintrich, PR, Lin, Y.G., Smith, D.AF., & Sharrna, R. (1990). Teaching and leaning in the college classroom: A review of the literature (2nd ed). Ann Arbor, MI: National Center for Research to Improve Postsecondary Teaching and Learning. Mitchell, R (1992). The development of the cognitive behavior survey to assess medical student leaning. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, CA. Moore, G.T., Block, S., & Mitchell, R (1990). A randomized controlled trial evaluating the impact of the new pathway curriculum at Ha'va'd Medical School. Unpublished report to the Fund for the Improvement of Post-Secondary Education. Cambridge, MA: Harvard Medical School. Moore-West, M., Harrington, D.L., Mennin, S.P., Kaufman, A., & Skipper, BJ. (1989). Distress and attitudes toward the learning environment: Effects of a curriculum innovation. Teaching ard Leaning in Medicine, 1(3), 151-157. Moore-West, M., & O’Donnell, M. J. (1985). Program evaluation. In A. Kaufman (Ed), Implementing problem-based medical education: Lessons fiom successfitl innovations (pp. 180-206). New York: Springer. Neufeld, V., & Barrows, H. (1974). The “McMaster philosophy”: An approach to medical education. Journal of Medical Education, 49, 1040-1050. Newble, D.I., & Clarke, RM. (1986). The approaches to learning of students in a traditional and in an innovative problem-based medical school Medical Education, 20, 267-273. Newble, D.I., & Entwistle, NJ. (1986). Learning styles and approaches: Implications for medical education. Medical Education, 20, 162-175. Nisbet, J ., & Shucksrnith, J. (1986). Learning to learn. In J. Eggleston (Ed), Learning strategies (pp. 1-10). New York: Routledge & Kegan Paul. 230 Nolte, J. (1989). Allocation of educational time by first-year medical students in traditional and in partially problem-based curricula. In D. S. Dabney (compiler), Proceedings of the T wenty-Eighth Annual Conference on Research in Medical Education (pp. 35- 39). Washington, DC: Association of American Medical Colleges. ' Nolte, J ., Eller, P., & Ringel, SP. (1988). Shifiing toward problem-based learning in a medical school neurobiology course. In D. S. Dabney (compiler), Proceedings of the T wenty-Seventh Annual Conference on Research in Medical Education (pp. 66-71). Washington, DC: Association of American Medical Colleges. Norman, G.R, & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine, 67, 557-565. Norton, L., & Hartley, J. (1986). What factors contribute to good examination marks? Higher Education, 15, 355-371. Palincsar, AS., & Brown, AL. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1(2), 117-175. Paris, S.G. (1988). Models and metaphors of learning strategies, In C.E. Weinstein, ET. Goetz, & P.A Alexander (Eds), Leaning aid stuay strategies: Issues in assessment, instruction, and evaluation (pp. 299-321). San Diego: Academic. Paris, S.G., Cross, D., & Lipson, MY. (1984). Informed strategies for learning: A program to improve children's reading awareness and comprehension. Journal of Educational Psychology, 76(6), 1239-1252. Pintrich, PR (1989). The dynamic interplay of student motivation and cognition in the college classroom, In C. Arne: & M. Maehr (Eds), Advatces in motivation and achievement: Motivation enharcing environments (Vol. 6). Greenwich, CT: J AI Press. Post, G.J., & Drop, MI. (1990). Perceptions of the content of the medical curriculum at the medical faculty in Maastricht: A comparison with traditional curricula in the Netherlands. In Z.M. Norman, H.G. Schmidt, & E.S. Ezzat (Eds), Innovation in medical education: An evaluation of its present status (pp. 64-75). New York: Springer. Preceptor Orientation: Block II Problem-Based Leaning. (1993). Unpublished internal document. East Lansing: Michigan State University, College of Human Medicine. Ramsden, P. (1984). The context of learning. In F. Marton, D.J. Hounsell, & N.J. Entwistle (Eds), The experience of leaning. (pp. 144-164). Edinburgh: Scottish Academic Press. 231 Rankin, J .A. (1992). Problem-based medical education: Efl'ect on library use. Bulletin of the Medical Libray Association, 80(1), 36-43. Ravitch, M., Golub, R., Altman, M., & McGaghie, W. (1994). Problem-based leaning at Northwestern University Medical School: Background and principles, Unpublished internal document. Chicago. Northwestern University Medical School. Saunders, K., Northup, D.E., & Mennin, SP. (1985). The library in a problem-based curriculum. In A Kaufman, (Ed), Implementing problem-based medical education: Lessons fiom successful innovations (pp. 71-88). New York: Springer. Schmeck, RR, Ribich, F., & Rarnanaiah, N. (1977). Development of a self-report inventory for assessing individual difl‘erences in learning processes. Applied Psychological Measurement, 1(3), 413-431. Schmidt, H.G. (1983). Problem-based learning: Rationale and description. Medical Education, 17, 11-16. Silver, M., & Wilkerson, L. (1991). Effects of tutors with subject expertise on the problem-based tutorial process. Academic Medicine, 66, 298-300. Svensson, L. (1977). On qualitative difi‘erences in learning: 111. Study skill and learning. British Journal of Eatcational Psychology, 47, 233-243. Tesch, R (1989). Types of qualitative research. In R Tesch (Ed), Qualitative reseach: Analysis types aid software tools (pp. 55-101). London: Falmer. Van Langenberghe, H.V.K. (1988). Evaluation of students' approaches to studying in a problem-based physical therapy curriculum. Physical Therapy, 68(4), 522-529. Vernon, D.T.A, & Blake, RL. (1993). Does problem-based learning work? A meta- analysis of evaluative research. Academic Medicine, 68(7), 550-5 63. Weinstein, C.E., & Mayer, RE. (1986). The teaching of learning strategies. In M. Wittrock, (Ed), Hauflrook of reseach on teaching (pp. 315-327). New York: Macmillan. Weinstein, C.E., Palmer, D.R., & Schulte, AC. (1987). LASSI user's manual. Clearwater, FL: H & H Publishing. Weinstein, C.E., Zirnmermann, S.A, & Palmer, D. (1988). Assessing learning strategies: The design and development of the LAS SI, In C.E. Weinstein, E.T. Goetz, & P.A. Alexander (Eds), Leaning and study strategies: Issues in assessment, instruction, and evaluation (pp. 25-3 9). New York: Academic Press. 232 Wetzel, M., Ramois, M., Armstrong, E., & Neill, J. (1989). Harvard Medical School: The new pathway. From pilot track to school-wide program. In Abstracts of the Innovations in Medical Education Exhibits: The 100th Annual Meeting of the Association of America: Medical College (p. 139). Unpublished compilation. Washington, DC: Association of American Medical Colleges. Wilkerson, L., & Feletti, G. (1989). Problem-based learning: One approach to increasing student participation. In AF. Lucas (Ed), The department chairperson's role in enhancing college teaching (pp. 51-60). New Directions for Teaching and Leaning, 37. San Francisco: Jossey-Bass. "‘rrrrrrrrrrrrrrr