3: 9|" N." i: w :53? {3‘ 1: lib-18H; . ,_ p ("/Oc/ This is to certify that the dissertation entitled THE EFFECT OF HUMOR IN INSTRUCTIONAL TEXT ON LEARNING, INTEREST, AND ENJOYMENT: IS GOOD HUMOR JUST FOR ICE CREAM? presented by Lorinda Marie Sheppard has been accepted towards fulfillment of the requirements for Ph . D . degree in Counseling , Educational Psychology, and Special Education Date g/Z/ZOZ,’ / / MSU is an Affirmative Action/Equal Opportunity Institution 0-12771 . LIBRARY Michigan State University PLACE IN RETURN BOX to remove this checkout from your record. TO AVOID FINES return on or before date due. MAY BE RECALLED with earlier due date if requested. DATE DUE DATE DUE DATE DUE R 1 0 Z Uzi Digit) 3 o 3 MAR: 06 W 3 932W) 0 6/01 c:/ClRC/DateDue.p65-p.15 THE EFFECT OF HUMOR IN INSTRUCTIONAL TEXT ON LEARNING, CiNTEREsT, AND ENJOYMENT: IS GOOD HUMOR JUST FOR‘ICE CREAM? .- By Lorinda Marie Sheppard A DISSERTATION Submitted to Michigan State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Department of Counseling, Educational Psychology, and Special Education 2002 ABSTRACT THE EFFECT OF HUMOR IN INSTRUCTIONAL TEXT ON LEARNING, INTEREST, AND ENJOYMENT: IS GOOD HUMOR JUST FOR ICE CREAM? By Lorinda Marie Sheppard This study examined the effect of humor in text-based instruction on learning, interest, and enjoyment. A review of the literature indicated both theoretical and empirical support for the potential effects of humor on learning, and research suggests that interest and enjoyment, in addition to being outcomes of humor, may also influence learning. For this study, a humorous version and a nonhumorous version were developed for each of two chapters from a book on basic experimental psychology; one chapter was on how to get experimental ideas, and the other chapter was on how to be fair with science (i.e., research ethics). Subjects read the humorous version of one chapter and the nonhumorous version of the other chapter. After reading each chapter, subjects answered several questions regarding how interesting and relevant they found the chapter, how much they enjoyed the chapter, how much they believed they learned from the chapter, and how well the chapter held their attention. Subjects were also asked what they liked and disliked about each chapter, what helped them learn the information in each chapter, and what the two most important ideas were that they learned from each chapter. Subjects then completed a short-answer and multiple-choice quiz. Afier reading both chapters and answering questions specific to each chapter, subjects were asked to compare the two chapters on several measures. Two weeks later, subjects completed another quiz for each chapter to determine long-term retention of the information. On the tests of immediate learning, humor was associated with increased learning for the experimental ideas (EI) chapter, but not for the scientific fairness (SF) chapter. There was no difference in long-term retention as measured by the delayed tests of learning. Humor was associated with increased enjoyment, increased situational interest, and improved attention for both chapters. Humor had no effect on personal interest or perceived relevance for either chapter. Differences in the effect of humor on immediate measures of learning may be due to differences in the amount, type, and integration of humor in the two chapters, and to differences in the cognitive burden placed on readers by the content of the chapters. In comparisons Of the two chapters, subjects reported that the experimental ideas chapter was easier to stick with, more enjoyable, and preferred for leisure reading, regardless of use of humor. Subjects reported they would more likely to find the nonhumorous version in a textbook, regardless of topic. Additional research is needed to determine the effects of humor in a classroom situation, and to determine if there is an optimal amount of humor in instructional text. Further experimental studies should explore the effect of humor on learning when the materials are more closely matched for type and amount of humor, general interest, and difficulty of content. Copyright by LORINDA MARIE SHEPPARD 2002 ACKNOWLEDGEMENTS This dissertation never would have been completed without the support, encouragement, and contributions of a number of people. A huge thank you goes to Steve Yelon, advisor for both my master’s and doctoral programs. Without his phenomenal advising and mentoring, it’s unlikely I would have begun the Ph.D. program, and even less likely I would have finished. Fortunately, Steve never really believed me when I said, “I just can’t do this anymore.” His response was always, “Let’s just get you through this semester, and worry about the rest later.” Fran Yelon also deserves a thank you for her kind and encouraging words, especially during times when I was frustrated and disheartened. As Steve’s last advisee, I hope my graduation will mark an end to the frantic and tearful phone calls she has had to field over the last many years from Steve’s students. Thank you to the members of my dissertation committee: Jere Brophy, Punya Mishra, and Ed Wolfe. Their willingness to work with me in a collegial and collaboratory manner was much different from the adversarial relationships some students have with their committees. They worked with me closely through all stages of this project so that the design, data collection, analysis, and interpretation went as flawlessly as possible. Thanks to David W. Martin, author of Doing Psychology Experiments, the book that served as a source for the readings I used in this study, for allowing me to use his book and for corresponding with me about the use and potential benefits of humor in text. None of this would have been possible without my parents, Ike and Donna Sheppard, who, while never placing any pressure on me to complete the program, were unwavering in their belief that I could eventually obtain a doctoral degree. Dad also provided a strong role model: the fact that he had a Ph.D. influenced me immeasurably in believing this was a worthy goal. Mom deserves special recognition for the emotional support she provided. Thanks to friends Donna Murrell, Anne Carrigan, and Telaina Eriksen for serving as raters and creators of the humor used in the materials. They also made sure I remembered there was life outside of graduate school. Thanks to friends Dan Kurkowski and Kevin Music for rating the humor used in the materials and providing needed breaks from the drudgery of schoolwork. Thanks to fellow graduate students Gina Cervetti, Michael Pardales, Mark Girod, Lisa Sensale, and Carolyn J aynes, who provided a support group during the difficult times, and who inspired me with their dedication to the pursuit of scholarly excellence. I am in awe of them. I also appreciate Lee Kokinakis, Debby Sleight, and Joe Brocato, who were all graduate students when I met them and who preceded me in obtaining their doctorates, for the example they set and for their words of encouragement as I pursued my degree. vi TABLE OF CONTENTS LIST OF TABLES .............................................................................................................. x LIST OF FIGURES ......................................................................................................... xiii CHAPTER 1 INTRODUCTION ............................................................................................................... 1 Statement of the Problem ......................................................................................... 1 Rationale and Significance of the Study .................................................................. 5 Overview of the Study ............................................................................................. 6 Humor in Text-Based Instruction ............................................................................ 7 Overview of the Dissertation ................................................................................... 7 CHAPTER 2 LITERATURE REVIEW .................................................................................................... 9 The Nature of Humor ............................................................................................. 12 Effects of Humor on Learning ............................................................................... 14 Studies of Humor and Memory .................................................................. 14 Studies of Humor in the Classroom ........................................................... 15 Studies of Humor in Text ........................................................................... 16 Effects of Humor on Enjoyment ............................................................................ 17 Effects of Humor on Interest and Attention ........................................................... 18 Effect of Humor on Perceived Relevance .............................................................. 19 Effects of Enjoyment on Learning ......................................................................... 20 Organization ............................................................................................... 21 Learning Sets ............................................................................................. 22 Visible Author ............................................................................................ 24 Effects of Interest of Learning ............................................................................... 26 Effects of Attention on Learning ........................................................................... 30 Effects of Perceived Relevance on Learning ......................................................... 32 ' Conclusion ............................................................................................................. 33 CHAPTER 3 METHODOLOGY ............................................................................................................ 35 Research Questions and Overview ........................................................................ 35 Pilot Study .............................................................................................................. 35 Findings ...................................................................................................... 36 Possible Confounding Factors ................................................................... 40 Summary .................................................................................................... 42 Major Research Questions ..................................................................................... 42 Minor Research Questions ..................................................................................... 44 Related Research Questions ................................................................................... 45 Model ..................................................................................................................... 45 vii Dissertation Study .................................................................................................. 47 Subjects ...................................................................................................... 47 Materials .................................................................................................... 49 Research Design ......................................................................................... 53 Procedures .................................................................................................. 54 CHAPTER 4 RESULTS .......................................................................................................................... 58 Scale Reliability ..................................................................................................... 58 A Note on the Analyses ......................................................................................... 62 Descriptive Statistics of Scales .............................................................................. 63 Major Research Questions ..................................................................................... 65 Effect of Humor on Learning (Immediate) ................................................ 66 Effect of Humor on Learning (Delayed) .................................................... 69 Effect of Humor on Enjoyment .................................................................. 70 Effect of Humor on Interest ....................................................................... 70 Minor Research Questions ..................................................................................... 71 Effect of Humor on Other Mediating Variables ........................................ 71 Relationships Among Mediating Variables ............................................... 72 Relationships Between the Mediating Variables and Learning ................. 75 Related Research Questions ................................................................................... 78 Other Findings ....................................................................................................... 79 Reading Time ............................................................................................. 80 Comparisons Between Chapters ................................................................ 80 Responses to Each of the Chapters ............................................................ 89 Summary ................................................................................................................ 96 CHAPTER 5 DISCUSSION .................................................................................................................. 100 Immediate Effects of Humor on Learning ........................................................... 100 Reason 1: Differences in Amount and Type of Humor ........................... 101 Reason 2: Differences in Cognitive Burden ............................................ 106 Conclusion ............................................................................................... 107 Delayed Effect of Humor on Learning ................................................................ 107 Effect of Humor Related to Specific Passages of Text ........................................ 109 Immediate Recall ..................................................................................... 109 Delayed Recall ......................................................................................... 111 Future Research ....................................................................................... 111 Effect of Humor on Enjoyment ............................................................................ 111 Effect of Humor on Interest ................................................................................. 112 Minor Research Questions ................................................................................... 112 Effect of Humor on Attention and Relevance .......................................... 112 Relationships Among Mediating Variables ............................................. 113 Relationships Between the Mediating Variables and Learning ............... 114 Related Research Questions ................................................................................. 118 Informativeness ........................................................................................ l 18 viii Humor Supportive of Text ....................................................................... 119 Perceived Learning .................................................................................. 119 Other Findings ..................................................................................................... 119 Reading Time ........................................................................................... 1 19 Comparisons of Two Chapters ................................................................. 120 Likes ......................................................................................................... 123 Dislikes .................................................................................................... 124 Aids to Learning ...................................................................................... 125 Summary .............................................................................................................. 126 Implications for Theory ........................................................................... 127 Recommendations for Authors who Wish to Incorporate Humor Into Instructional Text ........................................................................ 128 Strengths .................................................................................................. 130 Limitations ............................................................................................... 131 Next Steps ............................................................................................................ 132 REFERENCES ................................................................................................................ 134 APPENDICES ................................................................................................................. 141 Appendix A: Experimental Ideas Chapters .......................................................... 142 Version F (Humorous) ............................................................................. 143 Version C (Nonhumorous) ....................................................................... 152 Appendix B: Scientific Fairness Chapters ........................................................... 160 Version F (Humorous) ............................................................................. 161 Version C (Nonhumorous) ....................................................................... 170 Appendix C: Quiz Questions (with answers) ....................................................... 178 Experimental Ideas ................................................................................... 179 Scientific Fairness .................................................................................... 182 ix LIST OF TABLES Table 4-1. The eleven subscales used in this research, with the items representing those subscales indicated below each subscale name and the alpha reliabilities for the experimental ideas and scientific fairness chapters both for the first 25 subjects and for all subjects ............................................................................................... 59 Table 4-2. Means, standard deviations, and ranges for experimental ideas scales, including both humorous (H) and nonhumorous (NH) versions ....................................... 63 Table 4-3. Means, standard deviations, and ranges for scientific fairness scales, including both humorous (H) and nonhumorous WH) versions ....................................... 64 Table 4-4. Summary of the statistical analyses of major research questions for each of the chapters ............................................................................................................ 66 Table 4-5. Questions and answers related to text ideas that had clear ratings of use of humor by raters .............................................................................................................. 68 Table 4-6. Summary of the statistical analyses of major research questions for each of the chapters ............................................................................................................ 71 Table 4-7. Summary of the statistical analyses of major research questions for each of the chapters ............................................................................................................ 72 Table 4-8. Summary of the statistical analyses of major research questions for each of the chapters ............................................................................................................ 75 Table 4-9. Correlations between learning (both immediate and delayed) and interest (both personal and situational) for the experimental ideas chapter ....................... 77 Table 4-10. Correlations between learning (both immediate and delayed) and interest (both personal and situational) for the scientific fairness chapter ......................... 77 Table 4-1 1. Correlations between learning (both immediate and delayed) and enjoyment for the experimental ideas and scientific fairness chapters .............................. 78 Table 4-12. Correlations between learning (both immediate and delayed) and attention for the experimental ideas and scientific fairness chapters ................................. 78 Table 4-13. Correlations between learning (both immediate and delayed) and relevance for the experimental ideas and scientific fairness chapters ............................... 78 Table 4-14. Number of subjects who selected each response when asked which of the chapters they would be most likely to find in a textbook ............................................ 81 Table 4-15. Frequencies of subjects’ reasons why a chapter would be more likely to appear in a textbook (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) ................................ 81 Table 4-16. Frequencies of subjects’ reasons why a chapter would be more likely to appear in a textbook (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) .............................. 82 Table 4-17. Number of subjects who selected each response when asked which of the chapters was easier to stick with .................................................................................. 82 Table 4-18. Frequencies of subjects’ reasons why the chapter they selected was easier to stick with (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) ................................ 84 Table 4-19. Frequencies of subjects’ reasons why the chapter they selected was easier to stick with (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) .............................. 84 Table 4-20. Number of subjects who selected each response when asked which Of the chapters they enjoyed more .......................................................................................... 85 Table 4-21. Frequencies of subjects’ reasons why they found the chapter they selected more enjoyable (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) ....................... 86 Table 4-22. Frequencies of subjects’ reasons why they found the chapter they selected more enjoyable (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) .............................. 86 Table 4-23. Number of subjects who selected each response when asked which of the chapters they choose for leisure reading ...................................................................... 87 Table 4-24. Frequencies of subjects’ reasons why they would prefer the chapter they selected for leisure reading (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) .............................................................................................................................. 88 Table 4-25. Frequencies of subjects’ reasons why they would prefer the chapter they selected for leisure reading (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) ................ 88 Table 4-26. Subjects’ reports regarding what they liked about the humorous and nonhumorous versions of the experimental ideas chapter ................................................. 89 Table 4-27. Subjects’ reports regarding what they liked about the humorous and nonhumorous versions of the experimental ideas chapter ................................................. 90 xi Table 4-28. Subjects’ reports regarding what they did not like about the humorous and nonhumorous versions of the experimental ideas chapter .......................................... 91 Table 4-29. Subjects’ reports regarding what they did not like about the humorous and nonhumorous versions of the scientific fairness chapter ............................................ 91 Table 4-30. Subjects’ reports regarding what helped them learn the information in the experimental ideas chapter ........................................................................................... 93 Table 4-31. Subjects’ reports regarding what helped them learn the information in the scientific fairness chapter ............................................................................................. 93 Table 4-32. Subjects’ reports regarding the two most important ideas they learned from the experimental ideas chapter .................................................................................. 95 Table 4-33. Subjects’ reports regarding the two most important ideas they learned from the scientific fairness chapter .................................................................................... 96 xii LIST OF FIGURES Figure 1-1. Motivated students are likely to learn more ...................................................... 1 Figure 1-2. Humor’s potential effects on both cognitive and affective outcomes, including learning, interest, and enjoyment ......................................................................... 3 Figure 1-3. Mediating variables that may influence the effects of humor in text ................ 3 Figure 2-1. Hypothesized effects of humor in instructional text ......................................... 9 Figure 2-2. Interest and enjoyment as mediating variables between humor and learning .............................................................................................................................. 10 Figure 2-3. Hypothesized effects of humor in instructional text on both primary (i.e., learning, interest, and enjoyment) and secondary (i.e., attention and relevance) variables ........................................................................................................... 11 Figure 2-4. Hypothesized effects of humor, and relationships among the three main outcome variables ..................................................................................................... 33 Figure 3-1. Hypothesized effects of humor in instructional text ....................................... 43 Figure 3-2. Hypothesized effects of humor in instructional text on both primary (i.e., learning, interest, and enjoyment) and secondary (i.e., attention and relevance) variables ........................................................................................................... 44 Figure 3-3. Hypothesized relationships among variables, with major and minor research questions indicated .............................................................................................. 46 Figure 4-1. Correlations among the mediating variables for the experimental ideas chapter (**p<.01) ............................................................................................................... 74 Figure 4—2. Correlations among the mediating variables for the scientific fairness chapter (**p<.01) ............................................................................................................... 73 _ Figure 4-3. Correlations between the mediating variables and measures of immediate and delayed learning for the experimental ideas chapter ................................. 73 Figure 4-4. Correlations between the mediating variables and measures of immediate and delayed learning for the scientific fairness chapter ................................... 76 Figure 4-5. Hypothesized effects of humor in instructional text ....................................... 97 Figure 4-6. Connections among variables for the experimental ideas chapter .................. 98 Figure 4-7. Connections among variables for the scientific fairness chapter .................... 98 xiii Figure 5-1. Revision of model, showing factors that influence the perception and appreciation of humor in instructional text and the outcomes of humor ......................... 127 xiv CHAPTER 1: INTRODUCTION Statement Of the Problem Student motivation contributes to school performance: students who are motivated to learn are likely to learn more (Brophy, 1998) (see Figure 1-1). But how can we facilitate motivation to learn in traditionally less motivating situations, such as when students must engage independently with a textbook? Textbooks are frequently used as a supplement to traditional expository instruction, and often as a part of discovery learning as well. But students report they do not find academic reading to be interesting or enjoyable, and they are not affectively involved with such reading (Lorch, Lorch, & Klusewitz, 1993). Unfortunately, instruction will only be effective if students are engaged with it (Okey & Santiago, 1991). All text-based instruction has an affective component, and a “heavy” approach, such as that found in most textbooks or in a formal lecture, is less likely to draw learners in (Rowell & Van Kirk, 1978). How can we motivate students to want to read textbooks? motivation learning Figure 1-1. Motivated students are likely to learn more. “.. up" ‘ “\,. Pa .440 \‘ 7. v ' K an Past research on‘t’ext-Ibas’ed instruction provides several ways to increase learner motivation, including increasing the perceived relevance of the instruction (Means, Jonassen, & Dwyer, 1997); using headings, overviews, and summaries (Lorch, Lorch, & Inman, 1993); activating prior knowledge (Spires & Donley, 1998); and increasing the concreteness or case of imagery (Sadoski, Goetz, & Fritz, 1993). Research on classroom instruction suggests additional methods for increasing student engagement that may be useful in the development of text-based instruction, including instructor immediacy and use of humor. Understanding the differences between academic reading and leisure reading may provide clues regarding how we can facilitate student engagement with texts. Lorch, Lorch, and Klusewitz (1993) found that students reported academic reading to be cognitively demanding, requiring memorization, self-testing of understanding, and close attention. Students also reported that they read academic material more slowly. In contrast, they reported leisure reading to be more enjoyable, more interesting, more emotionally involving, and less cognitively demanding. Students reported that they read leisure material more quickly. They were more likely to anticipate and to visualize when reading for leisure, and they were less critical and distractible. This was true even when the leisure reading was intellectually challenging or when the purpose was to learn something in an area of interest. When we develop instructional text, how can we tap into the aspects of leisure reading that reduce students’ cognitive burden and increase learner interest in the text? Perhaps there are techniques we can use to make the reading more enjoyable and interesting, such as by accessing students’ positive feelings. Toward that end, Alexander, Kulikowich, and Jetton (1994) asserted that interest stimulates depth of processing which, in turn, enhances learning. Isen, Daubman, and Gorgoglione (1987) suggest that positive affect may enhance learner retention by increasing the connections the learner makes and thereby increasing the learner’s integration of new information with prior knowledge. Positive affect can be enhanced through the use of humor, and many opinion articles have been published on the perceived benefits of humor in education and training (e.g., Parrott, 1994; Wandersee, 1982; Korobkin, 1988; Peterson, 1980; Robbins, 1994). Controlled studies of humor in the classroom (e. g., Kaplan & Pascoe, 1977; Bryant, Comisky, Crane, & Zillmann, 1980) provide support for the positive effects of humor on student recall. Perhaps humor incorporated into textbooks can increase learning, in addition to enhancing learner interest and enjoyment of the topic of the reading. Figure l- 2 shows the potential outcomes of humor incorporated into text-based instruction. cognitive outcomes: --learning {fihlér§§t humor in text q—Itv-L: ' affective outcomes: ,v-enjoyment '3 :-interest Figure 1-2. Humor's potential effects on both cognitive and affective outcomes, including learning, interest, and enjoyment Figure 1-3 shows the hypothesized potential benefits of humor in text, including some of the intermediate variables as inferred from the literature. cognitive outcomes: l I «learning --interest affective I I outcomes: «enjoyment --interest . relevance humor In text ——> . anennon Figure 1-3. Mediating variables that may influence the effects of humor in Briefly, these variables are defined as follows and will be measured as indicated. (See chapters 2 and 3 for more in-depth discussions of these variables, and see chapter 4 for the specific items associated with each scale.) 0 Humor is a quality that makes something seem funny or amusing. Humor will be measured by self-reports of subjects’ perceptions and, to a lesser extent, by evaluations of other readers who identify humorous items in the text. 0 Relevance refers to whether the text meets the personal needs or goals of the learner. Perceived relevance will be measured by self-reports. 0 Attention refers to mental concentration and will be measured by self- reports. 0 Learning refers to retention and understanding of information and will be measured by recall and recognition quizzes. Subjects will also be asked to report on their perceptions of their learning. 0 Interest is a feeling of intentness about something and can affect learners both cognitively and affectively, increasing both the learners’ knowledge of the topic and their positive feelings (Krapp, Hidi, & Renninger, 1992). Interest can be specific to an individual or associated with the particular situation. Interest will be measured by self-reports. 0 Enjoyment is the act or state of getting pleasure from something and will be measured by self-reports. If we can find out what effects humor in text has on learning, interest, and enjoyment, then we will have clues that can help us address the much larger problem of student motivation in learning. Thus, the central question of this study is: Does humor in text-based instruction affect learning, interest, and enjoyment? Rationale and Significance of the Study The purpose of this study is to examine the effect of humor in text-based instruction on learning, interest, and enjoyment. Although the model presented earlier shows multiple potential effects of humor, I have chosen to focus on humor’s effects on learning, interest, and enjoyment because I believe these are three significant goals of instruction. Obviously any techniques we can discover that will help improve learning (as measured through tests of recall and recognition) are desirable. However, enhancing learner interest in and enjoyment of a topic are also worthy goals that may in turn lead to further study. When I tell other people that I am studying humor and learning, the most common response I get is an assertion that humor enhances learning, followed by an anecdote relating a humorous incident in a classroom or training session. However, despite most people’s perceptions of the positive effect of humor on learning, the numerous books and articles written on how to incorporate humor into your classroom or training sessions (e.g., Loomans & Kolberg, 1993; Watson & Emerson, 1988), and the numerous studies on the positive effects of humor in the classroom (e. g., Ziv, 1988; Kaplan & Pascoe, 1977; Bryant et al., 1980), there are very few studies on the effect of humor in text on learning. In fact, Schmidt (1994) noted that no comparisons had been made between humorous and nonhumorous materials that were matched. He further stated that “in an appropriate test of the effects of humor, the content of the material must be controlled, ruling out explanations that are based on interest” (p. 953). A review of the literature has indicated no such comparisons. In this study, I intend to look at the effects of humorous vs. nonhumorous materials that are matched on content and explore humor’s effects on learning, interest, and enjoyment. Overview of the Study To answer the central question— Does humor in instructional text affect learning, interest, and enjoyment?—I developed humorous and nonhumorous text materials and assessed reader learning via recall and recognition, as well as interest and enjoyment. Readings were adapted from Doing Psychology Experiments, a textbook on experimental psychology by David Martin. Two versions of two different sections of this text were developed—one version of each section was humorous, and one version had the humor removed but retained Martin’s informal, conversational tone. Since a conversational tone has been found to increase reader perception of relevance and enhanced interest (Rowell & Van Kirk, 1978; Means et al., 1997; Paxton, 1997), this study explored the effect of humor on these variables over and above what might already occur as a result of the conversational tone. Subjects read the humorous version of one chapter and the nonhumorous version of the other chapter. After each reading, subjects were given two quizzes, one open-ended and the other multiple choice. To see if the independent variable was operating, I asked subjects to rate how humorous they found each reading. I also asked subjects how interesting, enjoyable, and relevant they found each reading, and how well each reading held their attention. Two weeks after participating in this part of the study, subjects completed another quiz, because other researchers and my own pilot study indicated that humor may enhance learner recall, but only for delayed recall and not for immediate recall. There were significant differences in subjects’ responses to the two chapters on several of the variables, so I was unable to collapse the data across topics as I had planned, and therefore unable to compare humorous readings to nonhumorous readings. For each of the chapters, I looked at the effect of humor on 1) learning, as indicated by measures of recall (measured by the open-ended quizzes) and recognition (measured by the multiple-choice quizzes) of facts and concepts in both immediate and delayed testing conditions, 2) interest, 3) enjoyment, 4) relevance), and 5) attention. I also had subjects compare the two chapters they had read on a variety of dimensions. Humor in Text-Based Instruction I chose to study humor in text materials instead of in the classroom because text allows for a greater amount of experimental control than is possible in a classroom situation. Studies suggest that spontaneous humor in the classroom is more effective (i.e., more humorous) than planned humor, which makes a controlled study of humor in the classroom difficult. Also, some instructors are naturally more humorous than others, which means they may have to suppress a natural tendency toward humor in order to provide a control condition. I am not convinced that such suppression affects only humor in the classroom without affecting other aspects of the instructor’s style. In addition, the lack of studies on the effect of humor in academic text makes this area ripe for study. Overview of the Dissertation This dissertation has five chapters: Chapter I .' Introduction As you have already seen, the introduction gives an overview of the research project, including a statement of the problem, the rationale and significance of the study, the purpose of the study, and an overview of the study. Chapter 2: Literature Review In order to establish a model of the theory I tested, Chapter 2 provides a review of relevant literature, particularly in regarding the interrelationships of humor, interest, enjoyment, and learning. This review also documents the parts of the model presented in chapter 3 that are supported by prior research. Chapter 3: Methods The methods chapter provides a detailed description of how the study was carried out, including descriptions of the subjects, instruments, and procedures. Chapter 4: Results Chapter 4 describes the analyses that were run on the data. Chapter 5 : Discussion The discussion compares the hypothesized results to the actual results, and provides possible explanations for discrepancies. CHAPTER 2: LITERATURE REVIEW In this chapter, I provide evidence from the literature indicating that it is reasonable to expect humor in instructional text to affect learning, interest, and enjoyment. As stated in chapter 1, I have chosen to study humor’s effect on learning, interest, and enjoyment because I believe these are important goals of instruction. Obviously we want our students to learn, but if we can stimulate their interest in learning and increase their enjoyment of learning, we may increase the likelihood that they will seek out, or at least be open to, additional experiences with the subject matter. Figure 2-1 illustrates the hypothesized effect of humor in instructional materials. interest humor ——> learning enjoyment Figure 2-1. Hypothesized effects of humor in instructional Student learning from text is influenced by numerous variables, including prior knowledge (Alexander, Kulikowich, & Schulze, 1994); engagement (Sadoski, Goetz, & Rodriguez, 2000); personal and situational interest (Krapp et al., 1992); affect (Bless, 2001; Fiedler, 2001); text structure, including use of headings, overviews, and summaries (Lorch, Lorch, & Inman, 1993); purpose of reading (Narvaez, van den Broek, & Ruiz, 1999); case of imagery, or concreteness (Sadoski et al., 1993); and author visibility (Nolen, 1995; Paxton, 1997). Some of these variables were beyond the scope of this study and were either held constant across conditions (e.g., text structure) or assumed to wash out through random assignment of subjects to conditions (e.g., prior knowledge). Students who are motivated to leam are likely to learn more than unmotivated students (Brophy, 1998). Motivation is strongly linked to interest and enjoyment: according to (Deci & Ryan, 1985), behavior that is intrinsically motivated is, by definition, interesting and enjoyable. I propose that humor in text, if it is found to have an effect on learning, influences learning in part by increasing reader enjoyment and interest. In other words, I hypothesize that interest and enjoyment not only are important outcomes of instruction by themselves, but also may influence learning. Figure 2-2 shows this relationship. interest A humor " i learning 1 enjoyment Figure 2-2. Interest and enjoyment as mediating variables between humor and learning 10 Humor may also aid learning by directing learners’ attention and increasing perceived relevance, which facilitate encoding and retrieval of information. Attention and relevance may interact with interest and with each other, ultimately affecting learning. Figure 2-3 shows the model taking these variables into account. / attention relevance interest humor ’ learning enjoyment . Figure 2-3. Hypothesized effects of humor in instructional text on both primary (i.e., learning, interest, and enjoyment) and secondary (i.e., attention and relevance) variables In summary, the assertions upon which this study is based are as follows: 0 Humor increases learning of the topic presented humorously. 0 Humor increases interest in the topic presented humorously. 0 Humor increases enjoyment of the topic presented humorously. 0 Interest increases learning. 0 Enjoyment increases learning. 0 Interest and enjoyment influence each other. 11 0 Humor increases attention, which interacts with interest to increase learning. 0 Humor increases relevance, which interacts with interest and attention to increase learning. Below, I begin my review of the literature by summarizing research related to the effect of humor on learning. I then discuss the expected effect of humor on my other two outcome variables, interest and enjoyment, and the effects of these variables on learning. I also discuss the mediating effects of relevance and attention on learning, and their relationship to interest. The Nature of Humor Humor is “the quality that makes something seem funny, amusing, or ludicrous” (Agnes, 2000). Any study on of the effects of humor should perhaps begin with a discussion of the nature of humor; specifically, how humor works. Numerous theories of humor have been proposed: in a 1998 article describing his theory of humor, Veatch noted that 619 papers on various theories of humor had been written to date. The main humor theories are the cognitive—perceptual or incongruity theory, the social—behavioral or superiority theory, the arousal theory, and the psychoanalytic theory (Johnson, 1990; Goldstein, 1993). The cognitive—perceptual or incongruity theory proposes that humor is the result of a disparity between what is expected and what actually happens. Humor is found when ideas that do not belong together are joined. This theory posits that humor is a two-stage process: the audience first has to perceive the disparity and then resolve or understand it (in other words, they have to “get” the joke). Perception of the disparity is subjective and 12 may be affected by the “values, attitudes, knowledge, and expectations” of the audience (Goldstein, 1993, p. 247). The social-behavioral or superiority theory suggests that humor is the result of disparagement of others. This theory is based on the idea that we laugh at the failings and mistakes Of others so that we can feel superior to them (Goldstein, 1993). Barreca (1991) noted that men and women use this type of humor differently: men tend to disparage those they consider inferior, such as people with lower intelligence or those with physical handicaps, while women will make fun of those in positions of power, such as supervisors and bosses. The arousal theory sees humor as a release of tension. According to this theory, tension increases as the punch line nears. When the punch line is delivered, arousal is increased sufficiently to produce amusement or laughter (Goldstein, 1993). The psychoanalytic theory proposes that “laughter [can] be symptomatic of conflict, repressed sexuality, and anger,” and that humor is a powerful defense mechanism (Goldstein, 1993, p. 247). Freud noted that “tendentious” jokes are sexual or aggressive in nature and so tend to elicit a stronger emotional reaction than “innocent” humor (Veach, 1998). _ In his (unnamed) theory of humor, Veach proposed that “humor occurs when it seems that things are normal while at the same time something seems wrong” (p. 164). In other words, the situation is seen as predominantly normal, while at the same time a violation of the way things ought to be is perceived. Veach argues that this theory is more accurate than the more popular and widely cited incongruity theory on the grounds that 13 many incongruities do not necessarily produce humor (note, for example, the many incongruities that arise during scientific study that do not elicit a humorous reaction). Regardless ofthe type of humor or the theory used to define it, humor is largely a function of the perceiver. Certain events may strike some people as enormously funny, yet fail to elicit even a smile in others. Despite this, a fair amount of humor will be universally rated as humorous or at least recognized as an attempt at humor. Effects of Humor on Learning Despite individual differences in the perception of humor, there are some types of humor that are more universally accepted than others. In an attempt to verify that the intervention intended to be humorous was perceived by subjects as such, I asked subjects in this study to rate the materials on their “humorousness.” There is theoretical support for the effect of humor on learning. According to dual coding theory, comprehension and memory of text are affected by both verbal (e.g., text, speech) and nonverbal (e. g., imagery, affect) systems (Sadoski et al., 1993). The effects of these two systems are additive—we understand and remember more if both of these systems are engaged than if we rely on only one. Obviously, text will engage the verbal system. Humor, on the other hand, will enhance comprehension and memory by stimulating affect. Humor and text combined should have a powerful effect on learning. Studies of Humor and Memory Humor has been proposed to have numerous effects that increase memory for humorous information. Some researchers (e. g., Karis, Fabiani, & Donchin, 1984; Schmidt, 1991) argued that the incongruity component of humor (i.e., that humor results when ideas are presented out of context or in unusual combinations) leads to an increase 14 in attention. Alternatively, Schmidt and Williams (2001) hypothesized that the attempt to resolve the incongruities in order to understand the humor involves greater cognitive processing, which leads to an increase in learning. Yet another hypothesis is that subjects rehearse humorous material more, which leads to an increase in learning and memory of the humorous items (Schmidt, 1994). A study by Schmidt and Williams (2001) attempted to separate the effects of humor from those of incongruity and “bizarrencss.” They found that humor, separate from incongruity and bizarrencss, enhanced recall. They concluded that humor itself is the “potent mnemonic variable” (p. 307). The actual resolution of the humor or the perception of humor that resulted, rather than an attempt to resolve the humor, enhanced recall. Humor enhanced memory even when the influence of intentional verbal rehearsal was minimized. Schmidt and Williams (2001) concluded that their findings weaken the argument that rehearsal explains the effect of humor on memory. In an additional study, Schmidt and Williams (2001) found that the “humorousness” of cartoons was directly related to subjects’ memory of them: the most humorous cartoons were remembered better, and the cartoons rated in the upper half of “humorousness” were recalled better than those in the lower half. These results indicated that humor itself, rather than incongruity, resolution of incongruity, bizarrencss, or distinctiveness, enhances recall for cartoons (Schmidt & Williams, 2001). Studies of Humor in the Classroom There is moderate support for the effect of humor on learning in the classroom. Although publications on humor and adult learning appear to be largely anecdotal (e.g., Parrott, 1994; Wandersee, 1982; Korobkin, 1988; Peterson, 1980; Robbins, 1994), a few 15 controlled studies of the use of humor in the classroom have appeared in the literature (e.g., Bryant et al., 1980; Ziv, 1988). Perhaps one reason for a lack of empirical research on humor in the classroom is its almost inherent uncontrollability: doing a controlled study either would require instructors who are naturally humorous to suppress this tendency, perhaps resulting in differences in the way they interact with their classes more globally, or would require instructors who are not humorous to attempt to be funny on demand. Since the “best” classroom humor is perceived as spontaneous (Bryant et al., 1980), planned humor by nonhumorous instructors would probably yield unnatural, and possibly uninterpretable, results. Studies of Humor in Text Perhaps even more surprising than the lack of controlled studies of humor in the classroom is the almost complete lack of studies of humor in instructional materials. After all, there is a large amount of humor available in printed form (for example, in books, magazines, and newspapers). Unfortunately, humor does not appear to be prevalent in instructional materials. As I was preparing for this study, I sent an e-mail to 61 people, including family members, friends, professors, fellow students, and current and former coworkers, requesting references to humorous instructional materials they knew of. I received about a half dozen recommendations, none of which were suitable for my study (e.g., they were cartoon-based rather than text-based, or the author’s writing style was conversational rather than truly humorous). Humor appears to be a casualty of “textbookese,” the third-person expository style used in most textbooks that makes few, if any, references to either the reader or the writer (Crismore, 1984). Rather, most textbooks give the impression that their contents are delivered from an omniscient “other” who 16 lacks any apparent viewpoint, opinions, biases, or personality. A sense of humor would certainly be out of place in this style of writing. Despite the dearth of humor in textbooks, there is evidence to suggest that humor in instructional materials may contribute to both learning and the perception of learning. In the evaluation of a basic computer literacy self-study module, 67 percent of respondents felt that the humor contained within the module had helped them learn (Sheppard, 1998). This study is supported by a classroom study conducted by Mogavero (1979), in which 95 percent of students felt that humor increased the effectiveness of instruction. In addition, Zillmann and Bryant (1983, cited in Robbins, 1994) found that humor that is well integrated with the material can lead to greater retention of the information and make learning more enjoyable. In 1994, Schmidt noted that no comparisons had been made between humorous and nonhumorous materials that were matched. He further stated that “in an appropriate test of the effects of humor, the content Of the material must be controlled, ruling out explanations that are based on interest” (p. 953). A review of the literature since that time has revealed no studies that satisfy these criteria. In this study, I intend to fill that gap by looking at the effects of humorous vs. nonhumorous materials that are matched on content and exploring humor’s implications for learning, interest, and enjoyment. Effects of Humor on Enjoyment Although ideally humor will enhance learning, another important outcome of humor in instructional materials is to increase learner enjoyment. Enjoyment is a specific form of positive affect that refers to pleasurable experiences. Affect is a broad term that refers to both mood (an enduring trait of an individual that is not tied to any definite 17 event) and emotion (a more intense, short-lived state that generally has a specific cause) (Forgas, 1991). A learner who enjoys the learning experience may be more receptive to, and perhaps even seek out, additional experiences with the topic. There is evidence in the literature to support a link between humor and enjoyment. Humor is enormously popular in our society. Comedy is among the most popular television genres, and as of the early 19903, over 40 percent of the all-time top 100 rental movies and the all-time highest-rated television shows in the United States were comedies (Goldstein, 1993). Humor facilitates a change from a bad or mediocre mood to a more positive mood (Zillmann & Bryant, 1985; Zillmann, 1988; Bryant & Zillmann, 1989). Comedy allows individuals to “regulate their own emotional states”— people may actively seek out humor and comedy in order to positively affect their mood (Zillmann & Bryant, 1985). This study will determine if the link between humor and enjoyment holds true for humor in instructional materials. Effects of Humor on Interest and Attention Interest has been defined as “liking and willful engagement in a cognitive activity” (Schraw & Lehman, 2001, p. 23). Interest is a feeling of intentness about something that can affect learners both cognitively and affectively, increasing both the learners’ knowledge of the topic and their positive feelings (Krapp et al., 1992). Attention refers to capturing the learners’ interest and stimulating curiosity to learn (Keller, 1987); by definition, then, attention is closely related to interest. Interest is demonstrated through behaviors that include attention (Krapp et al., 1992), and interest results in spontaneous rather than selective allocation of attention (Hidi, 1990). 18 Potential benefits of humor in the classroom include increased interest and attention, increased comprehension and retention of the material, increased motivation toward learning, increased satisfaction with learning, more positive attitudes, and decreased boredom (Korobkin, 1988; Parrott, 1994); some of these benefits may also apply to print materials. In addition, the use of humor in the classroom enhances the student-teacher relationship, particularly students’ perceptions of instructor immediacy (i.e., physical and psychological closeness) (Gorham & Christophel, 1990). Based on the studies of visible authors (defined as authors who write in the first person and reveal personal opinions and other aspects of themselves), it may be reasonable to believe that humor in text can also take advantage of some of the benefits of instructor immediacy. Despite our love of humor and its apparent links to learning, if there is too much humor in instruction, the presenter may cross the line between having the purpose of his or her presentation interpreted as informative and having it interpreted as entertainment. But humor in appropriate amounts may help maintain student interest and attention, thereby resulting in greater enjoyment of learning. Support for this assertion comes from Ziv (1988) and Bryant et al. (1980), who found that three to four instances of humor during an hour classroom lecture was not only the average (Bryant et al., 1980), but also the ideal (Ziv, 1988). Ziv also found that the humor must be related to the concepts presented in the class in order to enhance understanding; if the humor is unrelated to the material presented, it can actually distract students from the main ideas. Effect of Humor on Perceived Relevance Relevance refers to meeting the personal needs and goals of the learner (Keller, 1987). There is no evidence in the literature to link humor to perceived relevance. 19 However, there are certain devices—such as immediacy and visible author—that have been shown to increase learners’ perceived relevance of material, and I am curious about whether humor is able to extend or compound these effects. Humor may also have a community-building mechanism that helps to increase perceived relevance. Use of the word “you” has been shown to increase readers’ perceived relevance of written materials (Means et al., 1997). Although use of a visible author has not been linked directly to increased perception of relevance, a visible author creates an atmosphere of collaboration with the reader (Paxton, 1997). Readers who are engaged by an author may be more likely to perceive the material as relevant—readers may unconsciously associate this engagement with the author as personal relevance. Humor goes beyond both the use of “you” and use of a visible author by endowing the author not just with visibility, but also with personality. In addition, if humor helps to build a community, as argued by Cohen (1999), and the reader feels a part of this community, he or she may perceive an increased relevance of the materials. In other words, if readers feel that the humor is targeted toward them, they may be more likely to conclude that the instructional material in which the humor is embedded also is targeted toward them more directly. Effects of Enjoyment on Learning In addition to being an important outcome of instruction, learner enjoyment may also facilitate learning. Students’ positive feelings toward a task or topic can increase their learning, both directly by fostering connections with prior learning and by facilitating use of general knowledge structures, and indirectly by increasing the likelihood that students will seek additional experiences with the task or topic. 20 Organization Isen et al. (1987) hypothesized that “positive affect results in an organization of cognitive material, wherein either more or broader (or more integrated) categories are primed and utilized than is the case under control conditions. That is, under conditions of positive affect more different kinds of material are brought to mind and dealt with at the same time, there is a tendency to see relationships and group things together, and ideas that ordinarily would not seem to bear upon one another are seen as related or similar and holding implications for one another” (pp. 147-148). Building on what the student already knows and helping him or her form relationships between new knowledge and previous learning and experiences is one of the crucial elements of sound instruction. Even minor differences in learners’ affective states may have a substantial impact on their cognitive processes (Bless, 2001). In general, individuals experiencing a positive affective state are more likely to rely on general knowledge structures—that is, heuristics, stereotypes, or scripts they use on a regular basis. In other words, “individuals in a positive affective state may feel more confident about relying on activated general knowledge structures that are potentially applicable to the situation” (p. 11). In contrast, individuals interpret a negative affective state as signaling a problem. When a problem exists, individuals may find it risky to rely on general knowledge structures, so they may instead attempt to deal with the problem by devoting their attention to the specific details. If we assume that problematic situations are deviations from normal situations, then relying on the knowledge we would usually apply during normal situations would probably not be the best approach. 21 Nonproblematic situations require less attention to the specifics. In these cases, the individual can rely on general knowledge structures, which saves processing resources. These spared resources can then be allocated to other aspects of the situation or to other tasks. This “transfer” of resources is highly adaptive, since it frees up attention for those aspects of the situation for which additional processing is potentially more beneficial and effective (e.g., inconsistent information). Individuals experiencing positive affect rely on general knowledge structures, which frees up additional attention resources to exploring the match between the knowledge structure and the available information, with inconsistencies triggering additional processing. Therefore, this mechanism allows for a flexibility in attention to the specifics of a situation. General knowledge structures enable the individual to enrich the stimulus information by making inferences beyond the information given (Bruner, 1957). Individuals who go beyond the information given may sometimes come up with new, creative inferences (Bless, 2001 ). New situations confer a certain amount of risk, so it would seem highly adaptive to rely on general knowledge structures as a basis for making inferences, especially if the situation is safe rather than problematic (Bless, 2001). By extension, if we can trigger positive affect (e.g., enjoyment) through the use of humor in instruction, we may enable learners to activate general knowledge structures and make connections to prior knowledge. Learning Sets According to F iedler (2001), “Over a long period of (ontogcnetic or even phylogenetic) learning, organisms acquire different generalized learning sets for positive versus negative situations that emphasize either exploration and curiosity or avoidance 22 and vigilance” (p. 93). In other words, a learning environment that promotes positive affect encourages exploration and creativity, while aversive learning situations (i.e., those that promote negative affect) maximize behaviors directed toward avoiding mistakes. In order to avoid the negative consequences of aversive learning situations, avoidance behavior must be reliable and attentive to potentially threatening stimuli. In contrast, in positive learning situations, the individual does not have to monitor any stimuli as carefully and can instead trust in internalized knowledge and behavioral routines. Negative mood (and the implied aversive learning situation) supports sticking to the stimulus facts and avoiding mistakes, while positive mood enables creative functions such as active generation and enrichment of the stimulus input with inferences based on prior knowledge. “Positive affective states signal the absence of dangers and obstacles so that the individual can take the risk of unusual, creative, exploratory behaviors” (Fiedler, 2001, p. 92). Even superficial and transitory affective cues, such as those manipulated by aspects of the situation, may be as effective in bringing forth certain learning sets (i.e., those associated with either positive or negative affective states) as more “genuine” emotions (Fiedler, 2001). I propose that the use of humor in text may provide affective cues that help elicit learning sets associated with positive affect. As educators, it behooves us to use whatever means we have available to help learners make meaningful connections between what they already know and what they are learning. Isen et al. (1987) noted that “positive affect leads to a change in the way material is categorized, and this supports the more general formulation regarding the influence of positive affect on cognitive organization” (p. 151). Oddly, however, Isen et al. obtained these effects after inducing positive affect by giving the subjects a small gift 23 or juice and cookies, or by having subjects watch five minutes of a comedy video—in other words, through methods that were unrelated to the topic under study. This is consistent with Fiedler’s (2001) assertion that superficial cues may be effective in stimulating the learning sets associated with positive emotions. But if favorable changes in cognition are observed even when the methods of improving affect are not related to the topic under study, what is the potential impact when affect is positively influenced via the instruction itself? This brings us back to the potential of humor that is integrated into the main ideas being learned (Ziv, 1988). Perhaps by integrating humor into texts, we can take advantage of the effects of positive affect on learning compounded, perhaps, by direct relatedness to the topic being studied. Controlled studies offer support for the role of affect in learning. In a study of reader recall of feature articles from popular magazines, Sadoski and Quast (1990) asked subjects about factors that influenced their recall. They found that affect was the most frequently mentioned subj ectivc characteristic—readers mentioned the presence of feelings as reasons for remembering text and lack of feelings as a reason for not remembering. The article that readers had, overall, rated the lowest in terms of affect was also the article that was most often reported as completely forgotten. This is consistent with a study of non-directed (i.e., incidental) learning from text, in which enjoyment of the text was positively associated with both perceived comprehension and text recall (Ryan, Connell, & Plant, 1990). Visible Author Rowell and Van Kirk (1978) asserted that self-instruction modules, by their very presence, have an affective component: learners form opinions about the subject based on 24 the reading, and it is necessary for module designers to include “fun parts” to maintain the learners’ attention and encourage students to stick with reading that may not appear interesting at the outset. They argued that a “predominantly cognitive, academic module” (p. 13) does not have to be dense and boring. They proposed instead that a conversational tone could help indicate to the student that the module presenter (writer, speaker, etc.) is aware of him or her as an individual, rather than just directing the information into a void. An author who is able to incorporate humor into instructional materials may also convey his or her enjoyment of the topic. Many students can recall an experience in which they found an instructor’s enthusiasm contagious. Along similar lines, recent research indicates that a visible author can have a positive effect on learning. Paxton (1997) had students think aloud as they read history texts that had either an invisible author (defined as an author who writes in the third person and reveals little or nothing of his or her own outlook or views) or a visible author. Students who read the text with the visible author engaged in mental conversations with the author, which led to a closer relationship with the information contained in the text. Students who read a text with an invisible author failed to engage with the text—Paxton (1997) wrote, “Student response to anonymous text might be characterized as passive boredom. These students showed practically no signs of engagement” (p. 245). In think-alouds while reading the anonymous text, “students gave little independent thought either to the author or to the subject matter. In short, the anonymous text imparted to students no feel for the subject of history, aside from the feeling that they would just as soon be doing something else” (p. 245). Readers of the visible text were “10 times more likely to give personal thought to the historical 25 information presented in the text. The visible author sought to create a rhetorical atmosphere of empathy and collaboration with the reading audience. These students— even the one who disdained the visible author—reacted positively to this approach” (p. 245) Similarly, Nolen (1995) found that women reading text containing a visible author interacted with the author while reading, which seemed to “influence the relations among comprehension, motivation, and affective response” (p. 47). In a similar vein, Bergin (1999) noted that the way students interact with a text could be considered an aspect of social interaction. He further noted that the extent to which students perceive that an activity allows them to socialize (even if it’s with the author of a text), they will tend to be interested in the activity. A text that contains humor may additionally increase learning by further reducing the social distance between the reader and the text. In summary, enjoyment of learning may have multiple positive effects on learners, including facilitating the integration of new learning into prior knowledge, engaging learning sets, and enhancing student engagement with the text. Effects of Interest on Learning According to Krapp et al. (1992), interest emerges from an individual’s interactions with his or her surroundings. They note that different researchers attribute different amounts of significance to each component in this person—environment interaction. Personal (or individual) interests tend to be relatively stable within an individual and are usually associated with increased knowledge and positive emotions. Personal interests are dependent on the individual’s characteristics, attitudes, and 26 orientations (Krapp et al., 1992); personal interest is enduring and context-general (Schraw & Lehman, 2001). An example from my own life is my interest in forensic science—I enjoy reading books by forensic psychologists, forensic anthropologists, and even forensic entomologists, and I try not to miss “Medical Detectives” and “Secrets of Forensic Science” on The Learning Channel. This is a topic I enjoy learning more about, and as a result of the time and effort I spend pursuing this interest, I imagine that I know more than the average person about certain aspects of forensic science. In contrast, situational interests can be elicited more universally (i.e., in many individuals regardless of their individual interests) through the use of certain devices (e.g., narrative style) or characteristics (e.g., novelty) of the presentation (Krapp et al., 1992); situational interest is generally spontaneous and context-specific (Schraw & Lehman, 2001). Situational interest, which can be evoked by something in the environment, usually has a short-term effect. An example of situational interest from my life has to do with a Nova episode on automotive safety technology. Nova was the least objectionable show I found while channel surfing during a late lunch on a Friday afiemoon. I had no interest in automotive safety, but the Nova developers have a remarkable ability to take a subject that I think of as a real snoozer and turning it into something fascinating. I was very involved during the episode, and I feel that I learned a lot about the evolution of automotive safety. I am probably more receptive to additional information on automotive safety, but I would not necessarily go out of my way to find out more about it. Despite the distinctions made between individual and situational interest, these two forms of interest interact with and influence each other (Hidi, 2000). Specifically, 27 situational interest may serve as the basis for the emergence of individual interests. In addition, personal interest may influence situational interest by moderating the effects of environmental variables on interest (e.g., an individual who has a personal interest in a particular topic may be bored by a book or article on that topic if it tells him or her nothing new). Krapp et al. (1992) refer to “actualized interest,” which is demonstrated through particular behaviors, such as relatively effortless attention that is focused, prolonged, and accompanied by feelings of enjoyment. This actualized interest is the result of an interaction between internal and external conditions (i.e., individual and situational interest, respectively). Schraw and Lehman (2001) described a taxonomy of interest. They divided individual interest into latent interest (i.e., “a long-term orientation toward a particular topic” [p. 29] and actualized interest (i.e., “a topic-specific motivational state that determines one’s engagement style in an activity” [p. 30]. Latent interest, in turn, comprises feeling-related and value-related interest. In other words, latent interest is composed of things we are interested in because we like them or because we feel they have some value to us. Situational interest, according to Schraw and Lehman (2001), is divided into text- based interest (i.e., interest based on properties of the information to be learned), task- based interest (i.e., instructions that change the individual’s goals), and knowledge-based interest (i.e., the effect of prior learning on interest). By incorporating humor into text, this study will tie into aspects of both personal interest (specifically, the feeling-related interest that Schraw and Lehman described) and situational interest (specifically, text- based interest). 28 The presence or absence of interest, whether individual or situational, influences the type of learning strategies individuals employ. When learners are interested in what they are learning, they tend to use deep-processing strategies—they attempt to examine the material from different perspectives, make diverse connections, and identify and solve problems on their own (Krapp et al., 1992). In contrast, learners who are not interested use surface-level strategies, relying largely on memorization to “learn” material. Alexander, Kulikowich, and Jetton (1994) also noted, “Interest, particularly one’s personal investment in the topic or domain, stimulates depth of processing in the content and, thus, enhances subject-matter learning” (p. 217). According to Hidi (1990), “Interest elicits spontaneous, rather than conscious, selective allocation of attention” (p. 549) and, therefore, may result in learning that requires less cognitive capacity and effort. There is substantial support in the literature for the assertion that interest, whether individual or situational, influences learning. For example, Wade and Adams (1990) found that interest had “a powerful effect on recall for both good and poorer readers” (p. 331) and that seductive details and main ideas (both rated as interesting) were best remembered, while details supporting the main ideas were least well remembered. High interest is associated with greater recall of text information for both structured and unstructured recall tasks (Garner & Gillingham, 1991), and learner interest is significantly related to recall of main ideas, elaborations, and idea units (Schiefele & Krapp, 1996). In summary, interest facilitates learning by directing learners’ attention to the topic at hand and engaging deep-processing strategies which facilitate encoding and retrieval of information. 29 Effects of Attention on Learning If learners don’t pay attention to the instruction, it seems unlikely that they will get anything out of it. The idea behind Keller’s “attention” is that grabbing and holding the students’ attention is an essential characteristic associated with motivation, and is necessary for any learning to occur. Humor would fall into this component of the ARCS model, since it would be a part of the supporting strategy of “including emotional content” under attention’s subcategory of perceptual arousal. There are several theories about the relationship between interest and attention and their effects on learning. One theory suggests that increased interest leads to increased attention (Anderson, 1982, cited in McDaniel, Waddill, F instad, & Bourg, 2000). A second theory is that interest results in a spontaneous allocation of attention, which frees up cognitive resources which can then be used for more flexible and efficient processing of the text (Hidi, 1990). A third theory agrees that interest results in spontaneous allocation of attention, but suggests that this enables the reader to focus on “organizational and situational elements implied by the text” (McDaniel et al., 2000) (p. 500). In contrast, readers who are not interested in what they are reading must expend resources to keep attention focused on merely extracting meaning from the text. Support for the effect of interest on attention comes from a study which found that interest did not affect recall of stories, but high-interest stories required fewer attentional resources for understanding than did low-interest stories (McDaniel et al., 2000). Keller’s ARCS model of motivation delineates four requirements that must be met in order for people to be motivated to learn: the student’s attention must be gained and sustained, the material must be [elevant to the student, the student must be gonfident 30 that he or she can learn the material, and the student must be gatisfied with the process of the experience (Keller, 1987). One of the theories on which this model is based is the expectancy x value model of motivation. This expectancy x value model maintains that “the efforts that people are willing to expend on a task is the product of (1) the degree to which they expect to be able to perform the task successfully if they apply themselves (and thus the degree to which they expect to get whatever rewards that successful task performance will bring), and (2) the degree to which they value those rewards as well as the Opportunity to engage in the processes involved in performing the task itself” (Brophy, 1998), p. 14). The value dimension of the expectancy x value model is most closely related to Kellcr’s attention and relevance components, while the expectancy dimension is more closely linked to confidence and satisfaction (Keller, 1979). Okey and Santiago (1991) support Keller’s assertions, noting that regardless of how well designed instruction is, it will only be effective if learners are engaged with it. They further point out that motivational design and instructional design are complementary, rather than conflicting, ideas, and that instructional designers who wish to produce engaging instruction should link the ideas of motivational design to a theory of instructional design. Integrating humor into text may be one way to do this. Although this study is not intended to determine the relationship between attention and interest, I believe that these are separate constructs and that humor may influence both. In my analysis of the data resulting from this study, I will explore the relationship between these two constructs. Such a close relationship between interest and attention will make it difficult to tease apart these two constructs. However, in my 31 research, I will develop separate scales for individual interest, situational interest, and attention to determine if they can be measured separately. Effects of Perceived Relevance on Learning As stated earlier, relevance is one of the four elements of Keller’s ARCS model necessary for individuals to be motivated to learn. In order for a student to sustain motivation, he or she must perceive that the instruction meets important personal needs (Keller, 1983). Perceived relevance of material may influence the amount of mental effort learners are willing to expend to learn (Cennamo & Braunlich, 1996). In a study of print- based text that had been motivationally enhanced to increase perceived relevance, subjects who received the motivationally enhanced lesson remembered more information than those who received the nonenhanccd version. The authors suggest that learners may take time to elaborate on the content of an enhanced lesson—specifically, they may stop to reflect on how the material applies to them and contexts in which they will be able to use the information. Main (1992) notes that “the very act of establishing an instructional goal implies some value to the person, organization or society in its achievement” (p. 18). We enhance a student’s desire to learn and to spend effort learning by helping them see the relevance to their job specifically or to their life more generally. Main further notes that the affective domain (including relevance) is particularly important to address in instruction that removes the interaction between the teacher and the student from the lesson delivery, such as occurs in text-based instruction. 32 A study by Means et al. (1997) found that perceived relevance was related to higher motivation and better posttest scores. Materials that had embedded strategies to enhance relevance increased learner motivation and achievement. In summary, there is both theoretical and empirical support for the effect of relevance on learning, and subjects’ perceived relevance can be enhanced in text through use of certain strategies. Conclusion In conclusion, there appears to be support in the literature for the links among humor, interest, enjoyment, and learning shown in Figure 2-4. Classroom studies provide interest A humor " b learning V enjoyment Figure 2-4. Hypothesized effects of humor, and relationships among the three main outcome variables evidence for an effect of humor on learning. There are strong indications in the literature for the effect of interest on learning, and moderate indications for the effect of enjoyment on learning. Both interest and enjoyment are considered to be positive affective states and are linked in the literature on learning. Perhaps the weakest links, at least empirically, are those between humor and interest, and between humor and enjoyment; however, the fact 33 that people actively seek out humor (in some cases because they want to change a poor mood into a good mood) implies that humor generates or enhances positive affect (of which interest and enjoyment are subcategories). In theory, then, humor in text should enhance learning through its effects on interest and enjoyment. The research I propose will determine if this theory holds up in a controlled study. 34 CHAPTER 3: METHODOLOGY Research Questions and Overview My research question was: Does humor in instructional text affect learning, interest, and enjoyment? In this chapter, I describe the study designed to answer this question, including the participants, the materials, and the procedures. I also list the questions that guided the research. Finally, I describe limitations of the study. Pilot Study I conducted a pilot study on the effect of humor in instructional materials in the spring of 2000 to see if there was any evidence for humor’s effects on learning, interest, and enjoyment. I recruited subjects through TEISO, an introductory course in teacher education, in large part because these were the students I had access to—TAs for these courses allowed me into their classrooms to recruit subjects. The research had two phases. During the first phase, 18 subjects provided demographic information and their initial reactions regarding how interesting and relevant they believed each of the two topics of the readings (i.e., getting an experimental idea and making instruction meaningful) was to them. Subjects read a humorous version of one chapter and a nonhumorous version of the other chapter. Readings were counterbalanced, with some subjects reading a humorous chapter first, and others reading a nonhumorous chapter first. Topics were also counterbalanced, with some subjects reading the chapter on getting experimental ideas first, and others reading the chapter on making instruction meaningful first. After reading each chapter, subjects answered both short-answer and multiple-choice questions about ideas contained in the text. Subjects also answered questions regarding the presentation of the material and their reaction to it, 35 including how interesting, informative, humorous, and relevant they found each chapter. Subjects answered questions specifically about the acceptability of the humorous version and the effect of humor on the information being conveyed. Subjects compared the two versions on several measures, such as which they found easier to stick with, which they would be more likely to find in a textbook, and which they would select for leisure reading. In the delayed recall phase, which took place one week after the initial session, I e-mailed short-answer and multiple-choice quizzes on both topics to all subjects in order to measure delayed recall. The short-answer quiz was the same as that presented during the initial session, but the multiple-choice quiz was different. Fourteen subjects responded to the e-mail. Findings Learning Because humor is a subjective phenomenon and to be sure the variable “humor” was operating, I asked subjects to rate how humorous each of the versions was on a five— point Likert scale (l=strongly agree that the chapter was humorous; 5=strongly disagree). Subjects reported the humorous versions to be significantly more humorous than the nonhumorous versions (t(17)=4.61, p<.001, y=1.09), indicating that subjects did, indeed, perceive a difference in humor in the two pieces. This validated my subjective judgment and allowed me to proceed with analyses comparing reactions to and learning from humorous and nonhumorous versions of text. There was no significant difference on immediate recall between subjects who had read a humorous version and those who had read a nonhumorous version (t(18)=0.40, 36 p=.70, y=.l3). However, differences in delayed recall between humorous and nonhumorous versions approached significance (t(l4)=1.87, p=.07, y=.7l). These findings are consistent with Kaplan and Pascoe's (1977) findings that humor integrated into a lecture did not appear to significantly affect immediate recall of information presented in that lecture, but that students exposed to humor performed significantly better on items testing recall of examples presented humorously. One question these findings raise is the effect of a longer delay period than I had used; specifically, what is the optimal delay for measuring the effects of humor on memory of the content of a single presentation of humorous instructional material? In addition, I made no attempt in my analyses to link questions on the recall quizzes to humor in the text. For the dissertation, I explored the link between recall of specific items and use of humor in the text. I asked subjects what the two most important ideas were that they had learned from each chapter. Several of the subjects reported that getting ideas through observation was an important idea from the experimental ideas chapter, regardless of which version they read. There seemed to be a slight tendency for readers of the humorous experimental ideas chapter to recall affective items (e.g., students do not need to be afraid of trying to come up with experimental ideas), while readers of the nonhumorous version remembered more cognitive items (e.g., can extend other research, ideas do not have to be complicated to be important); however, the small sample size (and my own biases, which may have influenced interpretation) causes me to question the reliability of these results. Two of the eight subjects who read the humorous version remembered a humorous acronym (ROT) that referred to the importance of experimental questions 37 being repeatable, observable, and testable, while none of the eight subjects who read the nonhumorous version listed this as one of the two most important ideas they had learned. When asked to list the two most important ideas from the meaningfulness chapter, readers of the humorous version appeared to recall more ideas relating to the importance of making instruction meaningful (e.g., valuing students’ input, the teacher’s role in helping make things meaningful), while readers of the nonhumorous version seemed to recall more techniques (e.g., how to motivate students, how to reinforce information). Again, the small sample size raises the question of the relationship between humor and learning, but does not provide clear answers. The larger sample size for the dissertation research enabled me to explore the types of information subjects remember and their relationship to humor. Interest Subjects reported that they found the humorous versions to be significantly more interesting than the nonhumorous versions (t(17)=2.56, p=.02, y=.60); however, expression of interest in reading more about the topic was not significantly hi gher for the humorous versions (t(17)=1.00, p=.33, y=.24). Interest dropped significantly for both the humorous (t(17)=3.00, p<.01, y=.70) and nonhumorous (t(17)=4.37, p<.01, y=1.03) versions from before reading to after. Although it is unclear why interest dropped, this may have been due to the satisfaction of an initial sense of curiosity (Lowenstein, 1994). This effect merits further examination, but doing so is beyond the scope of this study. The subjects’ reports of interest correlated positively with test scores, although correlations with immediate recall scores were not significant. Subjects’ reports of interestingness of the text and interest in the topic were correlated with delayed recall 38 scores (r=0.47, p=.12, r2=.22, and r=O.45, p=.15, r2=.20, respectively). This is consistent with Alexander, Kulikowich, and Jetton’s (1994) assertion that interest can stimulate depth of processing and so enhance subject-matter learning. Although it is unclear why this was more evident for the delayed recall than for the immediate recall, it may be that the effects of recency are sufficient to override any additional effects of depth of processing. Research on why this occurs goes beyond the scope of this study. Enjoyment The pilot study did not include a direct measure of subject enjoyment. My dissertation research asked directly about enjoyment of each reading, and I asked subjects which of the two readings they enjoyed more. Other Effects of Humor Subjects found the humorous versions to be significantly more informative (t(l 7)=2.3 8, p=.03, y=.56) than the nonhumorous versions, and subjects felt they had learned more from the humorous texts (t(17)=2.50, p=.023, y=.59). I have no explanation for these effects. I attempted to replicate these findings with my dissertation work; however, determining how or why humor affects subjects’ perceptions of how informative text is and how much they learned from it was beyond the scope of this study. There was also a tendency (though nonsignificant) to view the humorous text as more personally relevant (t(17)=l .88, p=.08, y=.44). There have been reports in the literature that conversational text and use of the word “you” can increase perceived relevance (Means et al., 1997). The fact that humor seemed to increase perceived 39 relevance when compared to text that used these other techniques may be worth exploring at some point in the future; however, it was beyond the scope of this study. Subjects felt that humor supported the information it was trying to convey (mean=1.9; 1=strongly agree, 5=strongly disagree). Subjects disagreed that humor detracted from the information it was trying to convey (mean=4.l), that they would have found the materials more instructional if they had not been funny (mean=4. l ), or that they would have learned more if the text had not attempted to be humorous (mean=4.2). Combined with the findings that subjects recalled more in the delayed recall quizzes, these findings led me to believe that humor may affect student learning. As based on previous research and shown in Figure 2-3 on page 10, humor may affect learning through any of a variety of mechanisms, including increasing attention, relevance, interest, and enjoyment. I designed this dissertation research to test the relationships among these variables. Subjects, in general, reported that they found it easier to “stick with” the chapter on getting experimental ideas, although this was influenced somewhat by humor. The reason for this difference is not clear, although I suspect it may have something to do with the amount and type of information being conveyed: the chapter on getting experimental ideas covered a fairly broad range of topics, compared to the chapter on making instruction meaningful, which covered a smaller number of topics in considerably more depth. Possible Confounding Factors There appeared to be some effects of the topics presented on subject recall and recognition of the material. For the pilot, I prepared two versions of each of two different 40 chapters. For one reading, I made minor modifications to a humorous chapter from an experimental psychology text (i.e., getting experimental ideas) for the humorous version, and performed a “humorectomy” (i.e., removed the humor) for the nonhumorous version. For the other reading, I used a nonhumorous chapter on making instruction meaningful that was written in a conversational style and attempted to “humorize” it. This process involved reading through the text carefully and recording humorous comments as they occurred to me. I then met with one or more others and we went through the readings paragraph by paragraph, brainstorming possible humorous additions to each paragraph. Making the text humorous was a struggle, and my perception was that some of this “humorization” may have come across as forced. (People who read the text prior to the pilot study confirmed this perception; however, the text was not changed significantly at that time, since these readers confirmed my subjective belief that the humorous version was more humorous than the nonhumorous version.) In addition, the text for the reading on meaningfulness went into considerably more depth on a rather narrow issue, while the experimental ideas reading covered a fairly broad area in less depth. The meaningfulness chapter may therefore have provided a heavier cognitive burden on the subjects and made it more difficult for them to remember without more concentrated study of the material. Average test scores for subjects reflect this difficulty: subjects scored an average of 56 percent on the test for experimental ideas immediately after reading, and 30 percent on the meaningfulness chapter. Subjects scored 39 percent on the test of experimental ideas after one week, vs. 23 percent for the chapter on meaningfulness. 41 The reading on experimental ideas also contained humorous drawings that were not reproduced in equivalent form in the nonhumorous text. I do not have any feel for how these illustrations may have affected student learning. For the dissertation research, I will remove all illustrations so all effects of humor come from the text and not from illustrations. Summary In summary, there appeared to be several relatively positive benefits Of humorous text compared to text written in an infomtal, conversation style: greater recall in the delayed condition, greater perception of personal relevance, and increased student interest. Although not all of these findings were statistically significant, these tendencies in such a small sample size made me believe this was a study worth pursuing. I have listed the major and minor research questions and related research questions for the dissertation study on the following pages. Major Research Questions The major research questions reflect what I believe to be significant effects of instruction: learning, interest in the topic, and enjoyment of the instruction. Figure 3-1 shows a model of the hypothesized relationships among the main variables. 1. Do learners recall more facts and recognize more concepts from a humorous version than from a nonhumorous version of text immediately after reading? la. How does humor’s proximity to tested items relate to subject recall and recognition ofthat information? 42 interest humor learning enjoyment Figure 3-1. Hypothesized effects of humor in instructional Do learners recall more facts and recognize more concepts from a humorous version than from a nonhumorous version of text two weeks after reading? 2a. How does humor’s proximity to tested items relate to subject recall and recognition of that information? Do learners report greater enjoyment of the humorous version than the nonhumorous version? Do learners express greater post-reading interest in the topic presented in the humorous version than in the topic presented nonhumorously? 43 Minor Research Questions The minor research questions explore the mechanisms by which humor affects learning. Figure 3-2 shows the model with the secondary variables included. attention H——-> relevance interest humor ' learning enjoyment Figure 3-2. Hypothesized effects of humor in instructional text on both primary (i.e., learning, interest, and enjoyment) and secondary (i.e., attention and relevance) variables 1. Which version will subjects report held their attention better? 2. Do subjects perceive humorous material to be more personally relevant than nonhumorous material? 3. Is interest related to enjoyment? 4. Is interest related to self-reported attention? 5. Is perceived relevance related to self-reported attention? 6. Is relevance related to interest? 7. Is self-reported interest correlated with subjects’ scores on the quizzes? 8. Is enjoyment related to learning? 9. Is self-reported attention related to learning? 10. Is perceived relevance related to learning? 44 Related Research Questions The related research questions are not illustrated in the model (i.e., Figure 3-2) but are related to learner reactions to the use of humor in instructional text, and to other potential effects of humor. 1. Do subjects perceive humorous material to be more informative than nonhumorous material? 2. How do subjects feel humor affects the information presented (e.g., does humor support or detract from the information)? 3. Do subjects believe they learn more from humorous materials than from nonhumorous materials? 4. Do subjects spend more or less time reading humorous materials? Model Figure 3-3 shows the hypothesized relationships among the variables. Solid lines indicate relationships that are supported by the literature. Dotted lines indicate possible relationships (either suggested but not directly supported by the literature, and/or suggested by the pilot study). Major and minor research questions are indicated by the letters M and m, respectively, along with the number of the question. For example, the dotted line connecting humor to learning is a hypothesized relationship, and tests major questions 1 and 2. 45 attention fl—m5—h relevance | Ieaming enjoyment / Figure 3-3. Hypothesized relationships among variables, with major and minor research questior indicated Of my three outcome variables (i.e., learning, interest, and enjoyment), only learning appears as an endpoint in the model. Although I am interested in humor’s effects on learner interest and enjoyment, I also hypothesize that these variables are mediating variables that will affect learning. These three variables appear in boxes with a thicker outline. The figure is not a comprehensive model of all the variables that may influence humor’s effect on learning. For example, humor may affect the amount of effort readers are willing to expend, and it may enable learners to better tap into their prior knowledge of a topic by increasing positive affect (Alexander, Kulikowich, and Jetton, 1994). However, I felt that adding additional variables to the model would substantially increase the complexity of the study, without contributing enough to the field’s understanding of humor’s effect on my three main variables to justify their inclusion. 46 Dissertation Study Subjects I was able to gain access to the following courses in order to recruit subjects for my research: 0 TE150, Reflections on Learning, an introductory course in the department of teacher education. 0 CEP260, Dynamics of Personal Adjustment 0 CEP 261, Substance Abuse 0 PSY255, Industrial/Organizational Psychology I arranged to recruit subjects during either the first or last five minutes of class, as arranged with the instructors in advance. During this time, I gave a brief description of the study and handed out additional information about the study and a list of available times. I also informed students that the study was not limited to education majors or to students in education courses (or, in the case of the psychology course, to majors or students in psychology), and invited them to sign up with friends or roommates. By recruiting in this manner, I hoped to attract a more diverse subject pool than I would have gotten had only education students enrolled in these courses participated. A power analysis indicated that I would need a subject pool of approximately 80 subjects, assuming (1 = .05, B = .7, and an effect size ofone-quarter (i.e., .25) ofa standard deviation. This effect size is considered small according to Cohen (1992). All subjects were required to be native English speakers, since the informal writing style or use of humor could be confounded by cultural variables in which it may be considered inappropriate to address the learner directly or in which the use of multiple 47 meanings of words may be lost, as might occur in a play on words. Subjects who participated in the pilot study were not allowed to participate in the dissertation study. A total of 133 subjects started participation in the study, and 126 completed the study. One subject was dropped from the study because she discussed answers to the delayed quiz with another subject (this second subject was dropped for other reasons). Of subjects who completed the study, 21 subjects were dropped from the analyses because they did not find the chapter that was intended to be humorous as more humorous. This criteria for dropping subjects was decided before data collection began. I considered alternatives, such as analyzing subjects according to the chapter they found more humorous rather than the chapter that was intended to be humorous; however, while humor in text can be manipulated, subjects’ perceptions of that humor cannot be. I also considered analyzing subjects according to which chapter was intended to be humorous, regardless of which chapter they found more humorous; however, I decided to conduct this study under conditions as close to ideal as possible, specifically, with subjects who perceived the humor as it was intended to be perceived. Once the effects of humor on this “ideal” group are determined, 1 can begin to look more at individual differences in subjects’ perceptions of humor and the effects of those differences on the outcome variables. This left me with usable data from 104 subjects. Of these 104 subjects, 103 were between the ages of 18 and 24, 100 had been students continuously since graduating from high school, 103 were undergraduates, and 41 were education majors. Fifty-three of the subjects read the humorous version of the experimental ideas chapter and the nonhumorous version of the scientific fairness chapter. The remaining 51 subjects read 48 the humorous version of the scientific fairness chapter and the nonhumorous experimental ideas chapter. I conducted this study in accordance with policies of the University Committee for Research Involving Human Subjects (UCRIHS). Subjects provided informed consent prior to participating in the study and were debriefed after completion of the study. Materials My original plan was to present all chapters (i.e., readings) via paper and all quizzes and questionnaires via computer. However, Murphy’s Law was in full force: the software I selected to present the quizzes was unable to support such a large project (i.e., 176 questions with 16 branching options). As I was attempting to get the computer program to work, I pursued an alternative means of presenting this information via computer (i.e., hiring a web programmer to develop a program to present the questions and collect the data), which also failed to work out. Given these roadblocks, I resorted to the computer-age equivalent of stone knives and bearskins (also known as “paper and pencil”) to collect the data. Instructional Modules The instructional modules provided a means for manipulating the independent variable, humor. In order to separate the effect of humor from the effect of an informal, conversational tone of voice, I developed two sets of instructional materials—a humorous version and a nonhumorous version for each of two topics—in order to provide the counterbalancing described in the section on research design (see page 50). Readings were drawn from David W. Martin’s Doing Psychology Experiments, specifically, the chapters titled “How to Get an Experimental Idea” and “How to Be Fair With Science.” I 49 received permission from Dr. Martin and from the publisher to use these sections of the book. The experimental ideas chapter was already humorous, and few modifications were required to prepare the humorous version for the pilot study. (See Appendix A for humorous [version F] and nonhumorous [version C] versions of this reading.) For the nonhumorous version of this chapter, the humor was removed and, where possible, replaced with nonhumorous infomration. The author’s informal, conversational tone was retained in the nonhumorous version. The scientific fairness chapter was written in an informal, fairly conversational tone. The text itself did not contain much humor, so with the help of others, I added humor to the chapter (see Appendix B for humorous and nonhumorous versions). I attempted to keep the humorous and nonhumorous versions of each topic the same length by having humorous material correspond with nonhumorous material; however, I was not always be able to find appropriate replacement material for the nonhumorous versions. Because of this, the humorous versions were approximately 10 percent longer than the nonhumorous versions. The humorous version of the experimental ideas chapter was approximately seven pages of 10-point type presented in two columns. The humorous chapter on being fair with science was slightly over eight pages. Quizzes The quizzes were developed to answer the question: Do learners learn more from humorous versions of text? I created one set of short-answer questions and two sets of multiple-choice questions for each topic. I developed questions that: 50 0 represented what I would want students to know about the ideas presented in the chapter, 0 asked about information that was likely to be remembered by readers, 0 were not too difficult (i.e., they did not require a memory for trivial details), 0 were not too easy (i.e., they could not be answered by simply reading the headings), and o addressed the main ideas. I used the same short-answer questions for both immediate and delayed recall, since these questions focused predominantly on facts. Also, since short answer questions are uncued, there was little likelihood that subjects would recall the answers they provided in the immediate recall condition when they completed them again for the delayed recall condition. Because it seemed that there was greater likelihood of subjects remembering their answers to the multiple-choice questions, my original plan was to use two sets of multiple-choice questions for each chapter, and randomly assign subjects to one of the versions for the immediate recognition condition and to the other version for the delayed condition. I developed several fact questions, which were randomly assigned to the two versions. I also developed matched questions about concepts covered in the chapters. These questions were then randomly assigned to the two versions, with one question of each pair assigned to each version. I ran reliability analyses on these instruments after collecting data from 25 subjects. Despite random assignment of the questions to the two versions of the quizzes, 51 for both topics one version of the quiz was highly reliable (coefficient or = .72 and .63 for version B of experimental ideas and version A of scientific fairness, respectively) and the second version was a dud (coefficient or = -.41 and .33 for version A of experimental ideas and version B of scientific fairness, respectively). Items with a corrected item total correlation less than .30 were dropped from the quizzes, and remaining items were aggregated into a single quiz for each topic. (See Appendix C for quiz questions and answers for both chapters.) Although it was possible that subjects would remember the questions and their answers from the immediate tests of recall when they were given the delayed test, my committee and I decided that this was far preferable to continuing to use instruments that lacked reliability. Questionnaires The questionnaires were designed to provide answers to the questions regarding whether students find humorous text more interesting and enjoyable than nonhumorous text (research questions M3 and M4). Even if I were to find no effect of humor on learning, I might have found that humorous text was more interesting and enjoyable for students. I developed questionnaires for the pilot test to gather information on the following: 1. subject demographics, including year in college, age, major, and number of years since high school graduation that the subject was not enrolled in courses, in order to determine the diversity of my subject pool. I also asked subjects if they were born and raised in the United States, since 52 cultural factors may influence perception of humor, particularly its appropriateness in instructional text. 2. initial reactions to the topics regarding how relevant and interesting subjects found each topic. These questions were intended to help me determine humor’s effect on perceived relevance and on subject interest in the topic. 3. input on the presentation of the materials, including a rating of the humorousness of each chapter. In the pilot study, the questionnaires asking for subjects’ initial reactions to the topics and to the presentation of the material included only a single item for each construct (attention, relevance, etc.). In order to be able to determine reliability for these constructs, I had to create at least three items for each construct. I used the items from the pilot study as a base (e.g., “I am interested in this topic”), and then wrote additional items using synonyms or similar wording (e.g., “I expect this chapter to be interesting”) or by using antonyms and reversing the scale (e.g., “I expect this topic to be boring”). Reliability analyses for each scale are reported in chapter 4. Research Design Subjects read the humorous version of one tOpic and the nonhumorous version of the other topic. Two combinations and four permutations of materials were possible: 0 humorous experimental ideas/nonhumorous fairness, 0 humorous fairness/nonhumorous experimental ideas, 0 nonhumorous experimental ideas/humorous fairness, and o nonhumorous faimess/humorous experimental ideas. 53 The order of presentation of these chapters to subjects was randomized. The design was a within-subjects design, with each subject participating in both experimental and control conditions. This design allowed subjects to compare the humorous and nonhumorous materials on such aspects as which reading they found more enjoyable and which they would select for leisure reading. Although this design introduced the possibility of an interaction (i.e., content x humor), this problem did not arise in the pilot study. (An interaction would be a problem because it would leave me unable to interpret main effects, such as an overall effect for humor.) Assuming no interactions, this design would allow me to collapse the data across subjects and compare the effects of humorous materials to those of nonhumorous materials in the statistical analysis. This design raised the possibility of contamination or cuing—after subjects read one chapter and before they read the next chapter, they were asked questions about how humorous they found the chapter. These questions may have cued subjects that humor was one of the variables being studied. However, with the counterbalanced design, I expected this cuing to affect all groups equally. I felt that the enhanced power provided by a within-subj ects design outweighed the potential negative effects of cuing. Procedures I developed the materials so subjects could read all text and answer all questions within about two hours. Two hours was chosen as a limit because 1) I did not think it was reasonable to expect subjects to be able to concentrate for a period longer than that, 2) two hours allowed me to present a reasonable amount of material, and 3) two hours seemed like a fair amount of time for subjects to spend for the compensation I was able to offer. 54 I recorded the time it took each subject to read each chapter. This enabled me to determine reading speed for humorous and nonhumorous materials and determine if students spent more or less time reading humorous materials. Since Lorch, Lorch, and Klusewitz (1993) found that college students reported reading academic material more slowly than leisure material, I expected a comparison of the time it took subjects to read the humorous and nonhumorous chapters to provide an indication of whether the humorous text tapped into aspects of leisure reading. I conducted the study in conference rooms and classrooms on campus. Subjects participated in the study in groups of up to 12, but subjects worked independently. Although conducting the study with different numbers of subjects in each group introduced an additional element of variability, I was forced to work within the constraints of the system. Despite my attempts to schedule subjects in groups of eight, some time periods were much more convenient to subjects and, where possible, I accommodated additional students at these times. Since subjects were randomly assigned to the four conditions, I expected that any effects of the number of participants at a single time would affect all groups equally. Materials and questionnaires were presented via paper to subjects sequentially in the following order: 1) consent form, 2) questionnaire on demographics and initial reactions to topics, 3) one chapter, 4) questionnaire on presentation, 5) questionnaire on use of humor if chapter presented was humorous (no questionnaire specific to the nonhumorous version was presented), 6) short—answer quiz, 55 7) multiple-choice quiz, 8) another chapter, 9) questionnaire on presentation, 10) questionnaire on use of humor if chapter presented was humorous, l l) short-answer quiz, l2) multiple-choice quiz, and 13) questionnaire on a comparison of the two topics. Approximately 10 days after the first session, I sent subjects an e-mail telling them that I would be sending the session 2 questions via e-mail and giving them the option of returning to the study site to complete session 2 in person. Two weeks after the first session, I sent subjects the session 2 questions via e-mail. The purpose of this second quiz was to explore delayed recall and long-term retention of ideas in the materials. Although Kaplan and Pascoe (1977) found significant differences between humorous and nonhumorous conditions six weeks after presentation, I chose a delay period of two weeks for two reasons: 1) in my pilot study, differences between humorous and nonhumorous groups approached significance using a delay period of one week, and 2) I anticipated that a six-week delay period would prove unwieldy—such a delay would likely put the delayed recall period into or after exam week for some students, and students might even forget that they had agreed to take part in a study. Unfortunately, a savvy test-taker could determine the answers to some of the short-answer questions from the multiple-choice questions. For this reason, the short-answer items were sent first and in a separate e—mail than the multiple-choice items, and I requested that subjects complete the short-answer items before opening the e-mail with the multiple-choice questions. Subjects received $25 for participating in this study, with $10 paid in cash after the first session and $15 paid after completion of the delayed recall quiz. Subjects who 56 participated in session 2 in person were paid in cash; subjects who completed session 2 via e-mail were paid by check. This amount of compensation averages out to about $10 an hour, which was comparable with subject compensation in other research projects. 57 CHAPTER 4: DATA ANALYSIS Scale Reliability This research used 11 subscales to determine subject attributes on the following dimensions: pre-reading interest, pre-reading perceived relevance, perceived informativeness of chapters, attention, personal interest, situational interest, perceived use of humor in the chapters, post-reading perceived relevance, enjoyment, self-perceptions of learning, and perceptions of the humor as supportive of text. Each subscale contains three or four items, as shown in Table 4-1. Subjects rated each item on a five-point Likert scale, with 5 indicating strong agreement and 1 indicating strong disagreement. Items were scaled so a high number (i.e., 5) indicated more of the attribute being measured and a low number (i.e., 1) indicated less of the attribute. Items that were reverse-scaled (so that a high number indicates more of the attribute) are indicated with “(R).” Scale items for enjoyment and situational interest were modified from the Intrinsic Motivation Inventory for text material (Deci & Ryan, 2000). Other scales were developed by writing items similar to those that were used in the pilot test. Although these items had face validity, I did not determine construct validity for the items. I used the reliability function on the Statistical Package for the Social Sciences (SPSS) computer program, version 10.0, to determine the alpha reliability of each of these subscales. The alpha reliability provides an estimate of the amount of variance observed that is attributable to variance in the subjects’ true scores (Crocker & Algina, 1986). I tested the reliability of each of these scales after collecting data from the first 25 subjects to determine if changes were needed to any of the subscale items, and again after collecting data from all subjects. With the exception of perceived learning, no modifications were 58 needed to any of these subscales based on the first 25 subjects. Dropping one question (“I already knew the information in this chapter”) from the perceived learning subscale resulted in an acceptable reliability. Table 4-1 shows the questions and the alpha reliabilities for each subscale. In order to derive a single score for each subject on each subscale, I averaged the ratings for each subject for the items on each scale. Alpha reliabilities were calculated separately for the two chapters and appear in italics for the experimental ideas chapter and in bold for the scientific fairness chapter. Table 4-1. The eleven subscales used in this research, with the items representing those subscales indicated below each subscale name and the alpha reliabilities for the experimental ideas and scientific fairness chapters both for the first 25 subjects and for all subjects Alpha Reliability (experimental ideas, scientific fairness) Subscales Initial (after Final 25 subjects) Pre-reading interest .80] 7 .8710 0 I am interested in this topic. .6473 .8478 o I expect this topic to be boring. (R) o I expect this chapter to be interesting. Pre-reading perceived relevance .8188 .8110 o This topic is relevant to me. .8295 .7845 o I expect the information in this chapter to have some value for me. o I expect the information in this chapter to be beneficial for me. Perceived informativeness . 7739 . 75 73 o This chapter was informative. .6925 .5141 o This chapter had a lot of information. o This chapter conveyed very little information relative to the amount of text. (R) 59 Table 4-1 (cont’d). Attention .9350 .8714 o I found it difficult to pay attention to the .9593 .8956 material in this chapter as I read it. (R) o This text held my attention. 0 It was easy for me to concentrate on this chapter. Individual (personal) interest . 7356 .9125 o I would like to read more about this topic. .9262 .9245 0 Now I am interested in this topic after reading this text. 0 I would like to know more about this tOpic. Situational interest .8239 .9015 o This chapter was boring. (R) .8786 .9028 o This chapter was interesting. 0 I would describe this material as interesting. Perceived use of humor in the chapters .941 7 .9259 0 This chapter was humorous. .9626 .9365 o I think the writer of this chapter has a good sense of humor. 0 I thought this chapter was funny. Post-reading perceived relevance .7889 .84 71 o This topic was relevant to me. .8537 .8711 o The information in this chapter will be beneficial to me. o The information in this chapter has some value to me. Enjoyment .9085 .9225 o I enjoyed reading this chapter. .9339 .9292 o I liked reading this chapter. 0 This chapter was fun to read. 60 Table 4-1 (cont’d). Self-perceptions of learning .7031 .6523 0 I already knew the information in this chapter. .7928I .7791 (R) 0 This chapter was written in a way that made it easy for me to learn. 0 I found it difficult to learn from this chapter. (R) o I learned a substantial amount from this text. Humor supportive of text (humorous chapter only) .7492 .8364 0 The humor in this text supports the information .9034 .8424 it’s trying to convey. o The humor in this piece detracts from the information it’s trying to convey. (R) o I would have found this piece more instructional if it had not used humor. (R) o I would have learned more if this text had not attempted to be humorous. (R) I determined actual learning (as compared to perceived learning) through a composite score of recall (i.e., open-ended) and recognition (i.e., multiple-choice) items for each subject for each reading for both immediate and delayed recall. In other words, there were four learning measures for each subject: «- immediate measures of learning of ideas in the experimental ideas chapter 0 delayed measures of learning of ideas in the experimental ideas chapter 0 immediate measures of learning of ideas in the scientific fairness chapter 0 delayed measures of learning of ideas in the scientific fairness chapter 1 Initial reliability for this scale was .5255 and .6809 for experimental ideas and scientific fairness, respectively. With one item deleted from the scale, reliability was .7031 and .7928 for experimental ideas and scientific fairness, respectively. 61 A Note on the Analyses I had designed this study so that subjects would serve as their own controls by reading the humorous version of one topic and the nonhumorous version of the other topic. My intention was to collapse the data across the topics so I could look at the effects of humorous text vs. nonhumorous text on the dependent variables (e.g., personal and situational interest, enjoyment, attention, perceived relevance). However, as I started to examine the data, it appeared that there were differences in subjects’ perceptions of the two topics. I decided to examine the quantitative data first as two separate studies to determine if there were differences between the two topics, and if not, collapse across the topics. I found that the subjects’ reactions to the variables listed above differed sharply between the two topics, which meant I could not collapse the topics. Rather than analyzing this as a lOO-subject, within-subjects experiment, I analyzed it as two 50- subject between-subjects experiments. Although I had hypothesized that humor would result in increases in the dependent variables, I felt it would be irresponsible of me as a researcher to fail to consider the possibility that humor may have detrimental effects on these variables. For this reason, I conducted all analyses as two-tailed tests rather than one-tailed tests in order to be able to determine significant adverse effects of humor, in addition to significant positive effects. Analysis of the data in this study involved running multiple analyses. This large number of statistical analyses increased the possibility of type I errors (since approximately one in 20 analyses will result in a statistically significant result due to chance). In order to reduce the likelihood of type I errors, I used a Bonfcronni correction, 62 which involved dividing the alpha level by the number of null hypotheses that could be considered to be in the same “family,” or measuring similar ideas. For example, for major research question 1a (i.e., How does humor’s proximity to tested items relate to subject recall and recognition of that information?), there are five independent variables for the learning dependent variable, so each null hypothesis was tested at a/5=.01. In addition to providing the value of the statistics below (e.g., the t value for t- tests and the r value for correlations), I have provided the significance level (p),and the effect size. For the t-tests, the effect size is noted as y and was calculated as the mean divided by the standard deviation. The 7 value corresponds with the following effect sizes: small, y=.20; medium, y=.50; and large, y=.80 (Welkowitz, Ewen, & Cohen, 2000). For the correlations, the effect size is noted as r2, and was calculated by squaring the r value. R2 corresponds to the following effect sizes: small, r2=.01; medium, r2=.09; and large, r2=.25 (Cohen, 1992). Descriptive Statistics of Scales Tables 4-2 and 4-3 show the mean, standard deviation, possible range, and actual range for each of the scales used in these analyses, for the knowledge quizzes, and for the reading time per page. Table 4-2. Means, standard deviations, and ranges for experimental ideas scales, includig both humorous (H) and nonhumorous (NH) versions Experimental Ideas Scales Version Mean Standard Possible Actual Deviation Range Range Pre—reading interest H 3.44 .67 1-5 2-5 NH 3.63 .70 l -5 Pre-reading relevance H 3.45 .69 1-5 2-5 NH 3.68 .66 2-5 63 Table 4-2 (cont’d). Reading time per page H 3.18 .56 1.48-4 NH 2.90 .55 1.77-2.58 Informative H 3.94 .54 167-5 NH 3.90 .50 1’5 2335 Attention H 3.94 .58 233—5 NH 3.64 .77 1'5 2-5 Personal interest H 3.25 .81 2-5 NH 3.23 .86 1'5 1.33-5 Situational Interest H 3.90 .57 2-5 NH 3.59 .81 1'5 1.33—5 Relevance H 3.42 .64 2-5 NH 3.58 .74 1'5 35 Perceived Learning H 3.97 .44 15 267-5 NH 3.82 .59 2.33-5 Enjoyment H 3.74 .68 1_5 2—5 NH 3.37 .85 1-5 Total Score—Immediate H 16.22 4.49 0-28 25-235 NH 14.18 3.48 75-21 Total Score—Delayed H 1 1.53 3.84 0-28 3-19.5 NH 10.80 3.10 3.5-14.5 Humor Supportive of Text H 3.08 .59 l-5 2-5 Table 4-3. Means, standard deviations, and ranges for scientific fairness scales, including both humorous (H) and nonhumorous (NH) versions Scientific Fairness Scales version Mean Standard Possible Actual Deviation Range Range Pre-reading Interest H 3 .44 .75 1-5 1-5 NH 3.39 .67 2-4.33 Pre-rcading Relevance H 3.64 .74 1-5 2-5 NH 3.62 .52 2.33-4.67 Reading time per page in H 3.53 .65 255-57 minmes NH 3.41 .69 2.3-5.54 64 Table 4-3 (cont’d). Informative H 3.84 .54 2.33-4.67 NH 3.94 .54 1‘5 1.67-5 Attention H 3.12 .88 133-5 NH 3.94 .58 15 2335 Personal Interest H 2.72 .85 133-5 NH 3.25 .81 1’5 2-5 Situational Interest H 3.26 .90 1-5 1-4.67 NH 3.90 .57 2-5 Relevance H 3.21 .82 1-5 2-5 NH 3.42 .64 2-5 Perceived Learning H 3.55 .81 1-5 1.33-5 NH 3.97 .44 267-5 Enjoyment H 3.14 .91 1-5 1.33-5 NH 3.74 .68 2-5 Total Score—Immediate H 19.86 6.65 0-40 7-33 .5 NH 19.87 7.88 3.5-36.5 Total Score—Delayed H 17.68 6.19 0-40 7-30.5 NH 18.04 6.08 6-29.5 Humor Supportive of Text H 3.76 .73 1-5 1.5-5 Major Research Questions My research question was: Does humor in instructional text affect learning, interest, and enjoyment? My major research questions address humor’s effect on each of these three variables (i.e., learning, interest, and enjoyment). Table 4-4 summarizes the results of the major research questions. Briefly, humor had differential effects on leaming, interest, and enjoyment depending on the topic. 65 Table 4-4. Summary of the statistical analyses of major research questions for each of the chapters Research Question Experimental Ideas Scientific Fairness M1. Does humor affect learning Yes—increase No (immediate)? M2. Does humor affect learning No No (delayed)? M3. Does humor affect enjoyment? Yes—increase Yes—increase M4. Does humor affect interest? Yes—increase Yes—mincrease (situational int.) (situational int.) No (personal int.) No (personal int.) Effect of Humor on Learning (Immediate) My first major question was: Do learners recall more facts and recognize more concepts from the humorous version than from the nonhumorous version immediately after reading? Learning was measured by open-ended and multiple-choice tests. As stated in chapter 3, only those students who perceived the humor as intended (i.e., who responded that they found the humorous version to be more humorous than the nonhumorous version) were considered in the analysis. Learners recalled significantly more information from the humorous version of the experimental ideas chapter than from the nonhumorous version, and the effect size was moderate (t(90)=2.442, p=.017, y=.51). However, there was no significant difference in recall of the different versions of the scientific fairness chapter (t(102)=.004, p=.997, y=.00). A related question was: How does humor’s proximity to tested items relate to subject recall and recognition of that information? For this analysis, specific instances of humor had to be identified and related to the questions in the quizzes. Each of the readings was rated by two people for the humor; like the subjects, each rater read the humorous version of one chapter and the nonhumorous version of the other chapter. 66 Raters were two women and two men; one man and one woman had bachelor’s degrees, and one man and one woman had bachelor’s degrees in progress. Raters were each given the humorous version of one topic and the nonhumorous version of the other topic, and asked to underline passages that they perceived had at least attempted humor. Raters wrote a number next to each passage they underlined: a three if they found the passage very humorous, a two if they found it humorous, and a 1 if they recognized that an attempt had been made at humor, but unsuccessfully. Since what people find funny varies from person to person, I wasn’t surprised that ratings of humor differed between the two raters of each chapter. In order to relate the quiz questions to the chapters, I examined those questions (or specific answers to open-ended questions) that could be linked to passages that were 1) rated as humorous by both of the raters who read the humorous chapter and 2) not rated as either humorous or attempts at humor by either of the raters who read the nonhumorous versions. I also examined questions/answers for passages that were rated humorous by all raters (regardless of humorous or nonhumorous version) or that were rated nonhumorous by all raters in order to determine if answers to specific questions were affected by overall humor in the text, rather than just specific instances of humor related to ideas in the text. Table 4-5 shows the questions and/or answers that fulfilled these criteria and were therefore compared for readers of the humorous and nonhumorous versions: 67 Table 4-5. Questions and answers related to text ideas that had clear ratings of use of humor by raters Question Answers Average Rating Average Rating of Related of Nonhumorous Humorous Text Text Martin listed nine Belief that you have to 2 0 reasons why students be a genius have trouble coming Belief that ideas must 0 0 up With experimental be com letel ori inal ideas. What are they? p y g Fear of using apparatus 2.5 0 Belief that ideas must 3 3+ sound scientific What is vicarious Getting ideas by 0 0 observation? reading other researchers’ work There was no significant difference in recall of either “geniuses” or “apparatus” (i.e., those answers that were related to humorous material in the humorous version only) between readers of the humorous and nonhumorous versions (t(102)=-.94, p=.35, y=-.20 and t(102)=1 .16, p=.25, y=.22, respectively). There was no significant difference in recall of either “original ideas” or the definition of vicarious observation (i.e., those answers that were related to nonhumorous material in both version of the text) between readers of the humorous and nonhumorous versions (t(102)=.55, p=.58, y=.10 and t(102)=1.81, p=.07, y=.36, respectively). However, there was a significant difference between the two groups on recall of “sounding scientific,” which was related to humorous text in both versions of the chapter (t(102)=3.32, p=.001, y=.69); readers of the humorous version were significantly more likely to list “sounding scientific” as one of their answers. * Two sentences were removed from this passage of the humorous version in the development of the nonhumorous version. These two sentences were rated as very humorous by both raters of the humorous version. However, the remainder of this passage, which was not rated as either humorous or as an attempt at humor by the raters of the humorous version, was rated as very humorous by both of the raters of the nonhumorous passage. 68 There was not clear agreement among the raters regarding use of humor in the scientific fairness chapter: in many cases, only one rater of the humorous version would perceived humor, while the other would perceive either an attempt at humor or no humor at all. Alternatively, raters of the humorous version would agree on the humor, but one or both of the raters of the nonhumorous version would detect humor in the equivalent passage in the nonhumorous version. For this reason, no analyses of individual questions/answers were performed for the scientific fairness chapter. Despite the disagreement between raters on the particulars of humor in this chapter, raters of the humorous version identified an average of 11 instances of humor, while raters of the nonhumorous version identified an average of three instances. Accordingly, the majority of subjects rated the humorous version of the scientific fairness chapter as more humorous than the nonhumorous experimental ideas chapter. Effect of Humor on Learning (Delayed) The second major question had to do with delayed indications of learning: Do learners recall more facts and recognize more concepts from the humorous version than from the nonhumorous version two weeks after reading? As with immediate learning, delayed learning was measured by Open-ended and multiple-choice tests. There was no significant effect of humor on delayed learning for either of the two topics (experimental ideas: t(102)=1.055, p=.294, y=.21; scientific fairness: t(102)=.300, p=.765, y=.06). Again, a related question regarding humor and delayed recall was: How does humor’s proximity to tested items relate to subject recall and recognition of that information? I performed the same comparisons for the delayed recall as for the immediate recall, with similar results. There was no significant difference in recall of 69 either “geniuses” or “apparatus” (i.e., those answers that were related to humorous material in the humorous version only) between readers of the humorous and nonhumorous versions (t(102)=-1.56, p=.12, y=-.30 and t(102)=l .76, p=.08, y=.34, respectively). There was no significant difference in recall of either “original ideas” or the definition of vicarious observation (i.e., those answers that were related to nonhumorous material in both version of the text) between readers of the humorous and nonhumorous versions (t(102)=.38, p=.7l, y=.08 and t(102)=-.76, p=.45, y=-.15, respectively). Although there was a significant difference between the two groups on recall of “sounding scientific” for immediate recall, with the Bonfcronni correction, there was not a significant difference between readers of the humorous and nonhumorous version on delayed recall ofthis item (t(102)=2.39, p=.02, y=.47). Effect of Humor on Enjoyment The third major question was: Do learners report greater enjoyment of the humorous version than the nonhumorous version? Enjoyment was measured as a composite (i.e., arithmetic average) of three Likert scale items (see Table 4-1). Subjects reported significantly greater enjoyment of the humorous version of both the experimental ideas chapter (t(96)=2.440, p=.017, y=.48) and the scientific fairness chapter (t(93)=2.839, p=.006, y=.56). Effect sizes were moderate. Eflect of Humor on Interest The final major question was: Do learners express greater post-reading interest in the topic presented humorously than in the topic presented nonhumorously? Like enjoyment, both personal and situational interest were determined by averaging the ratings of subjects on three Likert-scale items. The humorous chapter was associated with 70 significantly greater situational interest for both chapters, with moderate effect sizes (experimental ideas: t(88)=2.217, p=.029, y=.44; scientific fairness: t(102)=2.036, p=.044, y=.40). In contrast, humor had no effect on personal interest for either chapter (experimental ideas: t(101)=.l49, p=.882, y=.02; scientific fairness: t(102)=1.313, p=.191, y=.26). Minor Research Questions The minor research questions explore the mechanisms by which humor affects learning through the mediating variables, and the intercorrelations among these variables. As with the major questions, I found differences in subjects’ responses depending on the topic. Effect of Humor on Other Mediating Variables I explored two additional variables, attention and perceived relevance, as potential mediating variables between humor and learning. Table 4-6 summarizes the results. Table 4-6. Summary of the statistical analyses of major research questions for each of the chapters Research Question Experimental Ideas Scientific Faimess ml. Does humor affect attention? Yes—increase No m2. Does humor affect perceived No No relevance? Effect of Humor on Perceived Attention Attention was determined by averaging subjects’ responses to three Likert-scale items (see Table 4-1). Subjects reported that the humorous version of the experimental ideas chapter held their attention better than the nonhumorous version (t(93)=2.23 8, p=.028, y=.44). When the p value was rounded to two digits, the difference in reported attention between the humorous and nonhumorous versions of the scientific fairness 71 chapter was also statistically significant, with a low to moderate effect size (t(102)=1.965, p=.052, y=.38). Effect of Humor on Perceived Personal Relevance Relevance was determined by averaging subjects’ responses to three Likert-scale items (see Table 4-1). Subjects did not find the humorous version to be more relevant than the nonhumorous version of either the experimental ideas chapter (t(102)=1 .184, p=.239, y=.23)or the scientific fairness chapter (t(102)=l .031, p=.305, y=.20). Relationships Among Mediating Variables I made several hypotheses and provided theoretical support regarding certain re 1 ationships among the mediating variables—that is, relevance, attention, situational and p ersonal interest, and enjoyment. Table 4-7 shows my findings regarding the hypothesized relationships. Table 4-7. Summary of the statistical analyses of major research questions for each of the c h apters Re search Question Experimental Ideas Scientific Fairness m3 - Is interest related to enjoyment? Yes—positive Yes—positive m4 - Is interest related to self-reported Yes—positive Yes—positive attention? m S - Is perceived relevance related to self- Yes—positive Yes—positive reported attention? mmlevance related to interest? Yes—positive Yes—positive Although I did not make specific hypotheses about some of the relationships among these variables, for the sake of completeness I have included correlations of each 0 f tl'lese variables with all of the others. A score for each of these variables was detemined by averaging subjects’ responses to three Likert-scale items. Figures 4-1 and 4 s . . . . . . 2 Show the correlations among the medratrng variables for the experimental ideas and 72 .71“ r.29“——~ attention 4 snuafional interest v '49" .55“ relevance '69" 72“ f \.69** .86“: 1 personal interest V l—.44**————fi enjoyment ‘ .72**——J Figure 4—1. Correlations among the mediating variables for the experimental ideas chapter (“p<.01) —.41**——} attention ‘ .81**—j situational interest I .43 .64., relevance '79 74" fi \.60** .84“. 1 personal interest v enjoyment K— .75“"'———T Figure 4-2. Correlations among the mediating variables for the scientific fairness chapter (**p<.01) —.52**———p 73 scientific fairness chapters, respectively. As is noted in these figures, all of the correlations were statistically significant. With the exception of the relationship between relevance and attention for the experimental ideas chapter, which was significant at p=.003, all of these correlations were significant at p=.001. Relationship Between Perceived Relevance and Attention Perceived post-reading relevance was significantly related to attention for both the experimental ideas chapter (r=.29l , p=.003, r2=.085) and the scientific fairness chapter (F.412,p<.001,r2=.170). Relationship Between Interest and Attention I explored this question for both types of interest (i.e., situational and personal). Both types of interest were significantly related to self-reported attention for both experimental ideas (personal interest: r=.547, p<.001, r2=.299; situational interest: r=.712, p< - OOl, r2=.507) and scientific fairness (personal interest: r=.637, p<.001, r2=.405; s i tuational interest: r=.806, p<.001, r2=.650). Relationship Between Relevance and Interest Perceived post-reading relevance was significantly related to both situational and personal interest for both the experimental ideas (situational interest: r=.490, p<.001, 1.2:- 24; personal interest: r=.668, p<.001, r2=.45) and scientific fairness (situational i ht erest: r=.431, p<.001, r2=.l9; personal interest: r=.604, p<.001, r2=.36) chapters. Relationship Between Relevance and Enjoyment Perceived post-reading relevance was positively correlated with enjoyment for both the experimental ideas chapter (r=.442, p<.001, r2=.20) and the scientific fairness ch apter (r=.520, p<.001, r2=.27). 74 Relationship Between Interest and Enjoyment Both situational and personal interest were positively correlated with enjoyment for both the experimental ideas chapter (situational interest: r=.855, p<.001, r2=.73; personal interest: r=.719, p<.001, r2=.52) and the scientific fairness chapter (situational interest: r=.842, p<.001, r2=.71; personal interest: r=.753, p<.001, r2=.57). Relationship Between Attention and Enjoyment Attention was positively correlated with enjoyment for both chapters (experimental ideas: F690, p<.001, r2=.48; scientific fairness: r=.794, p<.001, r2=.63). Relationships Between the Mediating Variables and Learning I made several hypotheses and provided theoretical support for the effects of the m ediating variables on learning. Figures 4-3 and 4-4 show the correlations between each 0 f the mediating variables on both immediate and delayed measures of learning for the experimental ideas and scientific fairness chapters, respectively. Table 4-8 summarizes t h 6 results. Table 4-8. Summary of the statistical analyses of major research questions for each of the c h ap ters _R\esearch Question m ‘7 - Is self-reported interest correlated No with subjects’ scores on the quizzes? In 8 - Is enjoyment related to learning? No \ Experimental Ideas Scientific Fairness No No No “19 - Is self-reported attention related to No \leaming? m 1 0. Is perceived relevance related to learning? \ R e] a tionship Between Interest and Learning No No Neither situational interest nor personal interest was correlated with immediate l e - . . . . amlng for the experimental ideas chapter, and personal interest was not correlated With 75 relevance / .12 immediate learning .20 delayed learning / attention .17 suuafional H .18 . interest \.03 personal interest .21 \ enjoyment 1;. Figure 4-3. Correlations between the mediating variables and measures of immediate and delayed learning for the experimental ideas chapter immediate learning delayed learning / relevance .15 / attention .09 sfiuafional ‘ '20 interest \04 \ personal _10 interest \ enjoyment Figure 4-4. Correlations between the mediating variables and measures of immediate and delayed learning for the scientific fairness chapter 76 delayed learning. Although the correlation between situational interest and delayed learning was statistically significant (r=.202, p=.043, r2=.041), the effect size is too low for this correlation to be considered to have any practical significance. Table 4-9 shows the values of these statistical analyses. Table 4-9. Correlations between learning (both immediate and delayed) and interest (both ersonal and situational) for the experimental ideas chapter Experimental Ideas Immediate Delayed Personal interest r=.029, p=.785, r2=.001 r=.O98, p=.323, r2=.010 S i tuational interest r=.175, p=.098, r2=.030 r=.202, p=.043, r2=.041 For the scientific fairness chapter, personal interest was not associated with either i mrnediate or delayed tests of learning. Although situational interest was positively as sociated with both immediate and delayed tests of learning, as with the experimental i d 6215 chapter, the effect sizes are too low for these correlations to be considered of practical significance. Table 4-10 shows the values of these statistical analyses. Table 4-10. Correlations between learning (both immediate and delayed) and interest ) for the scientific fairness cha ter ( b 0 th personal and situational S c i entific Fairness Immediate Delayed P ersonal interest _\ r=.042, p=.675, r2=.002 r=.115, p=.245, r2=.013 wtional interest r=.200, p=.042, r2=.040 r=.221, p=.024, r2=.049 R elationship Between Enjoyment and Learning Enjoyment was significantly related to both immediate and delayed learning for t h 6: experimental ideas chapter; however, effect sizes were too low for these correlations to be considered of any practical significance. There was no significant relationship betVveen enjoyment and learning for the scientific fairness chapter. Table 4-11 shows the v - - alues of these statistical analyses. 77 Table 4-11. Correlations between learning (both immediate and delayed) and enjoyment for the experimental ideas and scientific fairness chapters j Chapter Immediate Delayed [Experimental Ideas r=.210, p=.043, r2=.044 r=.231, p=.019, r2=.053 Scientific Fairness r=.106, p=.348, r2=.011 r=.093, p=.348, r2=.009 Relationship Between Attention and Learning Self-reported attention was not correlated to immediate or delayed tests of 1 earning for either of the chapters. Table 4-12 shows the values of these statistical analyses. Table 4-12. Correlations between learning (both immediate and delayed) and attention for th 6 experimental ideas and scientific fairness chapters [E h apter Immediate Delayed [ Experimental Ideas r=. 171, p=.099, r2=.029 r=. 172, p=.080, r2=.030 [ s c i entiflc Fairness r=.088, p=.374, r2=.008 r=.l40, p=.156, r2=.020 Relationship Between Perceived Relevance and Learning Perceived relevance was not related to immediate or delayed tests of recall for e i ther of the chapters. Table 4-13 shows the values of these statistical analyses. I able 4-13. Correlations between learning (both immediate and delayed) and relevance f or the experimental ideas and scientific fairness chapters C h apter Immediate Delayed Experimental Ideas r=.115, p=.269, r2=.013 r=.171, p=.082, r2=.029 S c i entific Fairness r=.152, p=.123, r2=.023 r=.118, p=.233, r2=.014 Related Research Questions The related research questions are not illustrated in the model (i.e., Figure 3-1) but are related to learner reactions to the use of humor in instructional text, and to other potential effects of humor. 78 The first related research question asked if subjects perceived humorous material to be more informative than nonhumorous material. Subjects did not perceive that humorous materials were more informative than nonhumorous materials (experimental ideas: t(102)=.406, p=.685, y=.07; scientific fairness: t(lOO)=.066, p=.947, y=.Ol3). The second question asked how subjects felt humor affected the information presented (e. g., does humor support or detract from the information?) Overall, subjects reported that humor supported the information presented, although they found the humor more supportive in the experimental ideas chapter (mean=4.08; 1=strongly disagree, 5 =strongly agree) than in the scientific fairness chapter (mean=3.76). The third question asked if subjects believed they learned more from humorous m aterials than from nonhumorous materials. Subjects believed they learned more from th 6 humorous version of the scientific fairness chapter than from the nonhumorous version (t(102)=2.389, p=.019, y=.47). Subjects did not believe they learned more from th e humorous version of the experimental ideas chapter than from the nonhumorous Version (t(93)=1 .475, p=.144, y=.29). Subjects perceptions of learning, however, did not C Orrelate significantly with actual learning for either the experimental ideas (r=.143, p: - 1 69, r2=.020) or the scientific fairness (r=.157, p=.111, r2=.025) chapter. Other Findings I explored other effects of humor in the text by monitoring reading time for each c hapter subjects read, and by asking subjects to compare the two readings on a variety of aspeCts. I also asked subjects questions regarding what they liked and disliked about each C hapter, what helped them learn, and what the two most important ideas were that they r . . . eITlefnbered from each chapter. These findings are discussed 1n turn below. 79 Reading Time I recorded reading time for the two versions of the chapters. When adjusted for length (since humorous versions were longer than nonhumorous versions), there was no difference in the amount of time it took subjects to read humorous vs. nonhumorous text (experimental ideas: t(97)=.163, p=.87l, y=.03; scientific fairness: t(98)=.880, p=.381, y==. 18). Comparisons Between Chapters I asked four questions that had subjects compare the two readings. I asked which chapter subjects found it easier to stick with, which chapter they enjoyed more, which chapter they believed was more likely to be in a textbook, and which chapter they would 0 hoose for leisure reading. Tables 4-16, 4-19, 4-22, and 4-25 show the frequencies of s ubj ects’ responses to these questions. In these tables, the two chapters read by subjects are presented in a column (e. g., subjects who read the humorous version of the experimental ideas chapter, as shown at the top of the column, selected either that chapter 0 r the nonhumorous version of the scientific fairness chapter). More Likely in Textbook When asked which chapter they felt they would be more likely to find in a teDitbook, most subjects said they would be more likely to find the nonhumorous version i n a textbook: 88 percent of subjects who read the humorous experimental ideas (HEI) Chapter and nonhumorous scientific fairness (NSF) chapter reported that the latter would b e more likely to appear in a textbook. Sixty-six percent of subjects who read the I7‘()11humorous experimental ideas (NEI) chapter and the humorous scientific fairness ( H SF) chapter reported that the former would be more likely to appear in a textbook. 80 Table 4-14 shows the frequencies of subjects who said each chapter would be more likely to be found in a textbook. Table 4-14. Number of subjects who selected each response when asked which of the chapters they would be most likely to find in a textbook Chapter more likely Chapters Read to find in textbook HEI/NSF NEI/HSF Experimental ideas 6 31 Scientific fairness 45 16 Both 2 4 Neither O l The main reasons cited by subjects that a certain chapter would be found in a textbook had to do with either the content generally (e. g., “More information that related to something people might study in a course”), the use of humor (e. g., “Textbooks don’t usually use humor to help instruction”), or the overall presentation (e.g., “Textbooks are generally boring and formal”). Additional comments from subjects were not clear enough to be classified (e. g., “The text was very similar.”) Frequencies of responses are shown in Tables 4-15 and 4-16. Subjects were allowed to list more than one reason, so total responses may add up to more than 104. Table 4-15. Frequencies of subjects’ reasons why a chapter would be more likely to appear in a textbook (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) Reasons subjects listed believing the HEI NSF chapter would appear in a textbook Presentation—~—general O 25 Presentation—humor O 3 Content 2 12 81 Table 4-16. Frequencies of subjects’ reasons why a chapter would be more likely to appear in a textbook (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) Reasons subjects listed believing the HSF NEI chapter would appear in a textbook Presentation—general l O 2 1 Presentation—humor O 4 Content 7 4 As shown in the tables above, subjects cited humor as a reason a chapter would not be more likely to be found in a textbook. Easier to Stick With When asked which chapter was easier to stick with, most subjects (65 percent) reported that the humorous chapter was easier to stick with. However, preferences varied between topics: 92 percent of the subjects who read the humorous experimental ideas chapter found it easier to stick with that chapter than the nonhumorous scientific fairness chapter; in contrast, 37 percent found it easier to stick with the humorous scientific fairness chapter than the nonhumorous experimental ideas chapter. Table 4-17 summarizes the information; subjects who read the same two chapters appear in the columns. Table 4-17. Number of subjects who selected each response when asked which of the chapters was easier to stick with Chapter selected as Chapters Read easier to stick with HEI/NSF NEI/HSF Experimental ideas 49 32 Scientific fairness 4 l9 Subjects’ responses for most of the open-ended opinion questions could be divided into the following categories: 0 humor (e. g., “It was more fun to read with the humor” [subject #101]), 82 0 interest (e. g., “The topic was more interesting” [#167]), 0 easy to read or understand (e. g., “It was written more clearly—it kind of sounded like someone talking to you in a conversation” [#161 D, 0 use of examples (e.g., “He used examples to restate his ideas” [#120]), o enjoyment (e.g., “It was more fun to read” [#208]), o relevance or ability to relate to (e. g., “It was information that could be [beneficial] to anyone even if you are not a scientist” [#121]), o attention (e. g., “Got my attention early on and kept it” [#106]), and 0 read first (e. g., “I read this one first, so I was a little more awake” [#136]). Tables 4-18 and 4-19 show the break-down of reasons student gave for the chapter they found easier to stick with. Subjects who read the humorous version of the experimental ideas chapter cited a variety of reasons for finding that chapter easier to stick with than the nonhumorous scientific fairness chapter, with humor, interest, and ease of reading/understanding cited most frequently (see Table 4-18). Subjects who read the humorous scientific fairness chapter were most likely to cite the humor as the reason they found that chapter easier to stick with, but subjects who preferred the nonhumorous experimental ideas chapter cited interest and ease of reading/understanding (see Table 4-19). Four students said they found the first chapter they read to be the one they found easier to stick with; this is not surprising, given the amount of concentration required to complete the study (i.e., subjects read two chapters and answered over 100 questions in a two-hour period). 83 Table 4-18. Frequencies of subjects’ reasons why the chapter they selected was easier to stick with (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) Reasons subjects listed for finding their HEI NSF preferred chapter easier to stick with Humor 24 1 Interesting I 5 0 Easy to Read/Understand 14 0 Examples 2 O Enjoyable 3 0 Relevant/Related To 9 O Held Attention 3 0 Read First 1 O Smaller segments 2 l Table 4-19. Frequencies of subjects’ reasons why the chapter they selected was easier to stick with (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) Reasons subjects listed for finding their HSF NEI preferred chapter easier to stick with Humor 12 2 Interesting 2 8 Easy to Read/Understand 6 10 Examples 5 2 Enjoyable O 1 Relevant/Related To 1 O Held Attention l 0 Read First 2 1 The tables show only those responses indicated by at least two students. Several comments were listed by only one subject each. Comments by subjects who preferred the humorous experimental ideas chapter were: it was to the point, seemed shorter, had a broader range, used less jargon, and was more organized (one student each). Other comments by students who preferred the nonhumorous experimental ideas chapter were: it was more common sense, the topic was interesting, the subject paid more attention after being quizzed after the first chapter, there was less “excess material,” experimental ideas are fun to think about, there was more activity in the material, and the explanations were short. Another comment by a student who preferred the humorous scientific fairness 84 chapter was that it was more complicated. Other comments by students who preferred the nonhumorous scientific fairness chapter were: knowing where the chapter was going, humor didn’t detract from the information, and the information was new for the subject. More Enjoyable The majority of subjects reported that they found the experimental ideas chapter more enjoyable, regardless of which version of that chapter they read: 94 percent of subjects said they enjoyed the humorous experimental ideas chapter more than the nonhumorous scientific fairness chapter, and 67 percent enjoyed the nonhumorous experimental ideas chapter more than the humorous scientific fairness chapter. Table 4- 20 shows the frequencies of subjects who identified each of the chapters as more enjoyable. Table 4-20. Number of subjects who selected each response when asked which of the chapters they enjoyed more Chapter selected as Chapters Read "“0“” enjoyable HEI/NSF NEI/HSF Experimental ideas 49 34 Scientific fairness 3 17 Subjects who read the humorous version of the experimental ideas chapter cited a variety of reasons for finding that chapter more enjoyable than the nonhumorous scientific fairness chapter, with humor, interest, and ease of reading/understanding cited most frequently. Readers who found the humorous scientific fairness chapter more enjoyable cited the humor, while readers who enjoyed the nonhumorous experimental ideas chapter more said they found it more interesting or more relevant. Tables 4-21 and 4-22 show subjects’ written responses when asked why they found their chosen chapter more enjoyable. 85 Table 4-21. Frequencies of subjects’ reasons why they found the chapter they selected more enjoyable (readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) Reasons subjects listed for finding their HEI NSF preferred chapter more enjoyable Humor 20 0 Interesting 8 0 Easy to Read/Understand 8 0 Examples 3 0 Relevant/Related To 13 0 Held Attention 4 0 Organization 0 l Table 4-22. Frequencies of subjects’ reasons why they found the chapter they selected more enjoyable (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) Reasons subjects listed for finding their HSF NEI preferred chapter more enjoyable Humor 9 2 Interesting 2 8 Easy to Read/Understand 3 4 Examples 4 4 Relevant/Related To 1 15 Held Attention 1 1 Other comments listed by students who preferred the humorous experimental ideas chapter were: it was interesting to realize the observations that could be made every day, it involved interacting with the general public more, it flowed better, it was faster to read, and the information in the scientific fairness chapter was obvious. Other comments listed by students who preferred the nonhumorous experimental ideas chapter were: it wasn’t overwhelming, it was helpful, it “gave creative ways to do what was being explained,” there was more activity, and it didn’t have as much useless information. Other comments listed by students who preferred the nonhumorous scientific fairness chapter were that the information was new (to the subject) and better organized. There were no additional comments listed by students who preferred the humorous scientific fairness chapter. 86 Leisure Reading When asked which chapter they would choose for leisure reading, subjects again preferred the experimental ideas chapter over the scientific fairness chapter. Ninety-six percent of subjects who read the humorous experimental ideas chapter preferred it over the nonhumorous scientific fairness chapter, while 35 percent of the subjects who read the humorous scientific fairness chapter preferred it over the nonhumorous experimental ideas chapter. Table 4-23 shows the frequencies of subjects who identified each of the chapters as the one they would select for leisure reading. Table 4-23. Number of subjects who selected each response when asked which of the chapters they choose for leisure reading Chapter selected for Chapters Read leisure reading HEI/NSF NEI/HSF Experimental ideas 51 33 Scientific fairness 2 18 Subjects who had read the humorous version of the experimental ideas chapter cited reasons such as interest, ease of reading, relevance, and the chapter’s ability to hold their attention, in addition to humor. About one-third (35 percent) of subjects who read the humorous version of the scientific fairness chapter said they would select it for leisure reading. Several of these subjects cited the humor and enjoyment of the chapter as reasons for their choice; reasons for selecting the nonhumorous experimental ideas chapter include interest and relevance. Tables 4—24 and 4-25 show the answers written by subjects when asked why they would choose their preferred chapter for leisure reading. 87 4-24. Frequencies of subjects’ reasons why they would prefer the chapter they selected for leisure reading-(readers of the humorous version of the experimental ideas chapter and nonhumorous version of the scientific fairness chapter) Reasons subjects listed for selecting their HEI NSF preferred chapter for leisure reading Humor 1 l 0 Interesting 10 1 Easy to Read/Understand 12 O Enjoyable 1 O Relevant/Related To 8 O Held Attention 9 O Informative 0 l 4-25. Frequencies of subjects’ reasons why they would prefer the chapter they selected for leisure reading (readers of the humorous version of the scientific fairness chapter and nonhumorous version of the experimental ideas chapter) Reasons subjects listed for selecting their HSF NEI preferred chapter for leisure reading Humor 8 0 Interesting O 1 1 Easy to Read/Understand 3 4 Examples 1 0 Enjoyable 6 5 Relevant/Related To 1 8 Held Attention 2 l Informative 3 2 Other comments listed by students who preferred the humorous experimental ideas chapter were: it was common sense, the subject wouldn’t be as concerned about retaining the information, the subject liked the topic more, the topic was more helpful, it was more entertaining, it was less like a textbook, it seemed more like a self-help type of reading, and the scientific fairness chapter was too obvious. Additional comments listed by students who preferred the nonhumorous experimental ideas chapter were: it was more comfortable or pleasant to read, the reading moved steadily from one idea to the next, it would make the subject observe the little things they do, it required less concentration, and the subject liked the material better. There were no additional comments listed by students who preferred either version of the scientific fairness chapter. 88 Responses to Each of the Chapters Subjects were asked what they liked and disliked about each of the chapters and what helped them learn the information in the chapters. For ease of comparison, responses to the humorous and nonhumorous versions of each chapter are presented together in each table below. Tables 4-26 and 4-27 show subjects’ reports of what they liked about the humorous and nonhumorous versions of the experimental ideas chapter (Table 4-26) and the scientific fairness chapter. (Table 4-27). Elements Subjects Liked Readers of the humorous version of the experimental ideas chapter cited humor and interest as things they liked about the chapter. Subjects who read the nonhumorous chapter cited the writing style, the fact that it was easy to read or understand, the examples, relevance or their ability to relate to the material, and organization as factors they liked about the chapter. Comments could be grouped into categories similar to those used for most of the comparisons, with the addition of the category of text characteristics (e. g., “Bold face print told you what was important” ). Table 4-26. Subjects’ reports regarding what they liked about the humorous and nonhumorous versions of the experimental ideas chapter HEI NEI Humor 11 O Informative 2 3 Summary 3 2 Interesting 7 3 Easy to Read/ Understand/Writifl 8;er 9 31 Examples 4 9 Enjoyable 0 0 Relevant/Relate To 2 5 Held Attention 2 2 Organization 2 l 1 Text Characteristics 2 5 89 Table 4-27. Subjects’ reports regarding what they liked about the humorous and nonhumorous versions of the experimental ideas chapter HSF NSF Humor 26 2 Informative 3 1 Summary 2 3 Text Characteristics 1 7 Interesting 2 1 Easy to Read/Understand/ Writing Style 11 8 Examples 17 21 Relevant/Related To 3 1 Organization 6 1 3 About half of the readers of the humorous version of the scientific fairness chapter cited the humor when asked what they liked about the chapter. This percentage was much higher than that for the humorous experimental ideas chapter. Readers of the nonhumorous chapter were more likely to list text characteristics (e. g., use of bold or italics, headings, etc.) and organization as factors they liked about the chapter. Forty subjects cited the ease of reading or the writing style as factors they liked about the experimental ideas chapter, compared to 19 readers of the scientific fairness chapter. In contrast, examples were cited by 13 readers of the experimental ideas chapter and 38 readers of the scientific fairness chapter. Other responses regarding what subjects liked about the humorous experimental ideas chapter were that it was easy to remember, the points were stated directly, it was brief, it addressed human needs and fears, it was written to help the reader do something, explanations were simple, it didn’t try to be scientific, and it gave the subject confidence to come up with an idea. Subjects listed the way the information was broken down, the layout, and that it made them think about things they hadn’t thought about before as reasons they liked the nonhumorous experimental ideas chapter. 90 Other responses regarding what subjects liked about the humorous scientific fairness chapter were that the ideas were short, they liked the content itself, it was straightforward, and it had a lot of information in a small amount of space. Other responses regarding what subjects liked about the nonhumorous scientific fairness chapter were miscellaneous facts and that they learned new things. Elements Subjects Disliked Tables 4-28 and 4-29 show subjects’ reports of what they did not like about the humorous and nonhumorous versions of the experimental ideas chapter (Table 4-28) and the scientific fairness chapter (Table 4-29). Table 4-28. Subjects’ reports regarding what they did not like about the humorous and nonhumorous versions of the experimental ideas chapter HEI NEI Nothing 10 14 Text Characteristics 2 2 Dry/Boripg/Not Interesting/Didn’t Hold Attention 5 13 Too Long/Too Much Text for Amt of Info 2 7 Too Much Information 4 2 Too Many Examples 0 0 Lack of Examples 0 1 Humor 1 0 No Humor 0 3 Not Relevant 4 3 Repetitive 2 2 Organization 4 0 Phobias/Big Words 7 0 Author Talked Down 0 3 Table 4-29. Subjects’ reports regarding what they did not like about the humorous and nonhumorous versions of the scientific fairness chapter HSF NSF Nothing 6 5 Text Characteristics 0 2 Dry/Boring/Not Interesting/Didn’t Hold Attention l3 19 Too Long/Too Much Text for Amt of Info 12 10 Too Much Information 2 5 Too Many Examples 2 1 Lack of Examples 0 2 91 Table 4-29 (cont’d). Humor 7 0 No Humor 0 4 Not Relevant l 3 Repetitive l 2 Organization 0 1 Author Talked Down 0 O Twenty-four of the readers of the experimental ideas chapter, regardless of the version (i.e., humorous or nonhumorous), said there was nothing they disliked about it, compared to l l of the readers of the scientific fairness chapter. Readers of the nonhumorous version of the experimental ideas chapter were more likely than readers of the humorous version to say it was dry, boring, not interesting, or didn’t hold their attention. Readers of both versions of the scientific fairness chapter felt that it was dry, boring, not interesting, or didn’t hold their attention, and that it was too long or had too much text for the amount of information it contained. One reader of the humorous version of the experimental ideas chapter said they didn’t like the humor, compared to seven of the readers of the humorous scientific fairness chapter. Three of the subjects who read the nonhumorous version of the experimental ideas chapter said they disliked that it did not contain humor, while four of the readers of the nonhumorous scientific fairness chapter cited the lack of humor as something they disliked about the chapter. Elements that Helped Learning Subjects were asked what helped them learn from each of the chapters. Tables 4- 30 and 4-31 show subjects’ responses to this questions for the humorous and 92 nonhumorous versions of the experimental ideas chapter (Table 4-30) and the scientific fairness chapter (Table 4-31). Table 4-30. Subjects’ reports regarding what helped them learn the information in the experimental ideas chapter HEI NEI Humor 14 0 Overview/Summary 2 4 Interesting 2 0 Easy to Read/ Understand/Writing Style 16 12 Examples 16 22 Enjoyable 1 0 Relevant/Relate To 6 0 Held Attention 1 0 Organization 7 23 Text Characteristics 7 4 Table 4-31. Subjects’ reports regarding what helped them learn the information in the scientific fairness chapter HSF NSF Humor 13 O Overview/Summary 3 7 Interesting I 0 Easy to Read/ Understand/Writing Style 8 4 Examples 25 35 Relevant/Relate To 1 0 Organization 7 10 Text Characteristics 3 3 Twenty-six percent of the subjects felt that humor had helped them learn the information in the humorous chapters, and this was not dependent on which chapter they read. Examples were cited for both chapters, with 60 subjects citing the examples in the scientific fairness chapter and 38, the experimental ideas chapter. Readers of the nonhumorous versions were somewhat more likely to say the examples helped them learn. Organization was also cited frequently as something that helped subjects learn, with three times as many readers of the nonhumorous version of the experimental ideas chapter citing organization as readers of the humorous version of that chapter. For both 93 chapters, only readers of the humorous version reported that the chapter’s relevance to them or their ability to relate to the material helped them learn. Most Important Ideas Subjects were asked to list the two most important ideas they learned from each chapter. Table 4-32 shows subjects’ responses when asked what the two most important ideas were that they learned from the experimental ideas chapter. Recalled ideas could be categorized into the following areas: fears and phobias (general) (e.g., “I learned the things that prevent people from using creative ideas” [subject #150], finding ideas is easy (e. g., “Ideas for experiments are all around” [#116]), ideas come from observation (e. g., “Direct observation can be a good tool when trying to form questions” [#137]), questions can be answered through research (e. g., “Practical questions will be answered through research” [#124]), how to get ideas (nonspecific) (e. g., “The ways of coming up with ideas” [#1221), fears interfere with ideas (e. g., “There are a lot of irrelevant fears that prevent people from doing an experiment” [#207]), not to be afraid (e. g., “One should not be afraid of asking creating questions” [#124]), observation is important for science (e. g., “Observation is the key for effective research” [#202]), and 94 o a good experiment should be repeatable, observable, and testable (e. g., “Characteristics of an experimental questions (ROT)” [#203]). Table 4-32. Subjects’ reports regarding the two most important ideas they learned from the experimental ideas chapter HEI NEI Fears/Phobias (general) 9 11 Finding Ideas is Easy/Everyone has Ideas 17 18 Ideas from Observation l4 13 Answer Questions Through Research 2 0 How to Get Ideas (nonspecific) 6 4 Fears Interfere with Ideas 9 4 Don’t be Afraid 6 4 Observation Important for Science 3 3 Repeatable, Observable, Testable 2 4 There were no clear differences in what readers said were the most important ideas from the experimental ideas chapter. For the scientific fairness chapter, recalled ideas could be categorized into the following areas: 0 cheating hurts science and society (e. g., “Bad scientific research hurts everyone” [#120]), 0 general do’s (e.g., “Do experiments ethically” [#159]), 0 specific do’s (e.g., “Reorganize to make things clear” [#175]), 0 general don’ts (e. g., “It is unethical and immoral to conduct research poorly” [#1201), 0 specific don’ts (e. g., “Not to fabricate results” [#173]), o consequences of lying (e.g., “Falsifying an experiment can cause you to lose your credibility” [#138]), o to be skeptical of research, or that scientists sometimes lie (e. g., “”Fraud happens in all professions, even one as important as science” [#116]), 95 o differences among the types of “tricks” (e. g., “There are right ways and wrong ways that people can ‘change’ their experiments” [#209]), and o the importance of ethics (e.g., “Scientific study and research needs to have a solid foundation of ethical and moral standards when it comes to doing research and experiments” [#133]). Table 4-33 shows subjects’ responses when asked what the two most important ideas were that they learned from the scientific fairness chapter. Table 4—33. Subjects’ reports regarding the two most important ideas they learned from the scientific fairness chapter HSF NSF Cheating Hurts Science/Society 9 9 Do’s (general) 7 3 Do’s (specific) 8 9 Don’ts (general) 6 7 Don’ts (specific) 14 5 Consequences 4 7 Be Skeptical/Scientists Lie l4 8 Differences Between Types of Tricks 6 9 Importance of Ethics 6 6 Readers of the humorous version appeared more likely to list specific don’ts and the need to be skeptical of scientific reports than readers of the nonhumorous version. Summary Obviously, there are individual differences in appreciation of humor. This was demonstrated both by differences between the raters in their ratings of the humor in the chapters, and by subjects’ comments: while some subjects said they liked the humor in the humorous chapters, other subjects reported that they disliked the humor. Despite differences in humor appreciation, analysis of the quantitative data indicated that humor can help students learn under certain conditions. Humor in instructional text can also have other positive benefits (such as enhancing interest, 96 enjoyment, and attention). Figure 4-5 shows the hypothesized relationship among the variables when I began this study. Figures 4-6 and 4-7 show the actual relationships among these variables as indicated by this research for the experimental ideas and scientific fairness chapters, respectively. attention {——> relevance / interest \ humor learning > enjoyment Figure 4-5. Hypothesized effects of humor in instructional text The qualitative data suggested differences between the two chapters in the humor and the difficulty of the content. In written responses regarding what they liked about each chapter, subjects reported that the experimental ideas chapter was interesting and easy to read and understand; subjects liked the organization and examples in the scientific fairness chapter. When asked what they disliked about the readings, subjects reported that the nonhumorous version of the experimental ideas chapter and both versions of the scientific fairness chapters were dry, boring, or didn’t hold their attention. Subjects also reported that the scientific fairness chapter (regardless of whether there was humor or not) was too long or had too much text for the amount of information it contained. Several readers of the humorous version of the scientific fairness chapter disliked the 97 auenfion interest t sfluaflonal interest humor D personal V relevance enjoyment Figure 4-6. Connections among variables for the experimental ideas chapter attention d personal interest 3 snuaflonal / interest humor enjoyment Figure 4-7. Connections among variables for the scientific fairness chapter 98 leamlng relevance learning humor, while only one reader of the humorous experimental ideas chapter disliked the humor. In comparisons of the chapters, subjects reported that the experimental ideas chapter (regardless of humor) was easier to stick with, more enjoyable, and would be preferred for leisure reading. Subjects reported that they would be more likely to find the nonhumorous version (regardless of topic) in a textbook. 99 CHAPTER 5: DISCUSSION The purpose of this research was to determine if humor in instructional text affects learning, interest, and enjoyment. In this chapter, I review the arguments I made in the literature review regarding the effect of humor, compare my expectations to my findings, and discuss possible interpretations of my results. Immediate Effects of Humor on Learning My first major research question was: Do learners recall more facts and recognize more concepts from the humorous version than from the nonhumorous version immediately after reading? In chapter 2, I presented both theoretical and empirical support for the effect of humor on learning. Briefly, humor has been found to enhance learning in some classroom studies (e. g., Bryant, Comisky, Crane, & Zillmann, 1980; Ziv, 1988). Theoretical support for the effect of humor on learning comes from dual coding theory, which states that comprehension and memory of text are affected by both verbal (e. g., text, speech) and nonverbal (e. g., imagery, affect) systems (Sadoski, Goetz, & Fritz, 1993), and that the effects of these two systems are additive. In this study, I found that immediately after reading, learners recalled significantly more information from the humorous version of the experimental ideas chapter than from the nonhumorous version, but that there was no significant difference in recall of the different versions of the scientific fairness chapter. Why was there an effect of humor on immediate recall with the experimental ideas chapter and not the scientific fairness chapter? I have identified two possible reasons for the differences in immediate recall: 1) differences in the amount, type, and 100 integration of humor in the two chapters, and 2) differences in the cognitive burden placed on readers of each chapter. I discuss each of these possibilities below. Reason I .' Differences in Amount and Type of Humor Amount of Humor As stated in chapter 4, the humor in each version of each chapter was rated by two people. Although two raters is not ideal, it does allow me to speculate on how specific instances of humor may have been perceived by the subjects. Differences in the amount and type of humor in each chapter are reflected partially in the ratings given to the passages by these raters. There was much more agreement among the raters on the humor in the versions of the experimental ideas chapter: in the humorous version, two raters identified 14 and 16 instances of humor, respectively, with agreement between the two raters on seven passages. The two raters of the nonhumorous version of the experimental ideas chapter identified five and six instances of humor in that chapter, respectively, with agreement on two instances. There was considerably less agreement between the raters for the scientific fairness chapter: raters of the humorous version identified 16 and six instances, respectively, with agreement on only two passages. Raters of the nonhumorous version identified six and zero instances, respectively, with no agreement on any of the humor. This lack of agreement between raters of the humor in the scientific fairness chapter may indicate that the humor in that chapter has a more individual appeal. In contrast, the relative agreement of the raters of the humorous experimental ideas chapter may indicate a more universal appeal of the humor in that chapter. 101 As stated in chapter 4, raters of the nonhumorous version of the experimental ideas chapter identified part of a passage as humorous that was not identified as humorous by the raters of the humorous version. However, raters of the humorous version identified sentences that surrounded that passage as humorous. (These sentences had been removed from the nonhumorous version.) The fact that the text was identified as humorous by the raters of the nonhumorous version but as not humorous by raters of the humorous version indicates that there may be a context effect for humor. In other words, text that is surrounded by nonhumorous text may be more likely to be identified as humorous than the same text that is surrounded by humorous text. Types of Humor In addition, the two chapters had different types of humor, due in part to the development of the chapters. The experimental ideas chapter had humor injected by the author, and few changes were made for the development of the humorous version of that chapter. The humor in this chapter drew largely from the content of the chapter itself. As an example, Martin (the author of the chapters) talked about fears students have about trying to come up with ideas for experiments. He states in that chapter, “Psychologists call irrational fears phobias. Since I am a psychologist, I cannot resist the temptation to name the phobias behind our inability to get experimental ideas. (Any resemblance of these names to accepted psychological terminology is purely coincidental)” (Martin, 2000, p. 43). Martin proceeds to name the “phobias” using Latin and Greek (or Latin- and Greek-sounding) prefixes that are commonly associated with the fears he wishes to convey: for example, “pseudononphonoscientiaphobia” is the fear of not sounding scientific. 102 In contrast, the scientific fairness chapter did not have much humor originally, so humor had to be added to develop the humorous version. The humor added to this version referred more often to characters and ideas outside the readings, like Inspector Clouseau and Buffy the Vampire Slayer. Obviously, these references would only be understood by readers who brought with them the requisite knowledge to understand the references. This may explain why there was little agreement between the raters for this chapter: different people bring different experiences with them, and these differences may have been reflected by differential appreciation of the humor in the readings. In addition, since the humor in the scientific fairness chapter came from outside, instead of more directly from the content of the reading, the humor may have come across as more forced and possibly less related to the content. Subjects noted these differences in their comments on the humorous scientific fairness chapter: “I noticed more jokes in the article, even though they were cheesy—they made it more interesting” (subject #209), and “Neither was funny to me, but this one tried to make funny comments that I noticed” (#178). In order to further study the differences in the types of humor used in this study, the humor must be classified into specific types of humor using a taxonomy of humor. Several taxonomies have been proposed, based on different aspects of humor. For example, Wandersee (1982) lists 15 sources of humor (such as word-play, understatement, and departure from propriety) and 16 forms (including jokes, puns, riddles, and cartoons). Long and Graesser (1988) described a taxonomy of jokes that included 10 categories (including nonsense and social satire) and a taxonomy of wit that included 11 categories (such as irony, satire, sarcasm, and understatement). Berger (1997) described four categories of humor (i.e., humor involving language, logic, 103 identity, or action), under which 45 techniques are grouped (such as irony, absurdity, parody, and slapstick). Although in this study I have sufficed to say that different types of humor were used in the two chapters, future research should 1) categorize the types of humor used in instructional text and 2) determine the effects of these different types of humor on subjects’ learning and reactions to the text. Integration of Humor As noted by Zillmann and Bryant (1983, cited in Robbins, 1994), humor that is well integrated with the material can lead to greater retention of the information. As stated earlier, the humor in the experimental ideas chapter drew directly from the content of the chapter, while the humor in the scientific fairness chapter referred more to “outside” situations or characters. The humor added to the scientific fairness chapter therefore may not have been sufficiently integrated with the material to produce the desired benefits. Cohen '3 Theory of Humor Cohen (1999) developed a theory that supports differences in types of humor. He describes two types of jokes: conditional jokes are those that will work only with specific audiences, and pure jokes are those which are universal because they presuppose nothing in the audience. Cohen further points out that truly pure jokes don’t really exist, since they presuppose, at the very least, a familiarity with the language in which the joke is told. Conditional jokes require the audience to bring with them the knowledge or experience required from them to either get the joke or find it amusing. Cohen notes that “it is a vital feature of much joking that only a suitably qualified audience—one that can meet the condition—can receive the joke, and the audience often derives an additional 104 satisfaction from knowing this about itself” (p. 12). The best jokes are concise, and this concision is possible because a certain amount of knowledge is assumed on the part of the audience. When I consider the two humorous chapters in light of Cohen’s theory of humor, I can see that the experimental ideas chapter involved a purer form of humor, since the humor was derived largely from the text itself, while the scientific fairness chapter involved more conditional humor by requiring subjects to bring with them certain background or experiences that would enable them to understand the jokes. Cohen's (1999) theory of humor states that humor works in part by creating a community of the listeners. Cohen proposes that “a deep satisfaction in successful joke transactions is the sense held mutually by teller and hearer that they are joined in feeling” (p. 25). A failure of a listener (or reader) to “get the joke” represents a “failure to join one another in the community of appreciation” (p. 26). By relying on conditional jokes, the joke-teller pulls the listener in by requiring the listener to supply something. This sense of community is not created if the joke is explained or if the listener doesn’t “get” the joke. Community is created by letting the listener know that he or she and the joke-teller share common knowledge or experiences. Comedians such as Rita Rudner and Eddie Izzard help to create a community by referring later in their routines to jokes made earlier—in effect, they create an entire audience that is then “in on” the (inside) joke. By referring to ideas outside the chapters, 1 inadvertently required that subjects bring certain knowledge and experiences with them in order to “get” the joke. Subjects who lacked the necessary knowledge or experiences to understand the humor may have felt excluded from any “community” that may exist between the author and the readers. However, since subjects did, in general, perceive the 105 humorous chapters to be more humorous than the nonhumorous chapter, it is difficult to know exactly what the effects of this “added” humor were. Reason 2: Differences in Cognitive Burden In addition to the differences in the amount and type of humor in the two chapters, the content of the scientific ideas chapter may have been more difficult for students to understand. In support of this assertion, reading time was significantly longer for the scientific fairness chapter (3.46 minutes per page) than for the experimental ideas chapter (2.92 minutes per page), with a large effect size (t=10.933, p<.001, y=l .12). Subjects’ comments also reflected this difficulty. When asked what they disliked about the chapter, many subjects commented that it was dry, boring, or not interesting, or that it was too long or had too much text for the amount of information: “I didn’t like how boring the chapter was. I found it hard to concentrate and little motivation to keep reading” (#182) and “It seemed to drag on and I felt like I was receiving too much information at one time” (#105). Subjects may also have lacked the necessary background to be able to easily integrate this new information: “Occasionally, some of the vocabulary specific to experiments could get a little confusing and I had to read more slowly and carefully” (subject #108) and “Wasn’t clear on some materials and even after I reread the section twice, it still didn’t make sense” (#204). This lack of background may have required students to work harder to understand and assimilate the new information. In addition, percentage correct on the quizzes was significantly lower for the scientific fairness chapter (50.00 percent) than for the experimental ideas chapter (54.29 percent), although the effect size was low (t=3.023, p=.003, y=.32). While I can’t claim 106 that the tests for the two chapters were equivalent, taken together with the other evidence, this difference in percentage correct may support a difference in cognitive burden. There was no apparent floor or ceiling effect for either of the chapters immediately after reading, and the fact that some subjects scored quite well (e. g., high score was 84 percent for each of the chapters) indicates that it was possible for subjects to score well on the tests with only one reading. Possibly the increased cognitive burden posed by the scientific fairness chapter made the humor inappropriate: the increased level of concentration required may mean that the humor was not able to enhance learning. Conclusion This combination of the differences in the type and amount of humor in these two chapters, combined with differences in the cognitive burden placed on readers of each chapter, may have contributed to the differences in effect of humor in the text on subject recall and recognition of information in the two chapters. This general finding of the effect of humor on learning is consistent with Schmidt’s finding that humor facilitates learning; however, as you will see later, other of my findings contradict Schmidt’s finding. Delayed Effect of Humor on Learning The second major question had to do with delayed indications of learning: Do learners recall more facts and recognize more concepts from the humorous version than from the nonhumorous version two weeks after reading? In my pilot study, scores on the delayed quizzes (i.e., one week after the reading) approached significance. I decided to increase the delay period for this study because Kaplan and Pascoe (1977) found 107 significant effects of humor as measured six weeks after the event. I had hoped that the effects of humor in my study would be more pronounced with a longer delay period than the pilot study, with readers of humorous materials retaining more information than readers of the nonhumorous materials. However, humor was not associated with increased retention of material after two weeks for either of the chapters. A major difference between my study and the study by Kaplan and Pascoe is that the latter occurred in the context of a college class. As stated earlier, it may have been unreasonable to expect that a single reading of the materials (especially with a lack of motivation to remember the material or even read it carefully) would yield significant results. The definition and measurement of learning may also have affected my results for delayed learning. Learning is defined as “getting knowledge of (a subject) or skill in (an art, trade, etc.) by study, experience, instruction, etc.” or “fixing in the mind” (Agnes, 2000). Unfortunately, subjects in this study had no incentive to study or learn the material, or even to read carefully. “Learning” in this study was measured by open-ended and multiple-choice questions that were asked immediately after reading, and for practical purposes, was defined in this study as what subjects could recall from a single reading of the material. Rather than representing true learning, which results from carefully reading and studying materials, this measure of learning reflects only what students can remember after a single exposure to the material. 108 Effect of Humor Related to Specific Passages of Text Immediate Recall In addition to looking at the overall effect of humor in instructional text on learning, I also explored how recall related to specific humorous passages in the text. I found that, for information related to humor only in the humorous version of the text, there was no significant difference in recall of information between readers of the humorous and nonhumorous versions. For information related to nonhumorous material in both versions of the text, there was also no significant difference in recall of answers between readers of the humorous and nonhumorous versions. However, I did find a significant difference between the two groups on recall of information which was related to humorous text (as defined by raters) in both versions of the chapter, with readers of the humorous chapter significantly more likely to recall the information than readers of the nonhumorous chapter. These findings were unexpected, especially when considered in light of the finding of increased overall learning for subjects who read the humorous version of the experimental ideas chapter. If recall was directly related to humor, I would expect no difference in subjects’ scores on the two versions for passages that either were humorous in both versions or nonhumorous in both versions, and differences in favor of the humorous version for passages that were humorous in the humorous version and not humorous in the nonhumorous version. Given the relative lack of humor in the nonhumorous version of the chapter, this instance of humor may have been a distraction to subj ects—the humor may have been so unexpected that subjects were startled or confused by it, rather than amused by it. An additional experiment involving very limited 109 humor in one version of a reading and more humor in another version and questions related to humorous and nonhumorous passages in each, perhaps with a qualitative component to determine which passages individual subjects find humorous, may provide insight into these findings. An alternative explanation for these findings is that the raters’ sense of humor is not similar to or representative of the senses of humor of my subjects. These findings do not support Schmidt and Williams‘s (2001) study, which found that humor enhanced recall of specific items. The finding that specific instances of humor could not be linked to improved performance on specific test items may argue in favor of the effect of positive affect, rather than any effect of humor that comes from an increase in attention to specific instances of humor. The humorous versions of these chapters contained considerably more humor than the amount considered ideal in a classroom (i.e., three to four instances in a 50-minute lecture). Since it took subjects 20 to 30 minutes to read each chapter, one or two instances of humor would have been consistent with the ideal amount of humor for classroom instruction; this amount is much closer to the amount of humor contained in the nonhumorous chapters. However, written instruction lacks many of the aspects of classroom instruction that may contribute to perceptions of humor, including the instructor’s intonation and facial expression, the ability to tailor humor to a particular class, and an ongoing relationship between the instructor and the students. The finding that subjects who read the nonhumorous version of the experimental ideas chapter did worse on a question related to a humorous passage may indicate that the ideal amount of humor may be considerably higher in instructional text than in a classroom environment. 110 Delayed Recall I also explored how humor’s proximity to tested items related to subject recall of that information in delayed tests of learning. I performed the same comparisons for delayed recall as for immediate recall, and found no significant differences between groups in recall of any answers. These findings are consistent with my findings that there was no difference in overall recall after two weeks. These results do not support my hypothesis that humor would reduce the rate of forgetting. Future Research Future studies should look at the effect of humor in instructional materials in the context of an actual classroom setting, where students have the ability and the incentive to study, and where they have the background needed to understand the material. A qualitative study would also be helpful to determine what individual subjects find amusing and how that relates to their recall of ideas in the text. Also, more research is needed to determine if there is an optimal amount of humor in written instructional materials. Effect of Humor on Enjoyment Another major research question was: Do learners report greater enjoyment of the humorous version than the nonhumorous version? In chapter 2, I provided some evidence from the literature that supported a link between humor and enjoyment. However, none of that evidence was related to humor in instructional materials. This study explored the link between humor and enjoyment as it related to instructional materials. As reported in chapter 4, subjects reported significantly greater enjoyment of the humorous version of both of the chapters. This confirms my hypothesis that humor in instructional materials 111 would increase enjoyment. As stated in chapter 2, I believe that enjoyment is an important effect of humor in instruction, and these findings support this positive effect of humor in instructional text. Effect of Humor on Interest The final major research question was: Do learners express greater post—reading interest in the topic presented humorously than in the topic presented nonhumorously? In the literature review, I cited empirical evidence for the connection between humor and interest in the classroom (e. g., Ziv, 1988; Bryant et al., 1980). I also cited theoretical evidence for the effect of humor on situational interest. My study supported the effect of humor on situational interest: subjects reported significantly greater situational interest in the humorous versions of the two chapters; however, there was no effect of humor on reported personal interest for either of the chapters. This finding is consistent with Schraw and Lehman's (2001) assertion that personal interest is context-general (and therefore unaffected by the style of presentation), while situational interest is context- specific and can be elicited through the use of certain devices or characteristics of the presentation. Minor Research Questions The minor research questions explored the mechanisms by which humor affected learning through the mediating variables, and the intercorrelations among those variables. Effect of Humor on Attention and Relevance I proposed that humor may aid learning by directing learners’ attention and increasing perceived relevance, which would facilitate encoding and retrieval of 112 information. Attention and relevance may also interact with interest and with each other, producing a synergistic effect and ultimately affecting learning. Attention Humor was associated with increased attention in both the experimental ideas and scientific fairness chapters. This finding is consistent with my review of the literature. Relevance In chapter 2, I noted that use of a visible author enhanced perceived relevance (Paxton, 1997) and expressed interest in finding out if humor would additionally enhance relevance, perhaps by increasing the text equivalence of instructor immediacy. I was unable, however, to provide any direct empirical or theoretical support for the effect of humor on perceived relevance, and my study did not support the effect of humor on relevance for either of the chapters. In retrospect, this finding is not surprising: there is no reason to expect that humor would increase perceived relevance. Relationships Among Mediating Variables In chapter 2, I noted that the writings of several researchers indicate considerable conceptual overlap among the ideas of interest (both personal and situational), attention, and perceived relevance. Correlations among all of these variables were statistically significant for both the experimental ideas and scientific fairness chapters. These findings are neither surprising nor unexpected. Although I did not predict correlations between enjoyment and each of these variables, the high correlations, again, are neither surprising nor unexpected: we accept as common sense that we are likely to enjoy things were are interested in and believe to be relevant, and that we pay more attention to things we enjoy. 113 The fact that these correlations were significant for both of the readings indicates that the relationships among these constructs may be independent of topic; that is, interest, relevance, attention, and enjoyment tend to be all high or all low, depending on each individual’s reaction to the topic. The correlations among these variables support a conceptual overlap among these constructs, and raises the possibility that these are not, in fact, distinct constructs. Supporting this view, a factor analysis I performed after the first 25 subjects indicated that these variables loaded on a single factor. However, supporting a contrary view, the fact that humor affects these variables differentially (i.e., increases enjoyment and situational interest, and has no effect on personal relevance) in ways that are consistent with the theories cited in chapter 2, indicates that these may be distinct constructs. Relationships Between the Mediating Variables and Learning I made several hypotheses and provided theoretical support for the effects of the mediating variables on learning. The fact that none of these variables correlated with learning may provide support for Schmidt and Williams's (2001) findings, which indicated that humor itself, rather than incongruity, resolution of incongruity, bizarreness, or distinctiveness, enhanced recall. Although Schmidt and Williams obtained these results in a study of memory for cartoons, my findings suggest that humor may also have an effect on recall of ideas in text. An alternative explanation for my findings is that there is a mediating variable other than interest, enjoyment, attention, or relevance that is affected by humor and influences learning. Possibilities include the effect of physiological arousal (Vance, 1987), increased general motivation to do well, or desire to please an authority figure 114 (such as the instructor, or possibly even the author). A qualitative study of subjects who appreciate the humor and who perform well on tests of recall and recognition may help to identify additional variables. Relationship Between Interest and Learning As stated in the literature review, the presence or absence of interest, whether personal or situational, influences the type of learning strategies individuals employ. Learners who are interested in what they are learning use deep—processing strategies (i.e., making connections, identifying and solving problems on their own), while learners who are not interested use surface-level strategies (i.e., memorization) (Krapp, Hidi, & Renninger, 1992). I also cited several studies that found connections between interest and learning. My findings did not support this connection between interest and learning: neither situational interest nor personal interest was correlated with immediate learning for the experimental ideas chapter, and personal interest was not correlated with delayed learning. The correlation between situational interest and delayed learning, while statistically significant, had an effect size too low to be considered of any practical significance. Similarly, for the scientific fairness chapter, personal interest was not associated with either immediate or delayed tests of learning, and although situational interest was positively associated with both immediate and delayed tests of learning, the effect sizes were too low for these correlations to be considered of practical significance. The way learning was defined and measured in this study may have contributed to the lack of relationship I found between interest and learning: as stated earlier, subjects read the material once and there was no opportunity to study and no incentive to read the 115 materials carefully. Although the presence or absence of interest influences the type of learning strategies individuals employ, as stated earlier, there was no incentive for subjects to actually learn the material. Krapp et al. (1992) argued that situational interest motivates individuals to seek out new information. Similarly, individuals who are personally interested in a topic will seek out new information on that topic. Due to limitations of the study, I don’t know if humor has any long-term effects on subjects’ interest, or if subjects could be more likely to seek out or at least be open to additional experiences with the topic. A longitudinal study that explores interest immediately after reading and its relationship to 1) interest after several weeks or months and/or 2) subjects’ responses to additional readings on the topics after several weeks or months would provide information on the long-term effects of humor on interest. Relationship Between Enjoyment and Learning I proposed a dual role for enjoyment in learning: enjoyment may influence learning directly through affective mechanisms, and it may also make learners more receptive to additional experiences with the topic. Although enjoyment was significantly related to both immediate and delayed learning for the experimental ideas chapter, effect sizes were too low for these correlations to be considered of any practical significance. There was no significant relationship between enjoyment and learning for the scientific fairness chapter. Although a learner who enjoys the learning experience may be more receptive to, and perhaps even seek out, additional experiences with the topic, unfortunately there was no way to determine that in this study. As with the link between interest and learning, a 116 longitudinal study that explores subjects’ attitudes toward the topics several weeks later, and perhaps even their responses to additional readings on the same topic, would help determine if enjoyment can affect receptivity to additional experiences with the topic. In chapter 2, I cited research providing support for the idea that affect influences learning. Specifically, positive affect (such as enjoyment) results in a reliance on general knowledge structures, which reduces demand on cognitive resources, which in turns frees up those resources for other tasks, such as making connections with previous learning and additional processing. The results of this study did not support the effect of positive affect on learning; my findings failed to support Isen, Daubman, and Gorgoglione’s (1987) hypothesis that positive affect results in deeper processing of new information, with more connections being made to previously known information. However, as stated earlier, students had no incentive, and likely no intrinsic desire, to actually learn this information. Relationship Between Attention and Learning Keller (1987) argued that attention is an essential prerequisite to leaming— subjects are not likely to learn anything if they are not paying attention. This study did not find that attention was related to learning: self-reported attention was not correlated with learning for either of the chapters as measured by either immediate or delayed tests of learning. Although this finding seems counterintuitive, attention is likely insufficient by itself to cause learning. In the case of this study, subjects had no opportunity or incentive to study the materials in depth, or even to read them carefully; subjects had nothing at stake (e. g., a grade or other compensation) that would be likely to increase the amount of effort they were willing to put into learning the information in the readings. 117 More research, preferably in a classroom setting in which students have incentive to learn, is needed to determine if there is a correlation between attention and learning. Relationship Between Perceived Relevance and Learning Perceived relevance may influence the amount of effort learners are willing to expend in order to learn, and subjects’ perceived relevance can be enhanced in text through use of certain strategies. Despite theoretical and empirical support for the relationship between perceived relevance and learning, perceived relevance was not related to immediate or delayed tests of recall for either of the chapters. In this study, however, subjects were probably more focused on getting the task done than in doing well at the task, and they completed the task regardless of its relevance. Related Research Questions I explored several questions related to the role of humor in learning that do not appear in the model presented in chapter 3 (i.e., Figure 3-1). Informativeness The first related research question asked if subjects perceived humorous material to be more informative than nonhumorous material. Although my pilot study suggested that subjects found humorous materials to be more informative, in this larger study, subjects did not perceive that humorous materials were more informative than nonhumorous materials. Although this result is not surprising, the fact that this was not significant using a two-tailed test indicates that subjects do not perceive humorous materials to be any less informative than nonhumorous materials. Authors’ concerns that their materials will be perceived as less informative if they use humor would appear to be unfounded, according to these results. 118 Humor Supportive of Text The second question asked how subjects felt humor affected the information presented (e.g., does humor support or detract from the information?) Overall, subjects reported that humor supported the information presented, although they found the humor more supportive in the experimental ideas chapter (mean=4.08; 1=strongly disagree, 5=strongly agree) than in the scientific fairness chapter (mean=3.76). This is consistent with my earlier statements regarding the type and integration of humor into the two chapters: humor was more related to the ideas in that text and more integrated into the text itself. Perceived Learning The third question asked if subjects believed they learned more from humorous materials than from nonhumorous materials. Subjects believed they learned more from the humorous version of the experimental ideas chapter than from the nonhumorous version, but they did not believe they learned more from the humorous scientific fairness chapter. Oddly, subjects’ perceptions of learning did not correlate significantly with actual learning for either of the chapters. A qualitative study exploring subjects’ perceptions of learning as it relates to humorous versus nonhumorous materials, along with a comparison of how these perceptions relate to actual learning, might shed light on these findings. Other Findings Reading Time I recorded reading time for the two versions of the chapters. When adjusted for length, there was no difference in the amount of time it took subjects to read humorous 119 vs. nonhumorous text. This did not support my hypothesis that humorous text would tie into aspects of leisure reading as reported by Lorch, Lorch, and Klusewitz (1993). There are at least three possible explanations for this: 1) humor in instructional text does not automatically cause readers to tap into aspects of leisure reading, 2) subjects were not expected to study this text, so there was no incentive to spend any more time on the text than was absolutely necessary to “get the job done,” or 3) subjects’ perceptions of the amount of time it takes to read academic material compared to leisure material is inaccurate. Lorch et al. (1993) reported that students perceived their reading to be faster for leisure reading, even when they were reading with the intention of learning something. However, in the study by Lorch et al., there were no comparisons of actual reading speed. More research is needed to determine if leisure reading, and particularly leisure reading with the goal of learning something, is faster than reading done as part of a class assignment. Comparisons of Two Chapters Subjects were asked which chapter they found easier to stick with, which chapter they enjoyed more, which chapter they felt was more likely to be in a textbook, and which chapter they would choose for leisure reading. Subjects were also asked to explain their answers. Easier to Stick With When asked which chapter was easier to stick with, most subjects (78 percent) reported that the humorous chapter was easier to stick with. However, preferences varied between topics: 92 percent of the subjects who read the humorous experimental ideas chapter found it easier to stick with that chapter than the nonhumorous scientific fairness 120 chapter. Similarly, 63 percent found it easier to stick with the nonhumorous experimental ideas chapter than the humorous scientific fairness chapter. Obviously, with so many subjects preferring the experimental ideas chapter, the two chapters were not equivalent in terms of ease of reading, amount and difficulty of content, and/or other factors. However, since subjects who read the humorous version of the scientific fairness chapter were more likely to select that chapter than readers who read the nonhumorous version, humor may have some ability to retain subjects’ interest in informational text. In order to determine humor’s ability to hold a learner’s attention, more research is needed using texts that are approximately equivalent in terms of interest and difficulty of content. More Enjoyable Both versions of the experimental ideas chapter were enjoyed more than the scientific fairness chapters: 94 percent of subjects said they enjoyed the humorous experimental ideas chapter more than the nonhumorous scientific fairness chapter, and 67 percent enjoyed the nonhumorous experimental ideas chapter more than the humorous scientific fairness chapter. Again, since subjects who read the humorous version of the scientific fairness chapter were more likely to select it than were readers of the nonhumorous version of the scientific fairness chapters, this indicates that humor may affect readers’ enjoyment, even when the material is difficult. More Likely in Textbook When asked which chapter they felt they would be more likely to find in a textbook, most subjects selected the nonhumorous chapter they had read: 88 percent of subjects who read the humorous experimental ideas chapter and nonhumorous scientific fairness chapter reported that the latter would be more likely to appear in a textbook. 121 Sixty-six percent of subjects who read the nonhumorous experimental ideas chapter and the humorous scientific fairness chapter reported that the former would be more likely to appear in a textbook. Although 76 of the 98 subjects who responded to this question said they would be more likely to find the nonhumorous version in a textbook, only seven of the subjects said this was because of the humor. The largest percentage of subjects (47 percent) cited the presentation style more generally (e. g., “Readings out of books usually tend to be more monotonous and hard to pay attention too [sic]” [subject #123]). It is not clear why students overwhelmingly chose the nonhumorous version as the one that would appear in a textbook but did not cite humor as the reason for this, since the overall style of presentation was the same for both humorous and nonhumorous chapters (i.e., humor was removed from the nonhumorous version, but the author’s casual and direct style of writing was retained). This suggests that humor may have an effect on subjects’ perception of the presentation of the material that goes beyond the humor itself. A replication of this study using two chapters that are more closely matched for type and amount of humor, difficulty of content, and interest to subjects may provide a better idea of how humor affects readers’ responses and impressions of instructional material. Preferred for Leisure Reading When asked which chapter they would choose for leisure reading, subjects again preferred the experimental ideas chapter over the scientific fairness chapter. Ninety-six percent of subjects who read the humorous experimental ideas chapter preferred it over the nonhumorous scientific fairness chapter, while 35 percent of the subjects who read 122 the humorous scientific fairness chapter preferred it over the nonhumorous experimental ideas chapter. As with the findings regarding the easier chapter to stick with and which chapter subjects enjoyed more, humor appears to have influenced which chapter students would select for leisure reading. Nineteen of 104 subjects cited the humor when asked why they would select their chosen chapter. Twelve subjects who read the humorous version of the experimental ideas chapter said it was easy to read and understand, compared to only four subjects who read the nonhumorous version of that chapter, and three subjects said they would select the humorous version of scientific fairness because of the ease of reading. This suggests that humor may contribute to subjects’ perceptions of a reading as being easier to read. Likes When subjects were asked what they liked about each of the chapters, twice as many readers of the humorous version than the nonhumorous version of the experimental ideas chapter reported that it was interesting. Many more of the subjects who read the nonhumorous experimental ideas chapter cited the writing style or the fact that it was easy to read or understand, the examples, relevance or their ability to relate to the material, and organization as factors that they liked about the chapter. Only 20 percent of the readers of the humorous experimental ideas chapter cited the humor as something they liked about the chapter. About half of the readers of the humorous version of the scientific fairness chapter cited the humor when asked what they liked about the chapter. This percentage was much higher than that for the humorous experimental ideas chapter. Readers of the 123 nonhumorous scientific fairness chapter were more likely to list text characteristics (e. g., use of bold or italics, headings, etc.) and organization as factors they liked about the chapter. Approximately equal numbers of subjects of each version of the scientific fairness chapter listed ease of reading or the writing style as something they liked about the chapter; however, only 19 subjects cited this, compared to 40 of the readers of the experimental ideas chapter. The fact that more subjects said they liked the ease of reading or the writing style of the experimental ideas chapter than the scientific fairness chapter is consistent with findings that suggest that the scientific fairness chapter was more difficult for subjects. Regardless of which chapter they read, more readers of the nonhumorous versions than the humorous versions reported that organization was something they liked about the chapter. More research is needed to determine if humorous text is perceived as less organized, or if this is an artifact (i.e., although subjects were not limited in the number of things they could list that they liked about the chapter, perhaps since they could not cite humor as something they liked about the chapter, they searched for an alternative explanation). Dislikes When asked what they disliked about each of the chapters, subjects listed a variety of things. About one-quarter of subjects (23 percent) said there was nothing they disliked about the experimental ideas chapter. In fact, readers of the nonhumorous experimental ideas chapter were somewhat more likely (14, compared to 10 of the readers of the humorous version) to say there was nothing they disliked. Readers of the nonhumorous versions of each chapter were more likely to say that those chapters were 124 dry, boring, not interesting, or didn’t hold their attention. One explanation for this effect is that, even if subjects didn’t find the humor to be funny, the humor did provide novelty: it is unlikely that subjects encountered humor (even if the humor was a rather poor attempt at amusing the reader) in many of the textbooks they had read prior to their experiences in this study. According to Keller (1987), novelty can help to capture and maintain a learner’s interest. Unfortunately, if humor works because of its novelty and not through some other mechanism, the novelty effect is likely to wear off after repeated exposure. Aids to Learning When asked what helped them learn the information in the chapters, about one- quarter of the readers of each of the humorous chapters (26 percent and 25 percent of the readers of the humorous experimental ideas chapter and the humorous scientific fairness chapter, respectively) said the humor helped them learn. Readers of both versions of both chapters frequently said that examples helped them learn; readers of the nonhumorous scientific fairness chapter cited examples somewhat more frequently than did readers of the humorous scientific fairness chapter. More readers of the humorous versions of the chapters said ease of reading or understanding, or the writing style helped them learn. In contrast, readers of the nonhumorous versions were more likely to say the overview or summary helped them learn. In other words, readers of the humorous versions were more likely to cite the process of the reading, while readers of the nonhumorous versions cited the structure. 125 Summary The findings of this study support the assertion that humor can help students learn and can have other positive benefits (such as enhancing interest, enjoyment, and attention), but only under certain conditions. There were indications that the humor in the scientific fairness chapter was not well integrated with the text and therefore did not facilitate learning for readers. However, humor did not appear to have any negative effects, either on learning or on subjects’ attitudes. Regarding the qualitative data, it is difficult to know how subjects defined their uses of terms. For example, a subject’s use of the term “interesting” when describing what he or she liked about a chapter or why he or she preferred it for leisure reading may have encompassed humor in addition to any number of other variables (e. g., relevance). Subjects also combined ideas in their responses that I classified into two or more categories. For example, when asked what helped to learn the information in the experimental ideas chapter, one subject wrote, “It was easy reading that grabbed my attention” (#106). This was classified under both “easy to read/understand” and “attention,” but these factors may not have been separable in the subject’s mind. Based on my findings, I have revised my model showing the effect of humor in instructional text (see Figure 5-1). Learning, interest, and enjoyment remain as important outcomes of humor in instruction. Note that I have added subject knowledge and experiences and difficulty of content, which combine with actual humor in the text and delivery of the humor to influence subjects’ perception and appreciation of humor. If the humor is perceived and appreciated by the subjects, then interest, enjoyment, and learning result. Although I didn’t find that interest and enjoyment influenced learning in 126 this study, I proposed that interest and enjoyment may result in a greater receptivity to additional experiences with the topic; more research is needed to determine if this occurs. Although there was a direct link between humor and learning for the experimental ideas chapter, none of the proposed mediating variables were found to have an effect on humor. However, there may be other variables that mediate the effect of humor on learning. subject knowledge & expenences interest presence of humor in text perception/ appreciation of learning _ humor delivery of \N ? humor difficulty of content enjoyment Figure 5-1. Revision of model. showing factors that influence the perception and appreciation of humor in instructional text and the outcomes of humor Implications for Theory In chapter 2, I cited dual coding theory as providing theoretical support for the use of humor in instructional text. Briefly, dual coding theory states that comprehension and memory of text are affected by both verbal and nonverbal systems (Sadoski, 93), and that we understand and remember more if both systems are engaged. I argued earlier that, based on students’ reactions, the humor in the humorous scientific fairness was less integrated with the content. And although half of students who read the humorous version 127 of the scientific fairness chapter said they liked the humor, only one quarter reported that humor helped them learn. If humor was indeed more effective in the experimental ideas chapter, then this research supports dual coding theory: the chapter that engaged both verbal and nonverbal systems was better remembered. I also discussed Keller’s ARCS model of motivational design of instruction earlier. Keller’s ARCS model of motivation delineates four requirements that must be met in order for people to be motivated to learn: the student’s attention must be gained and sustained, the material must be [elevant to the student, the student must be gonfident that he or she can learn the material, and the student must be gatisfied with the process of the experience (Keller, 1987). Keller’s ARCS model includes two elements included in my original model: attention and relevance. I did not find a relationship between these variables and learning, but motivation by itself is not enough to cause learning. Other factors, such as the opportunity and incentive to learn, may override any effects of motivation. Recommendations for Authors who Wish to Incorporate Humor into Instructional Text Based on the results of my research (including this study, the pilot study, an early exploratory study of humor in learning, and reviews of the literature), I have the following recommendations for writers who wish to include humor in their written instructional materials: 0 Make sure the humor is closely related to the text. Humor that is only peripherally related to the text may distract readers from the main ideas of the text. 128 Make sure the humor does not assume background or experiences that students are unlikely to have. Students will not benefit from humor that they don’t “get.” Include humor only in instructional pieces that students are likely to understand reasonably easily. Humor does not appear to aid learning when readers are struggling just to make sense of the text. Include the humor as you are initially writing the material. Going back to the material later and attempting to add humor may result in humor that is more peripherally related to the ideas in the text and not as well integrated into the text as a whole. Link the humor to the main ideas of the text. Wade and Adams (1990) found that interesting ideas were recalled better than less interesting ideas that were more important. Build a relationship with the reader. In my initial studies of humor in instructional materials, I found that readers were taken aback by humor when there was no introduction by the author. When I included such an introduction (i.e., a note from the author telling his reasons for writing in the style he used), students were more receptive to the humor. Use humor with caution in particularly sensitive material. In the chapter on scientific fairness, after a discussion of a researcher who was investigated for research fraud and discredited, Martin wrote, “He then promptly committed suicide.” Although this was not considered particularly humorous, at least one of the subjects felt this treated suicide lightly: when asked the question “What 129 did you not like about this chapter?”, this subject wrote, “Suicide is not funny. It should not be used as a point of humor” (subject #195). 0 Do not allow humor to take the place of effective instructional techniques in text. When asked what helped them learn the information in the chapter, subjects frequently cited organization, examples, and ease of reading. These suggestions focus mostly on the circumstances under which it is appropriate to include humor in text, and not on how to come up with humor. Some professional organizations and companies that specialize in teaching public speaking offer seminars on including humor. In addition, there are books on comedy writing (e. g., Helitzer, 1987), and some community education programs offer courses in stand—up comedy and comedy writing. Authors who are interested in including humor in their textbooks may find it helpful to explore one or more of these opportunities. Strengths This study was a true experiment, which allowed me to manipulate the materials, determine subjects’ reactions, and make cause-and-effect conclusions for the effects of humor. Although I was not able to analyze the study as a single within-subjects design as I had intended, this design provided me with considerably more information than a between-subj ects design would have. If I had designed a between-subjects study using only one of these chapters, 1 would have come to a different conclusion: had I done a study using only the experimental ideas chapter, I would have concluded that humor facilitates learning, while a study using only the scientific fairness chapter would have led to a conclusion that humor does not aid learning. 130 A power analysis performed prior to data collection indicated that 80 subjects would be sufficient to determine actual effects of humor. I ended up with usable data from slightly over 100 subjects, which I believe provided sufficient power to detect any true differences between the groups. Limitations A major limitation of this study was that it did not occur within the context of an actual course. Students were tested on recall without having either the ability or the incentive to study. Although the results I found may be important, my ability to generalize my findings to a classroom situation are extremely limited. This study is limited to a single subject area (i.e., experimental psychology). 1 am not able to state the effects of humor in other subject areas, especially given that I discovered differences in the effects of humor between two chapters that came from a single book within a fairly specific subject area. This study is also limited to college students who have been in school continuously since graduating from high school. Additional research would be needed to determine the effects of humor on subjects who are older and/or who have been out of school for a while. Other than presence and absence of humor, I did not manipulate the amount of humor in this study to determine an optimal amount. Research has indicated that there is an optimal level of humor in a classroom situation (Ziv, 1988). However, spoken humor is qualitatively different from written humor: a presenter can rely on spontaneity and audience needs when presenting humor. These aspects are not available to a writer. Future studies may investigate the effects of differing levels of humor in text. 131 In order to look at how subjects’ responses compare to specific instances of humor in the text, I had four people each rate the humor in two versions of text (either humorous experimental ideas and nonhumorous scientific fairness, or nonhumorous experimental ideas and humorous scientific fairness). Obviously, more raters would have helped me get a better sense of what was funny in each chapter and how the humor was interpreted differently by different people. However, practical considerations limited me to having each version of each chapter rated by two people. Out of necessity, the text contained a visible author, which is very different from the majority of textbooks students have encountered. Some subjects may have found a visible author disconcerting or even unacceptable (Paxton, 1997). However, Paxton (1997) found positive effects of a visible author even for a student who found it objectionable. Next Steps Throughout this section, I have suggested additional research that is needed to confirm or further clarify my findings. In sum, additional studies should compare materials matched for type and amount of humor, general interest, and difficulty of content. Studies should take place in classrooms or other environments in which subjects have the incentive and opportunity to study. Research in an actual classroom setting, in which the students have a high motivation to do well, may result in the effects of humor washing out; however, if humor enhances interest and enjoyment, subjects may find learning to be easier. Subjects should be interviewed to determine what they find amusing in the chapters, and to find out other effects of humor (such as physiological arousal). Questions in tests of learning should link both to specific instances of humor in the text 132 (to determine effects of specific instances of humor on learning) and to the text more generally (to verify the overall effect of humor in text). Additional studies should include populations other than college students and should include text from subjects other than experimental psychology in order to determine the more general effects of humor on learning. 133 REFERENCES Agnes, M. (Ed.). (2000). Webster's New World College Dictionary (4 ed.). Foster City, CA: IDG Books Worldwide, Inc. Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68(1), 52-81. Alexander, P. A., Kulikowich, J. M., & Jetton, T. L. (1994). The role of subject-matter knowledge and interest in the processing of linear and nonlinear texts. Review of Educational Research, 64(2), 201 -252. Alexander, P. A., Kulikowich, J. M., & Schulze, S. K. (1994). How subject-matter knowledge affects recall and interest. America] Educational Research Journal, 31(2), 313-337. Anandam, K., & F leckman, B. (1977). Telephone dialogue intervention in open learning instruction. Journal of College Student Personnel, 18(3), 219-223. Barreca, R. (1991). They Used to Call Me Snow White... But I Drifted: Women ’5 Strategic Use of Humor. New York: Viking. Berger, A. A. (1997). The Art of Comedy Writing. New Brunswick, NJ: Transaction Publishers. Bergin, D. A. (1999). Influences on classroom interest. Educational Psychologist, 34(2), 87-98. Bless, H. (2001). Mood and the use of general knowledge structures. In L. L. Martin & G. L. Clore (Eds), Theories of Mood and Cognition: A User’s Handbook (pp. 9- 26). Mahwah, NJ: Lawrence Erlbaum Associates. Bohlin, R. M., & Milheim, W. D. (1994). Applications of an adult motivational instructional design model. Paper presented at the Association for Educational Communications and Technology, Nashville, TN. Brophy, J. (1998). Motivating Students to Learn. Boston: McGraw-Hill. Bruner, J. S. (1957). On perceptual readiness. Psychological Review, 64, 123-152. Bryant, J ., Comisky, P. W., Crane, J. S., & Zillmann, D. (1980). Relationship between college teachers' use of humor in the classroom and students' evaluations of their teachers. Journal of Educational Psychology, 72(4), 51 1-519. Bryant, J.S., & Zillmann, D. (1989). Using humor to promote learning in the classroom. In P.E. McGhee (Ed.), Humor and Children 's Development. New York: Haworth. 134 Cabello, B., & Terrell, R. (1994). Making students feel like family: How teachers create warm and caring classroom climates. Journal of Classroom Interaction, 29, 17- 23. Cennamo, K., & Braunlich, E. (1996). The effects of relevance on mental effort. Paper presented at the National Convention of the Association for Educational Communications and Technology, Indianapolis, IN. Clayden, G. S., & Wilson, B. (1988). Computer-assisted learning in medical education. Medical Education, 22, 456-467. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159. Cohen, T. (1999). Jokes: Philosophical Thoughts on Joking Matters. Chicago: The University of Chicago Press. Collier, K. G. (1980). Peer-group learning in higher education: The development of higher order skills. Studies in Higher Education, 5(1), 55-61. Crismore, A. (1984). The rhetoric of textbooks: Metadiscourse. Journal of Curriculum Studies, 16, 279-296. Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. Fort Worth, TX: Harcourt Brace Jovanovich College Publishers. Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. New York: Plenum. Deci, E. L., & Ryan, R. M. (2000). Self-determination theory: An approach to human motivation and personality [On-line]. Available.“ http : www. psych. rochester. edu/SD T /m easures/in trins. html. Eisenberger, E., & Cameron, J. (1996). Detrimental effects of reward: Reality or myth? American Psychologist, 51, 1153-1166. Elliott, E., & Dweck, C. S. (1988). Goals: An approach to motiation and achievement. Journal of Personality and Social Psychology, 54(5-12). Fiedler, K. (2001). Affective states trigger processes of assimilation and accommodation. In L. L. Martin & G. L. Clore (Eds.), Theories of Mood and Cognition: A User's Handbook (pp. 85-98). Mahwah, NJ: Lawrence Erlbaum Associates. F orgas, J. P. (1991). Affect and social judgments: An introductory review. In J. P. Forgas (Ed.), Emotion and Social Judgments (pp. 3-29). Elmsford, NY: Pergamon Press Inc. Gamer, R., & Gillingham, M. G. (1991). Topic knowledge, cognitive interest, and text recall: A microanalysis. Journal of Experimental Education, 59(4), 310-319. 135 Garrett, T. J ., Ashford, A. R., & Savage, D. G. (1987). A comparison of computer- assisted instruction and tutorials in hematology and oncology. Journal of Medical Education, 62, 918-922. Gathany, N. C., & Stehr-Green, J. K. (1994). Putting life into computer-based training: The creation of an epidemiologic case study. Educational Technology, 44-47. Glew, P. ( 1983). Kinesiology: Academic aspects of physical education. In G. Collier (Ed.), The Management ofPeer-Group Learning: Syndicate Methods in Higher Education (pp. 42-47). Guildford: Society for Research into Higher Education. Glynn, S. M. (1978). Capturing readers' attention by means of typographical cuing strategies. Educational Technology, 18(11), 7-12. Goetz, E. T., & Sadoski, M. (1995). Commentary: The perils of seduction: Distracting details or incomprehensible abstractions? Reading Research Quarterly, 30(3), 500-515. Goldstein, J. (1993). Humor and comedy in mass media. Medienpsychologie, 5(4), 246- 256. Gorham, J ., & Christophel, D. M. (1990). The relationship of teachers' use of humor in the classroom to immediacy and student learning. Communication Education, 39(1), 46-62. Hartley, J. (1987). Designing electronic text: The role of print-based research. Educational Communication and Technology Journal, 35(1), 3-17. Helitzer, M. (1987). Comedy Writing Secrets: How to Think Funny, Write Funny, Act Funny and Get Paid for It. Cincinnati, OH: Writers' Digest Books. Hidi, S. (1990). Interest and its contribution as a mental resource for learning. Review of Educational Research, 60(4), 549-571. Hidi, S. (2000). An interest researcher‘s perspective: The effects of intrinsic and extrinsic factors on motivation. In C. Sansone & J. Harackiewicz (Eds.), Intrinsic and Extrinsic Motivation: The Search for Optimal Motivation and Performance (pp. 309-339). San Diego: Academic Press. Isen, A. M., Daubman, K. A., & Gorgoglione, J. M. I. E., (pp. ). :. (1987). The influence of positive affect on cognitive organization: Implications for education. In R. E. Snow & M. J. Farr (Eds), Aptitude, Learning, and Instruction, Volume 3: C onative and Affective Process Analyses (pp. 143-164). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc. Johnson, H. A. (1990). Humor as an innovative method for teaching sensitive topics. Educational Gerontology, 16, 547-559. 136 Kaplan, R. M., & Pascoe, G. C. (1977). Humorous lectures and humorous examples: Some effects upon comprehension and retention. Journal of Educational Psychology, 69(1), 61 -65. Karis, D., Fabiani, M., & Donchin, E. (1984). "P300" and memory: Individual differences in the von Restorff effect. Cognitive Psychology, 16, 177-216. Keller, J. M. (1979). Motivation and instructional design: A theoretical perspective. Journal of Instructional Development, 2(4), 26-34. Keller, J. M. (1983). Motivational design of instruction. In C. M. Reigeluth (Ed.), Instructional-Design Theories and Models: An Overview of their Current Status (pp. 383—434). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc. Keller, J. M. (1987). Strategies for stimulating the motivation to learn. Performance and Instruction, 26(8), 1-7. Korobkin, D. (1988). Humor in the classroom: Considerations and strategies. College Teaching, 36(4), 154—158. Krapp, A., Hidi, S., & Renninger, K. A. (1992). Interest, learning, and development. In K. A. Renninger & S. Hidi & A. Krapp (Eds), The role of interest in learning and development. Hillsdale, NJ: Lawrence Erlbaum Associates. Long, D. L., & Graesser, A. C. (1988). Wit and humor in discourse processing. Discourse Processes, 11, 35-60. Loomans, D., & Kolberg, K. (1993). The Laughing Classroom: Everyone's Guide to Teaching With Humor and Play. Tiburon, CA: HJ Kramer, Inc. Lorch, R. F., Jr., Lorch, E. P., & Inman, W. E. (1993). Effects of signaling topic structure on text recall. Journal of Educational Psychology, 85(2), 281-290. Lorch, R. F ., Jr., Lorch, E. P., & Klusewitz, M. A. (1993). College students' conditional knowledge about reading. Journal of Educational Psychology, 85(2), 239-252. Main, R. G. (1992). Integrating the affective domain into the instructional design process ( AL-TP-1992-0004). Brooks Air Force Base, TX: California State Univ., Chico. Coll. of Communication. Martin, D. W. (2000). Doing Psychology Experiments ( 5 ed.). Belmont, CA: Wadsworth/Thomson Learning. Martin, R. A., & Lefcourt, H. M. (1983). Sense of humor as a moderator of the relation between stressors and moods. Journal of Personality and Social Psychology, 45(6), 1313-1324. 137 McDaniel, M. A., Waddill, P. J ., Finstad, K., & Bourg, T. (2000). The effects of text- based interest on attention and recall. Journal of Educational Psychology, 92(3), 492-502. Means, T. B., Jonassen, D. H., & Dwyer, F. M. (1997). Enhanced relevance: Embedded ARCS strategies vs. purpose. Educational Technology Research and Development, 45(1), 5-17. Mogavero, D. T. (1979). It's confirmed: J-students like humor in the classroom. Journalism Educator, 34(1), 43-44, 52. Narvaez, D., van den Broek, P., & Ruiz, A. B. (1999). The influence of reading purpose on inference generation and comprehension in reading. Journal of Educational Psychology, 91(3), 488-496. Nolen, S. B. (1995). Effects of a visible author in statistical texts. Journal of Educational Psychology, 87(1), 47-65. Okey, J. R., & Santiago, R. S. (1991). Integrating instructional and motivational design. Performance Improvement Quarterly, 4(2), 11-21. Parrott, T. E. (1994). Humor as a teaching strategy. Nurse Educator, 19(3), 36-38. Paxton, R. J. (1997). "Someone with like a life wrote it": The effects of a visible author on high school history students. Journal of Educational Psychology, 89(2), 235- 250. Peterson, 1. (1980). Humor in the physics classroom. The Physics Teacher, 18(9), 646- 650. Robbins, J. (1994). Using humor to enhance learning in the skills laboratory. Nurse Educator, 19(3), 39-41. Rowell, R. M., & Van Kirk, J. A. (1978). Tutorial modules: How we keep humans in our instructional packages. Educational T echnology, 18(11), 13-15. Ryan, R. M., Connell, J. P., & Plant, R. W. (1990). Emotions in nondirected text learning. Learning and Individual Differences, 2(1), 1-17. Sadoski, M., Goetz, E. T., & Fritz, J. B. (1993). Impact of concreteness on comprehensibility, interest, and memory for text: Implications for dual coding theory and text design. Journal of Educational Psychology, 85(2), 291 -304. Sadoski, M., Goetz, E. T., & Rodriguez, M. (2000). Engaging texts: Effects of concreteness on comprehensibility, interest, and recall in four text types. Journal of Educational Psychology, 92(1), 85-95. 138 Sadoski, M., & Quast, Z. (1990). Reader response and long-term recall for journalistic text: The roles of imagery, affect, and importance. Reading Research Quarterly, 25(4), 256-272. Schiefele, U., & Krapp, A. (1996). Topic interest and free recall of expository text. Learning and Individual Differences, 8(2), 141-160. Schmidt, S. R. (1991). Can we have a distinctive theory of memory? Memory and Cognition, 19, 523-542. Schmidt, S. R. (1994). Effects of humor on sentence memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20(4), 953-967. Schmidt, S. R., & Williams, A. R. (2001). Memory for humorous cartoons. Memory and Cognition, 29(2), 305-311. Schraw, G., & Lehman, S. (2001). Situational interest: A review of the literature and directions for future research. Educational Psychology Review, 13(1), 23-52. Sheppard, L. M. (1998, April). Transforming a basic computer literacy module from snoozer to success. Paper presented at the Abstract presented at the meeting of the Central Group on Educational Affairs, a division of the Association of American Medical Colleges, Chicago, IL. Spires, H. A., & Donley, J. (1998). Prior knowledge activation: Inducing engagement with informational texts. Journal of Educational Psychology, 90(2), 249-260. Svebak, S. (1996). The development of the Sense of Humor Questionnaire: From SHQ to SHQ-6. Humor: International Journal of Humor Research, 9(3/4), 341-361. Vance, C. M. (1987). A comparative study on the use of humor in the design of instruction. Instructional Science, 16, 79-100. Veatch, T. C. (1998). A theory of humor. Humor: International Journal of Humor Research, 11(2), 161-215. Wade, S. E., & Adams, R. B. (1990). Effects of importance and interest on recall of biographical text. Journal of Reading Behavior, 22(4), 331-353. Wandersee, J. H. (1982). Humor as a teaching strategy. The American Biology Teacher, 44(4), 212-218. Wanzer, M., Booth-Butterfield, M., & Booth-Butterfield, S. (1995). The funny people: A source-orientation to the communication of humor. Communication Quarterly, 43(2), 142-154. Watson, M. J ., & Emerson, S. (1988). Facilitate learning with humor. Journal of Nursing Education, 27(2), 89-90. 139 Weinberger, M. G., & Gulas, C. S. (1992). The impact of humor in advertising: A review. Journal of Advertising, 21(4), 35-59. Welkowitz, J ., Ewen, R. B., & Cohen, J. (2000). Introductory Statistics for the Behavioral Sciences (5 ed. Vol. 5). Fort Worth, TX: Harcourt Brace & Company. Zemke, R. (1991). Humor in training: Laugh and the world learns with you-~maybe. Training, 28(8), 26-29. Zillmann, D. (1988). Mood management through communication choices. American Behavioral Scientist, 31(3), 327-340. Zillmann, D., & Bryant, J. (1985). Affect, mood, and emotion as determinants of selective exposure." In D. Zillmann & J. Bryant (Eds), Selective Exposure to Communication (pp. 157-190). HIllsdale, NH: Lawrence Erlbaum. Ziv, A. (1988). Teaching and learning with humor: Experiment and replication. Journal of Experimental Education, 5 7(1), 5-15. 140 APPENDICES 141 APPENDIX A 142 .3 Ho 62 65 3: as.» meS Essum »~m Hose moon§E »H:m SEE 93 3:03 wsHoHooHlmeHto .wsso» Em EoEoEtRme EmE 65 vs: 8 zoos? a 93 H .862 3:3 wsH3oHH 53 EE 2o 3302-33 a mm .856 2: H6363 H 23.6 HmEso.» 6 H68 H 6E: ».66 £56» .8: .: 863:5 3 s33: .63 96: 36H m Hose 6:3 95 Homsoussoo 8 2t: oHo soao E39666: .ss 95ng 3:63: rsEsoo 633563 630E sso» 65 Hose msEow m 3 umsE :Emomm: wEo: oso»sw 65 H33 soEEoo 3H Eo: mEBm 9:36:66 @3356 \o 3652 Eeocnmwuob .soEEoo «moE 65 3 3 E96 933:: wEEoHHoH 3H. 63:36:69 32an 9 »onoEE.6u 333333 H6386 9 6:8: 82: Ho ousmHnEomoe »s$ .6662 HausoEtofion 6w 8 3:59: .Eo :E:3 £393 65 6E3 ou soESQEB 65 669— uossmo H .Hmmwo:o:o»ms a Em H 665m .6523 968 12858.: :8 EmwonosoEH .mEoEtoono »wo_o:o»mnH Ho wsHHosfimsmHEsmHE a Eo: wEEEBm .7326»: »:wsms 98 £62 fiEmEtoono 3on 966m 33H HSsoEHuonm Maison .so» 8 6636va E63. £63 .50» :6 .223 a 6:6 ism .33696 3.56: .50» 3398s :8 36H 3:. .623 o: so» 962 65 53 wso3 m: wEfoEom H336 2m. so» H3“ 3.: 3 »wE : as: .962 »E~ 96: rsoc so» 65 6st Hos mLH .EoEtono s6 SH 962 »:m 96: “how so» 6E :8 so» : so» 96:3 9 69:8 :3 H comma 3: EH ax..wsE..oE 65 E wEfi HE: :oooo3 66 H 65 m»mHo so 63666 98E H E5 a«HEM: £3 E 96E ems» so EE ESE H Eso:ms a«Ego o5 »E .5: 3:6 8 »m3 63 3a 333.. ..H commeo>lmm3H HESS—€69“: ”msommmom :s: .8 65.6: 6 3333 EwEs: «sons ofiwsofi Ho bow—s 96: 8 Emma :82 EN 6w so: :38: 93 Esocsum oEmm 65 .6st EH .»m3m 6:3 »HHEHm bmmotso £5 65 96:3 8 3.38 H a«H363 om Bacon E »:>?. .333: mm Hooow mm :26 H rose »:>>s amuse: t2 .6: £3 66 »ss6H. moo: 3oHHs its.“ om ENE 65 9 »:3 .»EEoH>H.. ”.8333 EwEs: wsHvsHoE .wEfib96 Eons msotso 96 63 E965? =wEm m< .6me o: 633 3:33...” 65 m: E638: 65 96:3 woo: H .3 638 8 3o: 3 E8 :33 Use 258 t »:3 Sons :oEaHo on :oEeoH Hose EoEoE 9:823 ma: H66HEoH 3o: o>3 H .sozmosv 65 .6336 8 6H£mmonHE_ z 958 omHm H .EoHnoE a 53 «won 233 «63 on 35me »:3 HESEoHEs 3 :soctw : Hos: H E: »Hso qu $.6on om 6m 63 op 33:. £333..“ 3:236 »E Ho :63 63363 3“ H963 3 2:8 wsmsaouw 65 was @52on 65 £68 32me Ho 5: 65 o>3< .EoEswmmmm ma: 8 msobomoe :65 »: :23an 33 H HE: E .EoEEEUE 3.58 m we EsmEEonQ s96m wEmoHohH Ho :93 65 8.65:6 »ono:o»mH bouoswobfi :wmwmm 8 mm :mHHooH Hose 23 om mm3 moso H ENE massive REE» basic H325: «\o 6:333» m 3 $3 :8 ME» SHEonm 53 M53285 5.» 5 328 «E 356385 .6on 336 2.23 8 MERE as 3 8 E93 See. 9: .39.. €36th m E 265.3. 3 No: Home: ENE b82382: 3S 338:6 $3: 9. we QoHocoka €98 o9: 865 63%: 63% sienna: m E musoEtoonm »ono:o»mnH wEoQ 8.3: S EEQEEE 9:3 N .63: @33st .mswuoms oow cam .wEEmRH somEoFH. Ho HERE: 6 .aner :to3363 of mo EEHEM em 3953363 Ho sommmmEuos 53 Humanism: .ooow© 3th): .3 d »: 48.33 am. 5:65th sMoHocosmN «SEQ E9: H6333 not. 3265.698 ca 60 3 30: 143 :68: 68668 88 .8868 E toms 88 8 8s.» .:8 6:8 .8: E us: J8toAHEEs 8: 85588 .8 6388382 8 85 wE»8w 8: E8 H .88: So» 8388 so» 83 8 83Es: 53 wE»8E 88.86 o:3 mcooEom H8: m»83H8 886 so» .882 8868:6886 woom «so 385 8 so» 8:8 8: Ho_so:m »65 8:88 So» 8888:: so» 83 8o 85 888 98 888 88 85 .6:E6E8 .88 858588 58888 65 9:88 85 886E586 685 »58 .6288 :3 so» 9: 88588388 858qu 8 98 so» $88.8 825.88 8o» 83 8 3o: 8 683E 8w 8.88 So» “so 88: 8 3o: 838688 :88 .66: so» :H .968: .865 wEEsoo 85 6:ws8 28583888 »8 o: 8 wE>8: 5895 6:83 oEom $938.88on 86K» 838E838wa .68: 885830 meQEoo 98E 38an m»83~8 888 so.» .mfiEmw VHE5 .85 .53 888 o .H. 8:88 65 6.8.68: 8888 »=8sms »65 6: »65 8:3 ”886E836 858.8E .85 86HnHEoo Eovam 8::o5HoEoEmw8nH 53 6:83 .sotmosHo 886E586 So» 6388 888 85 886E538 umoHnHEE 65 8.: E8 :Hso:m so» »HH868w .888H696 868an 8 888858 6E8 98 965 3:3 68668 3 “.88 u: .BQEE 8.: :H ”m: 88E 86:.H. .8838 :8 28 E 8868 no 6888 65 88:8 :3 85 886E588 88588 53 as ono “msE »65 :E5 8::o5HoEoE88m NbBQQEG8 88K» SeocQoEoE~E§~ E 8: 8 3o: so» :88 8o o:3 638—88 3 E3 3888 $8883 8: 888.888 833 Hog :8: :9888 65 8.8% a as: 39888 o5 so» 83 888 888.8%?‘ .688: :8 :26: 85 98E o: 8888 5:38.68 E8 8888888 3888 88888 8888 £85.86— H8:.6> 8 :88 .»ono:o»mnH mo 898 .650 .83 wE6HooE 58 .8888 .683 .888: »8 85 888.888 98E o: 53 »wo_o:o»mnH 8:8 8 888 88E 8 56866: 683 888.888 o: 8 88: 88s :9888 83 65 Ho 6Eom .6630: 538858 98 28:88: :8: ..H so_m.6>l83H 8868868me 39888 65 .683 65 .uaoEEsvo 65 6388 98E 65 85 83oz: 88».6>m 8339888 88658 88888 65 mo E83 8 98 so» .EmEaHmsHoo 35:88 58858588 88888 «H 838 5888696 »8 wEoHo .6888 8: :3 so» .: .88: 6:8 85 :O .888 mo :8: 8 85 58888588 98E 888.888 wEEsHo8 862 H88Em.6&6 »8 Eob »838 so» 9888 53 »888E 8H:.H. 885888388: :8 885588 6E8: 8 88 so» .988 a: 8:88 .888 :8 65 :8 ow x 888 8:3 Emu 65 85 8: 38888 65 8 688385— H8oH8:o6E 8o» Ho H88 Esm 65 :H 388: »3 8» MEoQ .8 88.5 8.383.: 8: :8 »888QQV \o 86.5 N~3o3Qo§8Em¢Q88R .5 ms mo 88 65 8:3 8.8:.H. .663o: .888 :8Ew E 838 68668 98E 8 5858 3 ubonH .98 so» H8Ewtocs 3o: »586 “so 88: :3 so» 88 .888E .8 898 .Eo» E 68: 83 68: 886E836 6:8 8:3 “so 85 8 3o: :88 :3 so» 888:8 86: 65 :H .».865 8.86 »Hoo:6Eom 88 8 8:68 8.86 »Hoo:6Eom H8 8885? 8s 88EE696 8oz .»ono:o»md E 83E 38 98 8885696 H8EwH8 »H8.H. 8838.8: H88 8 888 8 8:88 :88 8 Ewso5 83 »898 8: 3:35.83 wE5».66 85 8:3 8 53 .88 8:5 8E:Eoo o:3 8338858: 2 .H8Ewto »_8s_o38 m: 8: 86:8 88: »8 68:8: 8 58:8 88 8m:o:nH88:Em 53 6888 »8on 8.5855» .8 86K» m3oc§88~5~ 58.88 856» 663 »65 8:3 863 865 8 Hooow 8 »_:8:o8 88 88: 8o.» .88—8 .om :88 38s: 3 :88 886:8»:8 :8 88882: 888668 65o 85 .6:Es: 88 88:88:88: .886Ew696 85 »HQEM 8 86E 8: o: H: 3.83 mo 8E: 85 o: 888 8888 »Eo :E5 H 88: 65 Jon H 88:88:88 8888:6986 98E 3H. .Ho8so mE3 :8 8 8585688 3o »2 144 23:32.: :0: 885:: 8:88 5 0: 0: :55 8:: 2: .83:::: 85:38:: 8:: 8:8 83:::: 85:: 5 88225 2: :3 ::5m 88:: 8:85:89“: :53 :: w550: 50>: 0: ::3 8:: ::: 8528:: 05: 5:9 .8520: .50: :0 .8:::: :05: 8 8:02: :8: 380:8: :: :: 2:8 :8 85:38:: :: :: :8 8:: 2:3 0: :8:: 8.: 8:: :::8 :::0 80:58 8:820 :88 «:::8 0: ::3 8:: :5 5 :::3 88:: 8:25.898 2:8 8» 0: :2: 8.8: 53:88 .50 :05: 555 2:: :::3 8 2:3: 2: :3 8:: 302 .:5::::: 5:: .8: 2:: 530:: 0: 5 :8:: .:.:0w .38: .8 :8:: 822388.: .5 8298 0: :8: 8:83 ::: 8 85:88.: 85 :00w : 5 85 :00w < .:w::w::_ :8:: :58: :5: :0: :8: 55558 :000 .8880: 5 8:882 ::::580::8: 805 8:: :>:::: H .8523 5 :00: 5:: ::3 ::: :8: 8::w :8 :0: m< :::8»: :8 SE 8.: 8:838. :::88% 500: :8: :5 ::: 0: 28 :m .:0 w5:::8 2: :0: :2: ..8.85 ::w: 8:5 .2585 85.83 0:: 0: 85: 2:8 :0: : :8528:8: :582ww: 8:5: :0 ::2::5:5: 882:5 8 28:: 5:: £8.50: ::0 25:58:: ::H :::8: 8:8 :8 :2: ::3 2: 5 8:8 85:85:80 58.80 52 0:3 :::8: 8:8:3 ::0 ::: 0: w5:: :::80: 2: :0: ...:5:::2:: :88: 5 8:58:25: 8 88:8 ::: :0 8:252: 258:5: 8 :8:: :::: 5 ::8225 2: :0: : .:w::w::: ::::.8>: 0:5 :::588: :: 05: :8 88:08:: ...:52:0: ::0:w-8:: 8 :0::::: : m: :0::::8 55:: :: :0::5b5: 5::8w05:: 8 :8:: :::: m55588 5:55.898 8 m: 8528:: 5 8:8: :8:: 50: 2:82: 8 8:82: :00:.8::w8: : :52:>l8:: 8:85:89: .::::5 5:: 5 88082 :8 882 8:38: :5: ::H .388 8 55:88:: .::8: 25:52:: : 0: 8:58: :w::w::_ :::v :55:::: :2: 2: 0: 88:8 8 C858 ::>_0>5 ::: .50—055.8: 8:58:22: :: 85888::0 w5523 8 88:3 :88: 8 :5::::: 2855: :28: :: ::82:2 0: 8288:. :83 5: w5m: 5: : : :58 2: 5 :>: 8:2: 5:::: 50: :::8: 8:: :58: : .5 ...:::.8::5 :::8> 8 :0::22 2: :0 85.885: :8:.8w28 :8 5:20:08: 8 :8:: :::: 0:5 225858235 :: m: 8528:: 5 8:88 5 2: 8:83 2: :::3 8:8: 8:83 8:5:52 :::8: .5 :5588: 0: 8:58: 825.898 :: 88082 5 2:588 .8: .::3 m: 55858 :::8 :8: 85:28: :8 55:: 88:8 5: :8: 8.882 :: 2:8:0 8:8: :: 52:82 8:58 0: 0:3 25558 8:8 :53 ::8 8:: :::3 :00w :::8 0: :: :::5 55558 2:8 :5: 8:88—0:88: : 5 8:882 2:858 88:08:. :::858 5 ::8298 5 5 :5 85 ::2w : 858:2 ::8 :8 :58::: 88:5: 5:: :53 :::8: 8.2.88.8: 5:280: 8: :8 8:: :8::888.88:0:Q:o8::8& 85.8: 805—: .::>> .:::::.898 85.8: : 0:5 5 :85 :0: :8: 0: 5:: :: ::5 25:0 .58: 8:0: 5 8:55.898 .50: 50:: w::::: 5w:: :8 :w:5: :: :58 :0: : .:8:5.898 ::: :::::0: :8 :: :8 :0: m: 2:08 :53 2:802: 8825.898 :: :::8: :: 85.8: :::8 :8::898 :: .8: 8:: 8558 2C. 88:: 8558 8.8825898 ::: :8: 522:: 25: 8:0 2: 2:25.898 ::::_:50U 5:25.898 805 8:82: 8:: :585:0: 8 5: 8.88m :8 855:: :::5: :: 85:2 5058 8:: 88:88 :8 2: 8:52: 8:50.: :2: :55 5 8:: ::m 855:8 8:52 8882: :::552: :::5 00: ::2 w:3:: 50: 8:88 :::8 :::5::: 5::. 20:2 8:: :: :5: 8:05 880:2: 8: 8 5: :8 .50 :::83 :::::.8: 5 :8:: :5: :88 :8: 8:: :::855898 :: 80:: :0: :2 :0: =53 5:0:::::::.8::: :< «8:825: 3:8: :8 :8:» 8:0:Q8828QEN 145 .»8.B: 05 88: VH8: 80: H «0.80 8H:w0.: :85 88$ 0.80 3.8% 03.5 0800: 0Q .» .8050 05 :30: 8888 80 3.8% a £083 0: :08 H «80m 0:830 05 H0 0850000: 05 »83 H0 5st: 05 03w 0: »H00HHH 0.8:. 083.5 02 .0 .0w H mm0:0< .05 z .00» 0:08 .80 85 HES 3830008 8 8 03:8 H «00830 :55. :H 085 :85 008% 850: 086 808—0 0.582 0w8H 5 3:00:50 on .m 800.588 8 0:5 wEE 380:8 H0 8:08 033 8 00m H «“0583 5:053» :08 :85 0388.58 088 0580: 55 :08 055 8:83 on .v .:0 0>0E 850m .:8.H. 8800: 8 00:— 80H H H08 .8888 .858 8302 08 »0FH. .3025 H8080: w::0» 0 5H? 00.5 m 80:: 085 .8>0 wEfiHw mm :8803 w::0» < «Ewm: 8 .850: 0008 »H8H:w0: 8888 0:3 0300: on .m .3 :3 0880.80 03:00 < 200N808: 08 »05 85> 0.88 :::08 0:88 $80103 0Q .N 8:208? H08 8588 $ .850 05 8:283 .9: 0:0 38.: 0x5 8 8H 08.8:00 w:H»mH 8:283 03: 88: 0:83 H ”H :0_m8>|80E 8808:0805 «“005 mm 85803 05 8:3 0:05 0—83 0.00. .8 0.88 8m 0300: on A .wEEHHm E ::m 05 85 000 H :8 623:0 8583 H ”:8:: H 8:3 :0» 305m 0: :88 8 :0 0w HH.H 8:5 . 5:88 :88 :0» 8 :0» 0: .5000 85 8280:: 880:5098 07:80: H0 008: 088 8283030 5 008808 wEEmb a 2 03030 0: 0300: 0.8 0.85 0853 023:0 0H8? H88 .5 0.8 :0» :80: 05 082 50:0: 08 .8me 8 08: £58888: H0 08:00 80: 05 8:80: 8% .8H8P80Q0 0.55: 8282030 08:5 »nH 0088:0m :03 08: 802 8825898 88:05:88.: 802 £08888? mmrsm £888 a :00: 08: :8:: 0: .050: .8; 00m 8w:0H 0: 2:00 0:0 855 0008: wEHwa wEwa 52508 0:20:33. 8:885 05 85 H8050: 8: H8: 88TH :80H. HH .8085 8:855:00 808930 .8 .858 05 :00: 08: :38 333088502 8wH .8530: 808 :85 .850 :::50 0: w:H8>H8m 083 mwoc mi 85 H8050: 8: 8: >28: 83 HH .»8E0H0:: :050m 08: .88: 53:: 00505253: £0888 ES 8 8200— 83 0: :0:? .885 8m 28:: mi 85 H8050: 8: 8: 0:3 @083 H0855 HH 82830080 0388 8 5? 5888 808508: 880::898 E 508000: 07.88 05 H0 080m 60005 @8080 00:5 82 0: 3:25.898 8:08 53, :0» 028.5 3:050 :0H8>.8mno 5:88:00 H0 0—003 0:0 8:088: 0538: »HHS:0EH898 5? :0» 0.0308 :55 382.50 80:8: ::0» £02030 58w a 0:800: :0» 00:0 .:0» 5::08 :0 000w 8:3 wfiono: H0 80.88 8 »HQEHm fl 0802 8825.898 w:500 146 8 5: o: :o 58:38.: 5888» :58 5 :: A88 8:: o:3 30:5 :58 :58 558888: 8:855:88 2:89 .5855 8: 38:5: 0: 8588: .85 .5855 32:5: 5:88 8:: 30:5 8:: 8:85 .858wo:8 85858:: w5:o83 8988 8:588:88: 8825898 88888 882: :30 8: 8 5: 38:5 :8 :88: m 858:3 :::8 @2888: 8:28:88 8 85m .8588: :38 :85 8:: 8:8: 8888:: 882: :30 :8:: 8 8:85 :0 88:88:08 .8830: 555582888: 58888: 8825898 5 8:88:88: 88:88 85 8 8:0 83 :588855 .325 8:: :9: 8 “88:88 M58256 858:: 83 :8 88 50:3 8:588: 8 :8 858: a :53 8 5588 55:: 5 5:82: 8: 858225 :8: 8: 583 5::: 50 8:588:88 8 8825898 85 :88 8:5 :8 .855 8 8: :8» 8 525 8:88 28,—. 85888 8:: 8388 0: 885898 8 885: 5:8 83 .:8 588 a 85:: 8:3 885 25:: o: 582 85:: >8 8:8:3 38:: o: :53 83 .5 .58: 8:8 8:: :0 85888 85 838:... o: :58>:8:o 8:588:88 a 5: :8:: 83 .58 8 8:5 8:8 85:: 0:3 80:: 8:: :88 885 a 8 25:: 8:8 588 25:: o: 88:: 0:3 5:82: 8:8:3 38:: o: :83 83 N. 858:: 5 8 5 88:88 8.: 858885898 5: 8:: 8:8: :58>:8:o 8:588:80 z: 8838: 8: :8:: 8588:: 8:8 .8 o: o: :5 85 88 88558 :8 8: :8» 88:5 cm 0: 82:85 a 28:. 8888588: 8:888: 5:888: 58:88: :2: HO: 8:: :8:: 855 8 8: ::o.» 5 85888 8:: :8 OD mm: 8 88:58 85 :5 88: 0: 5:88:55 5 5 .8858 mm: 888w 88: 58: 55 8 85 8 8:5: 2:: 8 2:8 5:: 583 mm: .883 8:8 5 .55: 88 855588 85 8:3 8:88 0: 558285 5 5 85 :8 855588 .5 888>|m85 8:85:8an 58:8: :58: 5:0 8:88 mm: 85 588 59.88 :5 5:55:88: 58:88:85 mm: 8 8:28:58 850m .8828: 58:8: 8: 8:8: .85 888: 58885898 :8: 85:88 8:8 .585: £888 8 8:8 85 8: :58 2:: 8 285898 5: 5.. 2885:: 85: 55:: 88: on; 5858:: 8: 88 8:: 8:88: 8.: 85888 850 .885 88855898 8 8: 8: :8: 85:88 :88 :8 8:85:58 8888:: :8:: 55 8858885 85888 8:: 8388 5:8 85 88: 8a 855: 8::8 83 .8588: 88:: :::8 8558 8.558: 85588: c: 58:85 “.5858 85 8: 555:8 :8 83 55:3 258 28: 5.. 85:58 :88 :83 o: 8583 :5 888 5 5.. 880:3 55:88 5.. ”8:88 .8588: 88:: 8388 8:58 8:58 .5988 8.: .885898 z: 8838:... 8: :8 85888 88:88:: :8 8: 888: 88855898 8 8:5 :8: : 58:8 85 :5:3.. 5 85:08 8:: 30 Z .25: 85 :8 88:88 85 883 8% 5 :8 5:8 8.: 855 8:: 808 555. 885 8: 8w :9: 5G .58: 88555 85888 a 58: :8 :58>:8:o :8: 282 :8 58:08 500: :83 : 85:3 5 b: :9: 3:2 885:: :2: 8:: 8058 8.55:. 5855898 :5 585 85:88: :5: 8w 8:.“ H .58: :8 5 88:8 5: o: 8.88:: 28: 82:: 888-825 85 .55: o: 888 82:: 588.8: 8.2. .o .855: 8 8:0: 88 :8 w555: 8:8 8: 8 80:: 8:: 8 58: 2:: 85 88 5 ~58: 8:: 5 528 0:3 805 :85 8:8: :58588: :88: 58:: 8:: 5 58:8 o:3 88588 on .w 147 885 8058:: 85 5:5 305 :0» 88888 8:80.» 5:: 85:: 85 505 888:: 8 :5:8 : 8:5 »585: w58::88 8: :0» :05850 5:885:88 5:05 85 8:88: .w55 8:0 :0: .8w:8:>5: 858:: 5:88 8:: 50:08:: 55 88—8580: 85 55:88 8.888: :8 :58: nob—3:850 85:88 8 85:58: 55 ::5 85 855 :0 w 58:88 8.8808: 850 w558: »n .8855 5:88:58:me 8w 8:: :8 :0» 558888 8855 ::5 8508 m8— 5 5:5 »::: :0» 8:05? 858830 8085 885:5 88:58: 8.580: 8 85:85:55 88:: 85 805: 585 m: w5»:83 805:3 885:05>8 8.8: ::0» 8:85:55 :8 :0» 50555: 5 88:85 0: 888 :38 m: 83:85 :85 .8588: 83:85 88:80 »EwE 8 28:8 85 8: »85 858 885550 ::5 58555 88: :88 8: m8: ::5 5:5 :55 :0» 885858: 885:: 0: 58::88w 85 8:: :8 83:85 :85 8 :8:: 85 .55: :30 :85 5 »5:8 0: 88885 8: £852. 88% M55830 585550 5 885:: 83:85 5885:8808: 52558 8:88 0: 83: on :55 :0» £58588 5:5: 805: 88: 88 :.:5800 855: 805 8:88: 8:055:55 588 :0 8:88: 8850: »5 58:58:88: 8: ::5 m»:3 5 8:85 »::88w 8:558 .8888 85880 :: 0: 885800 5:: 5880: 8:058 88:: 5808 83:85 :85 ::5 58:8: 8:: 0:3 .385: 85:3 553 : :0: 8:85 58:3 :0» 8— 0: »:::5 ::5 80:: 85 5803 053 858—8 5:: 85:85 825 55:50:: :0» 585—50 983 8 :50: ::0» :0 8:58:85 .»5 5885: .8: 553 5885 8: 8: :0» t 58:88 8 8:8: .850 :0... 885: 500m :0» 88 08—: :8 8:555: 85 .30—0588: 8885:0885 8 :8: 85 5 8:858:08 885 5 588885 8: :0» b »5888: : 5 8:55: 88850 .8558 8.55.8an : :0mm8>lm85: 888583 .8355 :30 ::0» .88 858::— 8 8_:m 0:5 0:85 :0» .5 8:88 58:58:00 on »:5 :0 w 53:: 5 :8::0» 8:88 0: :::8— 0: 8:: =5: :0» .50—8 55 :0885 :0» t « 5:08: 88:55 5:: 8585 53 :0» :85 8: :55 .8555 >8: 85:5 0: £55585 ::0» 80 w588: 58.50» 0: 8582850 ::0» :85 .8585 w585 58>: 0: 58858800 8828585 5 .8 5:0: 58858:: 8: 8: »85 8:88: 85:85 :30 :85 0: :5888 w5»:: 58>: 855858 2:08: .883 8 5mm : :0: 85:88 5:: :85 8 850:5: 58:58:00 5 w5:::m .5580: m: 8::::: : 88850:: 8:: 5 85:85 :85 8:88 0: .8830: .85895 5 u: .885 88855898 8 88:8 500m 08—: 8: 858.5 80> .8585 58:. 35.8an .:0» 0: ::80 »85 m: 885: 85 :305 5:3 .885: 8 88:8 500w : w: :83 w: 8553.88: 85 :8 5880» w5>:850 885 858: :0» 0O .»:5 »88 05 :0» 855 z: 8: 85:. «8:8 80:: :0: :0 8: 5mm: ::0» :0 we: :8: ::0» 8: :0» 05 .88: ::0» 80:0 :0» 85$ 8305 858:: :0 :: 85853: 400— 85 0:5 :80: 8 8:0: ::0» 0: »80: 85 8: :0» on :55: 85 :0 8.5 858 :8— 85 :85 :0» 05 .588 ::0» :85 :0» 85$ :85 8:05 :0 558 ::0» 0:5 8: :0» 05 5:: 5053 85885 855 8:5 35:50:: 5 5 85 £850» 850: 8: 05 :0» ::5 883:8 0: 80855:: :88 »::: z .8388— :30 ::0» 850: 0: 585 :8 :0» 80:8 855 : 5:5 .»:085 : 8: 85: :: :8::— 85 £85588 :: :0: 85: :: :0» 8% :8 85:5 85:. .555 :0» 5:53 555 :0» »53 855 :::8 8:5 88 55:: :0» 8n .5 588885 8: :0» 83:85 85 8 8858 »::5 88:0: 0: 85: on :0» .53 »80 82 .»:.$ 55 :85: 5:858:08 500m :::8 8w :8 :0» .88—8588: 38.38 »_:0 85 m: .5850» 553 88:58:08 148 83 8:838 8:3: :: 8: cm .883: 88883898 8 :0 8:88: 83: 883 08 38:: :03 803208 8 :0: 8:38 88:30:: 8838:: 8 883 :03 :: 88:30:.— 38383: 8 :0 880:: 8:0 3:03 0: 80 38309:: :8:: 83: m: 883: 30:33.. ::3 .8883: 88883898 8 8w : :80 30:9. :0: m: 88:30:: :8:: ::03 83: 3:3 :::3 :03 .38888: :30 ::03 :0 :: w::30=0: :: .8038:: 83:09:: 38 8:88:08 88:: :88 .8388 0: ::3 8038:: 88883898 33:80:: :8 0: 8.8388 3:3 0: :0: 8: 88:8 :0 80m 83: 883.8: .8038:: .8383 38 .8383 83:8 3: 3:8 83 888083 83:88 8: 3: .383 83:0 83: :O 383:0: :88 3.8.8 :0: 383383 888 83.: 88: 0: :88 8838808 83 38:33 :: 88:83:: w::3898..8>8 8 380:3: 8880:: ::0 :838 0: 38333 883888 8: 3: 888883 88880033 83 :88 3: .8388 38> 38 888800.33 38> 83 88 88:88 :0 38:> 3838-830 33:. 8:383 3388: 88 83 83: 88:83 8:08 03:: 83880 83303 88 83 88:83 :0 ::0 83880 83303 :0 3888: 38.8388 83 0: 8038:: :0 838:: 83: 8888:: 3:838 8883898 388 .8839: .3388: :: 8388808 3: 8 388388: 8038:: .838: 38 .838: 8:88: 8 308888.: 83:88:08 8383 3:80:00 :88: 8:3. .888: 380 388: 83 832305: :0 3303 388.: 8 8 808:8 :0 3:33 033 83:08: 38:: 33 3:83 83: :8:: 3:88:33 8: 8038:: 38: :0 3:308 8::3:00 8 8 88888 :0 888:: m:3.:. 88388 3: 83: 8038:: 38308: 88:: a: 8:33 338:8 8883898 38...: 388:388 8 :0: 83 880080 83: 333 ::0 3:3 0: :83 38 83:88: 38898:: n: :0:m:8>|883: 88883883 33:3 3: 8808 388 :03 :O .88: 3:88:33 8 8 3: :88 :03 :: 8:83 3803 833 83:03 38:: 38 8883898 80 :: :88: 8:83.83 8 8 8:838 5380 8 38:03:08 883 388 :03 :O .m:8>8: 83:0 88038 :03 :833 88:83 833 888 0: :83 38:: :03 #883898 8 :: 8:38:8> 88383838 8 :0 8:88: 8:88 8:8 8:8 83:88 :0:: 388388: 8038:: :0 838:: 8 8.88: ::3 03 :03 883.898 38>”: .883: 88883898 38:: 8336:: 38:: 30888: :30 ::03 83: 3:3 :::3 :03 88883898 8888 8:03 883 :03 88:0 38.8883 :30 80.3 :0 933893.: .::8:::.898 ::03 :0: 8038:: 88883898 883: :0 8:0 88:88 :3w::: :0 3 .0w 3808 38888: 883:: 8.833 83888 33 88 8038:: 883: 833 8.68:3 :03 983 8838808 :::3 83:8 83:. 38888: 83: 33 38.8388: ::8: 8038:: 88883898 83: :0 8:0: 8 88:: .8838 8:80.: 83: 388: :03 8 .880 8:38 :: 38888 8888::— 8 03 0: 388: ::3 :03 38 38:03:85 .838: 8: 8.538008 8:3: .8880: 03:08am 8:08 :0:: .8838 38:88: 8:83 38.80.: 888 33:38 :80 :03 3:88.: :03 83:0: 88:8» 8.8:: 83: :0“: .:0 08 38 .83:::38 8388338 :0 88808.83 .8283: 8:8, :0 :03898: $300388 :: 38.83: 38:: .888 3888 :: :033888 ”23:80: 8 03:88 8 83 3808 03:0: ::03 .388: 33.038 :03 88:80.: :0 8:3: 833 305: :83: ::3 :03 .:03 B888: 83: 30888: :0 888 8 3:383: 8:3 2:08 :03 .883: 8 :0: 38888 ::03 88883 :: 30888: ::03 :: 88 38 3330:: 0: 8:38 83 38:: :03 83: 38 83:03 33:88:98 83: 38:8 :0 3038:: 8 388383 883 8838888: .8388 .3383: 3:038 38 883 :03 8:88 38 :03 :0: 38888: :0 888 83: 8:88:38 338.83: .8w38:305: :0 3303 8388 83: 08: :::8: 88883898 83: :3 3388.38 83 88 33038808 .3:088m 383038: 38:83:88 88 38:8 149 .00000000 030 000> 00 w0030=00 80.0 000 0005030000 000000003 00000000 0.000000 0050 w000000 >0 00000 00m 0000 000 00> .0050>00000 000000 800 0800 00000 0000 05 000052 .0000 00>0 000 .0000000 0000000 £00000> 0>00000 000 00> 00000 00w 0 0. .00000 0000080000000 00 00 00000000 000 6000000000 6000000000 00 0008 00000 0005000000 30000500000 000 00000 00003 3000 00 0000 0000 00 > .00> 00000 0503 05 080000 00 00003 00 00 00000 000008500000 w0500w 00 >00 00.88 000. .00000w00m 00500000 0000 805 000000000 >05 0500 00000 000w 0>00 >05 0>0000 000 00 000000 >008 .>=00E .00000000 00 0 0003 0000000 000 00 0000 0005 005 00 .00505000 0000000800 0000000 :03 0008500000 0005 005 .000800 000 00 0000 0005 005 000.0 00050 000000000 20800 503 000080000000 00 000000 000 00050 0003 0000000000 00000800 w0500000 00080000000 00 0000000 00 00050 000 20000 080m 000E000 00 000 :03 00000 000 005 000 0000000w 000 00000000000 0050 :0 005 000.0 00 00 080m .0000_ 000 00000 005 00000 00005000 00_0>00 00 00 >008 00000000 00800 00000 30000000 0000000 0>00 :0 03 0w0053< E08800 .000 0 000 000>? 000 ..«5005 00 0 030000 000>? 0080000 0050000 05 .000000 0< .0300 00 0000850000 00 3000000 000 00> 005 00300 00 00 0000 080.000 00050000 0008 005 005 :03 00> .00000 0000080000000 w0500w 000 000000000 0>00 03 05 0000000000 0050 05 503 0< .0000 000 >0000000 000> w0508000 000 0030000 00800 w00>00000 30000000 00 00508 0 30800 00 8000000 _0050000 0 858.0 .00000000 000000 000 00000 w0500w 00 >00 05 000w0 00 0050>0000O .03003 05 00 000080 0000000880 00 0>00 0w00005 000> 00 w00>00500 00 000 0 000 .00000000 0 000000>l00000 000008500000 00000 003 0003 005003 000000 000000 000000000000 05 00 005 005 0000000 0 0w005 00>0 .000000 >00000>00 000 >05 05 0050000 05 0000000 000500000 0000 00000 00>0: 0>00 0 05% 00 00>0 0003 0000000000 00080000 000l0000 00 000500500 >00005000 0050 00.0000 00 8000 00000000 .00 0000 005 00 003 000000 0800 50000000000: .0 w0000 000 00>508 00008 0>00 00 00000000 000 00 000 0000000 0000000 .09—00000 0000 00:00 0000 00850800 00 00000000 00000 0 w0000 00.0 000000 000850w00 30000000 0 00 8000000 .0050000 0 00 003000 00 w00000Z .005 00>00 00w08 00000000000 00000 005 0003000 000000880 0000 08000000 00050000 0000 >002 .000>_000000>00 005 >00005 00350050 00000 0 00 000>—000 000050000000 005003 3000 00 0003 >08 00> 00 0005088000 00.88 00 00008000000 800000000 0.80030 0 00300080 :03 0000000 >000 005003 3000 00 0003 >08 00> 00 .00000 EN 0000 30005080000 00 0000008 0 0w0000 000 00> 005 00 0000800 005530000 0000 000800 300 3000 00 0000 00> 0000000 00000000 000000 00:00 00 8000000 00050000 0500000 0 0300 00 0000000 00000000 .0000000 00 0008000030 05 00 0800 05 00 0000 00 00000000 0000 .00>0300 .000000w 00 080.0000 3050000 w00300 00.0 0.0000003 0>000 0085 00 0000 00000000 00000 .0000. .000000 0000> 00 005 0008 0000 00000000 00000 800 0050800000 w0000 000000000 0003 08000>0 >000—08 000 00 >008 005 00000 30.05 0800< .000>00000> 00 0050000000— 000 05 00 0000 00000000 00000 00 00000 000 .08000000 0030000 00800 w05000000 000 0000000000 00000300 0008 05 .00 0800 003000 00003 0000000000 00500500080030000 0.>0000. 08000000 00050000 0300 0000 000 00000000 00000 0w00500 8000000 00050000 >00 00 005200 0 00 00000000 0000 3500.0 00 >00000000 000 00 00 .0w00_3000_ 00 >000 05500000 05 w000000000 00 0000000 0000 05 000 0000 00000000 .00 005I000000000 00000 00 00000000 :0 005 w000000000 0000 0>00 150 0 000000>I00000 00000800005 000-000 Km 000%0000000K 00030800 .300000>00 000000000000 00 00000.0 05 000 00000000 00005 .< .0. .0800< gflemmum 00000000 0000 00 00000 00:00 00 0m0003000 05500000 w00000>00 00 3508000 00800 00000000 0003 .00000000 000000 00:00 00 8000000 00050000 0 0300 00 0003000 00000000 .00300 00 00 00000 005 8000000 00050000 0 w00>00 80.5 0800 00000 0000 05 00 0800 .>:0000 151 9000000 00 0000000? 000 000080000000 0002 .300000000 8 00008 300 000 08080000000 008w000 .0000. .00000 003 00 0800 00 000008 00 00000 0.000 .00 £305 00000 000000 000 00030003 800000930 0000 00000 0 003 000.0 0000 080800 :00 00 .008w000 0000000000 00 0 00000: 0000 000 0000000 00 00000 000 080080 0002 000.000.000.00 000000000005 00000 w000000w 0003 0000 0003 0003 000000 00 000m 00 0000000 000 00000 80% 0.0000 0000000 000 0000 0000 000000 0 0008 000 .0008 0 000036000000 0000080000000 0008 000 80 .000000000 w800 000 000 0000 0000 8 00000 :30 02 .00 00 0000 000 000 000.0 000000 80000700000000 0.0080» 000 0008080000000 00008 $00000 000 .0008 0020 wan—0070000880000 0000 0003 0 00 000000 000 0008000 0 .2000 00080.0 0 0000 0 000600003 .0000» 000 .0: 0000008 0000000 0.000000 :00 0000 0:0 00w000 000> 00 0008 00000000 w800 0:080 0000 00000 0008800 000 800 08000 0000. 00000080000 «.03 0808000000 000 00000 0003 0: 0800 00 80080000 00003 00800080 0800000 00000000 0008800 0008 000 00 0800 000 30.00 08080000000 .30—000000 00 80000000008008 0 80.0 w888000 00000000 000000 000 00000 0000080000000 8000 00000 00000 008080000000 800000.300 00 00000000 .000 00 000000008 8000 00000 0:00 00 .0003 0 0000 .0000 50000000 000000: 0000 0030000 0000 0000 0000. .0>00 00 :00 00000 000 0003 w00003 00 80000800 00000 000 000 0000 0000 00 008 00 80 .00000 0000 0>00 0.000 :00 0000 0:00 00: 0.00 000080000000 :0 000 00000 000 0>00 0.0000 :00 08 000 :00 0 :00 0.30000 00 000000 003 0 0000000 0000 000 o 0000000>I00000 0808000000 000800008 000 8 0000000 0008 0 8<.. :0800 003 8 0>08 000.0 00 800 00008 0 000009. :080000 000 08 00.0 00:00 00 003 0000 000 0.0003: ”0000000 000800 00000 $0805 00 300000 0>00 00 8000 ..0000 :0 00m 0000 00000.. 003 0800000 0800 000 .0000 5 .0030 00000 00800 00000000 0000 0000 0030000 00 000000 0 ..0.0008 00 800 08000 080000 0.08800. 00 003.. :0800 00 000w 00 0000 0 0.0000 003.. 2.0000 02 000 0003 000 08000. 0000 3000.. .0000 00 0008 0000 00 003 .088002.. ”0030000 00800 $000008 0800000030 8000 0000000 000 03 8000000 0080 00. .00000 000 0>00 0800000 0000 00 8000000 000 0030000 0.0000 0 .00 0200 00 0:00 00 0000 0003 0000 000000 0 003 00000 0008000 000 008000 0080 0>00 0 000 8000000 0000 8000 000 0 00w0000 003.0 80000000 000 0030000 00 000000080 0 0808 0000 0 8000000 0 00:0 0000 00003 0000 00 w8000w 003 0000000000: 00 0000.00 0 08.0 0 000 0000 002 R0000 .0 00m 03 00 3000.. .00000 0000 088000800 00 08580 .000 0 0000. 000803000 0000 00 0000000000 00000 00 0000000 003 0 0000 3. 00008008000 000000 0 00 0000080000000 00>00 80000000 00 0000 000 080030 0300000000 00000000008 000E000 00:0 0 .0800 000000000 008.000 00.000 0008000 000 00000500000 0 00 0.0: 0.000 0.20 0030000: .00.: 000.000.00.00 0.0 000 0.0 30000 08 00.000.00.00 00.0 0.008 8000 00.0.0: 00 0.00.000: =0 00 00 8000 0.000 03 .0000. 0.000000 0 00.0 0000.8: 00 00: 000: 0.0000 0000000000000 005 00000800 $000.00 00 00 000000000000 00000 00.: 000$ 000$: .0000 $0000.00 0 00.0 08080000000 0000000000 “.0800 00.0.0: 00 000080.000 0.000 N 000000 0000003.. 0000-000 000 0000 08000000 00008000. 00 00000000 0 .0080 000030003 000 00 080080 :0 0000300005 00 0000008000 0003 00080000 .0000© 80002 .3 d 00 000.0000 50. 500000.203 00000000000 MSoQ 800 000000< 000. 38080098 :0 000 00 30: 152 58855 55 5 88:095. 58 :0w8_. 5838: 8:: 2E. .A::0:w :0 .:588.8:: .8585 8505.8: 8 0: 82:08: 8w8:w:8: 23 :05585 85 85 0: 580::0 88 C858 58>_0>5 58 .50—0558: 8:08:22: .3 585888850 55:3 :0 88:5 :0w8Co :055585 b50555 558 85 882:8: 0: 882835. 5:03 85 m5? :8 ~ _ 8 5 88:0w8_ 2.5828 «88835. 05528 5 588298 5 5 t 885: 82w 8 858008: 3:0 :80 2:08: 850m 558.88. 35558. 5855898 828: 8 0:5 5 58:: :0: :8: 0: 858 8a 8:: 8850 .58: :w:0: 5 525898 ::0: 808 85:8: :82: :0: 5 .825898 85 8:5:00 5:8 :: :8 :0: 88 8208 53 85588:: 8885898 85 8:88— 85 85:8 3:58 885898 :8 :0: 885: 855:0 2E. .8885: 855:0 8888:5898 85 :85 88855 85:: :28 8:8 5:25.898 58:88:80 58:58:08 805 85808:: 85 :585885 58 28:05 8 88:8 8:05:08 85 8858: 8: 05 :85 50:50:: 58 8:8 82058 8:::0.a 85 55:: 5 :83: .88—058 8:50“ .885 00: 588: 558: 505 2:88 :28 85:58 55:. 5:08: 8:5 85 85: 5.05 880:8: 85 5:8 ::0 585:0? 3858: 5 .885 :88 5:: 8855 85855898 :8 808 :0» =8: 8: :55 2:08: 850m .=0.:08\.8& 585 80:28 8: 80:58 5 58: 80: 8 85. .28 858 .5 5 8: 5:58:55: 5 805588 8 855305— 885 w58m 8: :8 H .885 ::0: 8:88 :0: :8: 0: 8:02:08 55.: 8838 :80 :0.» .8885: 8825898 500w ::0 30:5 0: :0: 8:80 8: 5808 :85 ”5588: ::0: 888:5 :0: :8: :80 85 500: 8:8 588: :08 85 855858: .88: 805588 82:58 85 85:08: 85 5:25.898 805 3:0 858:00 :55 :0: t .8885 :0885 0: .558 ::0: 0: 85:8: 8805:me 8 8: 0: 805588 5:5 :8:: :0: 5005.028 ::0: w50:88: U :08:8>|m885: 8885:8935 :0 8885:: :8 8.80 ::0: w58_:080 83:05 88: :0: b 8:055:080 88:80 5888505 ::8 05 0: 5585 585 2:08: 850w 80.5585 .88_ 50:88:: 88500 88:: 8:85: 8:838 :80 :0» 2:58 555 .85 .555 :88 0:. 5.88: 85 w58:::8:5 350555 88: .588: :85 .05 >85 :25: ”:85 888500 50588 5:25.898 88:80 5830: 5:8: 0:3 2:08: .:0_88:c 8825898 ::0: 8288 :80 85 825898 829.58 85 :0: ::8 5808 :0: 588:8 5:25.898 85:58 0: 8888858 2:8 8:8 8.85 855$ 80:28 8 8500 85 8:88 :55 85 5:25.898 55$ :: 8:80 8:5 85 555 2:08: 850m 5.883500 5 8: 0: 30: :0: 5088: :80 0:3 838588 8: :55 8:02:08 588808: 5 8388::8 :25: 5:< 585m 8888: 85 :.:5 5 8: .8888: 05 :0: :8: :80 8:88:98. .88: 5:8 :08: :85 88:: 0: 8:58: 58:88: 58 .8858888 85:58 £5858 ::80:00 55:88— 858., 88 :08 0508508: :0 88:8 850 .88 w58505 58 .8888 883 .5805 :0: :85 58:38 8:05 0: 555 80.088: 5550 8 88:8 8.85 8 588—885 88:: 8588::8 0: :0 85:: 88: 50888: 88: 85 8 850m .8830: 55:85: 8:8 8:05:80: 50: 50888: :28: 0: 8588. 88:85:08 88500 .8 8: 85 85 88:8: 5502805: :8:: :0: 3:855:98 05858 588055588 85:08: 5 82:: 58:58:08 ::8 w505 858:00 8: E? :0: .5 5:8: 850 85 :0 85588 .8 8: 85 85:8: 85 58:58:88 28 588 0: 52:58: 8: :8:: :0: .88—30:5 8058502: 088: 505 :0: 82 :0: : 858.8%va 8:88 8:8 5 w:08 80:28 88:: 0: 58:8 85 :.:0Q .8225 8 88:8 ::0» 5 8:05 :88: 88: 5855898 850 8:3 ::0 5:5 0: 30: :82 :55 :0: 88850 58: 85 5 82885 w5858 88: 0: 85052: 153 $5558 5 ::m 85 85 88 H 58 655:0 8583 H 5885 H 853 :0» 3058 0: 50:8 8 :0 0w HH.H 85m .5508 :88 :0.» m8 :0» 0: .5000 85 5058:: 85855898 55880: H0 8:0: 885 60582850 5 888808 55585 8 8.4. .9850 0: 8308: 8.8 885 8853 855:0 583 5:8 .5 8.8 :0.» 500.: 85 888— .588: 5:8 8:8: 8 88: 85888.8: 50 83:00 58: 85 55588.: 8% 50.55.8850 0.55% 5583850 5:58 .3 5888:8w :85 885 88855 85855898 88:05:50.8: 802 58550885 H0 85085 5: :0H :305H 5 :0: 555 5 .8505 .85 88 8w:0H 0: 5500 58 :53 850: w:=w5w 5585 52508 85830085 8:885 85 85 58050: :0: 585 885 :82. HH 58885 w5:055:00 808888 50 858w 85 :85 885 555 888 508508 .8530: 885 :85 850 5:55 0“ 558588 8.83 $05 85 85 58850: 50: 585 >038: :8>H HH 28385:: 850w 88: 8.8: 555 85850255: .8585 555 8 5202 883 5 :53 .835 How 55:: 85 85 58050: :0: 585 53 8.883 5853 “H 558.3850 2:58 8 553 58.88 .30—0528: 85855898 5 50888.: 08888 85 50 8508 .5855 888.80 8:5 88— 05 5855898 8:08 553 :0.» 85305 5508 88.3850 5:88:00 50 883 8:0 8:05.85 2888 585855898 553 :0» 85530.5 H53 .5858 8.58: .50.» .8>.8850 500m 8 85085 :0; 80:0 50% 5::08 :0 80m 853 5850: 50 8:85 8 5:58 .5 88855 85855898 5580 882530 8.50 U :0_m8>lm885H 8585tvmxm .:0 w55080 8.8 :0» :85 .8505 5mm 52 M8505 55103 0D: 0: 8850 8580 :0; HH « B88 0: 83 885 85 5 85$ .8855 85855898 8508 8w 8 >5 8.8H 55888 .50 5003 555 8.85 853 H0 8838 8.8 83 85 302 5855898 :8 m58:5:00 853 28508:: 5 0:03 5858:5053 .0103 5 88:98 0: 588: 85.53 85 50 8855.88: 8855 500m 8 .5 885m 500m < .8w8:w:8H .85 5585 855 :0: 58: 885888 5009 85850: 5 885032 0558880588: 805 85 28585 H .8553 mm 5005 55 >83 85 50.5 88% :80 :0» m< 9.888858“ 8588838 5:58 :0 585.8358 8:885 H0 8858 85.. 585:0» 8:0 5:88:85 .PH. .8508: 850 88 85 >83 85 5 8.55 505885830 55.80 5% 053 8508: 85853 “:0 5:5 0: 55.5 58:88 8.8 :0» ...:05808: :88: 5 5088555 H0 8888 85 :0 888.85 858558 H0 8858 85.. 5 538.855 8.8 :0; HH .8w8:w:8H 8588.8 0:5 588.585 85 088 :80 88:035. .508800 5:08-88: 50 :050:5 8 88 :058558 0558 .3 :555555 05880585 H0 8858 85.. 555588 5855898 :8 88 5858.85 5 85:85 585 50.5 8.5885 50 8885 50050588: 8588 85 5 P5 80:08 0558 50.5. 8508: 85 :050: 8 .5 £85885 85.8.3 H0 8588.. 85 :0 55.8850 858880 58 0550:0985 H0 888 85.. 0:5 :058w58>5 :8 88 585885 5 5:08 5 8.8 85:03 85 :53 8:85 85.83 855858: 8308: 5 855885 0: 55585 5855.898 :8 88:88“ 5 835808 80m .283 88 885888 850 505 8558508 58 55:: 888m 85 505 50888.: 85 8.50850 .585 :H 50.88.88 8:58 05 053 885888 850 553 0:8: .85 :53 500.8~ 5:58 0: Q: 885 885888 8508 85 88888588: 154 v 880m .8888: 38:8 8: 8:80 85 8888: 288888098 :8 8058:: 888 588: R880» 8 888 85 :8 880 85 :0 8:88:08 :8 «H. 8888:: 3H: :85 80: 09.. 838888 8: 88 85 888: :8 8058:: .850 .883 8:88:88 H0 8: 88 80.: 8058:: :08 H8 888828 «.8885 8:8 83 .838885 8858:: 85 .8388 :88 85 :8: 88 8:8: 8:80 83 8:088: 885 808 80880 8.888: 888.88: 0: :0588 0:58.88 85 8: 3:85.80 80 83 8:55 8:8 88: 8.2... 880:3 :0588 8H: 88 :08 .8088: 888 .8388 8:80 8888 83888 8: 5:88:88 3 8.8388 8: 80 8088:: 8880:8H H8 8: 8808: 85:88:89.8 8 08H 53 H 2:08 82 823.. E 88508 85 30 Z 885 85 H8 88.830 85 8.83 :0» : 8w :38 :0» 88H: 85 5:08 VHEFH. 882 .88 8w :0» :5 #8: 8888.3 8058:: 8 8:8 :8 :0H8>.88:0 8 882 80% :::08 83 :83 H 333 x a: :0.» 302 8888 .8: 8:0 8088 885. 8:88:88: 8: 882 85:80: 8:8 8w 8:.HH £8: :8 H .850 >8 0: 8.88:: 32 H «8&5 888-885 85 8:: 0: 888 80:: 888.88. 8.2. .0 .8VHE H0 83 88 :8 w:H:HH:n 850 :8 m0 805 85 8 VH8: 80:: 85 88: H «88: 85 :H :::8 0:3 805 85 .858: 8:88:88 :88: >83: 85 8 :::8 0:3 38::8 09 .w 88.5: 85 88: VH8: :88: H U :088>|m8:H 8888:8818 .880 888: 85 .888 88 8.88 82:: 8308: 0O .5 .888 85 :30: w8800~ 80 8.88 8 883 0: :08 H «“88 380:8 85 H0 88588: 0: 83 b8 8w: 85 9,8 0: 80H: :88 8.83:: 8.8 .0 .0w H 808< .:H: x .8» 308 80 85 HES 18380.8 8 8 888 H “”8888 H888 :H 805 85 8:88 .858: 888 8880 8:88 8:2 8 88::8 on .m 800888 8 08H 8:: 88::8 :0 9:08 8:2 8 88 H 48:88: 5:05H3 88 85 8.58.58 8.88 8:88: 5:3 :88 ::c 8803 09 .v 8:088: .858 8.302 88 8:.H. 30:8 8:88: 8:0» 8 5:3 8.: a 8::: 8.85 .88 858 mm 8803 w::0> < $88 8 8:8: :88 3888: 8888 0:3 2:08: on .m .3 :8 8880.80 83:8 < fl“8:808: 88 85 8:3 888 :::08 :88 8.8483 0Q .w @8883 :8 w:H:88 E .850 85 8:283 8 8:0 18: 8:: 8 8w 888:8 w88H 88x83 03: 88H :83 H «88 fl .8583 85 8:3 8:0: x83 82 8 888 8w 2:08: 00 A 155 88:80 .»: :080:::80:: 0:8 :8:: 883 2 08:0: .»=888w 8:220 .8888 02880 :8 0: 80:88:00 ::8 .:8:w0_ 8:28: 888 2:08 828:0: :8:: :8:: 8:80: 08: 0:3 .888 0:::D 8::3 8 :0: 8.8:: :083 :9» :0: 0: :::8: :8:: 08:: 0: 2:03 0:3 838:0: ::8 :::8: 0.8: 388:: :9» .:0::::0 :::3 880:: :0: 0:8 :9» w: .8880: :0 80:8 :0::0 :0: 882 :00w :9» 03m 028 :8 8:220 8: $8888: 88880—08: :0 80:8 0:: 2 38:80:08 88: 2 88088: 0:8 :9» : 58800: 8 m: 8:220 888:0 £83.50 “£5880 .m:0:08:00.:8 83:88 0:8 :9» 80:: 0:88: 0: :0:: m: 8:882 ::9» ::0 8:20: ..:8::9» 0: 828288 ::9» :00: 0: 83:88: 08:8 8.: :88: 0:88 0:: 8...: .8288: :8:: 0w:8:0 ::3 .:0>:8:0 88: 0:8 8:: 30:: 8:: : .0800: 80:): .0280: 88 8:88 8 0>8::::0:: m8 2 8:88: :8:: 088:0 0: .8830: .::8::0::: m: :: .8802 8:88:88 :0 80:88 :00w 088 0:8 8:85 80> $08.5 .508 MREmeQ :9» 0: ::000 8:: 88 8802 0:: :30: 0:::3 .882 :0 00:88 :00w 8 0: :80 :8::9» w::>:8:0 “:8:: 00:0: :9» 0G ..»8: .»:0>0 0: :9» 8882:: :8 0:8 80:.:. 8.8:8 0.8:: :0: :0 8: ::w: ::9» :0 w: :0: ::9» 8: :9» 0: .80: ::9» 80:0 :9» 8::$ «:30: 028:: :0 :: 023:8: :00: 0:: 0::: ::00: :0 8:0: ::9» 0: 8: 0:: 8: :9» 09 «::wt 0:: :0 8:: 02m :0: 0:: :8:: :9» 0: .::00: ::9» :8:: :9» 85$ «8:: 8:03 :0 :::8 ::9» 0::: 8: :9» 0: E8 833 8280:: 85$ .0::: .»_:8:0:: 8: :: 8: £889» 00:8: :0: 0: :9» 8:: 80:88 0: 82:22: :88 :8:: :: .:2>8:0: :30 ::9» 00:0: 0: :80: :8 :9» 80:0 0::: 8 :::$ ..»:00:: 8 :0: 82 :8 8:8: 0:: 38:88:08 :8 :0: 802 :8 :9» 03w :8 88:2 0::. .2: :9» 8:3 2: :9» .»:3 802 088 0.8: :08 88:: :9» 8: .2 88832 0:8 :9» 828:0: 0:: :0 82:88 .»:8:: 80:00 0: 038 0: :9» ::3 .»_:0 :02 ..»83 2:: 882 U :088>|m8:: 8:88:88: 88:80:08 :00w 0E8 :0w :8 :9» .88—0:808: 8038 3:0 0:: m8 :8::9» :::3 88:89.8 :8 0: 0: :0 8:30: .»:88:0w ::8 w: :: .:0::0w0:8 82880:: w:::0:83 :0::08 8:288:08: 88:88:08 88800:: 8:88 :30 :0: :0 8:: 30:: :8 :88: 8 :0::0:3 80:8 8:088: 8:085:00 8 002m .8288: :30 :0:: :8:: 8:8: 88000:: 880:: :30 :8:: :8 8200: :0 88:88:00 .8830: 8882:8888: ..»wo_0:9»m: 8:828:08 2 8:68:00: 80:80 0:: :0 0:0 883 :0::00:80:::: .30:: .»8:: :9» «4 50889:. MRE8QQ 888:0 03 :8 8:0 :8:? 8.8288: .8 :8 8:8: 8 :::3 m: 028:: 0:::: 2 2:00: 8: 8:80:08: :00: 88: :83 0::: ::0 8:28—0:80 :0 8:88:88 802 :08 :08: ::8 .8802 .8 8: ::9» 8 :00: 8:88 0:8 :. .:0:80:d 0:: 838:8 0: 80:28:08 :8 :38: 2:00 03 .:8 880:: 8 w::>::: 8:3 888: 03:: 0: 8:8: 83:: .»:8 850:3 30:: 0: 8:3 03 h: .::8: :0::0 0:: :O :2808 0:: 83:8 0: :0::8>:8:0 8:288:80 8 0: 8:8 03 8:8 :0 809»: 8:8 03:: 0:3 80:: :8:: :8:: 888: 8 8 02:: 8.80 3.8:: 02:: 0: 800:0 0:3 2:00: 8:8:3 30:: 0: ::83 03 m. :2802: E 88 h: 2:888 8...: .:0:8::0::.8:8 .3 :8:: 8:8: :0:8>:8:0 8:288:80 .»: :08388 0: 8:8 80:80:: 088 .08 0: 0: :8: :8:: .»:8 0:82:50 ::8 8: ::9» :w:0::: 0w 0: 80:88 8 08:. 8:880:88: 03880: ::8 .0::8>:8:0 28:88: 0:: 80:: 8802 :0 8: ::9» E 80:80:: 0:: :8 0D :9: :0 00:08:08 0:: :0: 80: 0: 05:88:: 8: :: 880:0 :mm 8::0>0w :08: 088: 2:: m8 w:0_ 84 .08: 0:: :0 088 .»_:0 8:83 :5: 8:83 8:8 5 ::w: 0:8 8:02:80 0:: 8:3 2:8: 0: 0288:: m: :: :8:: ::8 802::00 28:80 :0::: .»::0 8808 :mm :8:: 88:0 2:888 :0: A:0::00:0: 88:88:80: :9: .8 8880::8 156 8058:: .838 :8 .838 w5>8_ 8 8888: 55:58 m35> 88:00 .858— 8: .888: 3:0 :8: 83 8:858:0— 8 .805 :85 8 8 888m 98 555 0:3 2:08 .885 .3 :85 85 50.5 88.85: mm 8058:: 38: D8 5308 8:588 8 8 888m b8 8.8.88 $55. 8838: 5 85 80588 8208: 885 a: 85.5 38:8 5885898 58m .8858: 8 8: 83 880080 85 53 80 ::5 05 583 :8 5:8: 88898:: 58 a: 8:88 88 :0.» .5 8.8— 5885: a 8 5 8m :0» 5 8:8: :803 8:3 8::03 85 :8 8885898 8:0 5 8.8— 8858: 8 8 8358., 58.80 8 8:05:00 88: 8:: :0» .5 88.8— .850 80050 :0» 8:3 88:8; 8:3 88 05 :83 8:: :0» .5:8E_.898 8 5 8558., 88:88:5 8 8 £8.32 888m 88: .858 88:88 8.: .88388: 8058:: 8 85:8: 8 882 E3 0: :0» 885.898 .m8>m .885 88855808 .888 8:308 8:: 8888.. :30 .80» 85 ::5 E3 :0.» 885588 888m 80: 885 :0: 8:0 888m :3080? :0 ”5:89am 5855898 80% 85 8058:: 85885898 885 50 8:0 828 :85: :0.» .0w 2:08 8888.. 8855 8.853 85888 .3 88 8058:: 885 853 .8885 :0.» :85 8.5888 :53 858 BE. .8888: 85 .3 8.8388: 58— 8058:: 85885898 85 .8 88: a 885 .8858 8:83 85 :8: :0» 8 .88 .858 :H .888 888.85 8 0: 05 :8: E3 :0: :8 388585 858 5 88:80.8 E5 .8805 85888 885 8m .8858 :888: 8:8: 88.80“ :8m 3:88 :8 :0: 5888 :0.» 8805 88:8 888 85 8h .:0 0.0. :8 .8558 0588558 8 88:80—88: .8085: 8:8, 50 :05888: £8058 5 .8885 .88 .8808 :::8 5 :0558808 85:80: 8 05888 8 85 2:08 0805 80> o :0_m.8>|88:_ 8825.895 :8: 2:08 :0» 8880a 50 893 853 305 :85 E3 :0 w 80» 38.855 85 8888: 8 88 8 .5585 8.5 3:08 :0» .85 8 8m 5888 .80» 85585 :H .8888: .80.» 5 8: :8 5:08 05 28 on 88 :0» 85 :8 $503 85 8:8 85 858088 50 :0585 8 :888: 885 888888: 8:88 585: .5858 :8 8:5 :0.» w5>8 :8 :0: .85 8:88: 8 88 85 85:58.8 .3885 $885305 50 .805 w:5w:8 85 055 ::8: 88885898 85 55 88.8 8: 88 80888 .::08m 585895 885800 88 :58 885 8058:: 85 85 305 :0» 898:8: 8:82. :8 858 85 :85 8.8.88 M8 ::88 a 85 .8858 w58888: 88 :0» :058:d 8885.898 :85 85 88885 .w55 8:0 .8: .88888 858.8 53.88 8: 58088 .55 w8858:0: 85 5358.8 @2808 50 885 :058850 8058:, 8 8:98:85 £5 85 85 58:: :0 w .8888: @8808: .850 w5:8: .3 .885 8588588 8m 088 :8 :0.» 8058.880 885: 85 8588 m8— 5 ::5 85 :0.» 8:052 8580 8085 .888: 5888.8: 2580: .8 8058595 888 85 808 8:8 8 8:883 80:53 “85:05.88 M8: .80» 88898:: :8 :0» 805:8 5 88855 05 .8588 85.8 mm 8:88: .85 .8858: 8:885 88:80 .585 50 28:8 88— 88 .85 85m ”:8:—:8 85 8555 m8~ :88 88 38 85 ::5 E3 :0» 888.858.: .888: 05 858.88% 85 88 :8 83885 :85 8 8:8 85 .58: :30 :85 5 :::8 05 858.855 88 28:53 8.8m «#88ch .88—50 5 8.858: 83585 88588808: 58588: 8.880 0: 838 85 E3 :0» 8:8:88 :::8 808 m8~ 8:8 u.::_:0o 82 808 @883 .805555 880m 8 8.858: 157 :85 m :8 85$: 8: 88.5 05 H 5808 85$: 8:803 :0828 85 .853 m< .828 3 3:35.898 85 3580: :8 8: 85 5828 3 3 58: 38308 _888: 888 85 5:5 53 :0: .883 8825898 wfifimm :5 58388 233 83 85 885808 .858 85 53 8. :8: 85 38288 89A 85:88: 58 8333 8:83 8888 338:8 8 8:85 8 3:88 8: 88.88 58888 8 85:5 .8888 53:8 8.5 882 w:58w 3 :3 85 :88 mm :058830 .283 85 8 88:: 8:252:23 8 98: 855:5 :8» r 8538 3 :8 5 58 .8888 w:85 :5 :88: 888582 3888: a 2 8288 5888: a 5 8388 8 858 Z 5:5 .88: 3me 888888 223 85 98388 88588:: 58: 88308 5888: 88 :82 88:88:88: 85 38.85 258.58 888 8 mm £888 530888.: .8533 3o§ 3 :83 88 :0» .5 8:285:88 8.88 :0 88888: 88888 885:8 8 888:: E3 8889 385 8533 308 3 83 88 :0: :0 .858 EN 58: 3828888 8 8582: a 8885 :8 :0: 85 8 838:: 858358: 58.: 38:8: 30: 32.2 3 58: 8% 8:38: .88.: 58:98 538 mm 8850:: 5888: 5888 8 838 3 588885 8883: .8328 8 5888858 85 8 28: 85 E 8:85 2 8888 88 .8830; 888w :H 8:832: 5888: 85:8 :8 38:53 288 8:5 8 805 8.888 223 .85. .8288 88: ON 85 888 8:85 8888 223 :85 :28855 88: 588885 8.83 8888 3.855: :8 8 :8:: 85 5:88 833 m:85< .8888883 8 8to883£ o 888>I85~ 8:88.898 :::m 8 =8 53 53:88: 88:88 :8l8:: 8 885885 38888 .850 .888 3 :88 8888 8 5:5— 35 05 33 288: 2:8 3883883 .5 885 :8 838:: 5838 233 S 58288 8: E 88 8:83 838: .888: 8:: 58:8 88 88888 mm 8888 223 m 8.: 85 :_ 885 8888 283 8 583 8.8 $8288 8333 8:8: 88888 :5 885888 55830: 886 85 8 8:8 85588 853 £39888 :05855OELOE33 M858. .2838: 888: 838 93 :8 8888 223 8858 .88—88 888: :8 8 5528 8 8 8.888 88 58% 8 8888: 8: 2 5 882305— 8 :53 35:28 85 888.85 8 809:: 28 85 :5 885 8888 .mW 85|n8888 23 mm 8.888 :8 85 w55888 :83 2,3 83 8:88 25 :m :5 cm .85: 8825898 8 8 853 85 33 88 88 :0: .8538 8 :5 wfifio E288 ~888: 8 833 8% b 828.5 888: a 8 8: 8:0 #83 8 8:0 5858:8m 89: 85 2 85: 85:5: ::3 .885: 8838898 8 8w H :8 33.9. 8: fl 8288 :85 89A 85 5:5 :3 :0: .8888 :30 89A :0 :: 830:5 :H 8858:: 585.895 58 88:88 88.: .88 83m8 3 “:3 3088:: 8885898 2580: :8 o: @8388 5:5 3 8: 2 8:28 8 88 85 83:3 8:083: 853 58 .853 828 a: 58 83 8:83 w:588 mm 5 5:3 .850 85 :O 5.83:5 88 3.88 :8 58383 288 25 88: 8 :88 885888 83 883 E 8.83:: 85898.88 8 8:85 .88on ::o :88 o: ::355 885888 2 5 8:83 888.5888 3 :8 a $588 38> 58 8888885 38> 3 :8 8:28 8 33> 5858-898 3: 588338 3 3 8858:: 8 83:8: 85 88885 38:88 “88:89.8 88 .8838: 5:8: 5 858288 5 8 58.8388: 158 U :o_m.8>|m82 8:85:85 83-90 KN cm~mo~2~§wa~ 828$ $8888: w5885w8 8 235 2: :8 888mm: .83: .< A. .8853 80:an 59882 8:: 8 28: 58:8 2 8:8—325 85823 w528>8 8 35855.8 @858 888.8: 253 .5238: 8:98 8:8 2 :8508 8288.8 8 2:8 3 8:28: 58.88% 5838 m: 8 £88: 85 5830.8 8288.8 8 m5>5 :85 8:88 282 88: 2: 8 850m 585m .8832 :3: 28% a: w5>>o=£ 50.: :8 €282,828 28:on 50888: @288: 8:8 w5m82~ B 285 8w 88 :88 8% £052,828 :25: :8: 8:80 822 82* 2t .8852 68: :28 :8 .8558 .2285 @828» 3.828 :88 8% 285 8w oh .285 8885.898 8: 3 2889 :8 632,830 63389.2 8: 8:5 883 8858888 3885828 28 285 £253 285 8 :8: 88 30> .8» :88 E83 2: 9.83: 3 :82 3 2 285 85855898 w5tmw 8 8: 885 2E. 88:88.5 85828 35 :8:... 8888: 85 5:: 822 woow 28: 85 28:8: 8: o: 288: 28:: 585m 620.288 2 5 8:3 82.8: 8: 2 82: 52.: 85 8 82588 882858 2:82 :53 “8:58:88 .52: 8:: 2:58 08 m5 822 52: 85 .82 22:0 8:88:38 295m :53 2:55.898 :0 58:8 28 @858 22.3 228828 8358 w5538: “8:58:88 :8 82288 8 58:8 8.8 8308: 850m .8528 on 8: E3 825 .80 85 ::8 55:5 88 258828: 8:8 :8 85 .82 m: 8 2:om .285 :8 803 85 v.82 8:58P: 8328: m: .8 885 .8328: 85:: :88 385:8 8.88: 28: :8 25 52852 8855 159 APPENDIX B 160 . 5.43"”. “"1"! 2:: :8: 882 8:: 8:8: 8:88: 8:28 ::o :8 .:::.:: 20:3 8:: 8: 8: :::8 8:: 28: 88:88.: a 8:3 8:28 2 8:2: 88 88:: 58:2: .985 28:88.88: 88:: :8 :23 H :88—:8: 22828 82 :::03 88.888 8 8:: 8:08:88 8 :o: 8m 8: 8:88 :m:8:w 8: 2:88 8:: :8 :0:: 8:38.: 88 8:: 8288: 8:8 882: E3 H :288 :8: 8:: :H 88.5 RE: 8::: 8:88 2:: 8 :288 :8: 8:: :2 88:88: 28888:: :8 :8::8:: 2.828 88:: 882: :23 H .:888: 2 8:88: 2:: 8:3 8:28 82288: .8 8222:: 8:: 88: 222:: 88888 8 :8 68828 8: 2 8:28 :2 8:88: 838:: .2 :88: 8 88828 2.5:: 32 8 88: 83 8:88: :8 8:28 :8 8 88:8: 8 8: :8 8:88: 838:: 8:88: ..8:8w 888: 8 8w 8 888888 8:: :o :::8: 8228: a 28: o: :8: H.. 8 ”:::8 82 8::8: ::o 88:: o: :8: H: ”gm:2:8:::: 82.: :8: H 82:: 2: 82:8: 8 w:8w £8.83 8::... 88 8:8 8 88m 8:88: 8:88 :838 :88w 288: 2 8:88: 8:m .8:28 82:88 8.8 :o: 88: 8:: 82 :2 8:3 :8:: 832:: 88: 8:: 8:: :8 :8 8::: 8:: 30:: 0:3 2:8: .8888 8: 8 2: :::8 :2: 8: 8.888 :oow 88: .8 28:8 8: 8:: o:3 8828232 :8 8:8:3 828.88: 8 8:28: 8: 2 2 88:82:88 :w88 8.8— m 88:: o: 28: 8:: 8 8::: 2.80: 838:: 8888 8::—88 o: 8:28: 2 E888 32>8 8:: 8:05? :83 8:8: :285: w2888 888:8: 2:: 888888 2 8:: 82 828888: :8:: .828: :o: 2 888: w232>8 2:: :m:o::H< :8:8 .888: 8:: :2 8828 :82 8:: 88 8:8 8:8: 8:: :2 ::828 88 8:: 82:8 8:28:8m 82:8 :2::2 o: 8828 8: .8:28 o: 8828 :85 H .2 8: 2:8: :8:: :8:: 28822: 88.28 E8: 8:: 88: :8 H 8:: 8.8: 882: .88—30:: 8 ::o: 8:: 8 8::: 88 888:: 8828 :8 88858 2:: 8:: 8 8.888 888 o: ::888 28:82 .80 8 802:8 :8 8.8328: 8:: 83 2:: :H 28:82 8:: 2 2:288 88: 8 8::::: :::8: 8:: wEm: ::883 8 822,28 2 5282.558 :8: 8:8:3 828.88: 8 8888 883888 8:: 888.858: .28: 2:: :2 :8882: :28::8:28:8 .8 82:: 8:: 32:8 8 88:8 8888 8:: 8:8:3 8:82:88 ..H :288>lm8:2m: 22825 32.8.: 2:.H. H.b::::::8 8.888 8:: 8 :88sz 8:::8> 8:: 8::: 8:: 8 :8:: 8 22:: .2 8328.: 888828888 8888 28:: 8.: :8828 22828 8 :88 a .8388: 2.2828 8:: 2 88:28:88 8 8 8:888 8:: :8:8 0: :8328 88 :9: 888: 2::88 8 m 82:82: 8:8: 8 2 :8:8 8 8:288 E3 8:23:5— .8 ::o: 8:: 8:: 888 o: 2 8:: 22:: 88828 32 a 8: 888m 2838:: :::8c2828 8.8288 8: :8 8882: w:83 8:: 2 :8:8 8 2 88:8 8 8:28 8 588:8 8:: 8:88.: 8:: o: :0» 82:89: 82.88:: :8 82:5: :8 :o 8::: .8 882:8 3:88:08 8.888 38 Z 8w:23o:2 .8 2:0: w2:8:8 8:0: 83 .:8 8:888 @288 m 2 2 8:: :2 8828 88:88: 8: :8 8:28 .8:8 88 5 .8:28 8:: w:::: 88:28:: :8 o: 28:: 8: :8 8: 3o: 8::03 :8:: :o> :8: :8 82:8 28388 :8:: 82828 328.: :8: .8838: .8588 w:2 2 88:28 :0: .:H :8: :8 82:8 :28 :.:8 8:28 .:88::2:: 8:3 88 8:28:88 :8 H8: :8 52:8 88:28:88: 853: .8: :8: 8:88 8:878:28 8:: :8 888.528 8:3 2: 8:28:88 :8 =8: :8 82:8 28:25: .80: 888:8: 8888 m :8:: 888.8: .832 8: 8:28 88:88 8:8 5 .322 8:28 w288: :23 :8: 83 .8888 2:: :H 8.48 8::8:m 8:28 8.8:: 885:: m8 8::888 m 8: $3 :8: .28 88:82:. was: m2:8.8: E :8 5 8.8885 m5:8.8:2~ 885 28:: 8.23 8 MRS? S: m: 8 :88. k8. 83 .25.... .8288 m. E 88.23 m: 8: :8: .848 8888.85 85 88:38:.» 885% 8 m: 8.888ka 88: 0:3 8::: 2.5.8 .258. $88.5 m 5 8:82.892: Q2088: w:8nH 8.83 8 .883:th 9.8: N .88: 2.88:8 .mfiwému cow 8: @288: :8:8:.H. .8 :222: a .::80 8.83883 8:: 8 828:2 8 2:838:83 8 8828.8: :23 8:288: .ooow© 2:82 .3 .0 :: €88.88 5m. SEEEQSQ @888ka MEGAN :8: :8::8:< wucgum Sam; :6“— 0m Ow 30: 161 883 «.828: 8838088 w888885 8:3 .309 $858582: 888808 8838088 8 888 8.8: 8 :0 58:98 8: 2:08 85 85 58 88.80 8.83 8:885 mm: 85 8:08:85: .88: 5:8 888 58:53:00 8.: 888888 888:: 8 8:8:: 8 8 :05888 58 .258 88888.8 85 .8: 2:8:088 .5888: 83 mm :83 8 28808 5:: 8888 3:0 8: 8:: 8:88: 8028:: 3808 90:88.3 5:8 85 0: 58558 88: 88: 2:8 88:8 ::0 .: 2:880: :88: 88: 2:03 85 82888855 85 8 :85 8: 5 822:8 8:88:88 .8: 8583 88.80 88888 0: :0 8:0m 88: 2:03 28:08 808 85 .888.» .88: 8 58>: 880.8 8:: 58 0:893 53.: .309 .8885 82:83 %: 58: 88 :8: 808:0 8 w8:08: 85 88 58 x8828 8 88808:: 580805 883 8:83 880: 08: ::8w 88:88: 85 8 8.: 8 U: 0::: 8::: 88:58 0::: 888: 88305880 88 5:8 .880 .858: .82.: 0::: 88:3 8:888:85 8 8:88 82:08:: :08 808 5:88: 58: 85 85 52:88 8:02:83 .885 8 585 88w 8 58:88: 8: 85 885 85 808 88858 cm 83 o: .859 .8885 858:8 8: 2:00 888888.88 588:8 85 :28: 85 588::8 0V8 0:893 d .H 5888: 888:: 8 88888 .8: .808: 88: 85 5 $8808 8 858:0 85 0: 58. 088 :8 8888 8 858:0 85 58885:: : 88.8088 8.0888 8 8883 8388 85 888m 85 58885:: 80w w888:0 :08 .880: 8::. 8:888 88:3 85 w::5=::8 3:880: 5:8 :0_85::5 m5 wfié 88: 8883 85 8:8 8::. .883 m: w8588om 85 38388 .8885 0: ::0 8:0» :0 :0888 :85 28: 0: 8888 58 w:08 8800 E3 8850 882305— 8 >50: 85 8 88:88 85 588.: E3 :0» .8: 88: :0» 8:3 8.888 500w 8:05 88: :0» 85 588.8 :0» r 5:: .5 808: :53 58 :8 8808: .8888 58: 05 :0» 5 .88—30:: 8 >50: 85 0: 88: 558 8 m: 8888 8 5885 E58885 808 8::. 820:8 585888 38808 85 8: C8: :0 88m :82 882.. .528.» 88: 2:03 52 85: w:80:8 8808 .58» 80:8 85 8 £5 8:: :::8 a 8::: 5.8: a :::05 02V .28 85:: 5:3 88.88 80: 58888:. 88: 3:88 m Commh®>lmmwchmwrvw UCh—Cmmom 58:; 588 mm: 85 58:85“ 88885— .38: 58:88: 5885880 .5888 8: 8.8 823 .28 85:: 8 80:88.8: 5:8: 85. 888888 8808 88888 0: 5830—8 883 885888 8:58— 025 .88.» 8>8 8:8 .58: 8:288:98 58885 0: 8mm: 088 35888 .850 .283 8 :8: 58: 8.8885: :85 8801388288 83 885 88: 85 85 5:8: 58 588:8 58: 8.88:8M 8:28.888 8 8:8:: 85 5.8: w:t: 0: 588:8 88: 85 58558 .8888 885 58:85 0:3 .88888 5:88 < 808:8:8 a: :0 588: 88: 58: :08:58 85 85 088 5:: 8:28.888 .88 808 8:888 :888808 :308 58: .508 30:8 5:3 :8:: 388.8: 8.8 823 88588858 85 85 >80 8: 588:8 8: :88 088—: :0 88588888 8: .8 8:28.888 :8: 58: 8: 85 58888 85 805308 88:38: 80.: 58.855 8::: 88:00 8 Ammo: .85 588:8 8: 2:00 85888888 58888 85 8888:0885 0: 588888 88883: 5888: 8808:: 8 .8009 :88 85 8 :8: . .8588: :08 8 88.888: :88: 88 885888 5808888: 828588888 8 888— 8558: 58 «888885 888 8:8 3888 585:8 5:: .8588 58830— 88:80 988888 88: m: 05 5.:09 .: 5888800 8: 88: :0» 58 8:5 mm 88888.8 8 888: 88088.: 0: 58:88 8: 88 :0» .8558 8 2 .w:0: .8: 88:88:08: 8: 8: E3 85 8:88: 80888.8 58.8.55 8 :88— :88: 0.08 58: 8::. .85—:8: 858888me 5.88: 0: 30m :0 m: 888:0 588 .858: 58: 8880583 888888 a: 8:3 0: :88: m: 05 0: 88: 85 =< .8858 05 0: w8:.88_ 8 888058: :: w8:w8 3:88:88 w:3:: 8 8888 885::8 :08 553 850: 0: 88: 8: 05 8::. :8 8 5 :8 0: 8: 8: 5888898 8 :8 0: 83 8888 85 85 30:: .8858888983 880m 8:88 888:8 0: m: 858:0 888—: 8 88: 8:0 .mfiawutcmk 955.85 88.5 88: 80588: 885 :8 53 H .8888: 5:: 2:85:88 3:0 8: 5882800 8: 58 58885:: 0: .888 58 888:8 808 8888 8:0 888 :8 8:88: 8::. .8588: 162 0::: 8:88 88:8: 80:8 8:83 8:58 ::3: 85 :0 888:8 :8: 38: 8: .:. .8888 88:: 8:07. 3:58:85 8:: 83 :8888: 58: 885:? 0: w:5::8:8 8:08w58>E a: 58:88:88 8830:: 8:0 A5:88::< 3:00: :: 88: :8:: >85|:0:m :0: 05 88: 38: .888 85:: .88: 38: ::0» 88 £888 8858588 :0: E85 w:_:_::88 0: :05: 8.85:? 88:88: ::0» :0 88888888: 83:35:: 8::: .88: :0: 85: :8: 8 :0 :8:—lama: .8503 a :8me :8888: :8:: 88: 38: 85 :0: 82:88 88:: 8:838 0: m: :8:: w::£::::::: :0: :058ww:m 8:0 A009 .8500: 5:8: 8:88: 58: 88888: 85 85 w::w8:8 58.83:: 8:: :88 88:88: 8 8:88 :::8 8 :88 :8:: 8:08:08. :8888: 8 8 8:88:88: 888: 8 25888: 58:83:: 8: :8:::.8>0w 85 8:08 :8 :0 888888: 8:888 8 88:08 :::8 85883:: :8 888888: 8:88 8:838— 85 0: 8:858 830:8 85 800w: 85 0: :8: w:58: 331830585833: 8 :88 8: 8:85 588:: 38:88: m: 88:88: 85 :8:? .Amwm: ...::8::88:m D<8:: :0: 8::88:w 88: 0: 85883:: 8:88: 58:: 888:0 588: :0 8:55.85 8:058 Z 85 853 8::: 8838.: 588.: 8:::: 8:.H. 88:: E 58858 88 88888 :0 :8::::: < .308 83:: :::8 83:: 5:3 :: 8:88 0: 838 8888 83 $8808 8 8 .8888: :::8: 888888 8:58:88 85 858:: 2:03 80:88:: 8:88:88: :0 80: 85 :::8 8:808 85 50: 88:88: 68:28:38: 8: :88 ::3 88:88 88:88 0 Z 88888888: >: 38:08:: :0 b58880: 85 8:88 :88 83 :88 30E 8858:8588 8:8:8> 85:8 :0 85:0: 85 a: 88:: 8: 88:8: 8888: 8:5 85 88::::0::: 088 m: :H :.>88::88:: 88: H 8: 8::: :::8 8: 0: H: ”85:: 825% x: 88:: 8 :88: 0: 8:8: 83 :5 :5 88:8: .53: .8883 8888888 :::8 8: :058888 28:2: 888 8 85 :8 883 m: :8:: :0: 888 85 85 8:w8 8.850 .83: .8382: 588858: 38:08 8:83 :8 88:58:: 88280: 8: ::_:0:8 88:: 5.8: 85 8:8 0:3 88:888.: 88 888 8:0 :0 .8::5:08 8:885:08 85 :::8 8:5: 885% :0::0: 85 E 8:88 883 80588:: :8:: 88:88:88 3885:: :::8: 8 J ,. «I. “I‘lflI‘IUH .: :0_m:8>|m8::8..: 55:25 8:888 83:. 50:8 85 0: 888 8:83 8:3: 88:: 8 8,88» :8:: 88 88:: 8888:: ::5 85 0: 8:88 85 8:888: :8: 8:3: 88588 :0: 8:88: :8: 8: 80588508 85 85 8888:: 88:8888: .5885 8:: 88¢. 58:52:: :88: 8: OH 85 ::8:::w8 85 w:5.8:::m 88:8 8.8:: 85 :0 8:0 83 8:3: 8858:: 5:3 8:88: 8::: .9 8:080 80: z: 53:35: :88: :8: 0:3 8:88:88: :55: 885:8 :8 :::m :80 :8 8:88:08 @8088: :: 8888 80:8: 80:: 8:.H. 98:8 :8 88: ME :0 8:: 85 888 0: 8H8 :88: 88: 2:03 :0 .C 885:: :mm ::0:::m 0: 88: 85 888:8 888:: 85 828:0 :::8 588:: 8:88:08 :8: 89888 :8888: 8:08:88 < .88: 8mg: :8: 888:: 50888. 8:: 85 8888:: 88:88: :8: 88:58:: 8 $5888: 88:: :8 88088: 0: 8820 Anna: 58:83: 8888:: 0: b::8 8:: 6:08: :83 :08888 :0 8888: 8 0: 8:888:88 :8::08: $8888 :3382 88H ::m :8>mH .883 8: 8 88:: 8588: 8 5:3 8585:8888 .883: 88: :0 830: 885:8 8838: 88:28 85 8:8: :88: 8 :::0 wEm: 88885898 8:: ::: 0: 8:88 5: :::8 8: 5:88:98 ”Gm? .8885: 3:585 85 88H 8:32:08 :88: 8:8: :0 58888 5:88 8:082 88:0 88588: 85:88-59 8: H .:::w 8053 8: 8:83 885888 85.20 85 :88 :::88::< ““885 85888:: 8 8:0: 58:88: 88:: :::88 8:85 8: :0 .38: 8:85: 8::: 8:< :::8: :0 8853585 85:88 88:88.: 58838: 8.88: .m.D.. :::8 h8w8:o 83:88:): 88.: 88:02 8:02.. 5885. 8:88:35. ::0:< 8:88:00 888: 8:88:82 55:28 :0 88888:: :0 805822.. ”85:88: 830:8 85 :::8 >588: : 88:89:38: 880— :8 8:088:08 8888 :H 250: 8:88 :8:: m: :8:: :0 88:88 8:8: 588:5883 :8:: 2:58:88 :0 88:88 :8: 0: ESE: 0::: :8: :00— 0: :8: H £00: £5 :0 85:8 8::: 85 :0: 8588 :5 88:3 : 8:3 588::8 58808 8:83: :8 .3088: 8:5 :0: :::0 8: 5:85: :8: >8:8:m:::vH :8: 8: .8058: 8.98893 0: :8: E 88:58 58:88:38 163 ..»58=:800 8838808 885 0: 8:088 .5888» :08 8888:: .8 8:088 8880 8 88:88:08 :88 88 8>> .8800 85 88380 .588: 88m 85 85 :88 83 $8808 8 8 .8808: 888:8:8 0: 80:88:: 85 88888 88:88: 388058: 88:88:08 30:: 83 .8820 8888 85 0: 82m 8: 8852:: :0 :8n8:: 8 885888 8:88 .3888 ::0 85 :08 85 808 888 8:88:85 82:. 2.885 :0 8888: 8:883 88 888 :0.» 880 30: :8 88 8:88 ::0.» 8880880008 30: :0 .8800 :0 68:88 2:03 82.5 8885 .»88 30:: 8: 0: :82: 888 m: 8:0:8: 8:088 ::0.» 88858 8:28: 85 :0 88> :85 85 88:8 223 88 :8 :::08 8:8 :8 28: ::0.» :0 :88 :0.» 2:03 “888:8:8 8 w820 8:: ..»8 :8 8:85 8508 0: :: 0:83 0: 8:83 :0.» a .8838: 8.3.3.. 8: >338: 2:03 880:8: 85 88858 8:88: 85 :0 88> :85 85 w8w88 8.23 88 :8 :::08 :::8 :08 28:: ::0.» :0 :88 :0.» 2:0 3.. ..»8 :8 5:88 8 0: :: 0:83 0: 8:83 :0.» 8: 88:88.5 Mfibfifimk 838—305— :0 .80: 0:58:08 85 28a 0: ::88:8 85 88808:: :83 8 £88 83 8.85:: 8888: 88:88:00 ::0 8::: :80 83 8883 8::: :0 :::n m: 80:88 85 8888::: 8:8 888888: 8882888 8: 80 8:88: 80:58 :8 :88288 88: 85 85 82:03 80:88 .»83 85 :0 85:88:28: 8 88:5 .»~:0 m: a $828: 88 :0.» 8:88 85 :0 80:8: 85 m: .8800 :0 8::. 8:::00 80:58 :0 808:8:8: 85 888888: 38: 0: 8:83:88 0: m: 80:88 ::0 8 :8:: 888:: 0: 83 838888-800 808 :08 88a 8::. 8808:8880 28:85:: 0: 28— 2:00 80:88 8 80:88:88 8 88:85 8: 805 .3 :88—:8: 85 88:8: 0:3 88:88:08 .»88 85 8888 3:588: 83:. :88—888— :w:0:5 8:88 :08 80:8: E3 888:0”: 8080:0088 058888 888828 :8 88.: 0: 8:88 88:8 8:08 88: 885888 82:: 85 888:8 :: 88:: 8:5 8. Ammo: .8883: 8:22:88 :85 80:8: :0 88> 0: :058 200: :8: 85 838 ::n .A8:w88:00 888 85 88:08:88 :8 .»85 m 888:: 83 5 88: 838:8 :0 88882: :0 8:88:00 8 88:08:88 28 .»85 28 82880 .888 8 0: 88:80:88: 0:3 .»:88>8: 80888: 8.8:: 8 8 885888 w:088 .28; 850 85 :0 8:88:83 :0 8:888:58 08 0: m: .»_:0 : :088>lm8::8: 8.58:8 .8 88:8: 88:08: 2:: 885888 000.0m .8 8888: 85 88::8 853 .588: :0 8888:: 8:88 Z 85 wwo: 0: awo: 808 8:888 :0 m .88: .8388: 8: :88 08:88:08 85 8808:: 20 S8 880m .83 8 80:88:08 88: 88mm: 2880.» 85088:: 88 :0.» :08 .8888 888:: 0: 88:8: 88 :0.» .88: 38: 8:88 :0 :8: 8 888 :0.» w: ..»88 88 88: 38: :0 8.858: :8 88:08 8:88:88 5:3 :08 .8508 8:0 808 88: 88:68: 880 8888.588: 28:: {:3 888.» 8.8 :0 8:88:8 8 :8 888 :88: 2:08 :0.» 888888: 88:8 85 :0 885088: .8508: :08800 8 85 858: 38.88 8 828:: .350 :0 8850:: 85 888 28 :88 808 888: 0: 88:05.88 88 8800:: :88028: 85 .3 82.30:: 8088:: :08 820850 85 85 88:8: 8::. .888 E8388: 8: 8850:: 85 8:3 :88 00: 88 :0528 8:5 :0 8800 85 85 :88 880m 885888 :0 .8888: 85 8 8::: .8 80: 8888808: 8 :0 80:88 0: 800 85 8:88: :08 .88: 85 8:08 0: 88:88: 8: 2:03 85 b8 :88: 85 :0 ::8: .888: 8888888 8 0: 8:8:00 :0 88:0 85 8888:: 0: 88:88: .»8:08 :08 885 85 .8 888888 0: 8:80:58 0:88:88: 85 :0 800 85 88208 888.8 8888 88: 8:88 88:88:08 8 .8 8800 8::. .2880: 8:: 2:03 888.» .8 838:: 8 8.8 88:88 88 88:: £033 8 85:8 88:38:02 :8 88882: 38838 :0: 8:8: w88888 .3 88:305— 8 .80: 85 0: 28 2:00 8850 88:88 88:0 8888 :85 8 8880 8.88 8: >538: 2:03 888888: 8:88:89 8:05:28 w830=8 85 8: 88888808: w8>E08 8::. .3: 39% :0.» 8:3 :0 8:08:88 .8802 88:5 :0: 8:02 .3822 :8 880 8 8: 88 83:. .w:E888 8:2: 8: 80888 82: 8:88 :I888m 288:: .88—02: 88::800 88v: .»_:0 @8388: 8:058 @8858: um 80:: 88:0 38: 8:88:88: 88:8 88:88 8 .8888 :0 : .880 85 8: 880 8: 833 .058: 85 0: 8:888 88 2:03 88: 8888: .83 8:5 5 82802 :8:—8:880 8 0: ::8 >388: :0 888888: 8:22:08 .3 8888 8: 2:00 £0888: 808 88: 8::. 88.858: 88— :8 88:0 88: :88: 8 :8: 164 0:00 0800::0 :88 80 8 020:0 05:: 5:3 00:80:00 :05 00 ::08 -0898 05 8:000 0: 0: w:5000H0 :0 8:050 05 00:8:88 0: :03 0:0 .:0: 00 0: 00088: H 85053 .0505? 8008808 05 0::088 5000 2:00 000: 8:80— :05 0050 828088 8 00808 0005:. 00:80:80 020-3058 8050 000:0: H 3320 008:0 H :83 ::5 500 0:0 800 0:0 .0w:00 .80 8050 020:0 H 02080 00882 H 803 05:02 08:0: :8 0:00:02: 0: 000: H 0088008 850808: :0 858:: 05 0:050: 00 2:0: 05 8050 000:0: H 8:53 5:3 00088.»: :0 00800 05 00:0 ::5 000: :8 >80 :0: 008050 0>05 0800 H .005 0: 0:000 00 0803 8085098 :0 :0:m .008: 0:88:80: :0 H0>0H 05 880008 .3 000:0>5:0::0 00.80008 03 .000: :00: 0 :0 00050 :0 0:0 .000: 808008 0 :0 0:00 0050 :0 .000: 320 0 :0 200:0 0: 0000: H 0:00 0800 :O .000:0>5:0::0 .080030 05 :0 80:00 :0 00: 000: 00:82 85003 0:80.880 0: 00:00 880050 H0880 :0 0008 80.0508: 8380008: :0 8:82 0: 0088050 H 505:3 8 8085098 :0 008:0:00 H 000:::0 88808 00.: .8588 :050::_0 0:5 :00 3808582 :00 03 00000 808 8 ::5 .8088 0: 2:00:50 0: w:H0::0800 8:0 0808:0098 880005080: 0800 5 030500, 8008808 0:0» 505 008008 50050808.? 0:50:09, 055 .80: 8 80:3 030500, 80800 0 0::: 07:050., 0080500: 0 0008 0.300: 0: 8:0—0 :0.» 5 8080898 :0 0::0800 008 :00 :0 .0» 80:00:05 88: .0080 0 :0 .000 :0.» .805 8.300000 :08 00 0:00:00 0005 08885: 0: :::850 :0: 00 :0.» 0:0 0:8000 05 8 08050 008000 0 00:00 0800 80508098 80.» :05 00 8085098 80.: :w:000 :0: :H 83% 8808.20me .m:5.5:8 88080898 8 00 08:88 0:00 85:0 500:: 8085098 05 8080 .8080898 :0 :0 :w:000 05 8050 0:000 :00 0:058 0008:. .0080 0 5:3 828:: 05 :0 08:00 88: :0 808328 8:208:00: 05 0: 08:. .0800: 05805080 00.82800 0: :00 80800805 :05 .8500 8:280 0:0 88300“: 0: 002 :05 85 030800008: 0:5 08:08:00.8: :008 :05 80500 0005:. 02000:. 038050000 0H :0:000>|000:0_00H 055:0:0m .8880 :0 8205 :0: 00 300000 000000: 055 00:08 :05 0080 05 30:8 0: 8:03 :0: 80 053 0005:. 00880 w8285 0: :0508080898 :0 000:8: H08 05 ::5 .::u: 05 :00 08080898 30850.8: mica $8800: 0.88080898 :0 8 3000 00:05:08 05 :88 02:0: 50:0 :05 08505 H :0 .0 .002: :0:: 05 :H 0005 8:00 00002800 0>05 :0: 0803 :0» :05 0:0 085 0:0: :0 0:003 0 003 020:0: 8:0 .:0 :0:00:00H0 05H: :05 0:0: H 08088: 05 :0::00 0:0 00:20: 0:00:00 05 080:: 38:00:05 :0 09m: 055 .2800: 0: E0800 0:0 0:058:00 803005 8080080 05 00:000m .800: 8820593: 88085098 :0 00: 0: 00: 8050088888 :0 08:8: 00 0088 0:0: 0 858 00: 08:2 0: 80050 05 .:05:0000 05: 00.8.6008 000000000: 02 85$ .858 :0: 20 :05 0:0, 0:5 :0 008500 0:0 000:0: H0880 00:05 0: ::5 00000080: 0:; 800“: :0500:088008 :0 0852 :000w 0:0 0088 0:5 0 005 0m .0::> 00530: 0 8:0: H0080 80:00.8 0::: :0w 0: ::8050 80080 00808: 80> 0 300 H .8800 :8 :H 300”: .2000: .3000 80:05 0 0: 08080008 «000808.: $03.80 :0 >00 83 H 0:00:80 50:0: 05 :0:8 ::08:000 055 :05 80:00 80553 0w 080:0 :: 0:050: how 0 :0w 0: 00 .0055000 .HHH0:0_000:00: 08000: 0: .8080 0:0:000w 0::: :0w 0: 0: 00: :0 > 008500 0:0 000:0: 08050:: 0:0: 0:0 8085098 :0: .80» 000800 8:058:00 0:0: 0:0: :: i=0:0:000:00: 80 :0: 0:3 03050 :05 00:0: :0 000:: 0 0: 08:08 < 88:08 00 0:0» 0 0:0 800.: 05 8 38:0: .000000 8:208:00: 0:0: 5:3 805 8008: :0:8 :0: .00:0w500>:: 00550:: 0 000 :0» :05 0:058:00 850 0: 088 0: 0380:8800 00>—000:0 0050: 03 :03 0:0 0: 088080898 :0 08580000 8:208:00: 800800: 0:08 05 088380 .882 0: 080m 05 :05 08500: 03 5 008030: 0005 A030 w:5H0: :0 050:00 88 80 03 .00>030H.H 08:08 :0: 0:0 .3 800.8 0:5 8 00:00:::0 00850800 80 008 8: 0:03 00>00::0 8 805 0:88 0005 :0 00>: 05 0:089:08 0: 00328 80 >80 :0: 0:05:08m 165 5288388 32232: :5: 8:305: :5 0: 8::: 28:83.8: :5: 8 ::08 58055: ::5: 8888 2:8 :02 .2:3 ::02 w:825::: ::53 .::03:8::8 ::23 8 ::08 :0 ::0 8:8 0: 3:: :02 3 8::: :: :88 5:3 :02 85: 2 2 2825 305 3:: 8:8:2 :8: 83:32: ::02 803:8::8 ::53 305— 0: :02 0: :: 2 :2 .:2::83::x: :: :< 9:88: 3:58 :5 0: 8:5: :0: :: :2: : 32:33:00 :5 3803 2 ::5: 888:5: 0: 2: ::03:53:23 :80: .82 8 83:8 : :3 .:03:53:23 888: : 258:8: 2:3 0: 8 8035323 :85: ::53 28: :85: 8 ::0 :8 0: :::380 228388: :80: 2:2 : 50:: 2:388: 2520: :0: ::03 2::::: :03:8:::: 25: 8 83:88 ::8: : 58058: .:::5: ::5 8038882: : 5:88: 28883888 :5 :03:53:23 82583:: 23 ::5: 288: 2:2 5:03:32: 3::: 23:88.3 ::08 :5: 2:88: :0: :85 8 2580388: 2 32:88 2_::0:w 2: ::03:8:::: ::2 :5: ::53 :8: :5: 82:2 .32:8388:: :5 :8 ::03:8:::: 82:8 ::53 280 3::: :5 ::0 2:2 :83:32: 825:. .8850 0: ::3 2 3 85853 .8 8:3: 8:: : :5 0: 25:55 2 5:8: 8803.8: : 85853 :88883 0: 32::800 258:: 2: 28: 5:03:32: .2 88:50 8 8: 5:3 :3 :< 2:3 3:::5 : 8 2:3 ::02 8828:: 8 2.8203: 38>: 02: :::8 :0 .2 8:22:88 :::Q 22:88: :88 :5 5:3 8:882 :5: 3:5: :88: 0: 883:008 :283 3805: 2:5: 880:8: : 88:28 0: 8:882 :8 :::8 2288388 3:::5 88853 .852. 2:83:82 820: :5: 3:3 053 8050: 3::» :0: :03:3::8800:: : 8 3::: 22883 8 88.83:: :: :0 8:32: 283:8 38:83:: :: 85:8 25:50:: ::3 2 .883 0006: 3::: :5 0: 3:5 5:23 23 :08: 28203 .288: 88:83:98 85 58288 3803 8:82:82 23 88:2 8 88:22: -808 ::8: ::5: 2:55:80: :5: 0: ::3 888 .883 0006: 88 5:8 23 3:2 0: 3:5 2288388 288382: 25: :5 5:8 23 :0 888: 23 8 :0380. 23 805: 28882 3:::5 :3:8 :85 2:8: 3800 88:83:88 :5:. 8:3 83:: :: :0 23028 :2 8035:: 238: :5: :::8:5 3:03:33 ::3 2:2 25:. :23 :5: ::08: 3:88 888: 23 2388: 208 23 .822 :5: 803 83 83:8 23 853:: :5:: : :0::::>l:8::_:: 033:20m .2 8:2 3:: 5:8 ::::8:8> : :0 888: : 3::: 2388: 88:83:88 23 5:228 3:08:82 28>: 83:. .882 w8>08 : 533 .8288 : :: ::5 0: 203: : 3:>08 28:83.8: 5053 :5 80 3:380 83 8:83:88 :< 383835223: :88: 880:8: 8 :::8::::::8 5053 :2 288388 :2 ::>: ::000 ::83:80: :8 85 5803888: :0 8:03:28 85:8 .8388 8 2:55:80: :5: :820:3 803:8:8 58m 35288: ::02 5:3 :85 0: 288288: 5::2> 533 :88: 2:02 0: :>:5 :02 :::8 0.5803 :5 883:3 2:5: :0 :5 :03:5::8:8 5053 8 2:38: 2 053 ::0 2 :w3:.a 3:55 .3 3:38:50 w8:5 ::2 :5: 8.: 3::: 88:38: 23 :0:: 23 0: 3:55 88:... :82 0: 253:0: ::>: 2 :: 22885 .2832: 23 23:88 23::3::::38 3:: 8:2 :5: 88:50 8w3:.a 5:88: :85 3:: 208:5:5 83:28:: 3:: :>3:2:: 8 235850 383:2: : 8:388 528 88:83:88 23 .2883: 8 8:0: 25: 38>: 0 .5. .8250 2: :8:—50:: 83:20: 23 3:23:88 23 883 02: 2 85 23 :385 053 88:83:98 23 3 .85 ::0 :0 88883 238838 208:5:5 :5: 23:88 :8 :3 8:88.: 2888 2 053 ::0 ::5: :>3:2:: :8: w:30:: 2 053 8:32: : :: 835:2: 25 8 :28: :5: :0 w:3::::8:00 38.2 :5 2 :0 382:: 2 828:: :5: 3:03 28>: :0 8328880 :5 :5 .3820 82: 25 85 8:32: 8582 2853003 8 :20: 8352 :5: :: :::8 8 8:8 : :0 8::: ::5 523 855530: :2: 8:32: ::0 ::0:::m .w:8:::3 83:28:: :::8> :>3::3: 8 8::: :83 8 82:88: :5: 3:002 0: :>3:2::8 :0 :>3:2:: 8 88:85 .2832: 23 23:85: 0: 283 88:83:98 :5: 888:8 :0: 388023 :::2 8:83:88 :5: :5 83:8 85 88203.8: :5: :::0:8: ::53 :88883 0: :::8w32 88:5 :8 :::8 :02 3 232088 2:3 802 w:30:=00 ::53 880523 :5 02: ::0 :0 2 .:::Q 280289 .8000 0: 2825 :85 2 85 50:: :::8:5 888800 208 :5 :23 :283 3:08: :5: 85 .::800 8 .8283 :::3 :5: 8 ::000 253888: :0: :23 85 88:83:98 8 8:0: :5: 8 83850 2:832): .:w:3:: 82:38: 5:33 8:202 ::05: 803 280 2:3 8:38 ::5: ::0 88:83:98 :5:. .::_5:3:> w83::0800 253:0: :5: 8 :88: :2 2202 50:: 166 58:8 ::3 82353 388 :88 88:8: 88230:: 8 ::30:w 3:: 88:80:: 2:: :23 2882898 8 8:83 88:88: :3 m3 888:: 8:88: 38382898 :8.» 8 3:88: 8:: :88: 2:08 :8» 53:33 38:88 8 m8: ::3 m8— w:_>3: 2:: 2288388 828:8: 288283: 3 83 2 388: .8: 2328:: 32288388 8:: 2:: :o :83: 88:3 3 88:8 :0.» 2:03 .282 .3 8:82:88 8:3: 2:3:m::: :3 8:38 2 388: :882898 288 3 8 :88: 3 ::833 :23 23:82. 32 .8:28: 2:: 8: 2:88:82 2:8: 2 8::3>:3 38882898 :23 83:83 m:::82 8 388:: 3:: :3:: 2882898 .838 cm 88: 8:3 2:8: .838 cm 823298 88:38:: 3 :8: 33: 88:: :3:: :::8 8 2:308 33: :8: 8:: .8838: .882: :88: :: :882898 28?. 3 8 288: 8:: :288: @0888: :_ 22::3 3:80.: 329»: 8:: 08 8:83: .832 .233 2:: :2 8:88: :88: 8: 2:08 :0» .882: 3 :3 8882898 8:: 3888:: 8:8 8:88: :w:o:::< 3:88: 38382898 8 MEEQQE 3828.83 2 2822:: 2:82:38: 8 8:2 8:8 8:0 ::2:3: 8:: :::3 w28::3: 33:83 323:3 8 82:88: 8:33: 838:8 388: 30:3 8: 88838 02m 8:: 88:83 880: 3 3:: 8 ::2 3.: 8:288:98: 88288 2 cm ::3 8:28 8:3>:3 8: 82:8: 8:: 8338: :83 53:02:50 .:8w 82 3:88: 88:12:28: :88 6338:8388 :88 82883: 8:: 8.8 838 o: 2:33 8 3:83 :3 ::m: :8 :8.» 888: 22:88 3 3:3 :0» ha .838 883:: :83—:2: 88: 828:2 3:: :3:: :3 2x3 88 :0 28m 8:: :82: .2238: 8 828 2::3w:w 3 2:: :82 828 3::: 3 838 o: 88 m.::3:w 8:: 8 8:: E2888: :0: .8:28 .2 3::: :: 32: 2:8 88882898 :3 2:838 8: Avg: :8: ”who: :8::830: 338832822: .3 2: o: 30: :o 88:: 82:3 23: 2:8: .::3:w 3 8::: 3:88: 8:: 8 888 8: o: ::33 :23 8» 23:2: .288: 8:: :88: o: :::8: 30: 8:3 ::3 :882898 :8.» :8:—3:3 23: :8» 88:::m 888% wEtamm .:88:898 8:: o: 8::: :8: 88:28-88: 3 8 :8: .283 :3 83: 8::8 0:3 28:28:: 8:288 ::28 8.» .88 2:: 5 2:: :8: :2 882:: 2 : :2m8>lm8::3: 32828 :38: :2:3 :88: o: 3.822 8 .383 :3 :w:o::: 8:38 3832223: 833: 8: ::28 8.» 2:838 8: .288: 8:: :88: 8.: 8:3 828:3 2: 28:3 ::3 8883898 3:: o: 22:: :8 8: 28:3 2828 :83 .8830: .2322 222:8 88:88: :8.» :0 8:38:28: :3:: 8:8 233: 3 :8 3832283: 82328:: :2 833 :::8 8:3 8 w 2 o: 8: 28:3 :9» .88: 8:38:28: 2:2:3>-:8:8:8: 8288888 3 8 28: 8:: :0 3832283: 3.23288 :2 :88:w:3 32w:— 3 333: 8: o: :0» 2 .8833: :28 :8:2898 :3 8: 2 :88: 3:: :3:: 8:882 2:28 8: 3:83 8: :3:: 82 8 :88 3 :3:: ::3 22:»: 882898 :o 828: 8 828 8:: 2 :8:88::: 3:3 8» 3:: 8:83 ::28 :0.» :O .828 8:: 30:3 8: 2:83 8:: 22:»: :o 828 3:88:28: 3 m3: 828: 2 88 :3:: :23 :88: 0: 22:3 :00: :83 8:3 28:28:: 38:: :3:: 8: ::28 28: 8:» 82:: 8 8883 3:: :2 2:28 8: 3:83 8: :82 :3 2:: o: :2 0:3 3832223: :3 80.: 3:3: 8:288 o: 828: ::28 8.: .:88:898 3:: 83:38 8:28: .28: 82:3 3 8:28: 8: 32:3 3.288: :o 32:: 8 3828 8:: :: 8:888: 383 :9» 88::8 8:53:82: :3 m< :88: 38882898 80% 8 88: 8:38:28: 8:: 288:3 :9: :2 ::3 .2 :88: 3:886: :8 :9: 2 .3:3: 8:: 88288 8:28: 8>2 8:38:28: 2:: 82888: 8.» 2 2:0 2:2:3> 83:88: 8:: :o :22 8:38:28: 38>: 88:3 :88 8: 8:3: :2 3832283: 23888 :8 8 > 2:323.» 8:88:82 8:: 8 282 8:: o: 880:8: 3:83:22: :8:: 8 28: 8:: :o 88:: 23:28:: 88: 28:3 8.» ::< 53:23:82 2::—8: 3 33 28:8» 8 838: :8: :23 2.: :.:2: 8:: 33:38: 8:: 82:8: 8838:: :02: 38283 238:2: 8» 28 3: 23:3.» 82:88: 8:: :0 8:38:28: :8:: 8 233: 8:: :o 22:38 :3 8:2 28:22::3: 82388:: 80:3 88:8 8: 8:8 8» 8:38: 2:: 8: 8:28:22: ::03 :8::8 o: :23: :3:: :882898 :3 o: 88: 2:03 :0» 2:8: 88.398 :3 30:3 0: :22 0:3 3832283: 8:: :3 882 3:3: :8 3o::: 2:8 :0» :2 53:23:: 88882: 3::388 82:32:38.8: :2 8:888: 2:82:88 8:3 :0» 82:3 8:388: 88:: 80:3 w:::8: o: :8 :0.» .88: 2:: :< .828 8:: 38:3 8: o: 3883 .828 167 00000008 00000 00000 Z 00000000 0 5 E05 000 0000 00 _ 000v 0000000 0>00 :03 00 00500 000 00 050000005 000 05500000 500 00 00 0000000500 000 :0 000 0w0000 w50000005 00 00003 005 00000 00>000 00 000 00 0000000 0000 0000000000 00 00003 00 .0 00000 00 00000 00000000 0003000 000000000000 09 000 00000 000 .0500 00 003 00>000 0 000000000 000 0 600000000 00 0 0000005050 00 000300 05 w50000000 000 000 .0000 005 00 000000 00005050 00000 005 0005 0000 500000 000 w50000 005 000 00000 00 00000000 0 w50000000 00 0050000 05 w550000 000 000 0 005 0007: 0000000005 00000 05 00500 000 0500000000000 0005 000 005 0005 0000 00 000000 05m 0000 000 .00000000 05 000 000 005 000000 00000000 000000 000 0w0050< .00 0005 000 000 000 .0000 0000 0000000 00 0003 00 0000000 0 0003 0005 0000000 00000000 0000 00000 00 000000 05 00005 00 000000 0000 00 0 0005 00 000 .000000 05 00 05500 000 005 0 00000000000 0.003 000 0>00_ 00 0000000000 0 00 0000 002 $0.5 000: 0 000 00 005 w50Q 000050000 0000.00 0000 0000000 000 00 000000 05 0000000 00005000000 000» 05000000 0 000 0>000 00 00000000 000 000 000 005 .00>0300 .0000 0m 0000000 53-53 0 000.0. 005 00500 53 000 00 00003 .00500000 53-53-53 0 0.00 .0000 0>00 000 000 .w5500 0000 0 .w5500 00000 0000000 0.000 cm .0 00000 0003 00 0003 0.000 00 .0 .0 00000 0000 00 0003 0.000 0 00000000000 05 320 000 0m A00 0 00 0w0000 00000 :00 0.000 000 0000 000 ”000 :00 000000000 0005 w5>00 00.000 07.00505 0000 000000 0000000 0000 0000 00 .000000, 0000 .000 0000 00 0050000 05 5 000000005 00 0000 00000 Z 00000000 0000000500 0003 000 00 500000 0000 00 0000.0 0w0000 0000 000 000.» 0 5 0:00 0000 w5500 00 55005 0000 0000000 000 0000000 .0005000 00.: 005005 000 0 000 000 .000000 0 5 00000000000 0.05 05 0005000 000 0003 000 000 000> .000w 00 .0530 .00000000 0 000 000 000000m 000000000 000 000005000000 000 0>00_ 00 00 000000 0000005000000 0000 00 w500000 00 003 000 .005 0.0.50.0 0.0.0003 :05 000 0>00 00>00 0000. .000 .005 055 000003 00000000 00 02 <0 .000000 05 50000000 000 0500000000 0050000005 00>000 00 0003000 0 000000>l00000000 00.500000 00 000000 0000000000000 000. 0000000 05 000 3000 00 00000 05 0>00 000 00 00000000 000 005 05 0.00 000 00 000 00000000 0.000000000 0000 :0 00000 0000 00 05 00 00005 0 0w0000. .00000 000 005 0>00 00 00 000000 0000000000000 00 00 w500000 000 000000 0000300 0005 000. .0 w500 000 00050000 0000 0 00 0 00000 w5000m ”006— w50000 000 00 050 0.: 0000000000 0000 0000 000 000 500 00500000000008 00000 00.00 3050 00 w .0000 00000000 000000000 0000000000 050000 00 0000000 00 00 00000 00000 5 0003 050000000 000 000 00 0 055 005 0000000 300000000 0000005000000 00 to 000000 0000000 00000000 00000 0000000000003 .0000 000 00w 000300 00 000 .0500 w0000000 0 0000 0>00 005 0000005|00003 00000000 05 00 00000005 000000000 05 000 000000 00000. .0000000 0050 05 00.0 003 w0003 05 00 0000000 w0003 05 000 003 0050 05 000005000000 00 0000. .000000w 000 00 00000 000000 00000 0005 0000. 0005005 00>0_-00w 00 0000000 00 00000 00000000 0005 00000 00000005000000 000000 05 5 00000000 0000000 0000w00 000000 05 5 0003 0500 0.0000000000 0 0000 000000 5 0>0000 0.000 .0005 :0 00 0000000 000000 0000000000 0 5 000000000 00005000035 05 .0 00 000000 0 000000 000000500000 00 0000 000 0003 000 .0000000 00000 0 000000 00 00000000 050000000 0000000000500 00 000000 00000000 0 00 000000 05 00 :00: 00 000000000 000050500 00 00 0500050000000 000000 0 000053. 0000000000 00500000 05 00 000 0003 050 05 000 0005 0002 000000. 0002 .0w0003000 00.500000 00 0000 05 00 0000000000 00000500035 05 00500 00300005 00 w5500 0000 00030000 0000 .000 05 5 .00>030m 0000000000 00000000000 00 w5000000 0000000000 00 00 00000000 00 000 0000050050 00 .00003 ‘000000 00 000000.. 0.00000 5 00000000 00000000 0 005 00000000 000000900 w5000w005 000 0000500000 0000 503 0000000 000000000 000 0000000005 05000000 .00000000 05 00 00>—000005 5500008 00 0000 05 000000 000 0000000 000 168 888: 88855898 85 no 8:258 85 888885 8:588 8885 5.8.885 8885.88,: 58 8852898 85.88.: :88 83 8 J88: 85 o: 38 8: oc »85 5 :88: 8 :85 885828 58 885.2898 58 8.. 88x :88 83 .2988 8.5 4:25.898 85 5288: »5888 8: 8828 85 58.. 8 5 388: 85855898 as 85:3 3 2888888 2 55 .8:2858 mo 88m 85 8..» .288: 8858888 88 2855898 mo 82:88 8 w5::o8: 58:8 8588 85.885 8:8 88 .83888888:s Q28 88 8=8R~8528QM585E-8 »wSflEQEQQmE 58 58.59588 88: 885 8.: M555 28388 885 w5:sQ .885 :8 8o :58288 w5:sv 8:888:85 8.558885: 58 85888.: MR§:888~8M~E »n :o 88:88 :8 .5855898 :8 wo :w82o 85 5 83528.. $558588“: 8.588 8 35.85 »nlmxomb 83558818 5 88:88 88 :88 8 3 55585888 .58 M5535 »A :o 85:88.: M55888» »5 952:: 355 5 88:88 :88 8 .3 .m»83 U8 85:8: 8 5 88:28 553 555:5 5885 :85 882 8A :88 8>> .8258:s 5 8288585 mo »won 85 5o :o_m:898 822.58 85 28:88: 85 8588 »:8 8282.85 .8 »won w53o:w 8 5 88:28 8ms8o8m 855m .8525 8355859 ow 52588 58 852:: »55 ow 8.8: :53 so» 8282285— 8 »coa 85 5o 5288 52858 85 5 E8 85 885 88 8:588 8258 85 2585.8 85 »88 so» t .28» 5 :25888 85 .885 6:8 85 :5 888558 8: 8>85 so» 85 88585858 88wwsm 5:8 55oz 888: 3 28 85 »85 on? 8888288 553 5 8825 o: 523 »85 so» is 88:88 5838: 8 85$ 88:28 “Hr. . AB R m :omm:8>lmm8:58m 55:28 o: 58.5 5 8588 885.8: 8 85853 2588: 8 58555 5 5:5 53 so» .8888 8:88 :5 .:2:8:5898 :8 88 888.5 53 so» 85 8:588:58 8558 85 :8 888858 8:85 o: »n 885 83 85858 55 5 .»w:8:8 5:8 8:5 8:88 8:85o 58 58858» 8.88 o: “:83 so» .8888 w5u58 88.50 :8 :85 858: 88888:: 583 8 m58s 8:8: 8 55:88:: 85: “8 555 .8:8:: 52858 :8 5 8282325 wo »won 85 8 w558 8:8 so» 8525.» 85 2858 :588558 8258 8.8:: :so» .588. .»:o85 88888 553 8:88: 85 85:5 8: 888: so» .8588: :so» 8588: 5 85:88: :so» 8:888:58: .8 5885958 :so» w5w:858 »n »:o85 582.8: 85 85 8855898 :so» 5 8 28 85 53 so» .8828; .850 8:85 w5385o 85 3 5885 ow 3 885 :53 so» 58 .58 8 5 8: 885: »:o85 :so» 85> 88:5 8: ES 885 5858:5855 .:o585:om5 38: 85 553 85 885 83822855 go 585 85 8 :o5s55:oo :so» 3o: 855.852: o: 8.85 so» .888 55 :5 858588 8:8 so» 8:o :o 58: 58:85:: 8 $888 85 5855898 :8 8:5: 885 828 5:08:88 85 8.8885 so» 8858: :O .5 8:58 w5>85 :5 :88: 8585 8 8.88858 :88_ 5:8 :88: 8:88 :8 825898 :8 ow so» 55558880 .525898 :8 8388:9085 85 888588.: 3 2888888 »88:8 5 5 585.5 :85885258N 88:23. 85 5:25 8: 8o": 5:5 85 w5v8n 88 w:o_ 88 .2588: 88 »58858 88 :85 :88: 2:98 so» 58 .885 8:8 88a .585 55 so» 5253 5 888 85 8288:: 858 55 8: 8 85853 .858 8882 82: 85 5 585 528: »85 so .r .2858 mo :so 8:8 3:25.898 w5>>o=£ 85 .8555898 528852858 85 wo :8: 85 :o 88:55:85 888 58:8 .5288: mo 82 88528.85: on. w53os 85 :288: 85 :2 8: 588: so» .8888 sosm :5 8525898 »855588 8:88 o5 5:8 as 588A 3 28582: 5 8:5 »85 so N» .8288 85 5 525898 :85 85 885 8.8; 8: 5858 5 85 8328 5855.898 :8 mo 8:888 85 85 8:5 »85 so» .8888: »:o8:o_98 w5oc :85? b88255 8858.583889‘ 8:588:925 5:8 m8m»8:8 828588 :8» “so “5:: 3 5255 85 o: 885 E83 85 858.580 8 888 85 8.88 o: 88:: 88:8 mo 88>: 85 :5:8:: 8 8: .8:5 85 8858 5:8 8:288: 85888 :8» 169 85.5 5::: 80333 :85 :8 :55 H .8888: 5:: 8858:: 3:0 5: 58:58:00 8 5:: 58885:: 8 88:: 5:: 5805: 808 8:88 80 :88 ::0 5333 8::. .5333 85 80.5 :80: ::5 858 8:33 8:88 .80 5:: .55 80:3 :5 5: 5:: .585 :5 :::8 88.888 : :33 8:88 8 885 :8 :85 .388: 8.8.: 8820.582: 8:5 :8 :3» H ”8835: 55:88 88 5503 88888 : 85 8:888: 08 5: :8 5:: 88:8 558:: 3 580:: 85 5:: :0:: 53308 :8 85 80333 :88 8:85 :5» H :888 58: :5 :H .835 E5 85:: 85:3: 85 5 :888 8.5 :5 8 80333 88588:: 5:: 8853: 388: 8:5 8:85 :3, H 58:85 8 5333 85 :33 8:88 w8888: 5 8835: :5 8:0: .588: 830.888 : 5:: 58888 5: 8 8:88 8 5333 8853: .8 88:5 8 5888:: 88:3 38 8 :>3 :3 8:83 5:: 8:88 .80 8 H8883 8 3 :8 5333 8853: 880:: ...:58w w88:: : 8w 8 5:888:58 :5 :0 :::8 8580: : :8: 8 5:: H: 5 “=500w :00: 8:58: ::0 :::8 8 5:: Ha 9.805855: :2“: 53 H 88:: :8 8088: 8 w80w 5.883 8::... 88 :88 5 88w 8:88: 8588 5.838 588w :::8: 8 5333 :::m 80:88 85:3: :8 5: :8: 85 88 8 :33 8:5 585:8 83 85 85 8: 5:: 8::: :5 30:: 0:3 8:8: 38:88 .8: 5 8: 5:3: 5:: :3 38:88 500m 855 5 88:8 3 88 0:3 58w58>8 8 8533 :88885 8 55385 5: 8 8 80535800 :w:0:: :w8H : :::8 8 8:8 85 5 ::05 350: 8:3 85 38:88 :5:—0x: 8 53885 8 8:88 3:38 :5 :w:05H< .::3 858 5588 88:88 885:8: 85 8385808: 8 85 88 8:805:08: 808 .888: 5: 8 888: 83838 85 8:055: 68:88 8 8888 :::8 88:88.: 8:8 :5 88: 8: H 85 83 8073 85830:: 5 >53 :5 8 5:55: 8: 885:: 5388 5:: 88::80: 3:0 85 8 38:88 ::88 8 5888 88:88 .80 5 885: 5:: 88838 :5 83 85 :H 88:80“ :5 8 85:88 8::: 5 838:: 5:88: :5 wEm: 58.83 8 88058 8 55:35:00 .80.: .8533 :88885 8 58:5: o :88:>lm8:.8: 55:88 8:3:38 :5 65885.8: .50: 85 8 58885 :058::85::8 5 :8:: :5 30:8 8 8::::: 58:88 :5 .8533 8:83:58 3:38 8::. 8 8838 888585808: 8888 .85 :8 5:888 85:88 5 ::8w : .8888: 55:88 :5 8 5:85:98 :: 5 :808:0 :5 80:8 8 585:: :8 :0: 883 8:888 5 ”H 88885 8:8: : 8 58:8 8 :::5:0: :55 858305— 5 :50: :5 85 88:: 8 8 88 5::: 85.8888 38 : :3 8:85 .8853: 3:855:88 5:88.80: 3 ::0 :05085 883 :5 8 58:8 8 8 83:: 5 8:88 5 :08898 :5 85.858 85 05 :0: w858< 885:5 5:: 885:5 5:0 :0 5::: 5 808:8 38830: 38:88 3: Z 85830:: .5 :50: w:5:::x: 8:3 :3 5:: $8830 .8308 : 8 8 85 8 8:88: 5:85:30: 3 :8 8:88 .8:8 ::0 :H 80:88 3: 855 8:88:8 :: 8 88:: 3 :8 :0: 30: 85:03 388 :0 .w 85:88 30:8 .80: 8 :8 :::88w 8 :0885 8::. 588.588 5.8: 8:88 85 88:: 5.8: 85 5: 588.588 5.88 88:85.8: 88:: 5:: 88:38 888: 88 :::8 85 8888800 :8: 85888:: 5:: 88:0: 802 .805 8::858: 38:88 : ::5 838:5 838 :3 8:88 .8888 :88 :H .388 8:88 55:85 55> H85 :3 .8530 85 :H .88: 588:5: 88:8 :8:: 85:5: :5 828885 : 3 N5: 88 85 5:5805‘ 5.:3 w8588: 8 a: 8 8.28:8 M8888 E :58 .83: 8.8: 8 :8:? a: 3 8 8::: 5.5: :3 .85: 85:58 : 8 85.8: 3 5: 5::: :88 88:85.58 ::5 5:585: 8:85 :3 :5 8805:8Q :::8 :53 8:5 8.8:: :50: 8.58.5 : 8 88:85::me @0588: w80nH 8.8: 8 585.885: 8:: N .80: 555:? @8803. 00m 8.: 88:83 5883:. :0 5835 : .::8O 55285:? :5 :0 85:8: 8 35535:?» 5 :08888: 53, 5885:: 50085 8582 .3 d .3 65.5.5: 5m. 82:85:85 8055.58. mfiaQ 808 58::5< uucflum :33 ha“— flm Ow 30: 170 ...5:8:: :0 8:058:85 858:5 8883: 5838.: 88:8: .md: 58 .8885: 8:5:0052 808...: 88:03 8502.. ....::85.:. 8:88:35. ::05< 8:88:00 888:: 85:08:82 055858 :0 85.8887: :0 8:588:23 ”88585 853050: 85 5::0: 5:88: H 88:8:838: 800: 58 8:088:08 8888 :H .850: 8588 58:8 8: 58:: :0 88888 85:: .5:8:::8::D 58:: 055888 :0 8::888 5:5 0: 80855 0::: 5085 500: 0: 585 H .5005 8:5 :0 8558 8:5 85 :0: 8:888 55: 883 H 853 588:8: 35008 858:5 58 58558855 83 85 850588 8.05893 0: ::8: :5 58:55:58 58388 883 888: 885888 8588885 853 .359 $853582: 88880:: 885858 8 5808 8:8: 8 :0 55:8 85 5:85.: 85: :85: 5:8 88:80 883 8:885 855 :85 85058855 88: 5:8 :58:m 58:53:08 8H: 8:885:88 858:5 :0 858:: 8 :0 :0::888 5:8 .858 8858855 85 :0: 258:0:8: 58:88: 883 o: .583 8 58808 ::5 88:8 55:0 :0: :::5 85.38585 8558:: 3808 8.05893 .39.: .8885: 88:583 :5 58— 88 80:: 800508 :0 w85085 85 88 5:8 £88558 88 5:880:05: 588805 w::m:: :::583 :88: 0::: ::0:w 8:85:85 85 :0 8:: 8 "5.: 0::: 8::: 885580 0::: 8885 88305808 88 5:8 .880 .855 .88 0::: 8853 8:88:88: 8 85:8: 8:088:58 50:8 ::058 :5w:0:5 585 85: 85 58888 8505893 .885 :0 H85 :88 8 52:88: 85 85 8085 8:5: ::058 ::88858 08 883 oz .850: .8885: 58585:: 85 5::00 8585888850 58:85:08 85: :58: 85 588::8 088 05883 .Q ..H. 5888: 858:5 8 88888 :0: .808: 88: 85 5 $8808 :0 858858 85 0: 585 088 :8 80888 :0 858850 85: 58885:: 5 .80808: 8.8888 :0 8883 8888 85 888» 85 53885:: 80w w88850 50:: 8:2 85:. 88888 2053 85 8:55:58: 5580: 5:8 :0::85::0: 85: 85:: 88:: 8:83 85 8:8 85:. .w:0:3 m: w85880m 85 558888 8>0o55 0: 5:0 8:0: :0 50:88: :85: 55:5 0: :::8:5: 5:8 m:0H8 8808 H53 8850 8855305: :0 >505 85 :0 :08888 85 5:88: 5:3 :0: .8: 885 :0: U Gcmmho>lmmmfimwm ocmufivmom 853 58:88: 500m 8:05 885 :0: 85 588:: :0: :5 ::5 .5 8:08: 5:3 5:8 :88 2:08: .8888: 585 05 :0: :H 48585305: :0 >505 85 0: 88:0: 558 0: m: 05 :88 :0: 8:5 8:03 85 .858888: 055888 8 m< 85888 8558800 :: 5858 58 35555588 855 58888: 88: 8:: ...58 555 5:3 88:88 80: 58888:. :85 588—: 585.. 85:8: 55 85 535858 888885 .58 8:55 :0 8:05:88: 5::0: 85:. 888588 8808 88888 0: 583058 883 8:58:08 8585 03: .888: 888 858 5::: 8058888 58885 0: :885 088 885888 850 .583 8 :85 585 888885 :85 88:0: 558855800 83 88:: 8:0: 85 :85 5::0: 5:8 58:08: 585 888885 8:058:88 :0 858:: 85 58: 85:5 0: 585:8: 88:: 85 58558 .8888 885 58585 053 .858888: 5:08: < 8885858 :5 :0 5888: :85 585 :0::0:58: 8:5 85 088 ::5 8858888 88 88:8 85888 58888888 :3058 585 88:8 30:8: 553 58:5 5888: 8:8 5553 88588888 85 85 5:0 :0: 58:88: 8H.H .508 588—5 :0 88588888 8::: :0 8:058:88 ::85 585 85 85 58888 8:: 805208 :8::538Q 80:: :88:::5 85:: 88:00 8 Ammo: .85: 585858 85 5800 885888.858 585888 85 8858:0885 0: 88838 888885 5888: 880—055 8 .8000: 5:88 85 :5 885 .8385 50:8 :0 88888: 558:0: 8:8 85:88: 8:088:05 8058588808: :0 88:8: 555:8: 58 88858855 88:0 88:80 85:88: 58:55:00 ::5 .8588 58833 88:88 8888:8888 885 5 05 :.:0Q .5 5888800 8: 885 :0: 5:8 8:5 8: 8888588 :8 8:885 8:85:58: 0: 58:88: 85 88 :0: .:85:8 8 2 .80: :0: 88808508: 85 :0: H53 85: 8:885 80888:: :::8:55 8 :85 8:85 088 585 85:. 85:85 53885895: 80:85 0: 30:: :0 m: .8885“: 588: 8:85 585 88:85:58: 8885888 :: 85:3 0: :85 w: 05 0: 885 85 :2 85:85:88 05 0: :88: :0 88:85.8: :: :wfi 588:5:va 5:5 0: 885 :0: 05 85 .H. .58 8 5 ::: 0: 8: 85 8:858:08 :8 :8 0: 83 :888 85 85 30:5 a888885888: 880w 85:8: 8:85:58: 0: m: w88850 88:83 :0 8:0: 8:0 358.258.: 9:05.55: 171 0:0 0800:: 8:80:80: 8: 3 888:: 80:08: ::0 080:0 0:: :0:: 08:0: 8::. .:080 ::0:::0—0: 0: 8030:: 0:: 8:3 808 00: 0:0 8:38 0:: :0 0:000 0:: :0:: :00: 080m 80:80:00 :0 888:: 0:: 8 :8:: :0 000: 888000: 0 :0 88:00 0: :000 0:: 08:8: ::0 .888: 80:80:88 0 0: :::8:00 :0 08: 0:: 800:::: 0: :0:—80: 8:08 ::0 08: 0:: .:: 8:08:88 0: 0:80:80 0:08:88: 0:: :0 :000 0:: 0::—0:: 80:08 08:80 08: 85:00 :0::088: 0 :0 8000 0::. 88000: 0: :::03 0:00.: :0 8:8:: 0 :08 :0:0:800 0:0 0:0: 823 8 08:80 :0::::::w:0_ ::0 ”:008:::0 38888 :0: 8:00: w88808 a: 8:830:0— :0 8:0: 0:: 0: ::0 :::00 0850 ”0:08:08 08: 8888 :0:: 8 3:080 0:08 0: 38:8: :::03 088808: 8:08: :0:0::::0 w::30:8 0:: 8: 808888: w::>::0:0 0::. A88 .0883: 00:0::800 8:0 3:0 :02000: 0858 :0:0::::: mm 80:: 08: 30: w::8::00: ::0:::0 80::0:w 0 80:80:: :0: .0000 0:: :0: 880 0: 823 .0:::: 0:: 8 88:08 0: :::03 0:0: 8:008: $03 0:: :: 80:88 80:08:00 0 0: ::00 £8000: :0 8088000: 8:83:08 :3 :880 0: 8:00 8:008: 80:: 0:0: 0::. 60888: :80: ::0 88:0 00: :08: 0 :8: 0::: :0::::0 08:0: w:080 0:03 8680 83: 0:: :0 800:0 :00: 30: 0::. .0888 0:0: 000.080 0:: 003 8:008: 0.8:: 0:0::0> 8 w:::80:8 0888:8081: 8:08:88 8030:: 0:0 8:88:94: :08: 30: :8: 0:0 0:08:08 80:0:88 :0: 88: 885800 0: 8::: 0388:, 80:88: ::0» :0 8:088:88: 8:82:08 0::: .88: 808:8? :0 8085 8:008: 80:: 08: 30: 0:: :8 83:08 08: :0::0:8 0: 0: :8:: 8:88:88 :0: 8:838 0:0 A008 .8800: 8800: 8:80: :0: 88808: 8: 8:: 880:0 c8888: 0::: ::0 88.8000: 0 :0::0w0 :::0 0 8:0 :0:: 8:08:08: 8:008: 0 8 8:08:08 888: 0 58000: .:0::030 0: ::08::0>0w 0:: 8:08 8:0 :0 808008: 05080 0 80:00 ::0 88083:: ::0 0888000: :0::0w0 88030: 0:: 0: 080:8 0388 :0:: 000m: 8: 0: :00: 8:8 30: 10303-0:083: 0 :08 0: 0:8: .:0:::: 388:0: 0: 888000: 0:: 8:3 Ammo: =.::0880:m 342...: 88:0: 8: ::0 2:80 8 08888888 08: ::0 88:88 ::08 o :0_0:0>|000::_0: 85:88 88:0: ::0::8 :0:—8:00 0:888:08 8:: 80888000: 88082:: :00::0::< :0 :0:0:0000< 0::. A08: .8800: :0:::000:8 w:::0>0:: :0: 88888 08: 0: 88083:: 8:88: 8888 808:0 :::003 :0 8:885 8:882 8: 883 8::: .00:>:0m 580:: 83:: 0::. 800:: 8 388.80 0:0 0:880:00 :0 888:: < 88988 088080 0:: 8.58: :::03 80:00:: 8:80:88 :0 000: 8: ::0 8000 8: ::0: 00800: .:0:0_0>0: 0: :08 ::3 8808 88:88 0 Z «0:08.808: 8: 88:08:: :0 358000: 0:: :0::0w0 ::0:w 03 :00 303 8080:0888 0:0:0> 88:0 :0 00::0: 8: a: :88: 0: 08:0: :800: 0:: :0:: 08:88:: 00:0 0: :: .88: .8083 08:08—0:00 :::8: 0: :88:0::8 0308:: 0:08 0 :0:: ::0 :003 0: :8:: :0: 0000 0:: :0:: 88:0 088.0 .38: .0282: :80088: 38:8: 0:03 ::0 ::0::::0:: 888800 0: :::0:0 0:0: 0.8:: 8:: 08:0 0:3 088808: 0:0 080 0:0 :0 088800 8:088:00 0:: ::0 8::: 80:85:. :0::3 0:: 8 0:08 0:03 0:0:0w0:0 :8:: 80880800 38:8: :::8: 0 :08000 8::. :::8 8: 8 :0::0 0:03 083: 0:08 8 0:00: 8:08 :08 000:: 88:00: :8: 0:: 8 0800 0:: :08080: :0: 083: 80:80:: :0: :0::0:0: :0: 0: 0:88—0:80 8: :0:: 88800:: 0888000: 8:00: 0:: :8:< .:8::0::: 8:080: 0: O: 8:: ::08:w:0 8: w:::0:::0 0:05: 8.88 8: :0 0:0 003 083: 80:88 :::3 88000: 0::: .5 08000 00:0: a: 8:88: :00: :0: 0:3 8880880: 8::: 80880 :0 .:::m :80 ::m :0::00:00 880880: 8 0000 0:080: :008 0::. .0w::::: :8: ::0:::0 0: 0:0: 8: 88:08 88:08 8: :0>:00:0 ::0 ::0083 8:000:00 :0: 80:0:08 8:008: 0:08:80 < .08: :0w:8 :0: 8:000:08 8:80:08: 0:: 8:: 88800:: 888000: :8: 80880:: 0 5:800: 0:08 ::0 880880: 0: 800:0 Ammo: :0::003: 8:808 8 8:30 0:: :88: :03 8:088: :0 00.80: 0 0: 0:88—0:80 :0::08: 3808::0 :830 Z 0000: ::m :0>m .38: .:0:0::: 8:53: :0:: 000: 8:30800 :00: 8:8: :0 80800 0:88 8:82 88:9 :0:0:0:0w 88:00-59 0::. 5:8 80:83 :0: 0:03 80:80:00 08:-80 8: :08 :::0:0::< ~88: w:::0>000:: 8 8:0: :8:8:: 0:08 888:0 0:8: 0: :0 .30: 08:5 8::: 0:< 172 .8083 8:: 85 2 885 w585 58858500 88: 8: 5:503 50> 85 5:8 855 :50> 8 8883 8 83 822:: >825 8 5285025 25 85 850: 2 58888: 8: 8:58 558 80588: 88:85 85 $85: 385088 80 85>: 25 .2888 2 >888 558 885528 58838: 8858888 85 85808: >850: 8:88:08: 855855898 :8 8: 2 :0: 82855885808 8 88:8— :0 5:008 85: 8 858 58: 88:52 05 88558 85 5288085 2: 5888025 88888 2: 58:3 .858 :05 25 85 82> 2: 50 8:288 558 88585 88>8 588: 8: :5: 88888 2: :88 5285855588 8 8:88— :88 558 5:008: 85: 8 58: 83 82> 58528 8 w585 80:8 88:58.8 0::: 8w 0: 858:8 858558 58588: >:8> 8 38 H .8880 >5: 2 >_:8m 22:: >85 5588—: 8 2 88.558580 «£558 ">83>:8 2 >88 53 H 88:88 >88: 8: 8::: 0.5255005 25 85 w2>8 550553 0m 5:508 2 88:88 how 8 8w 0: :0 585580 38528888 85008: 0: 80:8 885588 0:5: 8w 0: 2 85 50> 822:8 5:8 8:88: 58:23:: ::0> 558 8052898 :0“ :50> .8885 85280558 :50> m8: 2 58508888 8:8 50> 0:3 830:8 85 .8585 8 8025 8 2 85:58: < 85:58: :0 82> 8 8 :::8 85 2 >885 .5808 8528888 :50> :23 E85 :5885 85:: 50> .:08w58>2 58:28:: 8 8:8 50> 85 885528 :850 0: 88:5 0: 5558558500 .828850 80:05 83 >83 8:0 2 885852898 8 88558580 8528808 w522558m .8800 85 8:83:50 :8w52 05 858w 85 85 88:8: 83 2 88:28 885 >838 M558: 8 28580 88 8:8 83 .8830: >852: x8: :50 >: 80.88 25 5: 58:05:58 8558558 8:8 88 :5: m>83 588858 2 5:85 5:508 805 80 88>: 85 8882585: 0: 58328 8:8 >80 85 885528 5558:9500 8:38:88 5:85 0: 55058: >:8:858w 5:8 858:: 8 :55058 58:80 8 885528 :88 88 8 3 .8800 85 58:83:50 >858: 858w 85 85 :88 83 >888 8 88 .8588: 55852898 0: 80588: 85 885528 8:288: £88288: 885528 328 8 >> .5858 88:88 85 0: 588 :05 8852:: 8 8:85: 8 885528 858% >888 :50 85 88 85 :88 828 8058825 2::. “.852 30:: 8: 0: >82: 80:: 2 85058: 8.5528 ::0> .825 :8 58: :50> :0 5:88 50> 5:503 3582.898 58 w585 5::: >8 558 552.5 an “In. 14:13 u..- w n 8511:..- w o 528:8>lm85:8.: 0:5520m 85058 0: 5: 0:83 0: 8:83 50> a .8833: ..«>53: 8: 38:08 5:503 8:088 85 a885 :8 58: :50> :0 5:88 50> 5:503: >8 558 552.8 8 0: 5: 0:83 0: 8.83 50> ..= 88.5888 MRSNGRR 882305— 8 >50: 055528 85 5::: 0: 85:88 85 855550025 :83 88 Emma: 83 .8255: :8888: 88:88:00 :50 8::: :8 83 8253 85:: :0 5::: 2 80528 85 5588855: 855: 88:88.85 58:27:88 8: 58 8588: 8258 :8 528285: 88 85 85 8:83 80:28 >83 85 8 8255888555 58 :w:0:5 >80 2 8: @2588: 88 50> 888:0 85 8 805:5: 85 2 .8800 8 8::. 855500 8258 8 8058:8552 85 8:88:88: 38: 0: 8888:558 0: 2 80528 :50 2 5:88 8588:: 0: >83 82888-88 805: 558 :8: 8::. 880585588500 28285:: 0: 582 5:500 8528 5: 58052898 :0 5858:: :0: 805 >: 52888: 85 828: 0:3 885528 >585: 85 8:588 3252805 2::. 828882 850:5 8:88 :08 8055: :23 888500 85550025: 055528 885558 558 55: 0: 8588 88:8 805: 88: 885528 825: 85 8:88:58 2 855 25 :< Ammo: 52880:: 852288 :85 ::058 :0 >58> 0: 5288 :00: h:8: :85 :838 :5: .885 w5m>u88w :0 E28888 8 8:88:00 8 588888 58: >85 28 525-850 >838 8 0: 5855088 0:3 ©8825: :8888: .888 8 8 885528 w50::8 .558: 850 85 :O .w585w50:3 8 852888 08 0: m: >80 8 8058 52558: 58: 885528 ooodm 8 :8888: 85 8:05:58 :2:3 .588: 8 8:52:85: 8:282 85 wwo: 0: «mo: :88 8:55:88 :0 m .88: 3828—8: 2 5588 05.5528 85 88252 05 885 880m :83 88 852885008 8:8 8:88 :8::0> w28888 8:8 50> 558 .80528 888:: 0: $5588: 88 50> .885 38: w5::08 8 2:8: 8 88:: 50> 8: >88 8:8 885 38: 8 8>2:8: 558 88:08 88:55:80 5:3 558 .85058 850 58.: 885 88:58 :88 8:082:85: Ago: .52: 88> 8:5 8 5:55:25: 8 :8 885 5888— 580:8 50> 85858258: 85:08 85 8 825888 82:08:: 50:55:00 8 585 858: b85058 :8 822:: >855 8 5:288 85 885: 558 5588 805: 8885 0: 82058 173 2.: >285: 885 2: .885 2:: 50:: 83 8:85 2: 85:5 5.5 5 88: :8 8:: 88:53 8 :o 858: a :8: >285: 85858898 2: .8>85: ::8853 >88 85¢ .885 w585 : :53 8:85 8 a: 8:: o: :28 m :285 585258 853 5 5o :2::8 83 585:898 :4 .:83:ot:588 2:88 88:88: 8 5858885 853 5 8585:898 5 88 :88 85858 :8 8:: 8:55:55: 8 852585 8:8 .8388 8 .5588: 2: 88:8: 55588:: :::m :w532> 2 28 8 2: 5285585 853 8 8828:: 2 8:3 50 2 8::“ :55 3 .8588 w58. 88: 8:: 8.: :8: 88::85 8:: 88: 85 o: :::n 8w::.a 83H 8 2:88: 88 2 :H .5588: 58:38 2: ©8828 >:8:88:5 :8 8:5 2:: 8:88 8w::.H 88>8 28: :8 8:588: 2:52.85 :8 25588 8 8:828 5888 : 888:8 555 8:85:898 2: >8on: 8 58.: 2:: :88 PH. .8838 88 852:8: 8:588: 8:: $5582: 8:: 58: 88 2 8:: 2: 8:8: :55 85858898 8:: U:H .85 ::o :o 8888: 5582:: 88:88: 2:: >882: :8 25 85828 8 w58:58:oo 8: 8H :82: 88 2: 8: :8::8 8:88 85.58: 8 88: w5v8: 28 5 .898 8 82: a :o :::8: 8: :53 w:::£:8 5m :8::8 8:: 88::m .w588: 255885 m88> 2552.8 5 :88 85: 8 88588: 8:: :88: 3 255885 8 8552.8 8 8888: 858:8 51:82: 8 383 85858898 2.3 2:588 :8 .8882: 8:.H 585:898 8:: :H .885 8: 588:8: 2.: 8:88: 8:3 855.88: 8 58583 85:: 8: 8:5 :o> .: 38888 .88: ::o> w5828: 8:3 850:2: 8: 88 :8 :0» 82$ 55.8280 :88 0: >82: 82 2 85 88 888: 58558 885 on ::3 :58: ::88 85 5: .858 8 .:58: 8:: 2t 5 :88 >::888: 8: ::3 83 85858898 8 5:8 2:: 5 5588 88882 .858: 52858 :53 8582 8::: 5:: >5: :8: 82:8 8:: :8 85858898 2H.H. 82858 w5:::o58 258:: 8:: 8 858: 5 8:82 88 88: 8585: 85m >8 5 288 2::: :53 8:58:00 85 8 :85 +898 8:: :58: o: m: 5:888 8 888 2: 8:5:55 3 >83 50 U :o88>|m8::8...H 2:528 .8: 8 o: 8:85: H 858:3 .2858 58:88:5 2: ::858 >88 :::8 88 8:82 8:: 8:8 50885:: 5 88:8 85:. .858: >5 88:85: 3 :8: H 88558 w5:88:5 8 8:5:: 2:: 88:8: 8 28: 2:: 5:8 828: H 853 :55 85:2,: 8 8:8: 2:: 88 5: 8:: >5 >50 8: 8888 88: :58 H .85 3 >8 8: 283 5858898 8 8:w .88: ::8828: 8 :28: 8:: w5:88: >: 8885538 8:885 :3 .88: 82 m 8 88:8 8 :8 .88 88885 a 8 88: 8:8 :0 .88: >88 8 8 888 o: :25 H 88: 858 :0 8885538 58::8 2: :o 828 8 :8: 28: 8:82 8553 85588: 3 88: 588.5: 8:88 8 82: 82088: >88::o:5: 8 8:82 8 85538 H 853 5 585:898 8 88::58 H 88:8 2:558 8 ..H $5888 :5838 2:: :8 >8855w2 :8 25 88 >85 5 5: 8:58 o: :8::8 2 w5:::o58 88 5858898 >88885o: 858 :H 2:285 :8:88:5 :8> :53 88:8 >:8::588>m 2858 2:: .85 5 .855 2858 8:58 8 85 2885 852:8: : 885 28: o: 588 :o> : 585:898 8 :::858 88 :8 8 > 850:2: 58: .8:8 8 5 .88 :o> .55: 8888 8.8 8 8828 88:: “55:55 o: 5538 8: o: :o> :8 5:8: 2: 5 888 858: 8 8:8 :58 8:588:98 ::o> 8:: 8 585898 ::o> :58: :o> :H .Q58Q 8:85:83 .5808: 85858898 5 8 .2888 :8: w5::: £85 585:898 2:: w5::: 3858898 8 8 :58: 2:. w5::: :88 :8 55:8 885:. 822:: 28558:: 88558 2: :8 585858 8:: 8:8: 8:85:88: 3 :8: 8:: 5: 28588:: ::: 8885885 805 85 8:288 805. 85. 8.888 .8:28 5 828: 8: o: >288 888: 2:: 885 8:: 8::: 2.: 28:5 8 5:85 8: 88 0:3 8:5. .8:28 58:52 2 5285858898 8 80:5: 88: 2: 5: £5 8: :8 5858898 @2088: w5oQ $558: 813858898 8 5 >58 88:85 8: 8:5 883 88 8:: 28:8: H 8 .w 174 8 885808 8m Avmm: 55$ 3&9 588588 EQEMMRESMG .3 8: 08 30: :0 5005 85.83 88: 88088 58.8 8 085 588.. .50.» «0 850m 55 05 583 :53 50% .5883 .8588.— 85 5.888 05 .5888 30: 88 58 5855.898 50% 588388 88: :0» 880895 838.8% 8.580880% 5855.898 85 05 .85 888 888553-880 8 8 888 5508 8 888a 8580 053 8855255 855008 595 :0» .880 55 5 .55 c8.— 5 585.8 mm .858— 5053 5.888.— 05 8.853 80 88.8 8 8.885 50888 $850588 w5>8£ 85 555 :0» 885808 80.8 8588.. 85 5.88.. :0» 853 8850888 85 5:08 58 5855898 85 05 .58 88 8a 5.88 8585.8 :08 .8830: .588. 83858 5888885 .50» :0 80858888 85 .850 8885 8 8 3850589 5585528 5 8888 50:5 88 8% 5 50 88 2:08 =0» .88. 8585.88.88 8E8E8>-5858a85 585588588 8 80 58A 85 80 85850588 5585528 .88 5858.8 .8080— 8 88: 8: 05 :0.» : .8>830m .855 58085898 8 8: 5 508.88 85 85 888055 8555 8a 5.83 :88 85 888— 80 588mm 8 85 58 885.3 58085898 :0 8885 80 88.58 85 5 5888885 88 :0» 85 888 535 :0» .5 88888 85 3058 8: E83 85 @585 :0 88588 8585585 8 m8: 888: “5 88 85 :53 58a 05 8855 .808 :08 8.8 28503555 8885 85 8a 555 085 50> .888: “8 80888 85 5 8555 .88 5.83 :85 888— 8 83 05 :5 053 5850589 :8 50.5 885 855008 8 85085 535 :0» 3855.898 85 95.88 888m .585 w5mb 8 5.88.88 05 .0558 8.88088 :0 888: 8 888888 85 5 5888855 8.83 :0» 88258 558885: 8 m< .8888 85855898 50% 5 _8>8_ 80858588 85 .5088 :0» 5 58 .5 58.85 38080180 :0» h: .885 85 558280 8.8885 _8>8_ 80858888 855 855.885 8% a 380 8385883 5858885 85 :0 588— 8085.85.88 888 8508 885 8 555 .88 85850588 88558 80 80% 85858.3 58588855 85 80 m_8>8_ 85 05 8880888 858855 585 80 8885 85 :0 585 885558 .88: 5:08 :0» 55w 838588, 585885 85 80 80858888 .585 80 8882 85 8 88588 8 50.5 $8505.88 .81 ll r8188!!! -1 . O 50558>lmm8858m 05528 w5855:8 5058 5880 82 8:5 :03 £088.. 55 8h 85050585 .50.» 809:8 05 58:88 85 5855.898 8 05 .88: E83 :0» .5888 588898 8 3058 3 58:8“ 053 85850588 85:8 505 885 50 3085 2:00 :0» 85 585550 8808.855 858505 w58wm88>5 5 5888.855 5805088 8.8 :0.» 88853 8858888 8885 50.8 w5505 50 580 :0» .5508 55 2 88888 85 30:8 8: 05 8.88m .8888 85855898 58858.5 85 w53058 8p 08 5888 85850585 85 .8 805 awn—058 85 8.8085 >85 :0» .885 50% 8858388 855 4555588 8885 D8 885 8 8.8 885 8 :88 :0» m 88.8 8 885 E3 :0» 85 mm 5 380—: 30; 58 88.5888 888 805588 .50.» 8585888 853 305 08 :0» 05 a: 85 5 885855898 8 m< 5555585 85.88 8 855888.. 83 05 5 5055585 .585 853 8888 8885 8 8:0 88: 08 885500 88838825 8508 .885 8 508 885835 5888 8: 8805 .5808: 8585888 55 D8 55883 858 8 8:05? .8858 :80. 8058558 8 .8585 388558.58 80. 5555.85 85.85:: 85 85 8.588.— 888» 805588 588: 3582085 805 85 855808 80m .885 8 8388058850 85 58888 38808 8.8 80595888 888 85 8:3 885 85 5583 588580.88 8p :80 558588 55.80 853 58 588: 8a 80 8888 805588 8885. 80850 08 850 m5 5 85853 8 88888 888 8 8n 3 588—: .5 5888 850588 8 85853 855.885 08 5855500 .588: 88 8885 8058588 .88 88850 5 888 E3 83 88183 5885 8 5 885 50% 958588 508 058 8:5 30> 8.88858 88G 588.8008 885 8o :53 58583 85 85 8.588 05 88558008 8585 2:058 85 850888 8 8.8.885 05 585wvsm 88: 8:5 885855898 5885 8.8853 .855. .5888 85855898 85 385088 583 585585 85 85888 5 888.888 -5005 2858 85 3558808 85 08 885 w55w .8855 000.9 .88 8:0 85 888 08 85 885855898 3855.898 55 5 85 85 :0 85508 85 80 55800— 85 508 8585885 58885 885 88; 588 280 85855898 85. .85_ 0855 8 :0 388.50 :88 50288 8:88 85 888085 5855 83 8888 5E. :85 85 880.88 5885 .8588 175 85 w5:888 8:8 :0» .8888 55 :5 85:8: 5885558 55» 85 885 3:: 5888 5:8 555: 85 5:8 8:8: 8 53555 8 58558 8 85888 85 58.858 8: 58 H 85 887: 55:85:85 885 85 858 58 85858858: 885 8:8 85 8805 5:0 8 5885 25m 58: :0» .8888 85 55 8% 85 :88: 388:: 5:08 :05 8:85? .=8 585 55 :05 5:8 .885 50% 8388 o: 883 8 855:: 8 883 885 8858: 88:88 885 8508 8 588: 85 88:5 8 898:: 858 5 5 855 8 55 J88: 85 o: w558: 58 85 5 85855898 8853 50 285 3 585888 5 5 5:8 8 2 58.5 :88: 8 8: 5 55 555 585095 858.35 :8» 80:98 8: on 85:88: 85 8885 5855.898 :08 .5858: 8 58 885 o: 8558: 8: 8:8 :0» 85 .8830: .858 mm .88: 2,88 8» 5:8 @558: 885 H .558: 885 8:58 9:58 om .5 508 85:3 8 583 5:58 8.» .5 508 88: o: 583 :55 H 8855898 85 35p 8% om 58:58 5:88:52 8.83 8» 8 55555 85 8 8: 8% 8588 8 5 5855898 555 85 8:58: :0» 853 >85 58:— 8 85 8» 885::w .8888 :8 85855898 50 285 o: 5 :88: 85855898 50% a: 55858 8 83 8:0 .50 8.358 8.5383 .888: 85 52858 8: 55558 5585851858 o: 8:58: 5 :88: 85855898 2.; $525 85 8% 358 o: 888 85 88: 8: 58 555% 5:8 855 85 285 8: 58 :8» .8855 8.58588 ::o» :8 528 588: o: :5 an 555 5 8:85. .288 5:8 855 288 o: 5 808: 85855898 :8 Q: w5:85o :8 :8888: 8:528 805 85:. 5855898 85 ::oz b: :0» 55: 5585855898 528 5:5— 305 8.» .55: 85888:: 8 58:88 5 5 888 805 5 853 85528:: 58 >5 5 5 555 85 88:88: @8888: 85855898 0: to 8:5: 85:82 85558 585 5253852 8:88: 55: 85 :5 >83 w:o:3 85 8 88888: w:o:3 85 :5 >83 55: 85 85855898 o: 85. .8888 58: :o 882: 5:88 855 885 85:. 88535 887:8 8 8855 :o 8882 8:558: 52: 885 885855895 .888: 85 5 8858: 8:885 858— .588: 85 5 583 855 888888: U :ommhmxwlmmmncmwnw altar—06w 8 858 >885 5 88:2: :55 .855 :8 8 5585 5858 585888 8 5 558888 88wn8>5 85 5 88 85:58 5 :88: 85855898 :8 88: :o> 853 8% .8888 5:08 8 38:8: 5 8:885 855558 885::558 o: 808: 8:88: 8 8 8:88: 85 o: :5? 8 58888: 858588 5 5 855558588 8588 5 885?. 885 8oz .88—38:5 85558 8 585 85 8 :5858: 8.8858235 85 .858 28855 o: 558: 85: 85285 8:8 8:8 85 5 .8833: 8:58:55: 8:855:88 o: 5588: 88585: 5: o: 8558: 5 :88 8858235 :8 .583 .558: 8 553:5. 8.858 5 858::8 58:28: 8 85 58:88: 5858585 558885 :8 .5855898 888 :53 8:588 5588:: :8 :585855 55888: .8888: 85 3 8388585 555588: 8 88: 85 8:88 8:8 8888: 58 .5858 5:8 55:58 885 8:5 8585 855385 8 5388 85 8:58:88 55 553 85855898 8 8588 88835 :8 88 58:88 58:88: 85855898 50% 8 85:8: 85 :88: 5:58 :o> 58:83 5885 5 5552558 8:5 >_8:8::: :8 885 5 885: 5855898 8858 8 8 :88: 8 5888 :53 58:52 35 .888: 55 8 .5 55882555 585 5 85828 85855898 553 58:58 w5885 8 8888 85 85 85855898 5:85 08 w5ov 8:8 5:85 5:85 om 558598 8.5885 8 :85 885 885 85 8::: 08 :38:w 885 585 85 .8838: .855 588: :5 5855898 8858 8 8 85:8: 85 52.88: @8888: 5 5588 8:52 859$ 85 08 8588: 582 .583 55 5 8:88: :88: 8: 2:28 8% .855: 8 8 5855898 8:: 88:88 8:5 8:88: .8857: 85:8: 85855898 8 35.898: 8858.83 5 5855:: 58:25:85: 8 5.8.: 850 8:0 5580885 88558 5 08 .58 8:58 8:88 o: 558: 858 85285 88 88:58:50 doom 85 85:8: 555:8 :28 885 o: 883 8 588 :8 5:5 :88 8% .588: 25888 8 8:8 :9: 5 .888 8528 858555 w55 :58:5 85 85 08 5x8 88 :o 588 85 :85: 5588: 8 858 558wa 8 25— 85 858 55: 8 885 o: 88 8.588 85 8 58 a: 305 5:8 85855898 176 :88: 8885898 05 8 8:205:50 05 88088 80508 885 5.0085 8888085 58 8852.08 85.88.: :80 03 .8 .588: 85 05 558 8: 05 >05 5 :88: 8 :85 8.8588 58 88528.0 80 8.: 8x :80 83 688808 8.5 5885098 85 8:88: >588 8: 805 85 8.85 8 :5 88:0: 8885.898 5: 8:53 0: 25858008 mm 5 .>0:2058 8 858m 05 8.5 .808: 808802: 8 88085098 8 8508 8 8589:: 5:8 288:» 85.885 8:8 8 855888008: 088 0:8 88850.:88QME8EE8 585285058885 58 8558:5088 58: 885 0: M558»: .5888 885 w:5:Q .885 80 8 :0508500 w585 88:88:58.: 8.558858 58 8888.: 8.8588858 >5 8 888808 85 5:85.898 :8 8 :w85 85 :5 83588.: 85558880 85:00 0: 35585 >5|8505 0.580588: :5 08858 058 :80 83 8558588 80 W5§88k >5 :0 588.: m580.:.:58.x >5 825 >85 :5 8888 :80 0 3 .m>83 8 85:8: 8 :5 08208 55> 555:5 >88: :85 88— 05 :80 0 >> 8258:: mm 85055055 8 >505 855 8 :08898 82058 05 85:88.: 85 :0508 >:8 8823055 8 >505 8550.8. 8 85 00:28 888005 88m .8505: 2588588 05 80588 58 8505: >85 05 .88: :55 :o> .858—30:5 8 >505 85 8 5308 82058 85 :5 58 85 885 88 80508 8258 85 290:5: 85 >88 :0> 55 88> mm :0885 85 .5805 .58 85 :5 58855800 8: 885 :o> 85 8:58.858 588:8 5:8 3:8: 88.: 0: 258 85 >88 053 88:88:00 553 5 8:085 05 585 >88 :0> d: 8800 885508 8 :05? 80:28 U :088>|m8:58.m 055:20m 0: .585 mm :0508 8805.8: 8 85853 85885 05 580555 5 5:5 :53 :0> .880 0:88 :5 .8885898 :8 8 0085 :55 :o> 85 8058:: 80558 85 :8 58588508 880:: 0: >5 085 25 88850 855 :5 .5888 82058 :8 :5 8523055 8 >505 055 0: w8558 8:8 :o> 85853 05 58058 :2888800 80550 8.8:: 80> 88818085 888850 555 .8588: 85 8585 8: 580: :0> .388: 80> 8:588: :5 .8588: 80> 8588.888: :0 858588 80> w:mw:850 >5 >805 5088.: 85 0:8 8885098 80> :5 0: 0558 05 55> :o> .88305 .850 .5805 858:5 85 0: 5085 0w 0: 0.85 53 :o> 5:8 .58 8 :5 8: 805 >885 80> 853 885 85 :55 0.85 .>88:::.88D 805888.85 30: 85 55$ 35 :85 850—3055 8 >505 2.5 0: :05:55::00 80> 305 0:55.885 0: 085 :0> .880 855 :5 .m:50:5:00 0.8 :o> 80 :0 :5w5 58.855 8 8:80 85 885.898 :8 8:05 85 88 >5050::08 85 8.80855 :o> 885.8: :0 .5 8:05 w8>85 :05 :080: 8585 8 8.8088 .88— 58 :080: 0:88 :05 885.898 :8 05 :o> 558058000 5:85.898 :8 85585::5085 85 8888.88,: 0: 055888008 >5888w mm 5 >885 .MS88E88N 80:28 05 5:05 8: 805 5:5 85 88:85 8 82 8 25580: 8 5585058 8 :85 :88: 58058 :o> 5:8 .885 8:8 889 885 555 :o> 5253 8 .858 85 8508:: 858 $5 8: .8 85853 .858 80805 :8:: 85 8 :85 :88: >88 :0 V ....85.8 8 80 0.8 3:85.898 8530505 85 588085898 05 8 558885 8 508— 58 5:888:88: 0: 8530.. 85 .8580: 85 :8: 8: 58: :0> .8880 50:8 :5 8885898 b88508 8:88 05 5:8 5: 5085 0: 258.585 5 5:5 >88 :0 .w .858 85 :5 885.898 8.5 85 :85 0.85 8: 58058 5 85 83058 828.898 :8 8 880080 85 85 5:5 >88 :o> .50808: >88888 w:85 853 >880me 358883082 .085 85 8.8558 58 8858: 85:08: 80> 5:85 5880> 888 :83 8 :58: :o> om 5:58.885 58 88:88:: 505 85 0: 808585800 00: :8 .85 5808 858.858 05 5803 85 885 >8>8m 08 5:5 0: 5888 585 5888.58 05 5803 :0 .w .885 8 88: 88.855 88385 80858980 0:: 8.: 5800 :0> .885 08 55> >8>8m 8 58:85:00 :o> 5 888808 8.5 588058me 8 885 177 APPENDIX C 178 How to Get an Experimental Idea Martin listed nine reasons why students have trouble coming up with experimental ideas. What are they? (9 points) Geniephobia—fear of geniuses Imitatophobia—fear of imitating Paraphemaliophobia—fear of apparatus Manuphobia—fear of doing things by hand Parsimoniophobia—fear of simplicity Calculatophobia—fear of statistics Imperfectaphobia——fear of being imperfect Pseudomonophonoscientiaphobia—fear of not sounding scientific Ergophobia—fear of work According to Martin, what are the two factors that most strongly influence the ability to come up with a good experimental idea? (2) 0 Observation 0 Curiosity List the five people or groups Martin suggests that you observe directly as a means of getting experimental ideas. (2 1/2) 0 Yourself Friends Children Pets Others/public What is vicarious observation? (2) 0 Getting experimental ideas by reading other people’s research What is basic research? (1) 0 Research done for the sole purpose of increasing the scientific body of knowledge According to Martin, what are three ways you might expand on your own research? (1'/2) 0 Answer questions raised by your results 0 Set a variable to a different level in a new experiment 0 Explore unexpected results What are introspectionists? (1) 0 Researchers who concentrated on looking at their own mental processes 179 How to Get an Experimental Idea According to David Martin, what is the main reason that students believe they cannot come up with experimental ideas? (1 point) a. They are afraid there is something wrong with their ideas.* b. They do not have enough knowledge to come up with good ideas. c. They lack the scientific knowledge needed to come up with good ideas. (1. They lack the necessary life experience to come up with ideas.. A student reads an article about social learning among primates—specifically, the article discusses how baboons can learn how to fish termites from a termite hill using a stick by watching another baboon do it successfully. The student wonders if pigeons can also learn food gathering techniques through social learning. This an example of getting an experimental idea through: (1) a. direct observation. b. vicarious observation.* c. expanding on one's research. (1 focusing on a practical problem. What does Martin encourage as the main source for getting new experimental ideas? (1) a. Studying the research of others for inspiration b. Focusing on a practical problem that needs to be solved c. Using your prior research as a starting point for future studies (1. Observing the behavior of yourself and others* Why does Martin advocate using your own research as a means for getting ideas? (1) a. You will already be familiar with the literature, so it will be easier than starting over with a new idea. b. It's better for your professional development to know a lot about a fairly specific area than a little about a lot of topics. c. You will probably have more questions than answers after conducting a research study.* (1. Once you are an expert in a specific field, you are less likely to be challenged by your colleagues. Which of these is an example of someone getting an idea through direct observation? (1) a. A student reads a journal article and decides to pursue one of the questions the researchers raised as a result of their experiments. b. A student wonders if a certain memory technique that relies on visualization will work more effectively with people who are visual learners, as opposed to people who learn better through auditory or kinesthetic techniques. 180 c. A student does a study and finds that using cartoons in a presentation helps maintain audience attention. The student decides to explore the effect of differing numbers of cartoons in presentations of a certain length. d. A student who works in a day care center wonders if girls or boys will show a greater increase in aggressive behavior after watching cartoon violence.* 6. Using the three characteristics of an experimental idea, which of these describes the best experimental idea? (1) a. Are people who wear glasses perceived as smarter?* b. Do animals dream in color? 0. Is assisted suicide for terminally ill cancer patients wrong? d. Can some people communicate psychically with animals? 7. What is basic research? (1) a. Research that solves a problem b. Research that is original and builds on little if any previous research c. Research that is done solely to increase the body of knowledge* (1. Research that that uses little or no apparatus 8. Which of these is an example of someone focusing on a practical problem to come up with an experimental idea? (1) a. A student who is a part-time cashier wonders if men or women are more likely to pay for their purchases with cash. b. A student wonders if positive reinforcement works equally well for different kinds of animals. c. A student found in a previous study that subjects recall more unrelated items from a list using a particular memory aid and now wonders how subjects can be encouraged to put this memory aid to use for school work. (1. A student who works in a day-care center wonders how to best organize the play equipment so all the children get sufficient exercise.* 9. A woman observes that when she talks on the phone, she frequently engages in another activity, such as paying bills. Her boyfriend, however, paces the floor while talking on the phone. The woman wonders if there is a difference between men and women in their "auxiliary" behaviors on the telephone. This an example of getting an experimental idea through: (1) a. b. c. (1 direct observation.* vicarious observation. expanding on one's research. focusing on a practical problem. 181 How to Be Fair with Science How does Martin define “dirty tricks”? (2) o Unethical and unacceptable behaviors Martin describes two dirty tricks. What are they? (2) o Fabricating o F alsifying credentials How does Martin define “questionable tricks”? (2) o Behaviors that are frowned on and that should be guarded against, but are not so egregious that a researcher would lose scientific privileges Martin lists four stages during which questionable tricks may occur. What are they? (4) 0 Experimental design Collecting data Data analysis Reporting results How does Martin define “neat tricks”? (2) o Behaviors that make science more efficient and easier to understand Martin describes three neat tricks. What are they? (3) 0 Leaving things out o Reorganizing - Reformulating What is the purpose of a review of a scientific article prior to publication? (2) 0 Establish whether the research appears to follow the rules of experimentation - Determine whether contribution is sufficient to warrant using the limited number of pages in the journal What does Martin say are the four benefits of establishing a data archive? (2) Minimizes fraud 0 Researchers would be more careful in their original data analysis 0 Other people could add to the body of knowledge by examining issues not originally addressed 0 Longitudinal studies in which data are compared over time would be possible According to Martin, what is the best and most cost-effective way to prevent fraud in science? (1) o Emphasize to new researchers the importance of ethical conduct 182 How to Be Fair with Science What is the purpose of a review of a scientific article prior to publication? (I point) a. Determine if the authors have the necessary credentials to be considered credible b. Determine if the writing style is appropriate for the journal c. Determine whether an investigator who is capable of doing good research has lied about his/her findings (1. Establish whether the research appears to follow the rules of experimentation* What is the likely penalty to a student or researcher who falsifies his/her credentials? (1) A lawsuit Criminal charges Dismissal from the field* A full audit of research by a national organization such as the National Institutes of Health or the Association of American Universities 999‘s» According to Martin, what is the danger of scientists failing to take formal steps to find and eliminate scientific misconduct? (1) a. Scientific misconduct will become increasingly prevalent. b. Scientists will lose public funding for their research. 0. Congress may impose such steps through legislation.* (1. The general public will lose confidence in the results of research. Suppose you are studying how morning television affects children’s behavior. Which of the following situations would Martin consider to be cheating? (l) a. You discover that the children who watched Mighty Morphin Power Rangers had Chocolate Frosted Sugar Bombs and doughnuts for breakfast, while children who watched Barney ate a breakfast of eggs and ham. You decide that the breakfast probably didn’t make any difference and decide not to consider that as a factor in your study.* b. As you are writing up the results of your study, you find that an article in a new issue of a journal you read poses a theory that better explains your data than the theory you had originally operated under. You decide to replace your old theory with this new one and write up your results in light of the new theory. c. You use a questionnaire that has 58 items for each child, many of which you find to have no relevance to the data you collected. You decide against reporting the results of all 58 items and any possible analysis that could be done using that data. (1. You conduct this study as one in a series of studies. You find that when you are done, it seems to make more sense to present the results of the studies in an order that is different from the chronological order in which the studies 183 were conducted. You decide to present the studies in an order other than the one in which they were conducted. A researcher is comparing two methods of teaching reading: phonics and whole language. In which of the following situations would it be okay for the researcher to remove subjects from the study? (1) a. (1. Some children in both groups failed to show any improvement in reading. Since the results of these individuals fail to either confirm or deny the hypothesis, the researcher can safely disregard data from these subjects. Some of the subjects in the phonics group showed an unexpectedly large increase in reading skills. If the researcher feels that these children may have received supplemental instruction that enhanced their learning, the data from these subjects may be disregarded. Some of the subjects read proficiently prior to the study. Since the researcher decided prior to collecting data that proficient readers would not show much improvement and so would not contribute to the understanding of teaching methods for reading, it is okay to disregard data for these subjects.* It is never okay to remove subjects from a study after collecting data. According to Martin, what is the best and most cost-effective way to prevent fraud in science? (1) a. b. Emphasize to new researchers the importance of ethical conduct“ Require internal review boards to perform random audits on research conducted at their facility Encourage funding agencies to perform random audits on research they fund Require researchers to sign affidavits regarding their adherence to ethical standards According to Martin, which of the following is not a questionable behavior? (1) a. You hire a student to record the amount of time a pair of young rats exhibit “play behavior.” You tell the student what the hypothesis of the study is and which animals are in which experimental group, but you leave it up to the student to determine exactly what play behavior is and how it should be recorded. You hire a student to record the amount of time a pair of young rats exhibit “play behavior.” You provide the student with training on what constitutes “play behavior” in young rats. You also tell the student what the hypothesis of the experiment is, and which animals are in which experimental condition. You realize that the majority of your data on play behavior shows that the rats spent either a large amount of time playing or very little time playing. The statistical test you intended to use requires that data be in the shape of a bell. You decide to use that test. You have a graduate student record the amount of time a pair of young rats exhibit “play behavior.” You provide the graduate student with training on what constitutes “play behavior” in young rats. You don’t tell the student what 184 the hypothesis of the experiment is, or which animals are in which experimental condition.* For each of the following, indicate if it is something Martin referred to as a “dirty trick,” a “questionable trick,” or a “neat trick.” (1 point each) _B_ 8. A researcher wants to test a new method of teaching _B_9 _C_ 10 _A_ 11 _B_ 12 _C_ 13 _C_ 14 A 15 physical education skills to elementary students. He has the phys ed teacher use the old method in the classes that meet before lunch and the new method for the classes that meet after lunch. An experimenter spends extra time with subjects in a group he expects to perform better, and less time with subjects he expects to perform poorly. . After running a study on learning, a scientist decides that the study is more similar to studies that use situated learning theory instead of the cognitive learning theory that he had in mind when he ran the study. He decides to write up the study using situated learning theory as its basis. . A scientist beefs up his resume by including a few fictitious papers. . A scientist uses a statistical test that requires a bell curve distribution, even though he knows his data is not distributed in a bell curve. . A scientist runs some data analyses that reveal no new information, so she decides to leave them out of her report. . After running several related experiments, the research decided that it makes more sense to report them in an order other than the order in which they were run. . A researcher fails to receive funding for her research, but is still under pressure from her employer to publish articles. She runs a few subjects, creates data for the remaining subjects, and then publishes the results of her “research.” a. dirty trick b. questionable trick c. neat trick 185 ,--.. _B_? _B_ 16. A researcher is investigating the effect of sugary snacks on the behavior of preschool children. He observes tapes of the children and records their behaviors. He is aware of which children have had sugary snacks and which have had healthier snacks. . A researcher gets unexpected results, but is able to explain them using a different theory than the one he had in mind when he designed the study. He decides to report the results in light of this other theory. . A researcher wants to study a new teaching method. He has all the history teachers in the high school use the old method and all the science teachers use the new method. . After running a few related studies, a researcher decides that he should have run another study to help provide the groundwork for the other studies. After running this final study, he writes up the report presenting the last study first. . When a researcher runs an experiment, she notices that the data from a few of the subjects are substantially different from that of the vast majority of subjects. She assumes these data are not reflective of the majority of the subjects and eliminates them from her analyses. a. dirty trick b. questionable trick C. neat trick 186 IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII 1111.311111111111111411111131.1