AN INTEGRATIVE MODEL OF TEAM ADAPTATION By Jeffery A. LePine A DISSERTATION Submitted to Michigan State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Department of Management 1998 ABSTRACT AN INTEGRATIVE MODEL OF TEAM ADAPTATION By Jeffery A. LePine As in all organizational systems, teams inherit or develop routines that guide their behavior. Because routines are programmed sequences of behavior, they do not require active management, and therefore, are efficient means of accomplishing tasks in stable conditions. Among the critical aspects of teams, however, is the occasional need to change the way they go about doing their task in order to respond to changes in the work environment. However, while costly disasters have been linked with teams’ failure to adapt to such changes, not much research has been aimed at this issue. The purpose of this dissertation, therefore, is to develop and test a model that investigates the factors involved in team adaptation (defined as the reactive and non-scripted adjustments to a team’s role structure that result in a better fit given the new situation). Information processing theory serves as the underlying foundation for this model. Team composition and factors suggested by control theory serve as the model’s other key elements. The proposed model centers on three points. First, while routine activity does not require team members to actively process information, the type of activity required for team adaptation does. Second, the factors that influence (a) members’ capacity to process information actively and (b) the capability to “switch-on” active cognitive processing when the situation warrants it are critical for team adaptation. Finally, among characteristics of the team that influence these factors, team composition (team member characteristics including general cognitive ability, conscientiousness, and openness to experience), the nature of team goals, and information from the environment regarding progress towards goals are perhaps most important. Such information depends on the quality of feedback as well as the nature of the environmental change. ’ Hypotheses were tested in a laboratory setting using a computerized decision making task and 141 three-person teams. Consistent with past descriptive accounts, failing to adapt was both prevalent and costly (in terms of team performance). As expected, teams in abruptly changing conditions or composed of members with high levels of cognitive ability and openness to experience were more likely to adapt than teams in gradually changing conditions or when composed of members with low levels of cognitive ability and openness to experience. Also as expected, the effect of team members’ cognitive ability on team adaptation was stronger for teams with members who had high levels of conscientiousness. Unexpectedly, however, there were no main effects on adaptation for goal difficulty, quality of feedback or members’ conscientiousness. There was also an unexpected finding in that members’ cognitive ability appeared to be more highly related to adaptation for teams with easy goals. Findings from post hoc analyses are consistent with literature suggesting that difficult goals create performance pressures that cause members to focus their attention on the team’s standing in terms of their performance instead of on learning how to do the task in the changing environment. ACKNOWLEDGMENTS I would like to start off by saying that it would have been impossible to have a better graduate school experience. I learned a great deal and had a lot of fun doing it. John Hollenbeck (my chair) was an outstanding mentor and role model and provided me with the opportunity to be successful. I thank Dan Ilgen and Neal Schmitt for all their incite and helpful advice. I also thank Linn Van Dyne for always pushing me into considering the “bigger” picture. The learning and fun I had in graduate school can also be attributed to a great group of graduate students--especially Jason Colquitt, Marcia Simmering, Becky Luce, and Mike Wesson. I would also like to thank Alex Ellis, Henry Moon, Lori Sheppard, Amy Pepper and Christine Jackson for their help during the experiment. Finally, I would like to thank Mimi for putting up with my absence (as well as my presence) during these last five years. iv TABLE OF CONTENTS List of Tables ..................................................................................... x List of Figures .................................................................................... xi INTRODUCTION .............................................................................. 1 Definition of Teams ........................................................................ 3 The Nature of Routine ..................................................................... 5 The Dilemma ............................................................................... 6 Specialist Decision Making Teams ...................................................... 16 Specific Examples of Specialist Decision Making Teams ............................ 19 Purpose ....................................................................................... 23 CHAPTER 1 LITERATURE REVIEW ...................................................................... 25 Information Processing as a Theoretical Foundation .................................. 25 Problem sensing ....................................................................... 26 Groups as information processors ................................................... 27 The Basis for Routine and Adaptation ................................................... 29 Fitts theory ofmotor skill development..................................... ....... 3O Anderson’s ACT Theory ............................................................. 31 Routine: Distributed procedural knowledge ....................................... 34 Adaptation: Distributed declarative knowledge ................................. 37 Cognitive Resources ....................................................................... 40 Individual differences in cognitive resources ..................................... 42 Team differences in cognitive resources ........................................... 44 Triggering Declarative Knowledge Based Information Processing .................. 49 Content of information processing control ........................................ 49 Process of information processing control ......................................... 50 Summary ............................................................................... 51 Control Theory .............................................................................. 51 Application to a wide variety of systems .......................................... 52 Hierarchical structure of control loops ............................................. 54 Inappropriate routine as control system failure .................................... 56 Goals ......................................................................................... 57 Feedback .................................................................................... 64 Nature of Environmental Disturbance ................................................... 68 Alternative Reactions to Disturbances ................................................... 71 Team conscientiousness resources .................................................. 72 Team openness resources ............................................................ 76 Summary and Hypotheses ................................................................. 78 CHAPTER 2 METHOD AND ANALYSES ................................................................. 83 Choice of Setting ........................................................................... 83 Planning for Participants: The Power Analysis ........................................ 84. Study Participants .......................................................................... 86 Task .......................................................................................... 87 Procedure .................................................................................... 93 vi Overall Design .............................................................................. 96 The Pilot Study ............................................................................. 97 Evidence of routine ................................................................... 97 Necessity for Adaptation ............................................................. 99 Establishing easy and difficult goals ................................................ 99 Manipulation check ................................................................... 100 The Pilot Study: Results .................................................................. 100 Evidence of routine ................................................................... 100 Necessity for adaptation .............................................................. 102 Easy and difficult goals ............................................................... 106 Manipulation check ................................................................... 107 Summary of pilot results ............................................................. 107 The Primary Study: Variables ............................................................ 108 Adaptation .............................................................................. 109 Goal difficulty ......................................................................... 112 Quality offeedback ....... 112 Abruptness of environmental disturbance .......................................... 113 Team cognitive resources ............................................................ 116 Team conscientiousness resources .................................................. 116 Team openness resources ............................................................ 1 17 Team decision accuracy .............................................................. 117 The Primary Study: Analyses ............................................................ 118 vii CHAPTER 3 RESULTS OF PRIMARY STUDY ........................................................... 119 Overview of Results ........................................................................ 119 Individual-level Learning and Controlled Cognition .................................. 119 The cognitive resources-learning relationship .................................... 120 The manipulations-controlled cognition relationship ............................ 121 Summary ............................................................................... 122 Descriptive Statistics of Team-Level Variables ........................................ 123 Team resources ........................................................................ 123 Manipulations ......................................................................... 123 Team performance .................................................................... 125 Adaptation .............................................................................. 126 Analytic Strategy ........................................................................... 127 Assessment of Hypotheses Using Logistic Regression .............................. 132 Team Resources ....................................................................... 134 Manipulations ......................................................................... 134 Interactions ............................................................................. 134 Exploration of Alternative Operationalizations ........................................ 138 Conjunctive aggregation ............................................................. 139 Disjunctive aggregation .............................................................. 139 Predicting Speed of Adaptation .......................................................... 142 CHAPTER 4 DISCUSSION .................................................................................... 145 viii Overview of Problem and Theory ........................................................ 145 Overview of Pilot Study Results ......................................................... 146 Overview of Primary Study Results ..................................................... 147 Individual-level elements ............................................................. 147 Team cognitive resources ............................................................ 148 Triggers of controlled information processing .................................... 148 Factors that influence mode of discrepancy reduction ........................... 149 Understanding the Moderating Effect of Goal Difficulty ............................. 150 Absolute goal levels versus performance-goal discrepancies ................... 150 Results of post-hoe analysis ......................................................... 152 Implications of Results .................................................................... 155 Implications to theory ................................................................ 155 Implications to practice ............................................................... 155 Limitations .................................................................................. 159 Overall Conclusion ........................................................................ 161 APPENDIX A: Team Decision Making Consent Form (initial) .......................... 164 APPENDIX B: Team Decision Making Consent F orrn (experiment) .................... 166 APPENDIX C: General Overview Handbook ............................................... 168 APPENDIX D: Role Instructions ............................................................. 174 APPENDIX E: Experiment Protocol ......................................................... 178 APPENDIX F: Task Knowledge Test ........................................................ 192 APPENDIX G: Post Experiment Questionnaire ............................................ 196 LIST OF REFERENCES ....................................................................... 198 ix LIST OF TABLES Table 1 - Comparisons of Time to Receive Information .................................... 101 Table 2 - Comparisons of Reliability in Receiving Information ........................... 102 Table 3 - Descriptive Statistics for Teams .................................................... 124 Table 4 - Correlations of Study Variables with Dichotomous Adaptation ................ 128 Table 5 - Logistic Regression of Additive Independent Variables on Adaptation ....... 133 Table 6 - Logistic Regression of Conjunctive Independent Variables on Adaptation... 140 Table 7 - Logistic Regression of Disjunctive Independent Variables on Adaptation... 140 Table 8 - Relationships with Speed of Adaptation ........................................... 142 Table 9 - Logistic Regression of Discrepancy Variable on Adaptation ................... 151 LIST OF FIGURES Figure 1 - An Integrative Model of Team Adaptation ....................................... 24 Figure 2 - A Routine Among Four Actors ..................................................... 34 Figure 3 - Hierarchical Goal Structure in Teams ............................................ 61 Figure 4 - Role Requirements .................................................................. 88 Figure 5 - Measurable Attributes ............................................................... 90 Figure 6 - Pre-disruption Role Structure ...................................................... 90 Figure 7 - Ideal Adapted Role Structure ....................................................... 110 Figure 8 - Plot of Team Cognitive Resources by Goal Difficulty Interaction ............ 135 Figure 9 - Plot of Team Cognitive Resources by Team Conscientiousness Resources Interaction ................................................................ 136 Figure 10 - Plot of Team Cognitive Resources by Team Openness Resources Interaction ............................................................... 137 Figure 11 - Plot of Team Cognitive Resources by Goal Difficulty by Quality of Feedback Interaction ................................................................. 138 Figure 12 - Stern and Leaf Plot of Adapting Teams’ Speed of Adaptation ................ 143 Figure 13 - Plot of Team Cognitive Resources by Performance-Goal Discrepancy Interaction ............................................................ 152 Figure 14 - Plot of Performance-Goal Discrepancy by Quality of Feedback Interaction ................................................................ 154 xi INTRODUCTION Although not mutually exclusive to one another, interest in small groups and teams in organizations can best be described in terms of three somewhat overlapping and parallel waves. The first wave can be attributed to the Hawthorn studies (Roethlisberger & Dickson, 1939) which began in the 1920’s. These studies suggested that informal groups influence the behavior of individuals in work settings. Whyte’s (1955) research is an example of work in this stream. By showing that group unity was more important than maximization of personal income, Whyte illustrated the importance of the group on individuals. Out of this tradition grew the Socio-technical movement (e. g., Trist & Bamforth, 1951) that assumed that organizational effectiveness demands joint optimization of both the technical and social systems (informal groups). The importance of the social aspect of this equation was new and thus triggered interest in groups as units of interest in their own right. Research in this stream during the 1960’s through 1970’s generally focused on increasing member satisfaction with the group experience. This research, often referred to as “team-building,” attempted to improve the nature of collaboration within the group or relationships among group members (Beckhard, 1989). The second wave of interest in teams began in the mid to late 1960’s and early 1970’s as American firms began to recognize Japan as a competitive threat. Japan had used team structures as a way of involving workers in order to increase quality of industrial processes and end-products to world class levels. Throughout the 1970’s, project teams, task forces, autonomous work groups, quality circles and new product development teams were being implemented to such an extent that group structures began to dominate industrial processes (Thurow, 1983). By the late 1970’s, groups and teams were increasingly being referred to as basic organizational units (Davis, 1977) or building blocks (Peters & Waterman, 1982). Indeed, this trend has been recognized as a revolutionary shift in managerial thinking (Kanter, 1983; Ketchum, 1984; Peters, 1988; Reich, 1987; Walton, 1985). Whereas interest in the first wave centered on the importance of the group to the individual, the second wave viewed group structures as being a potential mechanism for gaining an advantage over competitors. Today, increasing global competitiveness and information proliferation have created a great deal of uncertainty for organizations. As a result, the importance of flexibility or adaptability to organizations has never been more important. Increasing global competition makes it imperative that organizations can grow or contract to meet changes in demand. The rapid pace of technology transfer demands that organizations ' quickly adopt innovation. As a response to these demands, organizations have de-coupled specific tasks from individuals and assigned units of work to teams (Hoerr, 1989). Flexibility is enhanced in such structures because teams can be composed (or responsibilities allocated among members) to take advantage of specialized skills and resources as the demands of the situation change. These types of teams have been credited with successes at Chrysler (Byme, 1993; Treece, 1992; Woodruff, 1991, 1993) and thousands of other organizations over the last ten years (Hammer & Charnpy, 1993). Thus, in many respects, what distinguishes the third wave of interest in small groups and teams from the second, is that teams are now viewed as more of a necessity than ever before. That is, whereas in the past teams were implemented in an effort to gain competitive advantage, now the use of teams is necessary just to compete. However, while a great deal of research has begun in order to better understand, predict and control important team processes and performance, reviews of this research suggest that we still have much to learn (Bettenhausen, 1991; Guzzo & Dickson, 1996; Guzzo & Shea, 1992; Ilgen, Major, Hollenbeck, & Sego, 1994; Levine & Moreland, 1990; Sunstrom, De Meuse, & F utrell, 1990). The purpose of this dissertation is to address one specific and important team problem--how teams adapt to changing environmental conditions. Before I go further, however, it is necessary to define explicitly what is meant by the word team. Definition of Teams Consistent with Katz and Kahn (1978) and other open system theorists (e. g., Boulding, 1956; J. Miller 1955, 1965a, 1965b; von Bertalanffy 1968), I will assume that individuals, groups, organizations, and so on, are partially nested open systems. 116% refers to the idea that individuals behave in groups which are embedded in organizations. 9&1 refers to the idea that each focal system is dependent on higher level systems for the resources it needs to survive. Survival requires that each focal system takes resources and transforms them into outputs. Finally, gym refers to the cyclical patterns of activity which transform resources to outputs. System boundaries, therefore, are defined in terms of the set of events that “return upon themselves to complete and renew a cycle of activities” (Katz & Kahn, 1978, p. 24). For example, a simple group-level social system consisting of actor A, B, and C might exist if actor A elicits a response from actor B, and this response, in turn, stimulates C, who, in turn, stimulates A. In this dissertation, I focus on group-level systems of a specific type-~the team. Although there are numerous definitions of teams, I use one that synthesizes most to date (Ilgen et al., 1994). The first three elements of their definition of teams are common to small groups and teams and were described by Steiner (1986) in his review of the small groups literature. First, a team must consist of at least two individuals. Second, these individuals must interact. Third, not only must the group interact, but there must be interdependence between the actors. Finally, teams exist for some task related purpose. Members interact to achieve task related goals which members are generally aware of and to a great extent share. It is this shared purpose element that most clearly differentiates a team from a group of individuals. For example, six individuals who meet on Thursday nights to discuss gardening are clearly a small group, yet they would not normally be considered a team. While such a group is composed of multiple individuals who interact and who are interdependent (to the extent their discussion depends on everyone’s contribution), they do not share a task related common goal (e.g., the individuals are not trying to grow a certain amount of corn). In the context of this dissertation, a team’s purpose is generally implicitly or explicitly determined by others (such as those in management). That is, this dissertation will not focus on the types of teams which define their own purpose. As Guzzo and Dickson (1996) point out, however, the difference between groups and teams is in “degrees of difference” rather than “fundamental divergence”. And although the word “team” is the current jargon in the organizational behavior, human resources, industrial and organizational psychology, and popular management literatures, there is along history of research on small groups that share the same elements of the above definition. Thus, although the concern in this dissertation is with teams as defined above, this dissertation will draw liberally from the literature on groups. The Nature of Routine In many teams, the organization of work is rationally designed to meet the demands of the task. The designers of such teams work outside the team, typically as upper level managers or perhaps as consultants. Typically, designers of such teams try to specify individual tasks and how these tasks are to be integrated in order to arrive at team products. This approach to work organization includes socio-technical designs which emphasize social as well as task considerations (Cummings, 1978). In other instances, work in teams is organized through compliance with institutionalized norms (Zucker, 1977). For instance, individual specialists may come together to perform a task for which they each have a clear understanding of their role ‘and what they can expect from other team members. While rational design may play a role in how these tearns are structured by providing a general organizing fiamework, actual responsibilities are governed by a set of “taken for granted” norms. Cockpit flight crews are a good example of this type of team (Ginnette, 1990). Finally, work in teams can be organized as the result of some developmental (Tuckrnan, 1965; Gersick, 1989) or role assimilation process (Hollenbeck, LePine, & Ilgen, 1996). Depending on the specific research perspective, team members are seen as either reactive (Katz & Kahn, 1978) or proactive (Graen, 1976) in developing roles, which when viewed as a system, eventually stabilize. Work in self-managed teams is organized in this manner. While all three organization mechanisms are conceptually distinct, they are similar because they lead to the establishment of standard operating procedures, job descriptions, role expectations, or routines (Cyert & March, 1992; Gersick & Hackman, 1990; March & Simon, 1992; Weick, 1979). Such outcomes, henceforth called routines, are natural in systems where there is a drive to reduce uncertainty (Thompson, 1967). The prevalence of routines is evidenced by their existence across many types of groups (Argyris, 1969) and govern most behavior in organizations (March & Simon, 1992; 141- 142). The creation of routines is generally attributed to “repeated success with particular behaviors in relatively constant problem environments” (Weiss & Ilgen, 1985, p. 59). To Gersick and Hackman (1990, p. 69) “a habitual routine exists when a group repeatedly exhibits a functionally similar pattern of behavior in a given stimulus situation without explicitly selecting it over alternative ways of behaving”. According to this definition, routines are (l) observable (patterns of behavior), (2) mindless (only superficial if any conscious consideration of alternatives), and can (3) vary in strength (how ofien the similar pattern is triggered). Over the last few decades researchers have invested a great deal of effort describing routines and standard operating procedures in groups and organizations and this research suggests that routines can be both beneficial and detrimental. The Dilemma Routine behavior has a number of firnctional consequences which have been well documented throughout the past half-century. These consequences are not trivial, and as many have noted, are necessary for the survival of systems at both group and organizational levels of analysis. First, because group members are interdependent and must coordinate with each other, routines provide a mechanism whereby members can anticipate each others’ actions (Argote & McGrath, 1993). Being able to anticipate others’ actions is critical in situations where members depend on others to carry through with their responsibilities. As an extreme example, routines are highly beneficial to trapeze artists who must, with great confidence and without hesitation, twirl through the air into the waiting arms of another. Routines also allow increased efficiency (i.e., save time and energy) because they need not be actively managed (Gersick & Hackman, 1990). Because repeated situations are handled the same way automatically, complex and time consuming planning and strategizing is not necessary. In simple terms, routines eliminate wasted resources caused by constantly having to “reinvent the wheel”. In addition, because routines invoke the same solution on a problem, system actors become well practiced in the behaviors specified in the routine. This is especially beneficial where many actors must coordinate non-redundant or specialized behaviors. Routines also increase reliability in performance by stamping out deviations from “normal” behavior (Levinthal & March, 1993). This is most beneficial in systems where avoiding failures is more important than reaching potential upper limits in terms of performance and in stable situations with knowledge of past successful behavior. As March and Simon (1992) suggest, this type of satisficing behavior is inherent in organizational systems with bounded rationality. Finally, routines reduce the uncertainty members have regarding their role responsibilities (Gersick & Hackman, 1990). In this way, routines increase individual actors’ level of comfort and confidence. In addition, because routines are accepted automatically, overt competition and disagreement between individuals in groups may be ' avoided. In this way, routines are beneficial to the cohesion, and perhaps long terms survival, of groups. Given the benefits of routines outlined in these paragraphs, it is understandable why routines are prevalent in group and organizations (Gersick, 1988; Gersick & Hackman, 1990; Hackman, & Morris, 1975). Indeed, Cohen and Bacdayan (1996) showed that routinized behavior is probably common even in simple systems with relatively short life-spans. In their study, routines were developed in the concocted laboratory dyads using a simple task (card game) over a relatively short time period (40 hands in 40 minutes). Thus, it appears that routines are developed even in simple systems where the importance of developing such patterns would seem to be minimal. Among the most critical aspects of teams, however, is the occasional need to change the way they go about doing their task in order to respond to changes in their context or environment which makes their routine inappropriate. Teams must be able to deal with unanticipated factors and modify their actions accordingly or team effectiveness will suffer (Argote & McGrath, 1993). Routines are particularly problematic in this regard because they are triggered mindlessly and thus can be transferred onto inappropriate situations (Cohen & Bacdayan, 1996). As Gersick and Hackman (1990, p. 72) point out, routines invite miscoding of stimuli because groups are likely to see what they know or what they expect, and thus, may fail to recognize that the context has changed or that they are in a new context entirely. Indeed, research concludes that once “the” way of going about doing things becomes established, group members tend not to think about or discuss their strategy (Hackman, 1987, p. 328) never mind change it (Hackman, Brousseau, & Weiss, 1976; March & Simon, 1992, chapter 6). Allison’s (1971, p. 109) humorous description of civilian-clad Soviet troops marching off a dock after they secretly arrived in Cuba illustrates the mindless activation of routines. Gersick and Hackman’s (1990) account of the Air Florida Flight 90 crash points out that the inappropriate transfer of routine behavior can have less humorous consequences, however. In this example, a flight crew that normally flew in warm weather did not take appropriate action during operations in freezing weather. The captain mindlessly responded “off’ after the first officer read “anti-ice” from a checklist and the first officer mindlessly went on reading. As a result of the failure to use the de-icing equipment, the plane crashed killing 74 people. Thus, recognizing that the establishment of routines is often desirable and probably inevitable (Gersick, 1988; Gersick & Hackman, 1990; Hackman, & Morris, 1975), the critical question becomes one of developing an understanding of how teams abandon or change these “habits” when they become inappropriate. Researchers have examined this dilemma for decades. For instance, Lewin (1951) recognized that change in organizations first requires “unfi'eezing” the old situation. Starbuck and Hedburg (1977) noted that learning in organizations first requires “unlearning”. This research, however, has been almost exclusively conceptual, normative, and quite abstract (e.g. Argyris, 1976; Argyris & Schon, 1978; Fiol & Lyles, 1985). Thus, in order to provide some precision to the topic being studied here, I will focus on “team adaptation”, which I formally define as; reactive and non-scripted adjustments to a team’s role structure that result in a better fit given the new situation. Decomposing this definition shows how adaptation is different from related concepts such as learning and innovation. The first element in the definition of team adaptation is the word reactive. Reactive implies response to something, typically a problem, error, or discrepancy. Thus, this element stands in contrast to the concept of innovation which is typically thought of in terms of proactive change in order to take advantage of opportunity. The second element, W, refers to the fact that adaptation does not refer to reactions to situations (problems) by implementing intact procedures or routines which were learned in the past. That is, adaptation is not just the reactivation or reinitializaiton of old schemes (Eckblad, 1981), scripts (Abelson, 1981; Gioia & Manz, 1985; Gioia & Poole, 1984; Lord & Keman, 1987; or stimulus-response associations. This is different from notions of learning which are based on the development of proficiency regarding when to implement lessons from the past (i.e., transfer). Adaptation refers to active and controlled search for, experimentation with, and implementation of new ways of doing things in light of a new situation. This is not to say that the adaptation comes from completely “new” knowledge, but that team members’ knowledge of facts, rules, and principles is recast in light of the new situational context. That is, old knowledge of team members is used as a basis for developing a new, more appropriate system of behavior. The importance of this point will become clear later. The next element in the definition of adaptation is the word adj ustment. Adjustment highlights that adaptation implies activity or behavior. Thus, adaptation is distinct from organizational learning which can mean a change in knowledge without any change in activity or behavior. Hedburg (1981) stresses that it is important to distinguish between processes which affect (a) shared interpretation of events, (b) the development of shared understanding and conceptual schemes, and (c) responses and behaviors, because 10 they are different phenomena. As F ioil and Lyles (1985) note, changes to cognition (a and b) or behavior (e) do not necessarily reflect changes in the other. Indeed, Hutchins (1996) has recently demonstrated that changes in the environment can cause team behavior to change without any shared interpretation of events among team members. Thus, the definition of adaptation being developed here is closer to conceptualizations proposed by Fiol and Lyles (1985) and Miller and F riesen (1980) who stress behavior change than to conceptualizations proposed by Meyer (1982) and Chakravarthy (1982) who stress cognitive change. Together, reactive non-scripted adjustments imply behavior change that takes place in the course of activity as opposed to behavior change that takes place in order to do the project. Argote and McGrath (1993) make this distinction when they distinguish teams’ reconstruction processes (modifications of the system as a consequence of doing a task) from teams’ construction processes (modifications of the system in order to do a task). The latter process has been the subject of a great deal of research (e.g., Barley, 1986; Poole, Holmes, & Desanctis, 1991; Poole & Roth, 1989a; Poole & Roth, 1989b; Poole, Seibold, & McPhee, 1985). The element m in the definition stresses that the focus is on changes in behavior at the team-level (as defined earlier). That is, adaptation is conceptualized as changes in the cyclical patterns of activity among those individuals who are part of a team (as defined earlier) in the course of transforming resources to outputs within the boundary of the set of events which return upon themselves to complete a new cycle of activity. While concepts of learning and innovation may occur at different levels, it is 11 best to explicitly ground theory within a level so that biases and fallacies are avoided (Rousseau, 1985). By using role structure, this definition also includes the behavioral focus of change. Using Katz and Kahn (1978, p. 189) as a basis, role structure can be defined as the pattern of recurring actions of individuals interrelated with the recurring actions of others. In essence, role structure refers to the cyclical pattern of activity among team members discussed earlier and in the previous paragraph. This conceptualization is consistent with Katz and Kahn who view organizations as “open systems of roles” (p. 187) Finally, the definition includes the requirement that adaptation result in a system of behavior fit better fits the new situation. This somewhat normative component to the definition is necessary because adaptation implies increased fit, consistency, congruity or correspondence between team structure and the situation. That is, from an objective standpoint, changes in a system of behavior must be more effective in the new situation than the old system was (or would have been). Activity which simply results in a different system of behavior cannot be said to be adaptive because it does not bring the team in closer correspondence with the demands of its situation. This requirement is necessary to distinguish adaptation from “forgetting” or “change or change for the sake of change”. I should also note that in this element of the definition (i.e., movement towards better fit), it is implied that adaptation is a response to negative as opposed to positive discrepancies between perceived and desired states. Despite the importance of adaptation to teams (and thus to the organizations teams are nested in), there has been very little theoretically driven empirical research on 12 this topic. Indeed, this was noted 30 years ago by researchers who stated that “[o]ne of the least understood phenomena in task-oriented team performance is the manner of adjustment to unprogrammed changes” (Behling, Coady, & Hopple, 1967). What research exists, focuses almost exclusively on describing how routines form and why they are difficult to change (Allison, 1971; M. Cohen, 1991; M. Cohen & Bacdayan, 1994; Cyert & March, 1992; Gersick & Hackman, 1990; Levitt & March, 1988; March & Simon, 1992; Nelson & Winter, 1982; Weiss & Ilgen, 1985) and thus only highlights importance of team adaptation. Perhaps the lack of research on team adaptation lies in the complexity involved in conducting it. Indeed, team adaptation not only involves multiple actors who may have only a partial understanding of an entire system, but adaptation is also emergent. That is, it is difficult to specify, a priori, what a new system of team-level behavior should entail. In fact, if a priori specification of a new system were possible, then adaptation would be unnecessary-~planning would be more efficient. Thus, given the nature of adaptation, it is understandable why theoretical research on adaptation has not progressed much further than description. However, given the increasing prevalence of teams that operate in an increasingly dynamic environment, the need to increase our understanding of team adaptation has never been greater. One stream of literature which would seem to be highly relevant to our understanding of team adaptation is the research on individuals’ ability to perform in new or changing situations. For instance, attributes such as change-orientation (Saville & Holdsworth, 1990), experience-seeking (Hogan & Hogan, 1992), flexibility (Gough, 1987; Paulhaus & Martin, 1988), social intelligence (Cantor & Kihlstrom, 1987; Zacan'o, 13 Gilbert, Thor, & Mumford, 1991), and openness to experience (Costa & McCrae, 1992) all would seem to be relevant to the topic of this dissertation. There are, however, at least three problems with using this literature as a starting point for developing an understanding of team adaptation. First, it is possible that a person on a team with certain characteristics may attempt to change his or her role to meet the demands of a changing situation, and if successful, change the role structure of the team. However, the other members of the team would have to “allow” this to occur and various lines of research would predict against this . happening. As Hackman (1992, p. 248) summarizes: “Uniformity, conformity to norms, and adherence to one’s role is the rule. When someone deviates, other members provide potent doses of discretionary stimuli intended to persuade or coerce the person to get back into line.” Obviously there are situations which would mitigate against this happening (e. g., the deviant has power over the other team members, or the deviant has a suggestion which is clear and unambiguously correct), however, there is no theory which integrates these factors with deviant and team member characteristics. Second, it is difficult to choose the best variables from among the list of possible alternatives. Obviously, one could use brute force and try them all. However, there are a number of flaws with not using theory guided variable selection, not the least of which includes being left with having to draw conclusions based solely on empirical results. This is a problem because without theoretical understanding, it would be difficult to specify the boundaries of generalizability. In order to overcome this problem, one would have to examine each variable in different settings and then infer which variable worked best in each setting. While such an approach would increase our ability to predict 14 adaptation, it would do so in a very inefficient manner. In addition, it does nothing to increase our understanding of adaptation in terms of underlying psychological mechanisms. Furthermore, since many of these concepts are redundant with one another, it is not likely that such an approach would lead to a very parsimonious literature base. A third problem is that it might be misguided to assume that the relationship between adaptability (originally defined in terms of some individual-level characteristic) and adaptation is homologous across the individual- and team-levels. The questions that must be asked in this regard relate to the extent to which individual-level scores on adaptability mean the same thing as when these individual-level scores are aggregated to represent the team. Such questions are critical since assuming homology can lead to a number of biases and fallacies (Rousseau, 1985). Addressing this problem requires the development and testing of theory which relates the individual- and team-level concepts (i.e., composition theories). However, since this stream of literature simply relates trait concepts to measures of learning and performance without much theory or consideration of the role of contextual factors (the nature of the work, the work setting, others in the group, etc.), it may be very difficult to specify adequate composition theory. In addition, since there are so many possible attributes to examine, it is doubtful that this approach would lead to a parsimonious theory of adaptation. I Overall, while it is possible to approach the issue of team adaptation from using the empirical base relating attributes of individuals to their adaptability, such an approach is not likely to be effective in increasing our understanding of team adaptation. This is not to suggest that the characteristics of team members are unimportant in team adaptation. Indeed, this dissertation views the composition of the team in terms of individual 15 attributes to be central to team adaptation. Instead, what I suggest is that research needs to be grounded in theory which explicitly considers team- or group-level phenomena. This dissertation takes such an approach. However, the first step in this process must be to explicitly state the domain of interest because progress in understanding can be made best when theories focus on a particular subdomain of phenomena rather than when theories attempt to be all-encompassing. Sgcialist Decgsion Making Teams While there are many different type of teams that do work in organizations (McGrath, 1984; Sundstrom et al., 1990), teams have begun to take on a number of defining characteristics and do not fit neatly in any current theoretical taxonomy or categorization scheme. First, because the proportion of service jobs has increased (relative to the proportion of manufacturing jobs) and because manufacturing is increasingly becoming computerized, teams are increasingly doing cognitive as opposed to physical work (Beyerlein, Johnson, & Beyerlein, 1995). That is, teams are increasingly doing their work by applying knowledge and making decisions (e. g., what type of products to develop, how to set up a cells in a flexible manufacturing systems) rather than performing psycho-motor tasks (e.g., mining). Second, while teams can be found at all levels of organizations, they are increasingly being used at lower levels where the basic work is done. That is, while there are top management teams, review panels, boards, and advisory councils which are involved in problem definition (establishing the type of work to be done in the organization), there are also an increasing number of teams that work on established and well defined problems (e. g., flexible manufacturing systems, product development). 16 Work in such teams consists of making a recurring set of fairly structured decisions which can be evaluated in terms of being right or wrong. Feedback indicating the correctness of these teams’ decisions varies in terms of both preciseness and time-lag. For instance, while surgical teams get fairly immediate and precise feedback after a major operation (e.g., the patient either lives or dies), product development teams receive feedback which is more delayed and is stated in terms of somewhat more ambiguous free- market criterion. In some of these teams the recurrence of similarly structured decisions occurs over a relatively short period of time while in others the recurrence of decisions is more spread out. For instance, a team responsible for configuring computerized equipment for small batch production runs will make more decisions over a period of time (e.g., two reconfigurations per week) than a product development team (e. g., two product introductions a year). Regardless of the timing, however, these teams make decisions which are recurring, and therefore should be more susceptible to problems associated with routine behavior than teams responsible for one-time or unique decisions. Third, because of rapid advances in technology, especially information technology, teams are increasingly becoming structured with professionals or specialists who have unique knowledge and skills (Tjosvold & Tjosvold, 1995). Because it is necessary to integrate multiple areas of expertise in order to arrive at effective team decisions, these teams can be characterized by their “cooperative interdependence” between members (Argote & McGrath, 1993). This means that team members exchange information and resources and coordinate activities with each other cooperatively. Such teams are distinct from those where individual members’ contributions are relatively independent or collaborative (e.g., brainstorming) or where members are in competition 17 with one another (e.g., negotiating or resolving conflicts of interest) (Argote & McGrath, 1993). Cooperation is critical because team members are reciprocally interdependent. That is, each member depends on the other members for informational and/or resource inputs (Thompson, 1967; Van de Ven, Delbecq, & Koenig, 1976). Finally, given the points above, the tasks facing many teams in organizations can be characterized as having a moderate degree of complexity. According to Wood (1986, pp. 66-71) the three dimensions of task complexity include: W (i.e., number of direct acts that need to be executed or the number of information cues that must be processed in the performance of those acts), coordinative complexig (form and strength of the relationship between information cues, acts, and products, as well as the sequencing of inputs), and dynamic complexig (the frequency of which individuals must adapt to changes in the causeueffect chain or.means--end hierarchy). Because teams are responsible for entire units or work, it is likely that in most situations performance will involve at least a moderate amount of component complexity. Because teams are composed of specialists who are reciprocally interdependent, there is likely to be at least a moderate amount of coordinative complexity. Finally, because the competitive environment is dynamic (Howard, 1995) recurring work cycles tend to be short which means at least moderate levels of dynamic complexity. As stated in a previous paragraph, the types of teams described above do not fit neatly in any single scheme. For instance, Sundstrom & Altman (1989) categorized work groups into four types as defined by four characteristics: work team differentiation (redundancy of member roles), external integgtion (synchronization with constituents external to the group), work cycles (the length and uniqueness of a performance event), 18 and apical outputs (physical versus non-physical outcomes). In terms of these characteristics, the types of teams described above are most clear in terms of having a high degree of work-team differentiation. However, these teams may have varying degrees of external integration and length of work cycles. In addition, while the process of these teams’ work consists of making decisions (the correctness of which can be considered non-physical), the ultimate outcomes of those decisions may be physical (a new product, a downed aircraft). Thus, for the lack of a better term, I will use the term Smgialist decision making team to refer to the type of team I described in the last few paragraphs. This dissertation focuses on these teams because of their increasing prevalence, importance, and susceptibility to problems with routine (i.e., they make decisions which are recurring). I should note that these teams can be found in a wide variety of contexts including business, education, military, and medical. What follows are a few specific examples. Specific Examples In the context of business, a manufacturing organization located in the Midwest uses specialist decision making teams in the mass production of glass bottles (Pagell, 1997). In this organization, teams are composed of four to five individuals who set-up production rims and monitor the production process. Set-up responsibilities include configuring a computerized forming machine which holds up to 24 molds. Configuration includes mounting the molds in the forming machine and setting initial production parameters (e.g., temperature, process speed, fill-rate, pressure, etc.) according to the type of bottle to be produced (size, material, color, finish, etc.). Specialization in these teams consist of differences in responsibilities rather than in specific areas of expertise as 19 defined by specialized training or education. Recurrence or set-up decisions correspond to production runs which last between two and three days. During production, team members monitor sensors on the forming machine and make adjustments to production parameters such as “temperature”, “speed”, “flow”, and “pressure” in order to keep the production process going. Team members are interdependent because a change in one parameter (e.g., temperature) impacts the others (e. g., required pressure, speed, flow). Any team member can make minor adj ustrnents to parameters, however, when major adjustments are necessary, or when there are disagreements, a team leader will consider team members’ opinions and make the final decision. Cooperation is the norm in these teams because breakdowns are very costly in terms of lost production time and clean—up. In fact, because teams work in close proximity to molten glass, breakdowns can be very dangerous. Feedback regarding the correctness of decisions, therefore, is rather immediate. Another business example includes the use of teams in the machining of tool parts (Pagell, 1997). In one such organization, teams are composed with a lead operator (team leader), three operators, a tool setter and a computer programmer. These teams are responsible for the setting-up of machines and the production of tool parts using five configurable computer assisted machines. When a new order for a part comes in, the team gets together and uses its distributed expertise to make decisions regarding what machines to use, what “cuts” to make, the order of cuts, and how to “fixture” the machines (how to configure the machine to make the part). Once the configuration of the machines is set, the team begins producing prototype parts. During production, each member is responsible for monitoring the process for indications of problems which 20 result from programming or settings of the machine, materials, or the cutting tools themselves. Members can make minor adjustments to deal with problems, however, the lead operator has final authority over changes since he or she is responsible for the team’s performance. A third business example of specialist decision making teams includes Chrysler’s ”platform teams”. These teams are composed of designers, engineers, suppliers, manufacturing personnel, and marketing experts, all of whom work together on a project at the same time (Byme, 1993). Whereas in the past, this set of functionally differentiated individuals would have worked independently and sequentially, now they work interdependently at all stages of the product development process. This structure allows for problems to be noticed earlier when they are easier to rectify and has been credited for the success of Chrysler’s minivans, the Grand Cherokee, the Viper, and the Neon (Treece, 1992; Woodruff, 1991). As opposed to the two previous examples, the recurrence of similar structured decisions in platform teams is more spread out (i.e., the development cycle) and the feedback regarding correctness of decisions is delayed (e.g., perhaps after the product is launched) and perhaps more ambiguous (e.g., sales relative to the competition). Multidisciplinary Education Teams (METs) which make decisions regarding placement of students into special education programs are an example of specialist decision making teams in the context of education. Although composition varies depending on the child and school district, METs may consist of speech and language specialists, social workers, school counselors, school nurses, occupational or physical therapists, adaptive physical education teachers, vocational rehabilitation counselors, 21 juvenile court authorities, physicians, general education teachers, and special education teachers (Hardman, Drew & Egan, 1996). Members of METs undertake independent assessments within their specialty, however, placement and program decisions are made by the team after integrating their knowledge to ensure that the student is viewed from multiple perspectives. The frequency of recurring team decisions corresponds to the number of students who are initially assessed for special education programs and the number of special education students who are re-evaluated (generally after every three years). In the 1992-1993 school year almost ten percent of all school children in the US between the ages of six and seventeen (4,893,865) received special education (US Department of Education, 1994). Specialist decision making teams can also be found in military contexts. In command and control teams, for example, individual team members integrate unique areas of expertise so that they can manage military operations within an assigned area. Team roles may include surveillance officers who use special rules to identify radar blips in assigned airspace, weapons officers who guide fighter aircraft towards blips the surveillance officers cannot identify or identify as hostile, and asenior director who supervises the surveillance and weapons officers and who also coordinates with outside agencies (e.g., other command and control turits, fighter aircraft squadrons, missile batteries, civilian agencies, etc.). Decisions made by these teams are the result of integrating each team member’s knowledge. For instance, while the surveillance officer may provide an initial target identification based on a set of rules (e. g., location, speed, altitude, heading) the other members of the team gather information which also must be considered in making final target identifications. For instance, the weapons officer 22 gathers information from the pilot of the fighter aircraft he or she controls (type of target aircraft, national markings, flight characteristics) and the senior directors gather information from other sources (e. g., intelligence reports). During the course of daily operations, a command and control team can make tens, if not hundreds of similarly structured decisions. Feedback regarding the correctness of those decisions is unambiguous and immediate. As evidenced by highly publicized disasters, most recently the accidental downing of a friendly helicopter over the no-fly zone in Northern Iraq, poor decision making can result in severe consequences. Finally, specialist decision making teams exist in medical contexts. For instance, surgeons, pathologists, anesthesiologists and nurses integrate their knowledge and make a series of decisions in order to safely perform a surgical procedure. Cooperative interdependence between team members is the norm during procedures since success depends on the joint contribution of each specialist. Recurrence of decisions depends on the frequency of procedures and feedback regarding the correctness of decisions is often immediate. hm: The purpose of this dissertation is to develop and test a theoretical model of adaptation in specialist decision making teams. This model will draw primarily from three literatures. As a brief overview, I first conceptualize routine and adaptation in terms of literature which views ”groups as information processors” (e.g., Cohen & Bacdayan, ‘ 1996; Hinsz, Tindale, & Vollrath, 1997). Based on this literature, I characterize the types of information processing which occur during routine and adaptive behavior (automatic and controlled). I then use the literature on individual differences to identify the 23 individual characteristic most likely to be important in the type of information processing used by team members during team adaptation (general cognitive ability). Finally, I use control theory as a framework for describing the mechanism by which team members switch between modes of information processing. The difficulty of goals, the quality of feedback and the salience of the change in the environment (abruptness of the environmental change) are identified as critical elements of this mechanism. Other individual differences (conscientiousness and openness to experience), however, are hypothesized to play an important role in determining whether or not active or controlled responses to problems are triggered. Figure 1 illustrates the proposed model that is developed in the next chapter. Chapter 2 describes a laboratory study to test the hypotheses generated from this model. Chapter 3 discusses the results of the study. Chapter 4 summarizes the results and discusses implications to theory and practice. Factors That Influence Mode of Information Processing (Goals, Feedback, Nature of Environmental Disturbance) Ability to Engage in Controlled Information Processing Team (Team Members’ General Adaptation Cognitive Ability) / Factors That Influence Responses to Perceived Environmental Disturbances (Team Members’ Conscientiousnes and Openness) Figure 1 - An Integrative Model of Team Adaptation 24 Chapter 1 LITERATURE REVIEW Information Processing as a Theoretical Foundation Although research on human cognition is diverse in terms of what specific processes are emphasized, this research shares the view that humans’ think and these thoughts play a large role in their behavior (Ilgen & Klein, 1988). As Ilgen and Klein point out, cognitive processes not only influence how objective information or stimuli from the environment is construed and responded to, but also play a major role in constructing the realities which are perceived as stimuli (Weick, 1979). This section describes the role information processing plays in routine and adaptation in teams. The most familiar view of human information processing consists of a sequence of operations. These operations generally consist of taking information from sensors (i.e., vision, hearing) or long-term memory, transforming this information into forms which can be interpreted by short term memory or working memory, and then storing this new information back in long term memory (Lord & Maher, 1991). This is the computer analogy model of information processing and is only one of many possible conceptualizations. It has, however, served as a useful heuristic to organize thinking about specific cognitive sub-processes and how these sub-processes interrelate to one another. While much of the research concerned with human cognition focused on the processes described above as subjects of interest in their own right, research in the organizational sciences has often used these processes to understand organizational phenomena. Although this work has been reviewed before (e.g., Ilgen & Klein, 1988; 25 Weick, 1979), one stream which would seem to be relevant to this dissertation is the work on managerial problem sensing. Problem sensing. In a conceptual paper, Keisler and Sproull (1982) focus on problem sensing because, in their view, it is a necessary precondition for adaptive activity, and thus, a crucial managerial activity in a dynamic environment. They define problem sensing as the cognitive process associated with noticing and constructing meaning about the environment. Keisler and Sproull’s aim in this paper was to outline how the very nature of human cognition makes problem sensing difficult. Errors come from the manner in which information (i.e., cause and effect relationships) is constructed (e.g., augmentation, discounting, illusory correlations, illusory causation), how information is organized (associative or schema based knowledge structures in long term memory), and from biases resulting from human drives and needs (e.g., dissonance, consistency, and equity theories). Keisler and Sproull’s view of problem sensing was a departure from past organizational research which viewed problem solving as a much more rational decision making process (objectively scanning the environment for opportunities and threats). However, their research was similar to past research because the focus was on individual information processing. That is, although individual’s information processing might focus on social objects or phenomenon (i.e., the content of cognitions), the processes of interest remain within the individual. Recently, however, this focus has begun to change. Qppups as infomgtipn processors. There is an emerging view of groups as information processors. This view holds promise as a meta-theoretical foundation for explaining many group phenomena (Hinsz et al., 1997) and is useful for understanding 26 group processes for at least three reasons. The first two arguments relate to the general applicability of the information processing perspective to groups and teams in general while the third argument suggests that the information processing perspective is particularly suitable for the study of routines and adaptation in teams. First, conceptualizing groups as information processors allows researchers to draw upon the vast accumulation of theoretical and empirical work on the nature of human information processing. While this literature primarily focuses on how information is processed within individuals (Weiss, 1990), it is increasingly being extended to include . how information is processed between individuals resulting in group-level cognitive outputs (e.g., Bazerrnan, Mannix & Thompson, 1988; M. Cohen, 1991; M. Cohen & Bacdayan, 1994; Hastie, 1986; Hinsz, Vollrath, Nagao, & Davis, 1988; Hinsz et al., 1997; Hirokawa, 1990; Ickes & Gonzalez, 1994; Larson & Christensen, 1993; Levine, Resnick, & Higgins, 1993; McGrath & Hollingshead, 1994; Sniezek, 1992; Streufert & Nogami, 1992; Tindale, 1989; Von Cranach, Ochsenbein, & Valach, 1986; Wegner, 1987). This literature is an abrupt departure from the past because the focus is not on cognition about social (i.e. group or team level) phenomena (e.g., F iske & Taylor, 1991), but on how cognition is accomplished socially (e.g., Hinsz et al., 1997). In other words, there has been increased interest in, and recognition of, groups as important information processing systems in and of themselves. As Larson and Christensen (1993) suggest, the analogy of the computer model of information processing may be applied to information processing by groups just as well as it is applied to information processing by individuals. Such processes refer to those that “relate to the acquisition, storage, transmission, manipulation and the use of 27 information for the purpose of creating a group-level intellective product” (Larson & Christensen, 1993). Because the primary determinant of the researcher’s focus is the level of the outcome of which the researcher is interested in (Freeman, 1980), conceptualizing the information processing system as a group should be especially useful when the outcome of interest (team adaptation) is also at the group-level. This is not to say that cognition at the individual-level and group-level is the same thing. Indeed, this would be like saying an individual’s recollection of an item is the same thing as someone bringing up an item in a group discussion (Larson & Christensen, 1993). While functionally similar, the nature of these processes is clearly different at the difi’erent levels of analysis. Just as computer information processing functions as an analogy which is helpful in developing a better understanding of individual-level information processing, individual-level information processing serves as an analogy which is helpful for developing a better understanding of group-level information processing. A second reason why an information processing perspective is useful in understanding group-level phenomena, as mentioned before, is because the work groups and teams do is increasingly intellectual or cognitive in nature (Galegher, Kraut, & Egido, 1990; Salas, Dickinson, Converse, & Tannenbaum, 1992; Walsh & Ungson, 1991; Weick & Roberts, 1993). However, even when the ultimate outcomes of interest are not cognitive in nature (e.g., the production of glass bottles), the processes leading to those outcomes are becoming increasingly cognitive (e.g., making a series of decisions regarding how to adjust parameters to keep the process moving). Research in small groups and teams has begun to emphasize these types of tasks (e.g., Brehmer & Hagafors, 28 1986; Hinsz, 1990; Hollenbeck, Ilgen, Sego, Hedlund, Major, & Phillips, 1995; Sniezek & Henry, 1989; Stasser, Taylor, & Hanna, 1989; Tindale, 1989; Vollrath, Sheppard, Hinsz, & Davis, 1989). Finally, the information processing perspective is useful for understanding routines and adaptation because the literature suggests that the very nature of routine and adaptation correspond with distinct modes of information processing thought to underlie human behavior (M. Cohen, 1991; M. Cohen & Bacdayan, 1996). In the next section I use this literature to explain how modes of information processing relate to routine and adaptation and how this connection can be used as a basis for developing a model of adaptation in teams. The Basis for Routine and Adaptation In a conceptual paper, Louis and Sutton (1991) used the phrase “switching cognitive gears” to suggest that the effectiveness of individuals and groups depends upon the capacity to shift between modes of information processing as dictated by necessities of the situation. Specifically, they proposed that the effectiveness of systems that process information depends on the ability to switch back and forth between a mode of information processing which is relatively unconscious and automatic and a mode of information processing which is more conscious and controlled. While there have been many attempts to characterize these modes of information processing at both fi__rm- (e.g., Fiol & Lyles, 1985) and individual-levels (e.g., Schneider & Shiffrin, 1977; Shiffrin & Schneider, 1977), this dissertation will use theory originating from the individual-level skill acquisition and learning theory research. Among the most important reasons for this focus is the desire to build on the work of others who have begun to use this literature as 29 a basis for developing theory aimed at understanding routine behavior in groups (e. g., M. Cohen, 1991; M. Cohen & Bacdayan, 1996). Additionally, however, the literature on individual-level skill acquisition tends to specify and focus on the process of moving from one mode of information processing to the other. This emphasis, therefore, has the potential to elucidate the factors involved in the triggering of shifts between modes of information processing. What follows is a brief review of the literature on skill acquisition which recognizes distinctions between modes of information processing. From this literature, I conceptualize routine and adaptation in terms of modes of distributed information processing. Fitts’ theory of motor skill development. Researchers have long been interested in the transition from slow and halting performance of the novice to fast and smooth performance of the expert (e.g., Bryan & Harter, 1897, 1899). In one example of this research, Fitts (1964) developed a three phase theory of motor skill development to explain the phenomenon. The first phase in this model is the cognitive stage in which the actor relies on the use of instructions, facts, and other information, which have to be used in the working, or short term memory. This phase involves the initial encoding of skill and requires verbalization or other rehearsal in order to execute a desired behavior. The second phase, or the associative phase, was seen as a smoothing out period and a transition to the autonomous phase where components of the task become more automatic and less subject to cognitive control and interference from other activities or from factors in the environment. Thus, according to Fitts, the difference between novice and expert motor performance boiled down to different modes of cognition which guide behavior. 30 While Fitts observations have not been the subject of a great deal of theoretical or empirical analysis, his ideas have provided the foundation for a much more elaborated and assessed theoretical framework. MKS ACT“ Theory. While Fitts (1964) was concerned with skill acquisition primarily in terms of motor skills, Anderson’s Adaptive Control of Thought (ACT‘) theory (1982, 1987) is broader and deals with the acquisition of cognitive skills. Corresponding to the cognitive stage in Fitts’ theory is Anderson’s declarative ptpgp. In this stage individuals use knowledge about things, facts and rules to solve problems. In Anderson’s second stage of skill development, knowledge compilation, practice converts knowledge about things, facts, and rules into a procedural form “in which it is directly applied without the intercession of other interpretive procedures” (Anderson, 1982, p. 370). This process happens over time and corresponds roughly to F itts’ associative stage. Finally, Anderson’s procedural st_age corresponds with F itts’ autonomous stage. Here performance is smoothed out as procedures developed earlier are combined into larger, more domain specific procedures. In Anderson’s theory, a key distinction is made between two discrete symbolic memory structures. Declarative m is knowledge of things, facts, rules, etc. (content) and is obtained from observation, reading, instruction, and so on. Procedural memog, on the other hand, is knowledge about how to do things (process) and is gained through experience with the task or problem. The underlying foundation for Anderson’s theory lies with the notion that problem solving is hierarchical (if A do B, if C results--then D, or else do E, etc.). With experience in successfully applying declarative knowledge to such problems, efficient 31 domain-specific pgpdppm are encoded into procedural memory W). These productions are simply sequences of cognitions or behavior which, once triggered, are executed automatically. Using productions to control behavior instead of interpreting knowledge in declarative form is much more efficient because reliance on declarative knowledge would require the representation and interpretation of many individual production steps in short-term or working memory. This would place a heavy burden on the capacity of this system and would cause errors resulting from missing information (Anderson, 1982). Over time, these domain-specific productions are collapsed further into single, even more specific productions which are stored in procedural memory (compilation). As Anderson notes, while the specialized productions will be used in the domain in which they evolved, the original declarative memory (e.g., knowledge of the fact or rule) and less specific productions (i.e., the domain-specific productions which served as the basis for the more highly specific productions) remain in declarative and procedural memory. That is, according to Anderson, the foundations for the highly specialized productions remain in long-term memory. According to Anderson’s theory, the primary element of an information processing system is working memory. Working memory contains the currently activated portion of declarative memory, declarative structures activated by procedural memory, goals that serve as sources of activation, and finally, information which is encoded from the outside world or from motor feedback. The information processing system operates as elements in declarative memory or productions in procedural memory become sufficiently activated in which case they are “poppe ” into consciousness or working memory. Once activated, these elements then interact with goals and other information in 32 working memory to further activate elements from declarative and procedural memory. Thus, Anderson views human cognition as the activation of nodes of memory and therefore is somewhat of a departure from other models of cognition which follow a strict computer analogy (proceeding from one step of information processing to the next in a logical sequence) more literally. While Anderson’s theory was clearly intended to explain cognition and the acquisition of skill at the individual level of analysis, concepts from his theory have recently been extended to understand routines at the group-level of analysis (M. Cohen, 1991, M. Cohen & Bacdayan, 1996). While there has been research which borrows concepts from cognitive psychology to understand behavior in groups, generally the cognitive concepts and theories are applied loosely resulting in little testable theory (e.g., Louis & Sutton, 1991). Often, higher level systems are anthropomorphisized (i.e., groups think) and individual level concepts are applied assuming that these concepts have construct validity at this new level of theory (Weick & Roberts, 1993). As Rousseau (1985) suggests, this may be a dubious assumption. M. Cohen and Bacdayan (1996) make a significant contribution in that their use of cognitive concepts remains consistent with the level of theory from which these concepts originated. Routine: Distributed procedural knowledge. As Gersick and Hackman (1990, p. 69) suggest, routines in groups exist ”when a group repeatedly exhibits a functionally similar pattern of behavior in a given stimulus situation without explicitly selecting it over alternative ways of behavior”. This description corresponds very closely with that given earlier for proceduralized information processing in individuals. Just as recognized inputs activate corresponding productions in individuals, perceived stimuli trigger 33 functionally similar patterns of behavior among groups of individuals. Just as information processing and behavior triggered by productions proceed without much conscious control in individuals, patterns of behavior among individuals are exhibited in given stimulus situations without selecting them over other alternatives. Finally, just as learned productions may be difficult to suppress, modify, or ignore in individuals, habitual routines in groups are often triggered even when the situation would otherwise suggest that they are inappropriate. M. Cohen and Bacdayan (1996) argue that the similarities between proceduralized behavior in individuals and routine behavior in groups is not coincidental. “As individuals become skilled in their portions of a routine the actions become stored as procedural memories and can later be triggered as substantial chunks of behavior. The routine of a group can be viewed as the concatenation of such procedurally stored actions, each primed by and priming the actions of others (Tulving & Schacter, 1990)” (Cohen & Bacdayan, 1996, p. 410). Figure 2 illustrates an example. Action 2 Action 3 Information Action 1 Action 2 _ fromthe -b.——>|BL 'lD] Environment ‘ Action 3 Figure 2 - A Routine Among Four Actors In this example, it is assumed that the four actors in a system already have developed procedural knowledge through experience. Actor A encodes information from the outside world into working memory. This information then is matched with a 34 production in actor A’s procedural memory. A corresponding production is then triggered which controls actor A’s cognition and behavior (action 1). This behavior results in information (i.e., an altered situation) which actor B encodes in working memory. This information then triggers a corresponding production which controls actor B’s cognition and behavior (action 2). The same process, in turn, also serves as a basis for actors C and D’s behavior. There may also be non-recursive effects as well. For example, D’s behavior, might influence cognitions and behavior of actors C and D (action 3). As a more concrete example, assume that the actors in the system in Figure 2 are members of a military command and control team similar to the one described earlier. Actor A is the surveillance officer who sees a blip on the radar screen. Based on experience using a set of decision rules, he or she then assigns the blip an identification of “unknown” by placing a computer symbol (i.e., U) over the blip on the radar screen. The surveillance officer also provides initial heading and speed using computer symbols (a line from the u symbol pointing in the direction the blip is traveling with a length indicating relative speed, U ------ >). After the surveillance officer notifies the senior director (actor B) by voice that there is a new unknown on the radar, the senior director notes that the “unknown” is traveling over a certain speed and in a certain direction, and thus needs to be identified. Since the unknown is in Actor C’s (a weapons controller) sector of responsibility, the senior director asks weapons controller C to direct a fighter aircraft towards the unknown (on an intercept heading) for a visual identification. The senior director also notifies Actor D (another weapons controller) to be ready to take over the intercept with the fighter aircraft she has under her control because the unknown may turn and head towards her sector. Using well practiced procedures, weapons controller C 35 immediately begins conducting the intercept, however, it becomes apparent to weapons controller C that the Fighter cannot complete the intercept without exiting the C’s assigned sector. Weapons controller C immediately notifies the senior director of this occurrence. Weapons controller C also notifies weapons controller D that the unknown is headed toward her sector and also passes along all known information (e.g., exact heading, speed, altitude). Based on this information, Controller D directs the fighter under her control toward the unknown. Once in visual range of the unknown, the pilot of the fighter under weapons controller D’s direction reports an identification (e.g., Hughes helicopter, tail number HGlO72) to weapons controller D. Weapons controller D then reports this information to the surveillance officer, who updates the unknown computer symbol to a helicopter symbol (i.e., H ------ >). The identification of an unknown in this example is a team-level outcome because between team variation in the effectiveness of identifying unknowns is dependent on the nature of the team (e.g., their pool of skills, the quality of their interaction, etc.), no individual member could produce the outcome by him or herself, and outcomes which occur all at once, depend on the entire system of activity. The view of routine as a system of reciprocally triggering behavior is similar to that described by other researchers (e.g., Dewey, 1922; Nelson & Winter, 1982; Weick, 1979), however, M. Cohen and ‘ Bacdayan’s (1996) conceptualization suggests a specific psychological mechanism that underlies the phenomenon. This is a significant contribution because it allows understanding and development of propositions regarding related phenomenon (adaptation). 36 Adaptation: Distributed declarative knowledge. Just as routine corresponds to team members’ information processing and behavior that is relatively automatic, adaptation corresponds to team members’ information processing and behavior that is more controlled. A situation which does not correspond to a known set of responses needs to spur an active search for and experimentation with new responses. Team adaptation requires that members use what they have learned in the past as a basis for developing an appropriate way of dealing with the new situation. Unsatisfactory partial solutions are abandoned while those which are successful are implemented. Over time, and assuming the environmental disturbance which necessitates the adaptation stabilizes, successful partial solutions become integrated and team-level activity becomes smooth. Using the model suggested by M. Cohen and Bacdayan, however, one can go further than simply characterizing the mode of information processing and behavior during adaptation. That is, by integrating the work of Anderson’s theory together with that of M. Cohen and Bacdayan, team adaptation can be understood as requiring team members’ use of declarative knowledge and lower level productions in information processing. That is, if information provided by the situation as encoded by team members does not result in the triggering of productions, lower level productions and/or an interpretation of rules specified in declarative knowledge will be used to specify appropriate action. In fact, because there is interdependence between team members, it is likely that even those who are not directly impacted by an environmental disturbance will. come to rely on their declarative knowledge and lower order productions to specify appropriate role behavior. Members directly impacted by disturbances may have to respond or behave in ways that are unfamiliar to others. Since those not originally 37 exposed to the environmental disturbance would then perceive a situation which would not correspond to stored productions, they would have to rely on their declarative knowledge and lower level productions to specify their role behavior. As an example, let me return to the command and control scenario. Command and control teams may have to identify many unknowns during the course of a work shift and the pattern of activity among team members becomes routine. However, many types of situations can occur which would make the pattern of activity problematic. Perhaps the simplest example is a communications failure (either voice or data) between team members. For instance, if for some reason weapons controller C was unable to communicate with weapons controller D, transferring intercepts between the two would be more difficult because last known heading, altitude, and speed of the unknown would be unknown to weapons controller D (weapons controller D would not know where to send her fighter aircraft). In this situation, weapons controller C might recall from past experience that the senior director is too busy communicating with outside agencies to act as an intermediate communications link, so weapons controller C contacts the surveillance officer and directly asks him to pass along information regarding the unknown to weapons controller D. Noting that the surveillance officer is acting as a communications link, the senior director recalls that in similar situations in the past the surveillance officer became overloaded and could not effectively keep up with the task of assigning computer symbology to radar blips. The senior director considers the situation briefly and then decides to monitor the radar display more closely so that the surveillance oflicer will no longer have to pass verbal messages when new unknowns enter the team’s sector. The result is a new pattern of interaction among team members. While some of 38 this new pattern is dictated by the disturbance (i.e., the communications breakdown), team members used what they knew from past experience to develop a new system behavior that could cope with the new situation. Among the most important implications of this conceptualization of adaptation is that while individuals’ reliance on interpretations of declarative knowledge is flexible in that it can be applied in novel situations, it has “serious costs in terms of time and working memory space” (Anderson, 1982, p. 311). During adaptation, team member behavior is governed by many small productions and knowledge from declarative memory. Resulting team behavior is much slower and halting than when larger specialized productions are triggered. Returning to and extending the command and control example once again should make this point clear. Until the members of this command and control team proceduralize their new role requirements, the members’ actions will demand their active attention. The senior director will have to remember to monitor the radar display more closely and learn how to smoothly integrate this task with other elements of his task. Weapons controller C will have to remember not to bother trying to communicate with weapons controller D, but that it is necessary to communicate with the surveillance officer. The surveillance officer has to work out a procedure for how to receive and re-send information in a timely manner without altering it and without interfering with other important responsibilities. Finally, since the target information must be sent through an intermediary, weapons controller D will have to learn how to interpret information which is more outdated (i.e., the unknown may have changed its heading, altitude or speed) than if the information were passed to her directly. 39 As the conceptualization outlined above suggests, one primary determinant of team adaptation may be the capacity of team members to actively process information. Teams with members who do not possess adequate capacity may not be able to develop systems which can effectively cope with changing situations. This implies that team members’ working memory is a critical resource for teams because the declarative knowledge and lower order productions which are used during active information processing must be represented there. In the next section, I discuss the notion of working memory and extend this concept to the team level. Cogpitive Resources Traditional models of human information processing posit that working memory consists of a space or area where cognitive work takes place. Other models of human information processing posit that working memory consists of that portion of long term memory which is currently activated. Generally speaking, both these conceptualizations assume that working memory is unitary in that all cognitive work takes place there and that once the limit of working memory capacity is reached, processing of other information (e.g., problem solving) will be problematic because some pieces of information will become lost. These models are referred to as “unitary fixed capacity” models of working memory. Researchers in cognitive psychology began to criticize unitary fixed capacity models in the 1970’s and 1980’s (Lord & Maher, 1991). These concerns first began surfacing as researchers in the dual task paradigm found that individuals could perform two tasks (e.g., responding to a beep while simultaneously attending to a visual display) without mutual interference. These findings suggested that perhaps human memory was 40 not of fixed capacity. Subsequent research found that while individuals could perform two tasks concurrently without much disruption when the tasks were widely different (e.g., verbal and visual), individuals’ performance was severely hampered when two tasks were highly similar (e.g., both visual) (Baddely & Hitch, 1974; Pashler, 1991, 1994). As a result of these and other findings, researchers in cognitive psychology began to develop models of human information processing systems with several relatively independent working memory subsystems (e. g., a visuospatial scratch pad and an articulatory loop), each dedicated to different cognitive sub-functions (Lord & Maher, 1991). While this “multiprocessor” view of memory may be better able to explain human cognition under certain circumstances (i.e., processing information from discrete sensory subsystems) than traditional unitary fixed capacity views, it is still useful to conceptualize working memory as having relatively fixed capacity for purposes of this dissertation. The primary reason for this statement is that one of the most “fundamental and stable” properties of human cognition is that the memog span of individuals is limited in capacity and fairly stable over a wide range of material (Brown, 1958; Peterson & Peterson, 1959) and that “[t]his limit places severe constraints on people’s ability to process information and solve problems (G. Miller, 1956; Newell & Simon, 1972)” (Chase & Ericsson, 1981, p. 141). Since this dissertation is focusing on adaptation, which is a problem solving activity (March & Simon, 1992), the limit in terms of capacity to process problem relevant information is the issue, not whether there is a unitary subsystem for processing unrelated non-problem related activities. Furthermore, the multiprocessor view implicitly assumes that each separate processing subsystem has a fixed capacity and is non-compensatory (e. g., if capacity for processing information 41 visually is consumed one cannot process the information auditorially). Thus, since the nature of a task determines which specific processing subsystem(s) is (are) required, it is sufficient to say memory capacity is limited when one is considering information processing in a specific task (e.g., problem solving). Indeed, over the last decade a number of organizational behavior and industrial and organizational psychology researchers have successfully applied this model in explaining individuals’ behavior (e. g., Barber, Hollenbeck, Tower & Phillips, 1994; Eyring, Johnson, & Francis, 1993; Kanfer & Ackerman, 1989; Kanfer, Ackerman, Murtha, Dugdale, & Nelson, 1994). In summary, although there is some debate as to the exact structure of working memory, it is reasonable to assume that in terms of problem solving, humans possess “at any moment a finite amount of processing facilities” (Navon & Goher, 1979). This finite amount of working memory generally relates positively to an individual’s ability to process information, solve problems (G. Miller, 1956; Newell & Simon, 1972), and perform in tasks (Navon & Goher, 1979). While terminology for this capacity differs somewhat across researchers (Kalmeman, 1973; Moray, 1967; Norman & Bobrow, 1975; Shiffiin, 1976), I use the term cogm'tive resources. The choice of this term is somewhat arbitrary, however, it is probably the most familiar to those interested in organizational behavior and industrial and organizational psychology. Individual differences in cogpitive resources. In the organizational behavior and industrial and organizational psychology literatures, individual differences in cognitive resources have been described in terms of general intellectual ability, general cognitive ability or (g) (Ackerman, 1986, 1987; Kanfer & Ackerman, 1989). Support for the existence of g comes from the fact that a single factor exists and underlies performance 42 on almost all tests which measure cognitive abilities (Hunter, 1986; Jensen, 1986; Kass, Mitchell, Grafton & Wing, 1983; Ree & Earles, 1991; Welsh, Watson & Ree, 1990). Support for the link between g and cognitive resources capacity comes from a long history of research on two fronts. First, psychologists studying the nature of intelligence report large positive relationships (reports generally range from about r=.60 to r=.80) between tests of memory span and scores on tests which measure g (e.g., Bachelder & Denny, 1977a, 1977b; Jensen, 1970). Bachelder and Denny (1977a, 1977b) proposed that this span is equivalent to the ability to respond appropriately when several cues (some of which are irrelevant) are simultaneously presented. This explanation is consistent with the long held view that individuals with larger spans or capacities can attend to more stimuli resulting in more complete and coherent units of perception than individuals with smaller memory spans or capacities (Lemming, 1922). Second, industrial and organizational psychologists report positive relationships between tasks which require active information processing and scores on tests that measure g (e.g., Hartigan & Wigdor, 1989; Hunter & Hunter, 1984). For instance, Ree and his colleagues (e.g., Ree & Earles, 1991) have conducted numerous studies that suggest that individuals’ g is critical in training success. Further evidence comes from reviews which report higher relationships between g and performance in complex jobs than between g and performance in simple jobs (e.g., Hartigan & Wigdor, 1989; Hunter and Hunter, 1984). Finally the literature on skill acquisition is consistent in showing that g is particularly important in early stages of task performance where a controlled mode of information processing is necessary (e.g., Ackerman, 1987). 43 In summary, because individuals with higher levels of cognitive ability are more capable of attending to and making sense of stimuli in novel situations (i.e., engaging in controlled information processing), it is certainly reasonable to expect that team members’ cognitive ability will be positively associated with levels of declarative knowledge gained through instruction and experience (i.e., learning). That is, team members with high levels of cognitive ability should have more knowledge about important aspects of the task (e.g., facts and rules) and the situation than team members with low levels of cognitive ability. Team differences in cogpitive resources. While the literature cited above focuses on between-person differences in the capacity to process information, the underlying principles are not anchored exclusively to systems at this level. Consistent with general systems theory, Norman and Bowbrow (1975) suggested that information processing principles transcend levels of analysis: “[t]he processing resources for any system are limited, and when several processes compete for the same resources, eventually there will be a deterioration of performance” (p. 44). Systems such as groups and teams engage in a number of sub-tasks or processes which consume members’ information processing resources. Groups and teams must not only (1) develop and maintain themselves but must also (2) do their required work, (3) modify themselves as a consequence of doing work (adapt), and finally, (4) manage relations with the organizational and environmental context (Argote & McGrath, 1993). Given that team members’ cognitive resources must be allocated among these different sub-tasks (since each team member should be more or less involved in each of the subtasks), it is reasonable to expect that the larger the pool of cognitive resources on a 44 team, the more likely the team should have adequate cognitive resources to allocate among these different sub-tasks. That is, teams with members who have high levels of cognitive resources should be more effective at these subtasks than teams with members who have low levels of cognitive resources. In this regard, the pool of the team members’ cognitive resources, henceforth team cognitive resources, can be conceptualized as a characteristic of the team, and therefore can be considered a team-level construct. Since adaptation is among those sub-tasks in which team members must engage a mode of information processing which relies heavily on the their capacity in terms of cognitive resources (i.e., developing and then using declarative knowledge and lower level productions), it is reasonable to expect a positive relationship between team cognitive resources and team adaptation. The notion of team cognitive resources does not suggest that aggregated scores on measures designed to tap individual’s intelligence can be used to characterize a team as being intelligent. This would necessitate consideration of group dynamics and the development of measures which reliably capture these dynamics. Instead, I suggest that the pool of team members’ cognitive resources can be thought of as a resource which influences team processes and outcomes and that aggregation is necessary simply to account for this resource. I note here that the appropriateness of the specific means of aggregation depends upon joint consideration of the attribute in question as well as the nature of the task (LePine, Hollenbeck, Ilgen, & Hedlund, 1997; Steiner, 1972). That is, the task not only determines which attributes are important for effective team processes and outcomes, but also how each attribute needs to be distributed among team members. If a task requires 45 every member to possess adequate resources in terms on an attribute, the member who is least adequate in terms of that attribute will determine the level of task performance (conjunctive task). Task performance will depend on the member who is most adequate in terms of a critical resource as long as the task is structured such that one person with adequate resources could perform effectively alone (disjunctive task). Finally, if each group member contributes to task performance in proportion to their resource level, team performance will be a function of the sum or average of team members’ resources (conjunctive task). Because there are very few studies on the nature of team adaptation, it is difficult to specify a precise means of aggregating individual attribute based predictors such a cognitive ability (and later conscientiousness and openness to experience). For instance, one could certainly argue that each member of a specialist decision making team might have non-substitutable expertise (due to high levels of specialization), and therefore, team adaptation might be conjunctive in terms of important team member resources that leads to that expertise. On the other hand, perhaps it is sufficient to have only one individual who is capable of devising a means of coping with unforeseen environmental contingencies. Thus, the task might be disjunctive in terms of critical team member resources. However, I would argue that the task a specialist decision making team faces is neither purely conjunctive nor disjunctive. I suggest that because there are good reasons to expect that adaptation has both conjunctive and disjunctive elements, perhaps the best way to represent the team in terms of member characteristics is with the additive model. This model captures scores for the highest and lowest members and has also been used in 46 the majority of studies on team composition. Thus, the additive model will be used as the primary means of aggregation in this study. However, given our current knowledge of adaptation, it is premature to rule out the alternative operationalizations. Therefore, while the primary method of aggregation will be additive (i.e., a mean), the viability of alternative means of aggregating individual characteristics in predicting team adaptation will be examined as a research question. Thus, setting the issue of means of aggregation aside for the moment, the first hypothesis is: Hmthesis 1 (H1): Team cognitive resources and team adaptation will be positively related such that teams with high levels of cognitive resources will have a higher likelihood of adapting than teams with low levels of cognitive resources. While the information processing framework proposed earlier leads one to expect a positive relationship between team cognitive resources and team adaptation, other literature might suggest otherwise. As noted previously, routines are often transferred to inappropriate situations because groups may fail to recognize changes to a familiar context or that they are in a new context entirely. This problem, however, may be particularly problematic for successful groups because they develop high levels of confidence in routines which have worked fine in the past (Gersick & Hackman, 1990). To the extent that higher levels of cognitive resources in a group leads to higher levels of performance (LePine, Hollenbeck, Ilgen & Hedlund, 1997; O’Brien & Owens, 1969; Tziner & Eden, 1985), routines that are perceived to have led to that success are 47 reinforced. In fact, a negative relationship is somewhat consistent with Anderson’s (1982, 1987) own suggestion that as productions are successfully applied, they gain strength. As individuals acquire confidence in their behavioral patterns, they tend to lower cognitive activity related to information search and receptivity (Weiss & Ilgen, 1985), thus lowering the likelihood of triggering controlled information processing (which is necessary for adaptation in teams). Following this logic, therefore, teams with high levels of team cognitive resources may be less likely to adapt than teams with low levels of team cognitive resources because contextual changes which necessitate adaptation are less likely to overcome the strength of the routine and trigger a more controlled mode of information processing. Granted, this line of reasoning does not seem consistent with the common sense notion that teams with more intelligent members should be more vigilant to changes in the environment than teams with less intelligent members. However, I could find no conceptual or empirical support for such a relationship in the literature. Instead, the information processing perspective suggests that the relationship between a team’s pool of cognitive resources and adaptation may be moderated by factors that influence the extent to which active or controlled information processing in team members is triggered. Thus, the critical question becomes what factors enhance the likelihood of triggering declarative knowledge based processing so that team cognitive resources can be marshaled for adaptation? The next section of this dissertation proposal presents a framework which should be useful in identifying these important factors. 48 Triggering Declarative Knowledge Based Information Processing Most models of human information processing generally describe how this system is controlled. These models vary widely in terms of underlying assumptions, but the primary distinction between them is that they tend to focus on either content (identifying specific factors which control attention) or process (how humans switches from one mode of information processing to another). Content of information processing control. Based on a review and integration of several literatures (primarily visual and auditory perception and speeded performance) Kahneman (1973, p. 42) concluded that the allocation of attention (the focus of information processing) is determined by “momentary task intentions of voluntary attention” (e.g., preference for attending to something as opposed to something else) and also by a “more enduring disposition which controls involuntary attention” (e.g., novel stimuli automatically attract attention). Thus, from this perspective, attention (information processing) towards a stimulus is viewed as being either on or off, and the control of attention (i.e., where information processing is directed) is determined by momentary intentions (allocation policies) and the nature of available information (novelty or salience). These two determinants of attention are not inconsistent with those suggested by most generic information processing models that do not distinguish between the modes of information processing discussed earlier. For instance, Hinsz et a1. (1997) reviewed the literature on information processing in groups and categorized the various factors that have been found to direct attention and subsequent information processing. These authors suggested that these factors either (a) suggest which types of information are relevant for 49 processing (e. g., goals, roles, norms, etc.) or (b) relate to the nature of available information itself (e.g., salience, novelty, etc.). WM As opposed to the models described above which focus on the content of information processing control, other researchers have focused on the process of control between different modes of information processing. Schneider and Shiffrin’s dual-mode theory of cognition is a good example (Schneider & Shiffrin, 1977, Shiffiin & Schneider, 1977) and is quite similar to the mode of control specified in Anderson’s ACT“ theory of skill acquisition. Schneider and Shiffrin proposed that there are two modes of information processing. Briefly, the controlled mode corresponds roughly to that in Fitts’ (1964) cognitive stage and Anderson’s (1982) declarative stage, while the automatic mode corresponds roughly to that in F itts’ autonomous stage and Anderson’s procedural stage. In this model, control between modes is determined by the familiarity of stimuli. Through practice, stimulus-responses associations are learned. In the presence of these stimuli responses are triggered automatically. Controlled processing, therefore, can occur only when stimuli do not activate these automatic responses. Anderson’s ACT" theory uses a similar conceptualization of control between modes of information processing. Essentially, declarative knowledge and lower order productions are assumed to be used only in situations where the compiled productions cannot be applied (Anderson, 1987, p. 197). That is, unfamiliar situations will not trigger productions, and therefore, people will have to rely on declarative knowledge and low level productions in order to perform in that domain. 50 m While the literatures cited above clearly suggests content and processes associated with determining a system’s mode of information processing, there is no clearly specified theory that integrates these factors. Clearly, it would be preferable to use an articulated theory to ground understanding and guide research and practice rather than to simply pick and choose concepts from these diverse literatures. Theory guided research should allow for the development of a systematic view of the phenomenon under question. Such an approach should reduce wasted effort and confusion caused by researchers who have studied similar phenomena and have come to similar conclusions but use different jargon. Using a theory to guide research should be beneficial because it increases the probability that other researchers will be able to build upon the present work. In the following section, I use control theory as a basis for developing a model that explicates factors involved in the switching between modes of information processing. As others have suggested, control theory is useful as a meta-theoretical or integrative framework (e.g., Hyland, 1988; Klein, 1989) for developing understanding of system behavior at many different levels of analysis (e.g., von Bertalanffy, 1968). The use of control theory, therefore, may allow for a parsimonious synthesis of the many factors that could be expected to influence the mode of information processing in teams. Contrpl Theog Although originally a branch of engineering, psychologists have used control theory in attempts to understand human behavior for almost a half-century (e.g., Ashby, 1952; Weiner, 1948). Because of this long history, it is not surprising that control theory comes in many difi‘erent variations (e.g., Campion & Lord, 1982; Carver & Scheier, 51 1981; Hollenbeck, 1989; Hyland,.l988; Klein, 1989; Powers, 1973; Taylor, Fisher & Ilgen, 1984). Despite these variations, however, the underlying foundation of control theory is the negative feedback loop. In its most basic form, control theory proposes that behavior is regulated by a negative feedback loop. The term negative is used in reference to this loop because the control system is intended to negate or reduce perceived deviations from a standard, and not because the discrepancy is negative in a normative sense of the word (i.e., bad) (Carver & Scheier, 1982). Inputs that are sensed from the environment (which itself may have been influenced by the system’s behavior as well as its own influence separately from the system’s behavior) are compared to a referent standard or goal. If this comparison process detects a discrepancy or error, it signals the system to take action in order to reduce the discrepancy or error. The system acts on this signal and then monitors the impact of this action from information gathered fiom the environment. If that discrepancy remains, the system sends another error signal, the system then takes action, and so on. In most conceptualizations of control theory, this sensing--comparing--acting process continues until the discrepancy or error is eliminated or reduced significantly. Applicatipn to a wide variety of systems. As von Bertalanffy (1968) points out, negative feedback schemes exist in electro-mechanical as well as in organic systems. The most popular example of a mechanical system is the thermostat controlling the temperature of a room (e.g., Carver & Scheier, 1981; Klein, 1989). A desired temperature is set and a sensor monitors the room’s ambient temperature. If the room’s temperature deviates from that which is set, a furnace or air conditioner will activate and operate until the desired temperature is reached. An organic example includes thermoregulation in 52 warm blooded animals (Carver & Scheier, 1981; von Bertalanffy, 1968). If the temperature of blood in warm blooded animals drops below a certain temperature, the brain activates heat producing mechanisms in the body (e.g., shivering) until normal temperature is reached. Of course, in the area of applied psychology, control theory has been used to explain observable human behavior with an emphasis on motivational processes (e. g., Campion & Lord, 1982; Hollenbeck, 1989; Hollenbeck & Williams, 1987; Keman & Lord, 1990; Taylor et al., 1984). As a generic example, if a salesperson senses that there is a discrepancy between his or her sales performance and quota, he or she may engage in some sort of behavior (e.g., work harder to achieve quota, argue that the quota is too high) or cognition (e.g., reject the feedback, change the goal) in order to reduce the perceived discrepancy. Most recently, control theory has been used in the applied psychological and organizational literatures as a meta-theory that integrates other theories of motivation (e.g., Hyland, 1988; Klein, 1989). Hyland (1988) used control theory to compare elements fi'om a number of basic motivational theories (i.e., Atkinson, 1957; Deci & Ryan, 1985; Locke, 1981; Murray, 1938; Weiner, 1980). Klein (1989) took a similar, but more applied approach by integrating work done by researchers primarily in the domains of organizational behavior and industrial and organizational psychology (e.g., Hollenbeck, 1989; Hollenbeck & Brief, 1988; Lord & Hanges, 1987; Taylor et al., 1984). Both Hyland and Klein reached the conclusion that most theories of motivation focus on different aspects of the underlying control process. 53 Although not the focus of current research in the organizational or applied psychological literatures, it is also reasonable to assume that control systems operate in higher-order systems such as groups, teams and even organizations. Indeed, Cyert & March’s (1992) view of the firm (as preferring some states to others and using decision rules to bring itself closer to those states when it senses discrepancies between those preferred states and the situation), closely parallels most conceptualizations of control theory focusing on behavior in lower order organic and non-organic systems. Furthermore, since control theory specifies the mechanism which links behavior at multiple hierarchical levels, it is highly useful as a framework for studying behavior in group and organizational systems. Hierarchical structure of control loops. A long line of research recognizes that purposes, standards, or goals are hierarchical-~that is, purposes, standards, or goals are often means of attaining other higher order purposes, standards, or goals (Barnard, 1938; March & Simon, 1992; Murray, 1938). Barnard (1938, p. 232) for instance, recognized this when he stated that one function of executives is to redefine and modify purposes “level after level”. Control theory acknowledges this structure by maintaining that the means of reducing discrepancies in higher order feedback loops become standards in lower-level loops (Carver & Scheier, 1982; Hyland, 1988; Klein, 1989; Powers, 1973). I should note that the majority of research on control theory focuses on negative discrepancies. Indeed, this focus can probably be blamed for the fallacious stereotype that control systems either proceed toward an endpoint or function simply to maintain a steady state (Carver & Scheier, 1982). In fact, however, the specification of hierarchical control loops allows for explanation of reactions to positive discrepancies as well as 54 negative discrepancies. Specifically, responses to achievement or over-achievement of lower order goals depend on the nature of the higher order goal from which the lower order goal originated. For instance, if a salesperson has a higher order goal of “striving for excellence”, he or she may set personal sales goals which are higher than the assigned quota after exceeding this quota. The issue of positive discrepancies, however, is not highly relevant to this dissertation because team adaptation, as defined earlier, is conceptualized as a response to a negative discrepancy (i.e., the perceived lack of fit between the team’s structure and the situation). While it is worthwhile to study the problem of how to make successful teams continuously strive for excellence through positive discrepancy creation, this is a different issue--one that will not be addressed in this dissertation. One important aspect of control theory is that discrepancy reduction does not require active or controlled information processing at all levels of the control-loop hierarchy. Indeed, it is widely believed that individuals have a set of well learned “programs” (lower order negative feedback loops) that they automatically invoke when faced with familiar types of discrepancies. As long as perceived discrepancies are such that they evoke these programs, controlled information processing is not necessary. For instance, a salesperson may automatically nod with agreement and say “uh-huh” when interacting face to face with important potential customers. However, when discrepancies are not associated with a learned response, or when learned responses no longer decrease discrepancies, active attention focuses on devising means of addressing the discrepancy. For instance, if the potential customer rolls her eyes every time the salesperson says “uh-huh”, the salesperson may notice and sense the need 55 to devote some active attention towards devising an alternative strategy (assuming saying “uh-huh is the only strategy the salesperson knows). Whatever the alternative strategy entails, he or she will then attend to information provided by feedback to assess the extent to which the strategy is succeeding. Until this new strategy becomes proceduralized (as happens when strategies are repeatedly successful), controlled information processing will be necessary to self-regulate in this specific control loop. This conceptualization is very similar to Wood and Locke’s (1990) notion that individuals will attempt to develop new task specific plans (through study, research creative problem solving, trial and error, etc.) when stored universal plans (directing increased effort or persistence towards the task) or stored task specific plans (task specific skills) are not applicable to a task/goal situation. Inappropriate routine as control system failure. As stated previously, routine behavior in groups can be characterized by mindlessly repeating patterns of behavior in a given stimulus situation without consciously considering alternatives (Gersick & Hackman, 1990). Given this description, therefore, it would seem that the inappropriate engagement of routine behavior (i.e., failure to adapt) can be conceptualized in terms of failure in a negative feedback system to detect situations that should not be associated with programs, scripts or proceduralized responses. Assuming this to be a reasonable assumption, the question now becomes, what aspects of a control system would facilitate such a failure? Alternatively, what factors evoke or activate controlled information processing? In Wood and Locke’s (1990) terms, what triggers the development of new specific task plans when stored universal plans or stored task specific plans are no longer appropriate? 56 A variety of researchers, some squarely in the domain of control theory, have speculated on the determinants of controlled information processing (e. g., Carver and Scheier, 1981; Lord & Hanges, 1987; Taylor et al., 1984). While these authors differ somewhat in their primary focus, in the aggregate they suggest at least three factors are involved; (a) the nature of the standard or goal, (b) the nature of the feedback which is used in the comparison with the standard or goal, and finally (c) the nature of information provided by the problem which makes adaptation necessary in the first place. The next three sections of this proposal will briefly review these factors. Ms As various researchers have pointed out, reference standards include goals (Carver & Scheier, 1981; Klein, 1989; Powers, 1973) that may relate to end states, rates of progress towards an end state, a non-terminal activity (e. g., self-improvement), or emotion (Hyland, 1988). Although distinct fiom one another, each serves as the criterion against which perceptual inputs are compared, and as a group play an important role in the performance effectiveness of individuals (Locke, Shaw, Saari, & Latham, 1981). In essence, goals direct attention. “[P]eople are bombarded with information of every sort, but they act only in response to a small segment of it, namely that segment which they decide is relevant to their own life interests and goals” (Latharn & Locke, 1991, p. 225). In information processing terms, specific and difficult goals serve as objectives that influence the focus of information processing. In Kahneman’s (1973) terms, specific and difficult goals influence momentary intentions which, in turn, determine how cognitive resources are allocated. 57 :tpn “racer I knit ~ Wart AI ‘8 a" hen Goals have a major influence on the mode of information processing because discrepancies may necessitate the development of strategies in order to narrow the gap between the goal and present standing (Campbell & Gingrich, 1986; Earley, Northcraft, Lee & Litcuhy, 1990; Earley & Perry, 1987; Early, Wojnaroski, & Prest, 1987; Latham & Saari, 1982; Locke, Frederick, Buckner, & Bobko, 1984; Mitchell & Silver, 1990; Wood & Locke, 1990). That is, when increasing effort or concentration (stored universal plans) in well learned activity (stored task specific plans) does not result in error/discrepancy reduction, attention shifts towards learning how to achieve goals in light of the situation for which there are no scripted responses (Kluger & DeNisi, 1996). This type of learning consists of controlled search and experimentation and thus draws on declarative knowledge and lower order productions (new task specific plans). A great deal of research supports the conclusion that given adequate ability and commitment, specific and difficult goals lead to higher individual-level performance than easy or vague goals. This conclusion appears to be especially valid for performance in well learned (Kanfer & Ackerman, 1989) and less complex (Wood & Locke, 1990) tasks than for performance during skill acquisition and in highly complex tasks. Goal specificity is important because vague goals are compatible with too many outcomes and thus lead to ambiguity concerning what constitutes effective performance (Latham, & Locke, 1991). As Klein (1989, p. 154) suggests, “[v]ague goals make poor referent standards because there are many situations in which no discrepancy would be indicated and, therefore, there would be no need for corrective action (Campion & Lord, 1982)”. Goal difficulty is important because individuals adjust their effort to the difficulty of the task (Latham & Locke, 1991 ). In control theory terms, the more difficult the goal, 58 the more effort is required to avoid errors (Klein, 1989; Lord & Hanges, 1987). In addition, the more difficult the goal, the more likely discrepancies will be large (Campion & Lord, 1982). This should not only make discrepancies more salient, and thus more likely to be perceived, but should also make it less likely that discrepancies will be dismissed as insignificant. Most research on goal setting is concerned with individual-level relationships (Locke & Latham, 1990), however, there is also research which has examined the relationship between goals and group-level performance (e.g., O’Leary-Kelly, Martocchio, & F rink, 1994; Pritchard, Jones, Roth, Stuebing & Ekeberg, 1988; Saavdera, Barley & Van Dyne, 1993; Weingart, 1992; Weingart & Weldon, 1991; Weldon, Jehn & Pradhan, 1991; Weldon & Weingart, 1988). Conceptually, group-level research on goals is more complex than individual-level research because, as Zander (1980) notes, there are different levels of goals within a group (e. g., the goal for the group, each member’s own goal as a group member). However, this apparent complexity is reduced if one accepts the hierarchical structure specified by control theory. Specific sub-goals which regulate individual team members’ behavior (e. g., being responsive to requests from team mates, making useful recommendations to leaders, etc.) result from their acceptance of a team- level goal as one of their higher order goals (e. g., producing a product safely). This effect was confirmed in a laboratory study using an idea generation task (Weingart & Weldon, 1991). In this study, individual members were more likely to set individual-level goals when they were assigned group goals. To an individual team member, a team-level goal is just like any other higher order goal which regulates aspects of their behavior—the only difference being that this goal is more or less shared with the other members of the team. 59 This conceptualization is consistent with Zander (1971) who suggests that self-set individual goals mediate the relationship between group-level goals and group performance effects. Zander suggests that such effects should be especially true when team members perceive that their “personal activity is more relevant to the work of the group” (p. 198). Thus, this type of individual-level goal setting should occur in specialist decision making teams because these teams are characterized as having cooperative interdependence. Since, team members’ roles are integrated into a system of activity which results in team-level outcomes, improvement in individual-level role performance should translate into improvements in team-level processes and outcomes (Weingart & Weldon, 1991; Weldon et al., 1991). For instance, in a laboratory experiment using a production task, Weldon, et al., (1991) found that when groups were assigned a difficult goal, individual members developed more efficient strategies for their individual role than members in teams assigned easier goals. These authors also found that this increased efficiency resulted in improved group performance. Figure 3 illustrates this conceptualization of the effect of group-level goals. At the top of this figure is the team goal. This goal may be explicit (e.g., management assigning the team a specific and difficult performance goal) or implicit (e.g., assuming a goal based on the team’s purpose), however, it is this goal that members more or less share (depicted by the boxes labeled Member X Team Goal). From these goals and a basic understanding of their task, team members establish sub-loops related to their roles as they understand them (e.g., acquiring and exchanging information in a timely manner). 60 / Memher A Team Goal Comparator Member A Subgoals Team Goal or Purpose Member B Comparator The primary implication of this conceptualization is that the nature of team-level Team Goal Member B Subgoals \ Memher C Team Goal Comparator Member C Subgoals Environment Figure 3 - Hierarchical Goal Structure In Teams 61 goals ultimately influence the nature of sub-goals that guide team members’ behavior and information processing. That is, difficult team-level goals should translate into sub-goals that are difficult and easy team-level goals should translate into sub-goals that are easy. Thus, when teams have difficult goals, environmental disturbances that disrupt the effectiveness of team members’ role performance should be more likely to result in perceived discrepancies in the comparator process related to the sub-loop than when teams have easy goals. Again, given a specific performance level, difficult goals necessarily lead to a higher probability of negative performance-goal discrepancies than easy goals. A negative discrepancy in the comparator process, in turn, should trigger the prob L11" 5“ men: search for a cause and solution to reduce the discrepancy. Individuals in teams with difficult goals, therefore, should be more likely to recognize an environmental disturbance as a problem that must be dealt with than individuals in teams with easy goals. When no scripted responses or programs are available to deal with such problems, the type of controlled information processing necessary for adaptation should be triggered. Accordingly, I expect that team adaptation will be higher in teams that have difficult goals than in teams that have easy goals. I should note two caveats to this discussion. First, it is unlikely that adaptation will increase in teams where goals are too difficult. This expectation is consistent with the literature that suggests that if individuals’ expectancies regarding their ability to overcome discrepancies is too low, they may withdraw from the situation instead of engaging in discrepancy reduction attempts (Carver & Scheier, 1982). In most goal setting interventions, however, the intent is to set goals that are difficult but achievable, and thus, in most real world situations, severe expectancy reduction should not be a problem. This follows fiom the notion that since goal setting interventions are normally intended to be motivational, it is unlikely that managers or policy makers will intentionally set goals that are de-motivating. Of course, events not under team members’ control may occur which may make goal achievement extremely difficult. However, such situations should be obvious to everyone involved and would seem to result in the goal of doing one’s best to achieve the stated goal in light of the difficult situation. This dissertation focuses on difficult goals which are achievable, even after an unexpected event makes the goal more difficult, and therefore avoids having to deal with specifying possible curvilinear relationships. 62 Second, goals which are too specific may cause individuals to focus their attention on aspects of the task situation which, almost necessarily, perpetuate routine. Goals that focus on processes (e.g., gathering and making decisions based on information A, B and C) instead of the ultimate criterion (e. g., a correct decision) are be particularly problematic in this regard in unstable environments (e. g., due to changes in technology the correct decision becomes a function of A, B and D). This should be particularly true for the types of teams studied in this dissertation. That is, when teams do not play a role in the establishment of their own purpose, their being given a goal, in a sense, becomes their purpose. Since, by definition, these teams cannot change their purpose, it is problematic to expect they will change it. More colloquially, imposition of a purpose related to “how something should be done” will result in the team members striving to do that something “how it should be done”. This dissertation, therefore, will focus on performance goals related to the team’s purpose (for being) and not on goals related to process. For example, if a team is created and exists to make machine toolparts, their performance goal will be stated in terms of some criterion related to making tool parts. Therefore, with these two caveats in mind, I expect that: Hymthesis 2a (32a): Goal difficulty and team adaptation will be positively related such that the likelihood of adaptation will be higher in teams that have difficult performance goals than in teams that have easy performance goals. In addition to this hypothesized influence of goals on team adaptation, I expect that the nature of team goals should also moderate the relationship between team 63 cognitive resources and team adaptation. That is, a team’s pool of cognitive resources should relate more positively to adaptation in teams with difficult goals than in teams with do your best goals because the use of declarative knowledge and lower order productions should result in higher requirements in terms of this resource. More specifically: Hymthesis 2b (H_2b): The relationship between the team cognitive resources and adaptation will be stronger in teams that have difficult performance goals than in teams that have easy performance goals. Feedback Task feedback can be defined as information concerning task performance received from different sources including others, the task environment, or even from within the individual him or herself (Ilgen, Fisher, & Taylor, 1979). Research interest in the relationship between task feedback and performance has been extensive, however, there has been little theory linking feedback to psychological processes (Ilgen, et al., 1979). The most recent review and theoretical effort sheds some light on this issue and proposes that feedback affects the locus of attention and is critical in control processes which involve learning, motivation and meta-tasks 0(luger & DeNisi, 1996). Returning to the control loop illustrated in Figure 2, it is apparent that the comparator process necessitates information that can be related to a referent standard or goal. Indeed, the notion that feedback is necessary in the evaluation of performance relative to standards is also consistent with the views of social cognitive theory (Bandura, 64 1991), learned helplessness theory (Mikulincer, 1994), and goal-setting theory (Locke & Latham, 1990). Among the most important characteristics of feedback is its informational value. The informational value of feedback can be referred to as feedback quality and refers to the extent to which it provides meaningful information about the “correctness, accuracy or adequacy of the response” (Ilgen, et al., 1979). Without feedback that contains such information, individuals may be biased towards believing that their state is consistent with expectations (Taylor, et al., 1984). Feedback with high quality should be ti_mgy and be smpjfip so as to be unambiguous in meaning. If feedback is m and summarized, the information provided may be ambiguous, and thus, cognitive resources (that might otherwise be allocated towards adaptation) must be allocated towards “sorting things out”. In addition, low quality feedback might perpetuate the triggering of scripted behavior in team members (and perpetuate routine in teams) because there is less indication that programmed responses are inappropriate or that changes to established routines are worth making. Returning to figure 4, when a team member’s comparator process notes a discrepancy in the sub-goal control loop for which there is no programmed response, the member will refer to his or her standing in regards to the higher order goal related to overall team performance. This implies that individuals in teams with a high quality of performance feedback should be more likely to recognize environmental disturbances as problems that need to be addressed than individuals in teams with low quality ' performance feedback. If high quality performance feedback is available and discrepancies are noted or anticipated, controlled information processing may be 65 triggered in order to develop means of decreasing this discrepancy. Therefore, since the triggering of controlled information processing is an important element of adaptation: Hymthesis 3a (H3a): The quality of performance feedback (timeliness and specificity) and team adaptation will be positively related such that teams with high quality feedback (timely and specific) should be more likely to adapt than teams with low quality feedback (delayed and summarized). In addition to the hypothesized influence of performance feedback on team adaptation, I expect that the quality of performance feedback should also moderate the relationship between team cognitive resources and team adaptation. Because the presence of high quality feedback should be more likely to trigger controlled (information, a team’s pool of cognitive resources should relate more positively to adaptation in teams that receive timely and specific performance feedback than in teams that receive delayed and summarized performance feedback Hyppthesis 3b (33b): The relationship between the team cognitive resources and team adaptation will be stronger in teams that receive high quality performance feedback than in teams that receive low quality performance feedback. Numerous researchers have concluded that both goals and feedback related to those goals are necessary for system effectiveness (e.g., Bandura & Cervone, 1983; Becker, 1978; Klein, 1989; Taylor et al., 1984). Stated simply, feedback has more 66 meaning when it can be compared against specific goals and vice versa. Thus, while there is some evidence concluding that feedback in the absence of goals may cue spontaneous goal setting (Ammons, 1956) and that goals in the absence of feedback may cue active feedback seeking (Ashford & Cummings, 1983), it is likely that triggering of controlled cognition, and thus adaptation, will be highest when difficult goals are coupled with timely and specific feedback related to those goals. Hymthesis 4a (H4a): Team adaptation is an interactive function of the difficulty of team performance goals and the quality of performance feedback such that adaptation will be more likely in teams that have difficult performance goals along with high quality performance feedback related to those goals than in teams with easy performance goals and low quality performance feedback. In addition to the hypothesized joint influence of team performance goals and feedback on team adaptation, I expect that these factors should also moderate the relationship between team cognitive resources and team adaptation. Because the joint presence of difficult team performance goals and high quality feedback should be especially likely to trigger a mode of information processing in team members that relies on their declarative knowledge and lower order productions, a team’s pool of cognitive resources should relate more positively to adaptation in teams which receive difficult team performance goals and high quality feedback than in teams that do not receive diflicult team performance goals and/or quality feedback related to those goals. 67 Hymthesis 4b (fl4b): Team adaptation is an interactive function of the difficulty of team goals, quality of feedback, and team cognitive resources such that the likelihood of adaptation will be highest in teams with high levels of cognitive resources, difficult goals, and high quality feedback. Na_ture of Environmthal Disturbance In the previous two sections I used control theory to describe how the nature of team goals and feedback influence the extent to which controlled cognition in individual team members is triggered and how these factors impact team adaptation. In addition, however, the nature of the environmental disturbance that makes a routine inappropriate also plays an important role in determining the extent to which controlled cognition in individual team members is triggered in an attempt to overcome it. In terms of triggering controlled cognition in individuals, outcomes of the self- regulatory comparison process (between goals and feedback) must not only suggest that there is an error or discrepancy for which there is no programmed response, but also that the outcome of the comparison must also suggest that the error or discrepancy is something that must be actively addressed. That is, in order to trigger the search for and implementation of new ways of doing things once a routine is established, there must not only be an indication of a problem, but the problem has to stand out against the backdrop of other information that may suggest that things are all right or will be all right in the near term (Weiss & Ilgen, 1985). Individuals in teams may well expect occasional errors or discrepancies due to bad luck or simple mistakes. Because perfect reliability or stability is not expected, not all 68 problems will cause increased cognitive activity directed towards search for causes and solutions. In these situations, errors or discrepancies will be attributed to unstable causes, and therefore, programmed responses will be deemed appropriate. In a sense, the response of doing nothing in such situations is simply another well learned or proceduralized program that is evoked in situations where there are occasional disturbances or errors for which no other programmed response is available. The implication of this idea is that if problems are to attract attention, they must suggest unambiguously that active attention is necessary (i.e., the environment has changed) rather than just something temporary that will work itself out on its own! Among the most important aspects of problems in regards to the likelihood that they will trigger controlled information processing, therefore, is the extent to which change appears abruptly rather than gradually. Mum changes to the situation that make routines inappropriate may be characterized in a number of different ways. For instance, change can occur as consistent minor inconsistencies gradually build up (e.g., seemingly unrelated minor improvements to technology which are later integrated into a revolutionary new product). Change to the situation can also occur as intermittent disruptions (e. g., power fluctuations in a critical piece of command and control communications equipment that result in messages that occasionally unreadable) eventually stabilize. In the former case, the change may be too minor to be perceived. In the latter case, the change may be noticed but it may be perceived as too random to address using anything but scripted responses or programs (e.g., ignoring it). Thus, in both cases, the likelihood of triggering controlled cognition aimed at addressing the problem is reduced. In both situations the environmental change 69 does not dominate their attention over other aspects of the situation that suggests the situation is all right. In other words, the change in the situation is not salient to team members. Abrupt changes to the situation not followed by signs that the situation will return to normal (e.g., the introduction of a new technology that will obviously revolutionize an industry, a critical piece of command and control communications equipment catching on fire) should increase the likelihood that team members will perceive that the situation has changed and something needs to be done. Accordingly, team members should apply their declarative knowledge and lower order productions in order to address the errors or discrepancies caused by the change. Since this type of information processing in team members is necessary for team adaptation: Hyppthesis 5a (flSa): The nature of the environmental disturbance necessitating adaptation will be related to team adaptation such that teams will be more likely to adapt when the environmental disturbance is abrupt rather than when the environmental disturbance is gradual In addition to the hypothesized influence of the nature of the environmental disturbance (that necessitates adaptation) on team adaptation, I expect that the nature of the environmental disturbance will also moderate the relationship between team cognitive resources and team adaptation. A team’s pool of cognitive resources should relate more positively to adaptation in teams that experience abrupt environmental disruptions than in teams that experience gradual environmental disruptions because abrupt changes to the 70 situation should be more likely to trigger a mode of information processing in team members that relies on their declarative knowledge and lower order productions: Hymthesis 5b (35b): The relationship between the team cognitive resources and adaptation will be stronger in teams where there is an abrupt environmental disturbance than in teams where there is a gradual environmental disturbance. The predictions regarding the effect of goals, feedback, and the nature of environmental disturbances on team adaptation come from fairly straightforward applications of control theory. Essentially, these three factors are all hypothesized to influence the extent to which outcomes of individual team members’ comparator process trigger the search for a new way of doing the task based on declarative knowledge and lower order productions versus simply evoking programs, scripts, or proceduralized responses. In the following section, however, a complicating issue is introduced-- alternative reactions to salient problems. Alternative Reactions to Disturbances One important issue that complicates the fiamework outlined above is the fact that team members may rely on cognitive modes of discrepancy reduction (i.e., abandoning the standard, changing the standard, or rejecting the feedback message) instead of the behavioral modes (actively engaging in new behaviors to address the negative discrepancy) necessary for adaptation (Kluger & DeNisi, 1996). Among factors that may influence this process is team members’ personality. Personality traits can be thought of as labels for characteristic tendencies, and research suggests that “conscientiousness” and 71 “openness to experience” influence how individuals respond to performance-goal discrepancies. In this section, I describe these characteristics and the argue that the composition of teams in terms of these characteristics is an important factor for team adaptation. Team conscientiousness resources. Among personality variables, conscientiousness has received the most support as a predictor of performance across a wide variety of settings. At the individual level of analysis, Barrick and Mount’s (1991) meta-analysis found that conscientiousness related to ratings of job and training proficiency as well as personnel data across 5 occupational groups with an estimated E of .22. Perhaps more relevant to the present research is Hough’s (1992) large scale study which found that two traits associated with conscientiousness (achievement and dependability) were related to ratings of teamwork (; = .14 and .17 respectively). At the group level of analysis, there has been far less research on conscientiousness, and what exists is fairly mixed. Barry and Stewert (1997), for instance, found that the average level of conscientiousness in 63 self managed (four or five person) MBA work groups did not relate to any group-level dependent variable (i.e., task focus, open communications, group cohesion, and performance). LePine et al., 1997), however, found that conscientious was important (explaining twenty-one percent of the variance) in the performance of laboratory teams performing a decision making task. The differences in these findings may be due to a number of factors including the nature of the teams (intact self-managed MBA teams versus concocted laboratory teams), their task (three analytic tasks with no correct answers versus a decision making task with correct answers), the scales used to measure conscientiousness (Goldberg’s (1992) loo-adjective 72 unipolar five factor instrument versus the Costa and McCrae’s (1992) NBC PI-R), how the composition variables were created (proportion of group members scoring high on the trait versus using the lowest team members’ score), and the criterion (instructor ratings of performance on three analytic problem solving tasks with no correct answer versus objective measure of decision accuracy operationalized as mean absolute error). Given the differences between these studies it is difficult to draw many conclusions regarding the role of conscientiousness on team processes and outcomes. However, this does not mean that conscientiousness is unimportant in teams or that research addressing the role of conscientiousness in teams should be avoided. Instead, I argue that the role of conscientiousness in teams should be investigated, but that instead of specifying relationships at the team level based solely on generalizations fiom the individual-level, specification should come from carefully considering the nature of the trait and the criterion under consideration. The essence of conscientiousness includes dependability (being careful, thorough, responsible, organized and planful) and volition (hardworking, achievement-oriented, and persevering) (Barrick and Mount, 1991). Conscientiousness individuals are proactive and striving, they generally have a high need for achievement, and they also tend to be committed to their work (Costa, McCrae, and Dye, 1991). Conscientiousness relates to whether or not individuals tend to set goals for themselves (Jackson, 1974), the difficulty of goals set for themselves (Hollenbeck and Williams, 1987; Steers, 1975), and the extent to which individuals tend to be committed to their goals (Hollenbeck, Klein, O’Leary, and Wright, 1989). 73 Based on the description of conscientiousness in the previous paragraph it is reasonable to expect that conscientious individuals should tend to stay committed to goals in the face of discrepancies resulting in the comparator process, and therefore they should be more likely to engage in active behavioral modes of discrepancy reduction (as opposed to cognitive modes of behavioral reduction), than individuals who are less conscientious. Thus, as with cognitive ability, team members’ conscientiousness may be thought of as a resource that is beneficial to teams in terms of their tendency to adapt to changing conditions. In this regard, the pool of the team members’ conscientiousness, henceforth, team conscientiousness resources, can be conceptualized as a characteristic of the team, and therefore, may be considered a team level construct. Specifically, teams with conscientious members should tend to react to problems, errors, or discrepancies behaviorally instead of cognitively. Since such an approach to discrepancy reduction is necessary for adaptation, teams with high conscientiousness resources should be more likely to adapt than teams with low conscientiousness resources. Again, as with team cognitive resources, I do not mean to suggest that aggregated scores of some measure designed to tap conscientiousness can be used to characterize teams as conscientious in the sense that the team is dependable or motivated. Instead, I suggest that teams can be characterized in terms of the level of their members’ conscientiousness and that between team differences in this resource have important implications for team level adaptation (because team conscientiousness resources influence the extent to which behavioral as opposed to cognitive responses to discrepancies, problems, or errors are triggered). 74 As with team cognitive resources, I offer hypotheses relating team conscientiousness resources to team adaptation assuming an additive model but acknowledging that other Operationalizations may be appropriate. Thus, the issue of aggregation is posed as a research question. Hymthesis 6a (H63): Team conscientiousness resources and adaptation will be positively related such that teams with high levels of conscientiousness resources will be more likely to adapt than teams with low levels of conscientiousness resources. In addition to this hypothesized relationship, however, I also expect that team conscientiousness resources will also moderate the relationship between team cognitive resources and team adaptation. This expectation follows from the notion that while a team’s pool of cognitive resources may be critical in the search for and implementation of alternative means of accomplishing the team’s purpose, this pool of resources will be relatively unimportant if team members invoke cognitive means reducing discrepancies (e. g., lowering the standard, withdrawing from the situation, etc.). More specifically, a team’s pool of cognitive resources should relate more positively to adaptation in teams with high levels of team conscientiousness resources than in teams with low levels of team conscientiousness resources because behavioral means of discrepancy reduction should be more cognitive resource dependent than cognitive means of discrepancy reduction. Therefore: 75 Hypothesis 6b (I_-_I6b): The relationship between team cognitive resources and adaptation will be stronger for teams with high levels of team conscientiousness resources than for teams with low levels of team conscientiousness resources. Team omnness resources. Relative to conscientiousness, openness to experience is less well understood (Barrick & Mount, 1991). This dimension, also referred to as intellect (Digrnan, 1988; Peabody & Goldberg, 1989), inquiring intellect (D. Fiske, 1949), culture (Norman, 1963), and intelligence (Borgatta, 1964; Cattell, 1957; Hogan, 1986). Openness to experience includes traits such as imagination, culture, curiosity, originality, broad-mindedness, intelligence and artistic sensitivity (Barrick & Mount, 1991). At first glance, Openness to experience might sound suspiciously like cognitive resources described earlier. Research, however, has found only moderate relationships (correlations ranging from .20 to .30) between scales that measure these two concepts (McCrae & Costa, 1987). Although openness to experience has not been found to relate positively to individual-level performance, there is a strong indication that it is an important predictor of training proficiency (Barrick & Mount, 1991). This effect has been attributed to the fact that people who are open to experience are more likely to “have positive attitudes toward learning experiences in general” (Barrick & Mount, 1991, p. 19). That is, these individuals may be more willing to engage in the type of self-monitoring and assessment that is necessary in learning situations. Mche (1987) suggests that openness to experience is strongly related to divergent thinking and creativity. Individuals who are 76 open to experience are generally more willing to explore alternatives which diverge from the normal routine. Errors, discrepancies, or problems should be interpreted by individuals who are open to experience as opportunities to learn or be creative, and not something that is necessarily dreadful or threatening to the self. These individuals, therefore, should be less likely to engage in cognitive responses (i.e., changing the standard, abandoning the goal, rejecting feedback) than those who are not open to experience. Since behavioral approaches to discrepancy reduction are necessary for adaptation in teams, teams with members who have high levels of openness to experience should be more likely to adapt than teams with members who have low levels of openness to experience. In this regard, the pool of the team members’ openness to experience, henceforth, team openness resources, can be conceptualized as a characteristic of the team, and therefore, is considered a team level construct. As with team cognitive resources and team conscientiousness resources, I do not mean to suggest that aggregated scores of the individual concept mean the same thing as the disaggregated scores. Instead, I suggest that teams can be characterized in terms of their members’ openness to experience and that between team differences in this resource has important implications for team adaptation. That is, team openness resources influence the extent to which behavioral as opposed to cognitive responses to discrepancies, problems, or errors are invoked. Also, as with team cognitive and conscientiousness resources, I offer hypotheses regarding the relationship between openness resources and adaptation, but I examine means of aggregation as a research question. 77 Hymthesis 7a (H7a): Team openness resources and team adaptation will be positively related such that teams with high levels of openness resources will be more likely to adapt than teams with low levels of openness resources. As with team conscientiousness resources, I also expect that team openness resources will also moderate the relationship between team cognitive resources and team adaptation. This expectation follows from the notion that while team cognitive resources may be critical in undertaking behavioral means of addressing discrepancies, these resources will be relatively unimportant if team members invoke cognitive means reducing discrepancies. Therefore: Hymthesis 7b (H7b): The relationship between team cognitive resources and adaptation will be stronger for teams with high levels of team openness resources than for teams with low levels of team openness resources. SM and Hypptheses The use of specialist decision making teams in organizations is increasing. Because these teams do their work by making a stream of recurring decisions, they are particularly susceptible to the problem of maintaining a routine in the face of some change in the environment which makes the routine inappropriate. To date, however, there has been little research on how teams adapt to such change. The purpose of this dissertation, therefore, is to develop a model of some factors that influence team 78 adaptation (defined as reactive and non-scripted adjustments to a team’s role structure that result in a better fit given the new situation). Consistent with information processing as an underlying theoretical framework and a recognition that this framework can be applied to groups and teams, routine and adaptation can be understood in terms of the type of knowledge that controls information processing and behavior. Consistent with Cohen and Bacdayan (1996), routines are conceptualized in terms of a system of reciprocally triggered procedural knowledge among team members. Adaptation, on the other hand, requires the application of team members’ declarative knowledge and lower order productions. Among the most important implications of this framework is the notion that the latter form of information processing relies heavily on team members’ cognitive resources. A second implication, however, is that in order for team adaptation to occur, team members’ information processing must switch from a procedural knowledge based mode to a mode based on declarative knowledge and lower order productions. Control theory is used as a basis for identifying three factors that should facilitate triggering the second information processing mode. Specifically, I hypothesized that specific and difficult team performance goals, high quality performance feedback, and abrupt environmental disturbances make discrepancies, errors, or problems salient, and thus, increase the likelihood of triggering declarative knowledge or lower order production based information processing in team members. One complicating factor is that while behavioral change is necessary for team adaptation, members may respond to ' discrepancies, errors, or problems by cognitive means (e. g., abandoning or lowering goals, withdrawing from the situation). Among critical factors in avoiding such cognitive responses, however, are team members’ commitment to their goals and their willingness 79 to explore alternatives which diverge from the norm. Team members’ conscientiousness and openness to experience, therefore, should be important in ensuring teams respond to environmental disruptions through adaptation. In summary, I present the following hypotheses: Hyppthesis 1 (H1): Team cognitive resources and team adaptation will be positively related such that teams with high levels of cognitive resources will have a higher likelihood of adapting than teams with low levels of cognitive resources. Hymthesis 2a (H2a): Goal difficulty and team adaptation will be positively related such that the likelihood of adaptation will be higher in teams that have difficult performance goals than in teams that have easy performance goals. Hymthesis 2b (H2b): The relationship between the team cognitive resources and adaptation will be stronger in teams that have difficult performance goals than in teams that have easy performance goals. Hyppthesis 3a (33a): The quality of performance feedback (timeliness and specificity) and team adaptation will be positively related such that teams with high quality feedback (timely and specific) should be more likely to adapt than teams with low quality feedback (delayed and summarized). 80 Hyppthesis 3b (H3b): The relationship between the team cognitive resources and team adaptation will be stronger in teams that receive high quality performance feedback than in teams that receive low quality performance feedback. Hypothesis 4a (H4a): Team adaptation is an interactive function of the difficulty of team performance goals and the quality of performance feedback such that adaptation will be more likely in teams that have difficult performance goals along with high quality performance feedback related to those goals than in teams with easy performance goals and low quality performance feedback. Hyppthesis 4b (34b): Team adaptation is an interactive function of the difficulty of team goals, quality of feedback, and team cognitive resources such that the likelihood of adaptation will be highest in teams with high levels of cognitive resources, difficult goals, and high quality feedback. Hyppthesis 5a (HSa): The nature of the environmental disturbance necessitating adaptation will be related to team adaptation such that teams will be more likely to adapt when the environmental disturbance is abrupt rather than when the environmental disturbance is gradual Hyp_othesi§ 5b (HSb): The relationship between the team cognitive resources and adaptation will be stronger in teams where there is an abrupt environmental disturbance than in teams where there is a gradual environmental disturbance. 81 Hyp_othesis 6a (H6a): Team conscientiousness resources and adaptation will be positively related such that teams with high levels of conscientiousness resources will be more likely to adapt than teams with low levels of conscientiousness. Hymthesis 6b (H6b): The relationship between team cognitive resources and adaptation will be stronger for teams with high levels of team conscientiousness resources than for teams with low levels of team conscientiousness resources. Hyppthesis 7a (fl7a): Team openness resources and team adaptation will be positively related such that teams with high levels of openness resources will be more likely to adapt than teams with low levels of openness resources. Hyppthesis 7b (H7b): The relationship between team cognitive resources and adaptation will be stronger for teams with high levels of team openness resources than for teams with low levels of team openness resources. In addition to these hypotheses, I will examine three different means of aggregating individuals’ cognitive ability, conscientiousness, and openness to experience. Specifically, I will attempt to determine which mode1(s) (additive, disjunctive or conjunctive) best predicts adaptation. The next chapter describes a proposed laboratory study to test these hypotheses and research questions. 82 Chapter 2 METHOD Most studies of adaptation have been based on post-hoc qualitative analyses of single events in the field. Such an approach to studying adaptation is reasonable because it is not only difficult to be able to anticipate or manipulate an environmental disruption, but even if this were possible, it is difficult to parsimoniously describe a new pattern of behavior in terms of either objective or perceptual psychometric variables. Studying adaptation is difficult because adaptation, by definition, is emergent and complex. Indeed, qualitative retrospective reports, even if serendipitous and based on a sample of one, can be enlightening and are important to scientific discovery (McCall & Bobko, 1990). However, in order to increase understanding of adaptation further, it is necessary to begin conducting research in settings where a_pp'o_ri hypotheses have a chance of being disconfirmed. The present research is a step in this direction in that not only are hypotheses offered, but they will be tested quantitatively in a controlled setting. This chapter describes the research method and analyses used to assess the hypothesized relationships. First, I discuss the choice of study setting, sample, task, design, and data collection techniques. I then describe the results from the pilot and main studies. Choice of Setting The research questions raised in this dissertation were assessed in a laboratory study. The choice of a laboratory setting over the field was based on two factors. First, the nature of the research question almost necessitates laboratory experimentation. The laboratory allows for (a) the observation of many teams performing the same task in the 83 same type of environmental conditions (needed for adequate statistical power and to rule out artifacts such as selection and history), (b) the presentation of an adequate stream of similarly structured decisions (enough so that routines can be developed and adaptation can occur), and (c) the manipulation of team goals, feedback, and the nature of the environmental disruption and random assignment of teams to conditions based on these manipulations (ensures that there are teams in all possible cells and helps to ensure equality of teams prior to experimental manipulation). For obvious practical reasons, these conditions would be extremely difficult to find in a natural field setting. Second, the hypotheses and their theoretical support do not imply boundary conditions that make a laboratory setting inappropriate for testing the hypotheses. Requirements for this study include teams of two or more individuals who interact, are interdependent, and share a purpose. In addition, these teams must be composed of individuals who are specialized and who make a stream of recurring structured decisions. Finally, the task must be such that it is moderately complex, and is long enough to allow for the development of routinized behavior. As explained in the sections entitled ”Task” and “Procedures”, these requirements are fulfilled in this study. Planning for Particimts: The Power Analysis In planning this study, I conducted a power analysis to determine an appropriate sample size for the main study (J. Cohen, 197 7; J. Cohen & P. Cohen, 1983). Statistical power is defined as the probability of correctly rejecting the null hypothesis (i.e., rejecting the null hypothesis when the null hypothesis is false). Thus, planning for power is desirable because it serves as a control for a type 11 error, or the probability of failing to reject the null hypothesis when it is false. 84 The strategy of planning for statistical power depends on a consideration of four factors, (1) the power of a statistical test, (2) the specified probability of rejecting the null hypothesis when it is true (or), (3) the sample size (n), (4) and the magnitude of the effect size. Once any three factors are known or estimated, the fourth can determined. For planning purposes in assessing hypotheses, or was set according to convention at .05. According to convention, I set desired power to be .80. Since there are no studies on team adaptation (or on adaptation at any level of analysis) which use the variables under consideration in this study, it is impossible to get estimated effect sizes from the literature. Establishing a minimum effect size based on theoretical or practical significance would also be problematic since there are so few studies on this topic. Thus, the approach used here was to choose an effect size somewhere in-between what Cohen considers small (r=.10) and medium (r=.30). However, since in some domains (e.g., between participation and performance) correlations around .20 have been questioned in terms of practical significance (Wagner, 1994), I leaned towards the medium end of this range and chose a correlation of .25 (i.e., R2 =.0625) for the minimum effect size. I had assumed that data collected would conform to the assumptions necessary for multiple linear regression so I planned to use this approach to assess my hypotheses. In order to find the appropriate sample size for the regression analyses, the following formula is appropriate: 11 = L/F2 + K + 1, where F 2 = srz/l-Rz, L comes from Table E2 in J. Cohen and J. Cohen (1983) where KB = 1, sr2 is the semi-partial effect size estimate, and K = number of independent variables. 85 First, using this formula for the main effect hypotheses together with the values; sr2 = .0625, R2 = .30 (6 independent variables X .0625 = .375 X .80 correction factor for correlated predictors), a .05, and power = .80, L = 7.85 and the appropriate minimum sample size works out to be 95. Using these same assumptions, the required sample minimum sample size to detect a seventh term (i.e., an interaction) with power of .80 is 90. Therefore, given the assumptions in this analysis, a minimum sample size of 90 teams was though to be adequate to test the hypotheses. Man—ts Research participants included 489 college juniors and seniors enrolled in a management course during the fall semester at a large Midwestern university. Sixty of these students participated in a pilot study and the rest (429) participated in the main study. The mean age for these participants was 21 (SD = 2.29), their self-reported GPA was 3.06 out of 4.00 (SD = .43), and half were male. Participation in this study was voluntary and participants were informed that they could withdraw from the study at any time. Participants who complete the study received participation credit for their time (3 hours). All teams had the opportunity to earn bonuses paid to the team on the basis of team performance. The top performing teams in each condition earned $60, the next best team in each condition earned $45, and the third best team in each condition earned $30. Individuals who chose not to participate or withdrew from the study were able to obtain equivalent course credit by completing an assignment that required an equivalent number of hours of work (3 hrs). 86 In the pilot and main studies, research participants worked at a team-based version of the Team Interactive Decision Exercise for Teams Incorporating Distributed Expertise computer simulation task (TIDEZ). A brief description of this task is provided below. The interested reader is referred to Hollenbeck et al. (1995) for a more complete description. TIDE2 is a software program for a decision task simulation that presents participants with values on a ntunber of attributes of a problem or object. Research participants are asked to make decisions about the state of that object (e.g., the desirability of a job candidate, the value of a particular piece of merchandise, the severity of a specific injury, etc.) based on these attributes. In this study, TIDE2 was programmed to simulate a military command and control team. When programmed to simulate a command and control team, the structure of the experimental task has a high level of mundane realism (Berkowitz & Donnerstein, 1982). The participants in this study were stationed at networked computer terminals and were responsible for communicating over this network in order to make classification decisions about targets within an airspace. In this way, the task corresponds very closely to what real command and control teams do on a day to day basis. Past research using TIDE2 programmed as a command and control scenario has also demonstrated that participants generally enjoy the task and want to do well (Hollenbeck et al., 1995; LePine, et al., 1997). These types of reactions reduce potential problems associated with participants being bored and not caring about their performance. The surface features of the task, however, do not define the boundaries of this study to military command and control team contexts. Indeed, command and control teams are but one example of specialist decision making teams in general. Therefore, to 87 the extent that the task models a command and control context, it should provide a reasonable venue for assessing hypotheses regarding specialist decision making teams. The team's mission in this study was to monitor an airspace. When a target aircraft enters this airspace, each team member needed to gather some information about particular attributes of the aircraft (e. g., its speed, altitude, range, etc.), and then arrive at a judgment regarding the appropriate response to make toward the aircraft. Each team member was assigned the role of an officer in one of three command and control stations; Alpha, Bravo or Charlie. Each team member was trained so as to possess unique expertise regarding aspects of the task. Alpha was trained how to interpret information related to location (number of targets, range, and position relative to commercial air corridors) of the target aircraft (the location rule). Bravo was trained how to interpret information regarding the motion (heading crossing angle, altitude, and speed) of the target aircraft (the motion rule). Finally, Charlie was trained how to interpret information regarding the category (electronic security measure, radar cross section, and rate change altitude) of the target aircraft (the category rule). These responsibilities are illustrated in Figure 4. Rule Alpha Station Bravo Station Charlie Station Number of Targets Location Range Corridor Status Heading Crossing Angle Motion Altitude Speed Electronic Security Measure Category Radar Cross Section Rate Change Altitude Figure 4 - Role Requirements 88 The instructions were such that participants knew that their area of expertise included only one decision rule and that making a recommendation based on their rule required knowledge of all three attributes. This is because a value of non-threatening for any attribute in a rule makes correct decision for the rule non-threatening (ignore). Alpha, who was responsible for making the final decision, was taught that the final correct decision for each target aircraft is an additive combination of the three rules. In monitoring the assigned airspace, teams had to assess a series of air targets in terms of their level of threat. Judgments on rules and final decisions were rendered on a seven- point continuum anchored by Ignore (lowest level of threat) to Defend (highest level of threat). Intermediate responses on this scale in increasing level of threat included; (2) review, (3) monitor, (4) warn, (5) ready, and (6) lock-on. The task was programmed so that there was interdependence among staff members in the way information could be accessed. Although the three rules involved combinations of three distinct cues, no one team member was able to measure all of the necessary components of any one rule. For instance, Alpha was able to directly access “number of targets” and “range” but not corridor-status”. This piece of information had to come from Charlie. Figure 5 illustrates who could measure which attributes. In this Structure, Alpha needed to transmit “speed” to Bravo, Bravo needed to transmit “rate Change altitude” (RCA) to Charlie, and Charlie needs to transmit “corridor status” to Alpha. This structure is illustrated in Figure 6. 89 Rule Alpha Station Bravo Station Charlie Station Number of Targets Location Range Corridor Status Heading Crossing Angle Motion Altitude Speed Electronic Security Measure Category Radar Cross Section Rate Change Altitude Figure 5 - Measurable Attributes Alpha Corridor Status Speed Charlie Bravo RCA Figure 6 - Pre-disruption Role Structure 90 As stated earlier, adaptation is defined as reactive adjustment to a role structure resulting in a role structure that makes sense given the new situation. The environmental disruption or situation change in this study was the failure of the transmit mechanism between Bravo and Charlie. Bravo was able to execute the transmit “RCA” command, however, the attribute “RCA” did not reach the Charlie. A clock on the screen counted down the time before the team needed to make a decision. The computer began to beep when there is 30 seconds remaining. This gave participants a clear impression that the time available for making a decision was running out. Recommendations regarding each decision object were forwarded from Bravo and Charlie to Alpha who then considered his or her own information along with these recommendations and made a final decision for the team before time runs out. In the course of the entire experiment (which lasted 3 hrs), participants made decisions on a series of 83 (including 3 for training and 2 for practice) targets. Following decisions, team members received feedback indicating the accuracy of each staff member’s judgment as well as accuracy of the team’s decision. However, only the team's performance mattered in terms of winning bonus money; hence team members had a common fate. Team performance was defined in terms of decision accuracy, which in turn was defined as the absolute difference between the decision object’s “true score” and the team’s decision on that decision object. Decision objects’ true scores were based on the rules that comprise participant’s role training. Decision accuracy could range from 0 (a perfect match) to 6 where a low score indicated higher accuracy. Only five outcomes were fed back to participants, however. A _Ip'_t_ indicated no difference between the true score and the team’s decision. A near miss indicated a difference of one. A miss indicated 91 a difference of two. An incident indicated a difference of three. Finally, a disaster indicated four or more points off. Associated with each outcome were points; 2 for a hit, 1 for a near miss, 0 for a miss, -1 for an incident, finally —2 for a disaster. The task as just described included several elements which made it a team task. First, it is clear that more than one individual was involved in the decision making and these individuals were interdependent. Each team member was dependent on others to provide them with critical pieces of information (task interdependence). Since there was only one final decision per object, and since team members were rewarded based on team performance, members were also dependent on one another in terms of their making accurate recommendations and judgments regarding target classification (outcome interdependence). Finally, team members had a common purpose (to make accurate decisions) for which members shared a common fate (team based performance rewards). In addition to these characteristics, the teams had several attributes which made them examples of specialist decision making teams. First, the teams were responsible for processing and sharing information in order to make decisions and therefore the task is primarily cognitive as opposed to psychomotor. Second, the teams were responsible for doing work related to a defined purpose (i.e., making a stream of decisions about targets that come into their assigned area) and not for defining that purpose. Third, team members were trained about unique aspects of the team’s task and therefore they were Specialized. Finally, the task itself was moderately complex. In the task each team member needed to (a) perform a number of distinct tasks (e. g., measure attributes, communicate with team members, consider attribute values and make recommendations about targets’ level of threat), (b) learn who had which attributes and the relative weights 92 of those attributes for predicting the criterion, and (c) be involved in developing a way to do the task once the situation changed. Procedure Research participants were scheduled at the beginning of the semester for their three—hour experimental session. Research assistants scheduled participants during the first recitation meeting of the semester. Because appointment slots were alternated from one section to another, and because most students did not know one another early in the semester, students did not sign up as intact or familiar groups. At this time, participants were given general information concerning the purpose of the experiment (“a study of decision making in teams using a computer simulation”). After participants signed-up, they were instructed to fill out a consent form (Appendix A). The participants were then given an abbreviated NEO-PI-R personality inventory (Costa & McCrae, 1992) and the Wonderlic Personnel Test Form IV (Wonderlic & Associates, 1983) in order to measure individuals’ conscientiousness, openness to experience, and general cognitive ability. Teaching assistants made periodic announcements throughout the semester in order to inform students who missed the first recitation session to make arrangements with the laboratory to sign-up for the experiment and complete the instruments. Prior to the experimental sessions, teams were randomly assigned to experimental conditions. In order to ensure enough participants were available to compose teams, participants were overbooked by one. Upon arrival to the laboratory, participants filled out another consent form (Appendix B). After 3 participants arrived, they were taken into a Separate room and instructed to take a seat at any of the computer consoles. Because participants chose their own seat, there was random assignment of position. If a fourth 93 participant showed-up for the experiment, he or she was assigned to an alternative study that required the same amount of time and effort. Once participants were seated, the experimenter welcomed the participants and gave them a general task overview booklet (Appendix C) and an individual role responsibility sheet (Appendix D). The experimenter then overviewed the material and gave participants 8 minutes to read through it themselves. After 8 minutes the experimenter returned and answered questions. He or she A then proceeded with the hands on portion of the training. The hands on portion of the training primarily involved the first (of five) training trials and is described in the experimenter’s protocol (Appendix E). During this first trial, research participants were instructed about the mechanics involved in gathering and sharing information about target attributes. These actions included (a) measuring attribute values, (b) Mg others for attribute values, (c) directly transmitting attribute values to others (only permitted on values that could be measured by the station), and (d) communicating via sentence-long free form text-messages (not permitted between Bravo and Charlie). The task training also involved instruction on individual role responsibilities. Role information was provided in a role responsibility sheet which participants kept throughout the experiment. Role expertise information included: (1) the specific attributes the participants needed for their role, (2) how to translate raw data on targets into judgments about how threatening the target is likely to be on a specific attribute, and also (3) how to combine information on attributes into judgments about rules. The participant filling the role of Alpha was also instructed how to combine judgments on rules into a final decision for the team. During the first training trial, 94 participants were also encouraged to practice communicating with each other using all modes of communication. Following the first trial, participants were given the opportunity for hands-on practice on two additional trials. During these two trials, participants were encouraged to practice communicating with one another in order to obtain the information they needed for their role. The research assistant stood by to answer questions and clarify obvious misunderstandings. Prior to the fourth trial, the experimenter instructed participants on how to exchange information most efficiently (using the structure illustrated in Figure 7). During the fourth and fifth trials, the participants practiced using this structure. After the fifth trial, the simulation was paused and any final questions were answered. Participants were told that in order to make the simulation more realistic and interesting there may be some communications jamming and that information sent by one member might not go through to the other member. Participants were also told to do their best to work around this problem and that it was important to obtain all the information for their role. This instruction was necessary so that participants would not stop engaging in the experiment because they thought that there was something wrong with the equipment that could be fixed by an experimenter (e.g., a computer virus). This instruction was also important to prevent participant frustration and anger due to their feeling disadvantaged relative to other teams who may not have experienced such a problem with their equipment. At this time participants were also reminded that all communications must transpire over the computer and that while they could send free-form text messages to one another at any time during the remaining trials, there would be seven opportunities to 95 send these messages during feedback displays between trials. In contrast to the normal feedback displays lasting 7 seconds, these opportunities lasted 60 seconds. These opportunities gave even the slowest typist an opportunity to communicate with the other members of the team. These opportunities also allowed for communications in a somewhat less stressful environment. I should note, however, that these periods did not allow for extensive communications and planning. Following this instruction, participants were given a 6 item task knowledge test (Appendix F). After participants completed this test, the experimenter wished the team “good-luck” and re-started the simulation. The experimenter then left the room but was able to monitor (listen to) the team to ensure there was no talking during the experiment. Following the experiment, participants were given an instrument (APPENDIX G) that included questions about the reliability of communications between members during the experiment (items 11-34). Some of these items were used as a manipulation check for the abruptness disruption (depending on the condition). The entire subscale was also used as a component of a measure of situational awareness (described more fully later). Appendix G also included manipulation checks items related to perceptions of goal difficulty (items 1-2), value of feedback (items 3-4), amount of effort (items 7-10), and perceived importance of the disturbance (items 5-6). After participants finished the instrument, they were debriefed and released. Overall Desigp This main study uses 6 independent variables in a between groups design. Goals difficulty (difficult versus easy), quality of feedback (timely and specific versus delayed and summarized), and the nature of the environmental disruption (gradual vs. abrupt) 96 were manipulated. Team cognitive resources, team conscientiousness resources, and team openness resources were not manipulated in this study and were operationalized as continuous variables. Prior to the main study, a pilot study was conducted to ensure the task, scenario, and manipulations were working as intended. The Pilot Study Prior to the primary study, I conducted a pilot study using sixty participants. These participants were arrayed into 20 three-person teams and performed the task as described above. The pilot study had four specific purposes: (1) to ensure teams would establish and maintain routines prior to the communications breakdown, (2) to ensure that adapting the communications structure was necessary to promote high performance after the communications breakdown, (3) to establish easy and difficult team performance goals, and finally, (4) to ensure the communications breakdown manipulation captured the participants’ attention. The pilot teams also served a number of other important functions. For instance, initial teams in the pilot were used in the training of five research assistant experimenters. Additionally, bugs in the computer program were identified and fixed during the first few pilot runs. Finally, based on pilot participant debriefings, I was able to refine the experimental procedures and instructions in order to reduce ambiguity and confusion during the training. Evidence of routine. One of the most important purposes of the pilot study was to ensure the task allowed teams to establish and maintain a routine means of exchanging information prior to the communications disruption. M. Cohen and Bacdayan (1996) suggested three factors that indicate the presence of a routine: (I) evidence of repeated 97 action sequences, (2) increased speed in performing the task, and (3) increased reliability in performing a task. To ensure all teams used the W, participants were told how to exchange information the most efficient way possible (illustrated in Figure 7) after the third training trial. To assess the extent to which team members maintained this structure, I examined the communications data for the teams. The data should show that for each trial Alpha transmits “Speed” to Bravo, Bravo transmits “Rate Change Altitude” to Charlie, Charlie transmits “Corridor Status” to Alpha, and finally, that Alpha, Bravo, and Charlie receive the information that has been transmitted to them. To assess the increase in smed in p_erforming the task, I compared the average speed of receiving information across four blocks of ten trials (the first ten trials after training, trials 14 through 23, trials 24 through 33, and trials 34 through 43). Although team members’ communications required different types of activities (i.e., measuring attributes, transmitting information, receiving information), receiving information from other team members represented the final step in obtaining needed information and therefore captured prior activity. I expected that there would be a significant decrease in the amount of time it took for members to receive their information between the first and second block of trials and that this increase in speed would stabilize between the third and fourth blocks as their routine becomes established. To assess the extent to which there was increased reliabilig in worming the g, I compared the standard deviation of the speed of receiving information across the same four blocks of ten trials (the first ten trials after training, trials 14 through 23, trials 24 through 33, and trials 34 through 43). I expected that there would be a significant 98 decrease in the standard deviation of time it took the team members to receive their information between the first and second block of trials. I also expected that the decrease in the standard deviation would stabilize between the third and fourth blocks as the routine becomes established. Necessity for adaptation. The second purpose of the pilot study was to ensure that at least some teams adapted, and also to make sure adaptation was necessary in terms of promoting higher performance after the environmental disruption. In order to ensure some teams adapted, I examined the extent to which they developed role structures that were beneficial in terms of promoting higher performance after the communications breakdown. First, I compared the performance of 5 teams that were trained in the ideal way to exchange information after the disruption made the original routine inappropriate (this structure is described more fully in the next section) to teams that were not trained in the ideal adapted structure. This comparison will be based on the average performance (in terms of decision accuracy) for however many trials on average it takes for the teams to begin to find new ways to give Charlie the value for "Rate Change Altitude". For instance, if untrained teams found a way to give Charlie his or her information on trial 60, the comparison will be on trials 54 (the trial where the disruption first occurs) through 60. As a second check on the importance of adapting, I compared the average decision accuracy across an equivalent number or trials prior to and after teams found a way to deal with the communications breakdown. Establishing easy and difficult goal levels. The third purpose of the pilot was to establish difficult and easy goal levels in terms of team level decision accuracy. I examined the pilot teams’ performance and set the difficult and easy goal levels at 99 approximately 1 standard deviation above and 1 standard deviation below the mean of the pilot teams’ performance level. Manipulation check. Finally, I examined the post-experiment manipulation check questions to ensure that participants noticed the communications disruption. The Pilot Study: Results Evidence of routine. As described next, the pilot teams showed evidence of routine based on three criterion suggested by M. Cohen and Bacdayan (1996). First, based on a qualitative examination of the communications data, all 20 pilot teams appeared to use the same pattern of exchanging information they were encouraged to use during training. Team members transmitted the attribute they needed to transmit and received the information transmitted to them. I also computed the average number of times each member of the team transmitted and received all the appropriate information. Over the 20 trials prior to the communications breakdown (trials 24-43), individuals in teams received the information they needed for their role 98.5% of the time (sd = .02). Second, team members appeared to increase the speed in performing their portion of the team’s task early in the simulation. The mean number of seconds to receive needed information (with standard deviations in parentheses) for trial blocks 1 through 4 were 22.19 (5.66), 17.40 (3.52), 16.39 (4.32), and 15.89 (3.67), respectively. A One-way AN OVA revealed that at least one of these blocks of trials differed from another, F(3, 236) = 26.10, p < .001. I conducted 3 post hoc multiple comparison tests (Tukey’s Honestly Significant Difference, Bonferroni, and Scheffe) in order to find which blocks differed. The results of this test are shown in Table 1. 100 Table l - Comparisons of Time to Receive Information Significant Differences (p < .05) Trial Block Difference in Mean Tukey Bonferroni Scheffe (i) (j) Time to Receive HSD (ii) 1 2 4.79 .00 .00 .00 3 5.80 .00 .00 .00 4 6.31 .00 .00 .00 2 1 -4.79 .00 .00 .00 3 1.01 .58 1.00 .66 4 1.51 .23 .36 .31 3 1 -5.80 .00 .00 .00 2 -l .01 .59 1.00 .66 4 .50 .92 1.00 .94 4 l -6.31 .00 .00 .00 2 -1.51 .23 .36 .31 3 -.50 .92 1.00 .94 The Bonferroni test, Tukey’s honestly significant difference test, and the more conservative Scheffe test all revealed that the mean time to receive information in the first block of trials was significantly greater than in blocks 2 through 4 which did not differ significantly from one another. Thus, the pattern of these data suggest that members increased the speed in performing their portion of the team’s task during the first two blocks of trials but the increase in speed leveled off during the third and fourth blocks. Finally, the pilot data also suggested that the reliability of team members’ role performance increased over time. The standard deviations in seconds of the time it took members to receive their information (with standard deviations of these standard deviations in parentheses) were 7.94 (5.26), 4.10 (3.33), 3.90 (3.44), and 3.67 (3.19) in blocks 1 through 4 respectively. A One-way ANOVA revealed that at least one of these 101 blocks of trials differed from another, E (3, 236) = 12.61, p < .001. Results from a Bonferroni test, Tukey’s honestly significant difference test, and the Scheffe test (illustrated in Table 2) revealed that the standard deviation in seconds to receive information in the first block of trials was significantly greater than in blocks 2 through 4 which did not differ significantly from one another. The pattern of these data suggest that members increased the reliability in performing their task during the first two blocks of trials but this increase in reliability leveled off during the third and fourth blocks. Table 2 - Comparisons of Reliability in Receiving Information Significant Differences (p < .05) Trial Block Difference in Standard Tukey Bonferroni Scheffe (i) (j) Deviations to Receive HSD (ii) 1 2 3.84 .00 .00 .00 3 4.04 .00 .00 .00 4 4.27 .00 .00 .OO 2 l -3.84 .00 .00 .00 3 .21 .99 1.00 1.00 4 .43 .95 1.00 .96 3 l -4.04 .00 .00 .00 2 -.21 .99 1.00 1.00 4 .23 .99 1.00 .99 4 1 -4.27 .00 .00 .00 2 -.43 .95 1.00 .96 3 -.23 .99 1.00 .99 Necessity for adaptation. As defined earlier, team adaptation implies the development of a more appropriate role structure in light of a new situation. Therefore, before I could confidently say that some teams adapted to the communications 102 breakdown, it was important to ensure that at some teams responded by developing new, more appropriate role structures. It would be reasonable to say that a W role structure should ultimately result in higher levels of team performance than other behaviors. Thus, in the context of this study, it was important to assess the extent to which informing Charlie (getting "Rate Change Altitude" to Charlie) resulted in higher team-level performance than not informing Charlie. Of the 15 pilot teams that were not trained in the ideal adapted structure, 3 never found a way to get Charlie the information he or she needed after the communications disruption. It took the remaining 12 pilot team an average of 11 (sd = 6) trials to find a way to get “Rate Change Altitude” to Charlie. That is, while the link between Bravo and Charlie was severed on trial 54, on average these teams began to inform Charlie on trial 65. Across these first 11 trials, the average performance in terms of decision accuracy or TDA, (the average of the absolute difference between team decisions and the correct decisions) of the 15 teams that were not trained how to exchange information was 2.00. For teams that were trained in the ideal structure, however, TDA across these 11 trials was .69. That is, teams that were trained how to inform Charlie made decisions that were, on average, 1.31 points better than teams that were not trained, E(l,18)= 31.30, p < .001. Next, I compared the performance of the 12 teams that found a way to inform Charlie on the first 11 trials after the communications disruption to the performance of these teams on the last 11 trials in the scenario. This is just a simple comparison of teams' performance before and after they learned how to inform Charlie. As expected, TDA on the last 11 post—disruption trials was significantly higher than that on the first 11 post- 103 disruption trials (1.08 versus 2.02), _t_ (11) = 5.48, p < .001. Thus, overall, it appears that informing Charlie in this task should be beneficial in terms of promoting higher levels of team performance. Based on the analyses outlined in the two previous paragraphs, I was fairly confident that any appropriate role structure should include behavior that results in getting Charlie the "Rate Change Altitude". However, just because Charlie gets informed, does not necessarily imply that the team has adapted because the definition of adaptation implies that the team establishes a new role structure. As mentioned earlier, a role structure can be defined as the pattern of recurring actions of individuals interrelated with the recurring actions of others (Katz and Kahn, 1978, pp. 189). In order to say that a team has established a new role structure, therefore, evidence should suggest that a new pattern of activity or behavior among team members recurs. Although somewhat arbitrary, I felt that the most reasonable indicator of "a recurring pattern of activity or behavior" (in the context of this study) would be whether or not the same pattern of communications actions among team members (queries, transmits, receives, text messages) was repeated for 3 consecutive trials after which the majority of remaining trials used the same pattern. Of the 12 pilot teams that ultimately got information to Charlie after the disruption, only 7 showed evidence of developing new role structures. That is, it appears that about half the teams developed coherent role structures after the communications breakdown. Furthermore, it took these 7 teams an additional 8 trials (sd = 9) on average to establish a new pattern of activity after they first figured out how to get Charlie his or 104 her information. Stated somewhat differently, it took approximately 20 trials on average for teams to develop new role structures. Of course, this leaves five teams that did not seem to establish a new role structure (as I have defined it here) despite finding ways to inform Charlie. After examining these teams' communications more closely, it appears that two patterns emerged in these teams. First, there may have not been enough time for some teams to develop a new structure during the scenario. Two teams (teams 015 and 019) found a way to inform Charlie rather late in the scenario (trials 74 and 73 respectively). Because new role structure emergence took 9 trials on average after teams first found a way to inform Charlie, it is possible that these two teams would have developed new role structures had they had a few more opportunities. The second pattern that emerged was that, for some reason or another, some teams used a slightly different pattern of activity from trial to trial. Members of two teams (team 013 and 014) apparently did not have a clear picture of the extent of the communications breakdowns throughout the latter half of the scenario. Team 013 engaged in a great deal of task related communication aimed at addressing the problem but never settled into a stable new pattern of activity. In Team 014, members seemed to send information to one another almost at random in hopes of the right team members getting the right information after the disruption. Members of another team (team 016) engaged in a great deal of social communication using text messages during the scenario and never settled into a routine. This team figured out how to inform Charlie early (only after 3 disrupted trials) and continued to do so throughout the remainder of the scenario (19 out of 30 trial), however, there was a great deal of seemingly random social communication that 105 interfered with the team developing a new role structure. I should also note that this social communication appeared to be highly deleterious in terms of team performance. This team was the third best in term of the number of times Charlie received his or her information after the communications disruption, yet the team was also the third worst in terms of decision accuracy. Finally, teams that established a new role structure including a means of informing Charlie performed better in terms of decision accuracy (TDA = .94) than teams that did not establish such a role structure (1.30), p < .10, one tailed test. Easy and difficult goals. I calculated the mean and standard deviation for the pilot team’s decision accuracy (the absolute difference between the correct decision — Alpha’s decision) for the trials preceding communications disruptions (trials 1 through 53). The mean accuracy of team decisions for the twenty pilot teams was 1.03. That is, the pilot teams made decisions that were a bit over one decision-level off on average. The standard deviation for these decision were .33, and therefore the top 16% of the teams should have decision accuracies of less than or equal to .70 (1.03 - .33). The bottom 16% of the pilot teams should have decision accuracies of greater or equal to 1.36 (1.03 + .33). Because participants received feedback according to the scoring_outlined earlier (2 points for O-off accuracy, 1 points for 1-off accuracy, 0 points for 2-off accuracy, etc), the mean + lsd goal would have been 1.40 for the difficult goal condition (2 - .70) and .64 (2 - 1.36) for the easy goal condition. However, these goal levels were adjusted slightly upward for two reasons. First, because the pilot teams were used for training experimenters and also for working out problems (i.e., reducing ambiguity) in the training protocol, I felt that the decision accuracy for teams in the primary experiment would be slightly higher than for 106 teams in the pilot study. Second, I felt that participants would be more likely to understand and remember their goals if they were at “natural” _points on the scoring continuum. Therefore, I chose 1.50 and .75 as levels representing difficult and easy performance goals respectively. Manipulation check. Each participant in the pilot study was given a “problem log sheet” that had 2 columns. Trial numbers (1-83) were listed in column 1. Column 2 was labeled “Problems with Communications” and included blank spaces for participant notes. Participants were instructed to note the type of problem they were having with communications in the blank corresponding to the trial when problems occurred. An examination of these sheets revealed that Charlie station in each of the 15 pilot teams (i.e., those individuals in teams not trained to adapt) noted a problem with the communications from Bravo beginning on the 53" trial. Alpha and Bravo, however, did not become aware of the problem until (a) Charlie either explicitly indicated he or she was not receiving information from Bravo, or (b) the actions of Charlie caused Alpha or Bravo to question Charlie about his or her status. These actions included Charlie waiting longer to send a judgment to Alpha or Charlie not sending in a judgment at all. Sum—mag of Pilot Study Results Overall, the results of the pilot study indicated that teams did establish and maintain a routine way of going about the experimental task. As team members gained experience with the task, they accomplished the same pattern of activity more quickly and more reliably. After a certain level of experience, the rate and reliability of task activity stabilized. 107 The pilot study also supported the notion that some teams adapted and that adaptation was beneficial in terms of promoting higher levels of team decision making accuracy. First, the pilot data suggested that an appropriate means of dealing with the communications breakdown should include finding a way to inform Charlie. Teams that were trained in means of informing Charlie outperformed teams that did not find a way to inform Charlie. Teams also performed significantly better once they found a way to inform Charlie after the commrmications breakdown. Second, almost half the pilot teams showed evidence of developing new role structures including a means of informing Charlie in response to the communications breakdowns. Teams developing new role structures performed better than those teams not developing new role structure. Among factors that prevented teams from adapting seemed to be a general lack of awareness about the situation, mindlessly or randomly trying new ways of doing the task, and high levels of social communications. Finally, the pilot study supported the use of communications disruption manipulation. Charlie always noticed the communications disruption but the disruption did not become apparent to the other team members until later. The Primary Study: Variables The primary study originally consisted of 489 participants arrayed in 143 3-person teams. However, hardware failures during the experiment resulted in unusable data for two teams. In one team, Charlie’s keyboard and mouse stopped working on trial 11, and thinking this was part of the experiment, did not tell the experimenter. In the team, a network crash late in the game (trial 74) resulted in the loss of data prior to that point in 108 the experiment. These two teams were removed from further analysis resulting in a sample of 141 teams with no missing data. This study used 6 independent variables in a between groups design. Goal difficulty (easy vs. difficult), quality of feedback (timely and specific versus delayed and summarized), and the nature of the environmental disruption (abrupt vs. gradual) were manipulated. Team cognitive resources, team conscientiousness resources, and team openness resources were operationalized as continuous variables. Teams were composed randomly and as a result there were mixed as well as single gender teams. Before I describe these independent variables, I will describe how the primary outcome variable, adaptation, was operationalized. Adaptation. As mentioned in the procedures section, teams were shown how to exchange information after initial training so that each team member received all the information they needed to accomplish their role responsibilities. This communications structure is depicted in Figure 7. After the communications disruption, however, team members had to use a different structure to get Charlie his or her information (“RCA”). As the pilot study demonstrated, any new role structure should include informing Charlie. Given that the task was structured such that Bravo and Charlie could not communicate using free form text messages, and since only the station that originally measured the attribute could use the transmit fimction to send the attribute, the most efficient adapted structure is illustrated in Figure 7. This is the structure the five "trained" pilot teams used. after the communications breakdown. 109 Alpha Corridor Status peed RCA RCA Charlie (text (transmit) Bravo message) Figure 7 - Ideal Adapted Role Structure In this structure Bravo transmits “RCA” to the Alpha, who in turn, sends a free form text message with the “RCA” values to Charlie. This structure has the fewest inefficiencies in terms of extra key-strokes. For instance, if Bravo used the text message function instead of the transmit function to send the “RCA” value to Alpha, he or she would have to do more keystrokes. In order to use the text ftmction Bravo would have to select the text function, select Alpha as the station to send the message, type characters for the “RC8” value, and finally, select enter. On the other hand, if Bravo used the transmit function, he or she would only have to select the transmit function, select Alpha as the station to send the message, and finally, select enter. In addition to saving keystrokes, the transmit function does not require the actual attribute values (e. g., “RCA”=5,725) to be held in Bravo’s short term memory. However, while the experimental task allowed for the ideal adapted structure (in terms of keystroke efficiency) to be known in advance, there was an issue as to whether deviations from this structure actually detracted from teams’ performance. If deviations from the ideal structure did not negatively influence team performance, then I could not 110 say that the structure was ideal. This, of course, would imply that teams adapt when they simply establish a role structure that includes means of informing Charlie. In order to assess the extent to which the structure in Figure 7 is ideal, I created a variable called Adapted Inefficiency and correlated it with the accuracy of teams’ decisions after the communications disruption (WW Accuracy). I created the Adapted Inefficiency variable by first examining the pattern of communications used in new role structures (i.e., when the same pattern of communications actions among team members was repeated for 3 consecutive trials after which the majority of remaining trials used the same pattern) after the communications breakdown. Adapted Inefficiency was then calculated for each team as the number of extra actions (transmits, receives, queries, and text messages) in the team’s structure above that required to perform the task as illustrated in Figure 8. For the 75 teams that eventually developed a new role structure, Adapted Inefficiency was 1.03 on average sd = 1.56). That is, teams in the experiment developed new role structures that were inefficient by a little over 1 action. The correlation between Adapted Inefficiency and Post-disruption Team Decision Accuracy was not significant, p = -.02, p = .84, however. This suggested that inefficient role structures did not detract fi'om team performance in this task. That is, effectively adapting in this task, did not necessitate using the ideal structure illustrated in Figure 7. As suggested by the analysis and the results from the pilot study, adaptation simply required members to establish a new role structure that included a means of informing Charlie. Accordingly, adaptation was initially operationalized as the number of trials in the disrupted situations where teams used a new structure to inform Charlie. 111 As mentioned earlier, evidence of a new role structure should suggest that a new pattern of activity or behavior among team members recurs. I felt it was reasonable to characterize a recurring pattern of activity as a pattern of communications actions among team members (queries, transmits, receives, text messages) that was repeated for 3 consecutive trials after which the majority of remaining trials used the same pattern. I examined the pattern of each team’s communications after the breakdown to identify when a new pattern began. Adaptation was calculated as the number of remaining trials. Goal difficulty. The goal specificity manipulation followed the first training trial. Research participants in the difficult goal condition were told: “Even though you all have different roles, you should work as a team to achieve a goal of at least 1.50 as an average score”. This goal level was determined in the pilot study described above. Research participants in the easy goal condition were told: “Even though you all have different roles, you should work as a team to achieve a goal of .75 as an average score.” These instructions were repeated once more directly following the final training trial. After the experiment, participants were given two questions (Appendix G items 1 &2) about the difficulty of their assigned goal (1=very easy to 5=very difficult) to serve as a manipulation check for goal difficulty. The reliability of this scale was .73, and as expected, individuals in the difficult goal condition though their goal was more difficult M = 3.74, SD = .92) than individuals in the easy goal condition (M = 2.88, SD = 1.00), t(421) = 9.25, p < .001. Mia of Feedback. Prior to target 41, all teams received the information on the outcome of the trial as well as the average team-level performance immediately following each trial. This information was displayed on each members’ monitor. The average team- 112 level performance was displayed next to the team’s goal. After target 40, teams in the low quality feedback condition received only average (all preceding trials) team level performance feedback every 9 trials. Participants in this condition were told during training that “as in many situations in real life, you will not always get immediate feedback on how well your team is doing. After trial 40 you will get feedback after every 9 trials”. Teams in the immediate feedback condition continued to receive information on the outcome of each trial as well as average team-level performance. After the experiment, participants were given two manipulation check questions (Appendix G items 3 & 4) asking how much performance feedback they received during the task (1=very little to 5=very much). The reliability of this scale was .66, and as expected, individuals in the immediate feedback condition though they were more informed about their standing (M = 3.41, E = .96) than individuals in the delayed feedback condition (M = 2.79, $ = .96), t(421) = 6.63, p < .001. Abruptness of environmental disruption. As explained earlier, the environmental disruption was accomplished through changes in the manner in which information could be transmitted. The first 43 trials were the same for all teams. All of these trials had the full communications compliment. For teams in the abrupt disruption condition, the next 10 decisions also had the full communications compliment. However, on the 54th trial, the communications breakdown occurred (the removal of the transmit link between Bravo and Charlie) and did not change back for the remaining trials. The teams in the gradual disruption condition, however, experienced periodic breakdowns beginning on trial 44. The pattern of these breakdowns were such that they occurred with increasing frequency (trials 49, 50, 54, 55, 56, 59, 60, 61, 62, and 64-83). That is, after decision 43, there were 113 fewer and fewer decisions in which the team had its full communications complement (4 decisions between 44 and 49, 3 decisions between 50 and 55, 2 decisions between 56 and 59, and 1 decision between 62 and 64). Beginning on decision 64, the disruption occurred on every decision. The structure of this manipulation was dictated by a number of considerations. First, there needed to be adequate time for teams in both conditions to develop routines. This was facilitated by training teams in their initial role structure and giving them forty trials in which this structure was appropriate. M. Cohen and Bacdayan (1996) found that evidence that routines (e. g., increased reliability, speed, repeated action sequences, sub- optimality in different circumstances) could be developed within 40 hands in a 40 minute card game. This evidence, together with the results from the pilot study described above, suggested that 40 trials was enough to develop routines. Second, the environmental change in both conditions needed to commence with a significant amount of time remaining in the scenario. From a practical standpoint, teams might not invest effort in adaptation if the shift occurred too late in the scenario simply because such effort would have lower utility (i.e., after developing a new system of activity there will be fewer trials in which the new system can be used). I felt that the points that could accrue over 30 trials would be fairly significant to teams. I should note that there was the possibility that teams in the abrupt condition might develop “stronger” routines (and thus be less prone to adapting) because they had more experience with the task before any communication breakdowns occur. However, three factors mitigate this concern. First, as suggested in the pilot study, teams should approach asymptotic levels of routinization prior to the communication breakdown. 114 Second, there were only 3 trials (trials 44, 49, 50) in which breakdowns occur in the gradual condition prior to any breakdowns in the abrupt condition (trial 54). Finally, in order to allay concerns about this issue, I ran twenty teams in a condition where there was an abrupt communications breakdown beginning on trial 44 and ending on trial 73. There were no statistically significant difference in Adaptation or Post Communications Disruption TDA between these twenty teams and the other teams in the abrupt conditions. Thus, it is not likely that differences between teams in the gradual and abrupt conditions can be attributed to differences in the strength of their routines prior to the communications disruption. After the experiment, participants were asked to rate the unreliability of communications (0-100%) between stations during different phases of the experiment on a 7-point scale (Appendix G items 11-34). I acknowledge that the items did not include the words “abruptness”, and thus, the items and the label I chose for the construct seem to be a mismatch. However, I felt that participants experiencing the manipulation would be better able to respond to their experience in terms of “unreliability of communications” rather than “abruptness of communications disruption”. That is, I felt that it would be better to match items to what the participants experienced than to a label that may be imperfect to the extent that it did not perfectly match the manipulation. I felt that these questions about the unreliability of communications during the period at which the change was occurring would serve as a reasonable indicator of individuals’ perception about the abruptness of the communications disruption manipulation. The more abrupt the disruption, the more the participants should perceive that their communications were unreliable. Individuals in the 20 teams experiencing an abrupt disruption beginning on 115 target 43 thought that communications between Bravo and Charlie across trials 44-53 were less reliable M = 4.03, E = 2.14) than individuals in the teams in the gradual condition M = 3.48, S_D = 1.93), t(251) = 1.87, p < .10. Individuals in the teams in the condition where the abrupt communications disruption began on trial 54 also perceived that the communications between Bravo and Charlie across trials 54-63 were less reliable M = 4.79, S1; = 2.07) than individuals in the teams in the gradual condition M = 4.08, S_ = 2.02), t(361) = 3.28, p < .001. Tea_rp cpgpitive resources. As stated earlier, cognitive resources can be thought of in terms of individual differences in general cognitive ability or g. In this study, general cognitive ability were measured by scores on the Wonderlic Personnel Test (Form IV). This test has a great deal of support in the educational and psychological literatures as a reliable (Dodrill, 1983; McKelvie, 1989; Weeless & Serpento, 1982) measure of the same verbal, quantitative and spatial abilities that indicate g (Hunter, 1986; Jensen, 1977). Internal consistency reliabilities have ranged from .88 to .94 across forms of the Wonderlic (Wonderlic & Associates, 1983). Since consistency in terms of cognitive resources was not expected or specified within groups, no measure of team-level reliability is appropriate. Consistent with the rationale outlined earlier, team cogg'tive resources were operationalized three ways: as an average of team member scores, as the lowest team member’s score, and finally, as the highest team member’s score. These Operationalizations correspond to the additive, conjunctive and disjunctive models. Tm amigttiousness resources. Individual conscientiousness scores came from the long version of the Revised NEO Personality Inventory (NEO PI-R) (Costa & McCrae, 1992) which was administered when participants initially signed-up for the 116 study. This particular conscientiousness scale includes 48 items capturing six sub-factors thought to underlie the construct (competence, order, dutifulness, achievement striving, self-discipline, and deliberation). Internal consistency reliabilities for this measure of conscientiousness have generally been in the low.90’s (McCrae, 1987). This study was no exception (Cronbach’s alpha = .90). Since consistency in terms of team conscientiousness resources was not expected or specified within groups, no measure of team-level reliability is appropriate. Consistent with the rationale outlined earlier, te__a_m_ copgientiousness resoggps was operationalized using the additive, conjunctive, and disjunctive models--that is, as an average of team member scores, as the lowest team member’s score, and finally as the highest team member’s score. Team omnness resources. Individual openness to experience scores also came from the Revised ‘NEO Personality Inventory (NEO PI-R) (Costa & McCrae, 1992). This scale includes 48 items capturing six sub-factors thought to underlie the construct (fantasy, aesthetics, feelings, actions, ideas, and values). Internal consistency reliability have ranged from the mid .80’s to the mid .90’s (Mch 1987). Cronbach’s alpha in this study was .88. Since consistency in terms of team conscientiousness resources was not expected or specified within groups, no measure of team-level reliability is appropriate. As with team cognitive resources and team conscientiousness resources, team oxnness resources was operationalized three ways: as an average of team member scores, as the lowest team member’s score, and finally as the highest team member’s score. Team Decision Accuracy. Although not stated as a formal hypothesis, it is important to assess the extent to which adaptation leads to higher levels of team performance after the communications breakdown. In addition, it would be informative to 117 assess the extent to which the independent variables relate to team performance prior to and after the communications breakdown. Accordingly, I calculated two decision accuracy variables. Pre-disruption Team Decision Accuracy (Pre-TDA) is the average absolute difference between the teams’ decisions and the correct decisions for the non- training targets prior to target 44. Post-disruption Team Decision Accuracy (Post-TDA) is the average absolute difference between teams’ decisions and the correct decisions for the targets where communications were disrupted. Th; Primgy Study: Analyses Analyses were conducted in three stages. In the first stage, I assessed (a) the extent to which high levels of cognitive resources resulted in higher levels of knowledge about the task and situation, and also (b) the extent to which goals, feedback, and the nature of the communications disruption influenced the allocation of cognitive effort toward the task after the disruption. In the second stage, I examined descriptive statistics of the study variables with particular emphasis on the distribution of adaptation. Finally, I conducted analyses aimed at addressing the hypotheses and research questions. 118 Chapter 3 RESULTS OF PRIMARY STUDY Overview of Rethp The results of the primary study are presented as follows. First, I present an analysis on the relationship between individuals’ cognitive resources and their learning. Second, I present descriptive statistics on the team-level variables after which I describe the analytic strategy. Fourth, I describe the results of the hypotheses organized in terms of those relevant to (a) team resources (cognitive ability, conscientiousness, and openness) (b) the manipulations (goal difficulty, quality of feedback, abruptness of the disruption), and finally, (c) the interactions. Fifth, I explore the effect of alternative Operationalizations of the compositional variables. Finally, I conclude with an exploration of another dimension of adaptation. Individual-level Learning and Controlled Cogg'tion Because the literature on human information processing, skill acquisition, individual differences, and control theory supports the underlying process assumed to be involved in the proposed model at the individual-level, I did not present aptjpp' hypotheses in regards to the effects of individual differences and the manipulations on those processes (i.e., individual-level learning and the triggering of controlled information processing). However, because these processes are the underpinnings of the model, I felt that it was important to ensure that they were at work in this particular research setting. In this section, I present data addressing two questions. First, did individuals with higher gleam more about the task itself and have more awareness of the 119 team’s situation after the communications breakdown? Second, did the manipulations (diffith goals, full feedback, abrupt disruptions) trigger higher levels of active thought about the task? An individual-level focus is appropriate for these analyses because learning that results in a change in the pattern of activity among team members takes place in the minds of the individuals who compose the team. Such learning does not have to be shared among members in order for adaptation to occur (Fiol & Lyles, 1985; Hedburg, 1981; Hutchins, 1996). The com’tive resources-learning relationship. In order to assess the extent to which high levels of cognitive resources resulted in a larger pool of knowledge regarding the task and situation (assumed to precede the behavioral changes associated with team adaptation), I examined the relationship between individuals’ cognitive resources (as measured by individuals’ score on the Wonderlic Personnel Test) and declarative knowledge acquired during training. Task knowledge was measured by a 6-item instrument developed for this study and was administered immediately after training. As expected, there was a positive relationship between an individuals’ score on the Wonderlic and the task knowledge test, I = .16, p < .01 (p = 423). This statistically significant relationship suggests that those with higher levels of cognitive resources learned more during training and their initial experience with the task than those with lower levels of cognitive resources. It was also important to examine the extent to which higher levels of cognitive resources enabled individuals to have more knowledge about the team’s situation during the experiment (situational awareness). The most relevant aspect of the situation was the reliability of the communications between each dyad (i.e., Alpha-Bravo, Alpha-Charlie, 120 Bravo-Charlie), therefore, the measure of situational awareness was based on this aspect of the situation. After the experiment, individuals were asked to rate the unreliability of communications during different phases of the scenario using items developed for this specific study (Questions 11-34, Appendix G). While these self-reports suffer from the weaknesses of being retrospective, asking participants during the simulation would have created a priming effect. I should also note here that some of these items were used as a abruptness manipulation check. However, the measure of situational awareness included only some items related to the communications between Bravo and Charlie. In addition, these items are only one component of the situational awareness measure. Specifically, the measure of situational awareness was created by subtracting individuals’ ratings of communications unreliability for each series of targets from the true unreliability of that series of targets, and then averaging across each series (series 1= targets 43-53, series 2 = targets 54-63, series 3 = 64-73, series 4 = targets 74-83). Creating such an index was necessary because individuals in different conditions experienced disruptions at different points in time. As expected, individuals with higher levels of cognitive ability had more situational awareness, I = -.11, p < .05 (lower scores on the situational awareness variable indicate higher accuracy in terms of knowledge of the situation) than those with lower levels of cognitive ability (p = 423). The manipulations-controlled cogpt'tion relationships. In order to ensure that the manipulations triggered controlled cognition intended to overcome the communications breakdown, I examined the relationship between scores on a self-report cognitive effort scale (items 9 and 10 in Appendix G, Cronbach’s alpha = .66) and the goal, feedback, and environmental disruption manipulations. As with the measure of situational awareness, I 121 felt that the potential problems caused by priming effects outweighed the weaknesses of a self-report retrospective measure. After controlling for the effects of the individual differences (cognitive resources, conscientiousness, and openness to experience), two of the three manipulations resulted in higher levels of self-reported cognitive effort. Significant (one tailed) partial correlations indicated that the goal as well as the abruptness manipulation resulted in higher levels of self reported cognitive effort (t = .08, p < .05 and I = .11, p < .05 [n = 423], respectively). There was not a statistically significant relationship between quality of feedback and cognitive effort, however. Summgg. Overall, the results these analyses were fairly supportive of the assumed effects of the independent variables on individuals’ acquisition of declarative knowledge and triggering of active or controlled information processing. The only relationship that failed to indicate support for the implied process was that between the feedback manipulation and cognitive effort. That is, there was not a significant difference in the amount of self-reported cognitive effort between individuals who received timely and specific feedback from those who received delayed and summarized feedback. As pointed out earlier, individuals in the high quality feedback condition did perceive that they were more informed about their standing than individuals in the delayed feedback condition. One explanation for this unexpected finding is that individuals in the low quality feedback condition had to expend relatively more cognitive effort in order to self- regulate in the new environment (monitor and evaluate their standing). That is, while there was no difference in the amount of cognitive effort expended, the focus of the effort was directed differently for those in the different feedback conditions. If this is the case, then individuals in the high quality feedback condition may have expended more 122 cognitive effort trying to devise means of overcoming the breakdown, while individuals in the low quality feedback condition expended more cognitive effort trying to figure out where they stood. An alternative explanation for the lack of a feedback effect is that while there were differences in perceived amount of information provided by feedback, both conditions provided enough information to trigger active thinking. Descriptive Statistics of Team Level Vagabjgs Descriptive statistics for the study variables at the team level of analysis (n = 141) are presented in Table 3. The first two columns of data list means and standard deviations of the team-level variables. The columns numbered 1-15 list zero order correlations. Team Resources. The continuously measured individual difference variables are listed in the first 9 rows of the matrix (three characteristics aggregated three different ways). Across characteristics, the means for the conjunctive operationalizations are approximately one standard deviation less than the additive and two standard deviations less than the disjunctive operationalizations. Alternative operationalizations of the same characteristic are more highly related to one another than to the other characteristics. Correlations between the additive and other operationalizations (conjunctive and disjunctive) were high (.70-.80) while the correlations between the conjunctive and disjunctive operationalizations were all more moderate (.24-.30). Manipulations. Correlations between the three manipulations are all near zero. Only one of the twenty-seven correlations between the manipulations and the measured characteristics reached even a marginal level of significance and the average correlation was small (r = .02). Overall, therefore, it appears that the random assignment to conditions worked as intended. 123 2.828.832": .8. .8.- 8. .8- 8.- .2- .2.- .2.- 2. 8.- 8. 8.- .8. .8- 8. 82