A CLINICAL ASSESSMENT OF A COMMUNITY COLLEGE - AFFILIATED GUIDANCE CENTER FOR WOMEN Thesis for the Degree of Ph. D. MICHIGAN STATE UNIVERSITY JERRY G. SULLOWAY~ 19.69 LIBRARY Michigan State University TH F'SIS This is to certify that the thesis entitled A CLINICAL ASSESSMENT OF A COMMUNITY COLLEGE - AFFILIATED GUIDANCE CENTER FOR WOMEN presented by Jerry G. Solloway has been accepted towards fulfillment of the requirements for Ph .D. d Education egree in______ Date February 27, 1970 0-169 I new .4... GI: : - SOLE, ABSTRACT A CLINICAL ASSESSMENT OF A COMMUNITY COLLEGE-AFFILIATED GUIDANCE CENTER FOR WOMEN By Jerry G. Solloway Evidence of role changes among mature women in our society may be found in the employment statistics of mature women. More than one out of three married women are in the labor force today. However, the growing number of mature women who train for re-entry into the labor force or who are searching for meaningful employ- ment outside the home are often in need of specialized counseling services geared to assist women in this transition process. Higher education has made a substantial commit- ment to serving the unique needs of mature women through educational and vocational counseling services. Most recently there has been growing interest amont some community colleges to provide adult counseling services. The emergence of the community college as perhaps a logical institution to serve the educational and voca— tional guidance needs of adults in the community has Jerry G. Solloway given rise to the necessity to learn more about the effectiveness of such services. Statement of the Problem The study was designed for the twofold purpose of assessing the impact a community guidance center for women had on adult clients and to determine the relation— ship between clinically-Judged counseling impact and selected personal and demographic characteristics of clients. The study also included an analysis of such related variables as client expectations and satisfac- tion, and the decision-making and post-counseling behavior of clients. Procedures The sample was selected from 816 clients of the New York Guidance Center for Women. A representative sample of llu clients, drawn randomly from the popula- tion stratified according to the counseling disposition of clients, provided the source of data. Client perceptions of entry and post-counseling behavior were obtained from the Client Questionnaire which consisted of forced-choice items with provisions for free-response categories. Client attitudes toward the Guidance Center and perceptions of the counseling experience were measured by the Client Satisfaction Scales. ‘ o .u'v‘n ‘e ‘ “fin!“ c“ “\I\ w--vo- IN; ‘17:» n‘ .ut ‘UAOIg a- I ans d- . "On-pct Cine u I" t‘. L.;€ PESE‘ETC" Al se.ec:eu for 9 o, C) ”3 n“ ‘_ . - .. 6‘1 Suva»... ‘. to an . ‘r‘V‘e I”. Lk) Jerry G. Solloway More specific data on client expectations and satisfaction, and in-depth information on post-counseling behavior of clients were obtained by telephone interviews with clients. Four experienced counselors, using a Client Interview Guide, conducted the interviews, ana— lyzed the findings, and classified clients into cate— gories by the degrees of positive impact the Center was judged to have had upon its clientele. Descriptive and statistical analyses were made involving all relevant data obtained in the study. Two non-parametric statistical techniques were used to test the research hypotheses. The .05 alpha level was selected for defining the critical region of rejection for all statistical analyses. Major Findings of the Study 1. There were no differences in client-expressed favorableness toward the Guidance Center between clients who completed counseling and clients who did not complete counseling. 2. No differences were found among clients classi- fied according to the degrees of positive impact the Center had upon them on the basis of age, marital status, and educational and employment background. 3. No differences were found among the four impact groups in terms of the number of months which elapsed since counseling was terminated. 14. Jerry G. Solloway A larger proportion of clients expressed satis- faction with the services of the Guidance Center than were Judged clinically as persons for whom the Center had moderate or substantial positive impact. Counseling was perceived by many clients as a supportive service for decisions made prior to counseling. Clients perceived educational and career decision-making as a secondary outcome of counseling. A CLINICAL ASSESSMENT OF A COMMUNITY COLLEGE-AFFILIATED GUIDANCE CENTER FOR WOMEN By Jerry G. Solloway A THESIS Submitted to Michigan State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Department of Higher Education College of Education 1969 To my Grandmother, the late Christine M. Kasper, a dedicated teacher in the Common Schools of Indiana 11 ACKNOWLEDGMENTS The author wishes to express his appreciation to the many people who generously provided time, effort, and encouragement from the planning phase of the research project through the completion of the thesis. It is impossible to list all those to whom the author is deeply indebted. In this moment of overwhelming gratitude, my deepest appreciation to Dr. Max R. Raines--friend, out- standing national figure in the community college field, advisor, and director of this thesis-«for hours of patient guidance and reflection, and continuous support and encouragement. The same spirit of gratitude to Professor Russell J. Kleis for his genuine interest in the design of the thesis and to Drs. Louis C. Stamatakos and Shirley J. Taylor for their willingness to serve as members of my guidance committee. A special expression of gratitude to the late Dr. Max S. Smith, an outstanding contributor to the community college movement, for his personal interest in my professional development and assistance in plan- ning my doctoral program. iii To Dr. Marie R. Prahl and Miss Barbara Stephenson for serving as interviewers and assisting with the classification of clients; and to Dr. Natalie Sproul for many hours of assistance with the research design and statistical analysis of data, the writer is grateful. To the patient and cooperative staff of the New York State Guidance Center for Women, especially, Dr. Esther M. Westervelt, for her guidance and insight, and help with the data. To Mrs. Priscilla Jackson, Mrs. Eleanor Driver, Dr. Mildred B. Erickson who each contributed uniquely to the thesis. And finally, to my precious and loving wife, Sharon, who has been a tower of strength and patient encouragement; to Chris and Jenny for their sacrifices and amazing under- standing, and to our loveable surprise, Sara Linn, for her inspiration and joy which greatly helped her daddy finally finish his Ph. D. iv .- db-Ubvnc -. .n-vvn' .- .— A' I - :‘w...\ v I..- nigh . I ?\ ‘. A. I ‘9 ‘ 'K Y‘. .4 C C) TABLE OF CONTENTS Page DEDICATION . . . . . . . . . . . . . . . ii ACKNOWLEDGMENTS . . . . . . . . . . . . . iii LIST OF TABLES . . . . . . . . . . . . . Vii LIST OF FIGURES . . . . . . . . . . . . . ix LIST OF APPENDICES . . . . . . . . . . . . X Chapter I 0 INTRODUCTION 0 O O O O O O O O O 0 O 1 Introduction to the Problem Area . . . . . l The Changing Role of Married Women . . . . 3 Sources of Intervention . . . . . . . . 5 Counseling and Counseling Outcomes . . . 8 The Problem . . . . . . . . . . . 9 Assumptions of the Study . . . . . . 12 Operational Definitions of Terms . . . . . l3 Delimitations . . . . . . . . . . 14 Organization . . . . . . . . 16 II. DEVELOPMENT, ORGANIZATION, AND OPERATIONAL PROCEDURES OF THE NEW YORK STATE GUIDANCE CENTER FOR WOMEN . . . . . . . . . . . 18 Introduction . . . . . . . . . . . 19 -History of the New York State Guidance Center for Women . . . . . . . . . 19 Functions of the Center . . . . . . . . 21 The Services of the Center . . . . . . . 22 Operation of the Center . . . . . . . . 26 Present Status and Future Plans . . . . . 32 Summary . . . . . . . . . C) t") (j) (I) y——.. - o , ,1. .— Y A‘ou...y._ :“~, Lu“... V“ A.."".‘ I \ I I . No. ~'_“.‘~.‘ ‘N \~. ‘ V“. n " ~, .3 ¢.~ ~. 5. _- c «l. - ‘.._‘~ Q.. ._ 9“; \. n5“ VV.. :~_‘ .A 9-... ' Iv “— s§~~‘y‘do.:‘“ .‘ '\\W\'-“ R“ hfiy. ‘ y — \ uueh‘o‘U ~~ Chapter Page III. A REVIEW OF RELATED LITERATURE . . . . . . 39 Introduction . . . . . . . . 39 Role Ambiguities of Women . . . . . . . 42 Sources of Intervention . . . . . . . AS Community College Intervention . . . . . U8 Counseling Outcomes and Evaluation . . . . 51 Client Demographic and Personal Variables Related to Counseling Outcomes . . . 61 Summary of the Review of Related Literature . 65 IV. METHODOLOGY AND PROCEDURES . . . . . . . 70 PART I--Definition of the Population . . . 70 The Sample . . . . . . . . . . 71 Collection of the Data . . . . . . . . 73 Instrumentation . . . . . . . . . 7A Attitude Scale Analysis . . . . . . 77 Statistical Treatment of the Data . . . . 78 PART II--The Clinical Judging Process . . . 80 Summary . . . . . . . . . . . 88 V. ANALYSIS OF THE DATA AND FINDINGS . . . . . 90 Part I——Profi1e Analysis . . . . . . . 90 Part II—-Statistica1 Analyses . . . . . 108 Summary . . . . . . . . . . . . . 114 VI. SUMMARY AND CONCLUSIONS . . . . . . . . 116 Summary . . . . . . . . . . . . . 116 Methodology . . . . . . . . .' 117 Findings of the Study . . . . . . . . 119 Implications of the Study . . . . . . . 122 Suggestions for Further Research . . . . 12A Conclusions . . . . . . . . . . . 127 BIBLIOGRAPHY . . . . . . . . . . . . . . 130 APPENDICES . . . . . . . . . . . . . . 136 vi Table 10. 11. 12. LIST OF TABLES Statistical Summary of the Counseling and Testing Services of the New York State Guidance Center for Women . . . . Clients Counseled by Type of Service and Average Number of Interviews . . . Item Analysis of Scale A by Frequency and Percentage of Error . . . Item Analysis of Scale B by Frequency and Percentage of Error . . . . . . Frequency of Clinical Ratings by Classification Criteria and Degrees of Positive Impact . . . . . . Distribution of Client Decision-Making Behavior by Degrees of Positive Impact . Distribution of Client Post—Counseling Action on Plans by Degrees of Positive Impact . . . . . . . . . Distribution of Client Information Sources by Degrees of Positive Impact . . Distribution of Client Expectations by Degrees of Positive Impact . . . . . Frequency Distribution of Client Ratings of Criteria for Counseling Success . . . Frequency Distribution of Client Endorsements by Counseling Impact Categories . . . . Distribution of Client Characteristics by Degrees of Positive Impace . . . vii 30 31 79 79 83 85 87 92 9A 99 100 Table Page 13. Distribution of Attitude Scale Scores by Degrees of Positive Impact . . . . . . . 107 1“. Frequency Distribution of Clients by Impact Categories According to the Number of Months Elapsed between Counseling Termination and Evaluation . . . 113 viii LIST OF FIGURES Figure Page 1. Results of the Mann—Whitney U Test for Two Sub-Groups Classified According to Counseling Disposition on the Counseling Satisfaction Scale . . . . . . . . . 108 2. Chi-Square Analysis for Differences in Client Age for Groups Classified According to the Degrees of Positive Impact of Counseling . . . . . . . . 110 3. Chi Square Analysis for Differences in Marital Status for Client Groups Classified by Degrees of Positive Impact of Counseling . . . . . . . . 110 A. Chi Square Analysis for Differences in Employment Background for Client Groups Classified by Degrees of Positive Impact . . . . . . . . . . 111 5. Chi Square Analysis for Differences in Educational Attainment for Client Groups Classified by Degrees of Positive Impact of Counseling . . . . . 112 6. Chi Square Analysis for Differences in Time Lapse since Counseling Termination for Client Groups Classified by Degrees of Positive Impact of Counseling . . . . 11A ix LIST OF APPENDICES Appendix Page A. Pre—Test and Final Client Questionnaire; Letters of Transmittal to Client Sample; and Pre-Test Procedures and Results. . . . . . . 137 B. Pre-Test Client Questionnaire Tabulations. . . . . 154 C. Table C-1.--Age Distribution of Sample and Population; Table C-2.——Distribution of Client Sample and Population by Marital Status; Table C-3.——Distribution of Client Sample and Population by Employment Background . 156 D. Client Interview Guide . . . . ... . . . . . . . . 158 E. Table E-1.--Distribution of Impact Categories by Guidance Center Counselors; Table E-2.-- Distribution of Clients into Counseling Impact Categories by a Panel of Judges . . . . . 162 F. Table F-1.-—Frequency Distribution of Attitude Scale B Scores by Counseling Disposition . . . . 165 G. Table G-l.--Distribution of Degrees of Positive Impact and Satisfaction by Client Character- istics; Table G-2.--Distribution of Degrees of Counseling Impact and Satisfaction by Client Characteristics . . . . . . . . . . . . . 167 H. Free Response Statements Submitted on Client Questionnaire. . . . . . . . . . . . . . . . . . 172 CHAPTER I INTRODUCTION Introduction to the Problem Area Our society is more affluent today than at any time in its past. Technological advancements, increased social and economic mobility, changes in urban and family living, increased manpower needs, and significant changes in the world of work have produced dramatic changes in the atti; tudes, values, and life—styles of individuals and groups in society. If we were to search for the one person most affected by the social and economic changes of the last quarter century, it would be the married woman over 30 years of age whose family no longer demands most of her time and who is inclined to seek enrichment of her life both in and out of her home. She is generally aware that her know- ledge, skills, energy, and experience could make her life more interesting, challenging, and productive. If she considers employment, she may know little about Job oppor- tunities, working conditions, and the skills required in a highly competitive economic system. She may also be uncertain of her ability to learn new skills, or to com— pete in educational or Job situations; or she may be worried about managing her household responsibilities and the reactions from her husband and children.1 Social institutions have attempted to respond to the needs of mature women affected by social-economic changes. One such kind of response has been provision for somewhat specialized counseling services geared to assist women in making a successful transition from the single role of housewife to the dual role of housewife-worker or full time employed person. Education, and particularly higher education, is one social institution which is making a growing commitment to serving the unique needs of mature women through counseling and counseling related services. The major purpose of this research was to determine the effectiveness of such services offered through a community college-sponsored guidance center for women. The focus of the study was on the adequacy of counseling services provided by an educational agency with particu- lar concern on the degree of impact these services had upon client behavior. The study was also concerned with the role personal characteristics of clients plays, if any, in the impact level of counseling. lKate H. Mueller, "Counseling Mature Women for Employment," Women's Education, Vol. 5, No. 1, March, 1966. 2New York State Guidance Center for Women, affili- ated with Rockland Community College, Suffern, New York. The Changing Role of Married Women Increased leisure time, expanded educational Oppor- tunities, increased manpower needs, and growing affluence have provided mature women with the opportunity to explore a broad scope of activities outside the home. Many women now anticipate filling a large portion of their lives with satisfying and productive experiences. The principal change in the composition of the labor force and the most important source of its growth has been the increased participation of married women. Between 19A0 and 1960, the labor force increased by over 1“ million persons. Over 56 percent of this increase consisted of married women.3 Several factors have influenced the changing role of married women in the labor force today. Over half of the women in our society are married before they are 20 years of age.“ Whereas women formerly worked prior to the child-bearing stage of their lives, now many women have , their children first and then enter the labor force. The median age at which American women complete child-bearing 3Glen C. Cain, Married Women in the Labor Force (Chicago: University of Chicago Press, 1966), p. 1. “Mary D. Keyserling, "Facing the Facts about Women's Lives Today," in New Approaches to Counseling Girls in the "1960's. Report offithe Midwest Regional Pilot Conference (Washington: Office of Education, 1965), p. 5. is now 26 and four out of five young women may expect to be employed some time during their lives.5 Also influencing the role of married women today is increased leisure time resulting from technological advances in the home, more widespread adherence to family planning, and an increase in the length of the educational period of children. The rapid rise in the standards and costs of living is another factor which has given impetus to the employment of married women. Today more than one out of every three married women are in the labor force.6 For many women considering employment outside the home or returning to some form of post-high school educa- tion to prepare for work, several problems stand in their way. They have lost touch with the ever wider range of employment opportunities which modern technology has produced. Many women who have been out of the labor force for several years have lost confidence in their ability to perform in new undertakings as well as to adjust their schedules to their new dual role. Others simply may need assistance in career planning or information concerning 5Committee on Education, "Report of the Committee on Education" (Washington, D. 0.: President's Commission on the Status of Women, October, 1963), p. 29. 6Edgar M. Hoover, "Population and Labor Force Pro- Jections for 1985," Women's Education (Washington, D.C.: AAUW Educational Foundation, December, 1967), p. 7. educational and training programs to prepare for re- entrance into the labor force. One of the most common characteristics of middle— class housewife-mothers is the pervasive lack of confidence 7 has observed that "American in their own ability. Self housewives have relatively little feedback concerning their own real abilities, and lack external criteria for evalu— sting themselves . . . they all too often underestimate their competence and personal worth as they survey the inevitable problems with husbands, children, and routine housework." Sources of Intervention Numerous public and private agencies have tradition— ally provided career guidance and placement services to women seeking entry into the labor force. Available sta- tistics indicate that the state employment services offer vocational guidance or information to the greatest number of persons. They serve nearly 750,000 women jobseekers annually.8 Yet a survey in 1962 revealed that there were only 3,120 counselors in various state employment services, and only 35 percent of these were full-time counselors.9 7Gerald Self, "Women on the Move: Some Common Psy— chological Problems," A paper presented to the Governor's Commission on the Status of Women, Las Vegas, Nevada, June 13-lh, 1969, p. 2. 8 9 Committee on Education, op. cit., pp. 27—28. Committee on Education, op. cit., p. 28. The Committee on Education urged that "new sources be tapped to relieve this shortage of qualified personnel . counselors in public employment offices do not meet the standards recommended by either the United States Employment Service or professional organizations in the field."10 The U. S. Office of Education reported that in the fall of 1967, the number of women college students was over 2.8 million. Over 300,000 women students were between 25 and 34 years of age. While statistics on the number of adult guidance programs in the U. S. are not available, a review of the Department of Labor report on educational programs for women suggests that guidance services for women returning to college have lagged behind the rapid increase in continuing education programs for women. The American Association of University Women esti— mated in 1967 that there were at least 300 colleges and universities in the United States offering some form of special educational-vocational counseling services to 12 ‘women. While statistics are not available on the number 10Committee on Education, 0 . cit., p. 28. 11Women's Bureau, U. S. Department of Labor, Continu- in Education Programs and Services for Women, Pamphlet 10, I968 (Prepared by Jean A. Wells). 12Virginia L. Senders, "Continuing Education for Wonmnr-The Third Revolution," The University in Motion: The Status of Woman (Urbana, Illinois: Bevier Lecture Series, November, 1967), p. AA. of junior colleges which offer such services, the Women's Bureau report indicates that junior and community colleges have not adequately responded to this need.13 One of the most dramatic new developments in the short history of the community college movement in this country has been the emergence of community services pro- grams. Based on the philosophy that education is a life- long process, the concept of community services establishes a commitment by community colleges to serve the entire community. Harlacher has identified community counseling services for adults as an important function of the junior college community services program.1u In 1958, Tyrus Hillway recommended that counseling services for adults be provided through a "community center of guidance and information, which could be operated by the community college or some other agency." Unless there are other agencies offering such a service, the community college probably ought to accept responsibility for a community guid— ance program . . . There seems to be no reason, except in a large urban center, why one guidance program cannot be organized which will care for all needs of this type in the area. Such a ser- vice, of course, must be on a highly professional level and somewhat more complete and specialized 13Women's Bureau, op. cit., pp. 85-92. luErvin L. Harlacher, Effective Junior College Pro- grams of Community Services: Rationale, Guidelines, PracticesVTLos Angeles: University of California Junior College Leadership Program, Sept., 1967) Occational Report #10, pp. 29-30. than the personal and social uidance included in the usual school program.1§ Counseling and Counseling Outcomes One of the primary tasks of educational—vocational counseling is to assist individuals in developing decisions. Goldman has observed that "an almost universal characteris- tic of counseling . . . is that it deals with decisions and plans . . . usually to give help in making decisions and plans for the future and in choosing among alternative courses of action in the world of reality."16 Decision-oriented counseling involves the clarifica- tion of the client's needs or problem; provision for obtaining relevant information, exploration and evalua- tion of emerging alternatives, consideration of anticipated outcomes of the alternatives, and ultimately, the assess- ment of behavioral outcomes. Despite an emphasis upon a cognitive approach, successful counseling cannot ignore affect. Inasmuch as the client's perceptual ability and attitudes will have a profound influenCe on the decision- rnaking process, the degrees of success in counseling will be related to the counselor's sensitivity to client feel- ings and his insight into the client's perception of the problem or need. A client may be attempting to resolve a 15Tyrus Hillway, The American ngzYear College (New York: Harper & Brothers Publishers, 1958), p. 13“. 16Leo Goldman, Using Tests in Counseling (New York: Appleton-Century-Crofts, 1961), p. 25. vocational conflict or to determine an apprOpriate occupa- tion for which to prepare or to explore job opportunities in the community. Whether or not the problem is a "personal" problem depends in large measure upon the client's perception; but in any case, alternative solu— tions are likely to have implications for the client's future activities. Other factors related to the assessment of counsel- ing are the personal and demographic characteristics of clients. While little research has been conducted into this aspect of counseling effectiveness, it may well be that personal characteristics, return patterns, and other attributes of clients are important determinants of the impact counseling may have upon clients, particularly, mature female clients receiving specialized educational and vocational counseling. The Problem Statement of the Problem The central purpose of this research project was to assess the effectiveness of counseling within a randomly selected sample of adult clients from a community college- afTiliated guidance center for women. More specifically, this investigation proposed to assess the impact of cusunseling upon the behavior of clients and to analyze tflie relationship between the degrees of counseling impact ; | . I" I; I1: "EL 10 and selected personal and demographic characteristics of clients. The study focused on the degree of client satisfac— tion as measured by an attitude scale and on the decision— making and post-counseling behavior of clients as assessed by a panel of clinicians. It was the purpose of this 1 research to examine the following questions: I 1. To what extend did the guidance center have a r: v- ania fi"7'i . positive impact upon clients and how is the degree of impact related to various characteristics of clients served by the center: a. Did the center have more positive impact on younger clients than older ones? b. Did married clients with children at home differ from married clients with no children or single clients in the degree of impact counseling had upon them? c. Did the center have more impact on clients with limited employment experi- ence than clients with extensive work backgrounds? d. Did the center have more impact on college-educated clients than non- college-educated clients? 2. Is there a significant positive relationship between clients categorized according to the degrees of impact counseling had upon them and a. Scores on a counseling satisfaction scale, b. The number of counseling sessions, and c. The time lapse between the termination of counseling and this research study? a 1V" V--“‘ g not! A? “1“...U.‘ ”I‘“"sei 11 3. How do the modal patterns of client personal characteristics compare for the group of clients who were clinically judged as persons for whom the center had "substantial" and "moderate" positive impact with the group of clients judged to have received "limited" or "no" benefit from counseling? Related to these inquiries are further questions relevant to the investigation of counseling outcomes. The study was designed to answer the following questions: 1. To what extent are the sources of client infor- mation about the center and client entry expectations related to the center's impact on clients? 2. Is achievement of a "satisfactory decision" ranked by clients as the most beneficial outcome of counseling? 3. Were clients who withdrew from counseling less satisfied with counseling than those who completed counseling? A. Which criterion, if any, had the greatest influ— ence upon the clinical judgments of the panel of judges in determining the degrees of impact counseling had upon clients? Hypotheses to be Tested Hypothesis I: Clients who completed counseling will express a significantly higher level‘ of satisfaction with counseling than those who did not complete counseling. ‘7. 4n T—.-.-u-- 12 Hypothesis II: The degree of positive impact of coun- seling upon clients over forty years of age will be significantly greater than for clients under forty years of age. Hypothesis III: The impact of counseling upon clients who are married with children at home will be greater than upon clients who are single or married with no children at home . i l i i L Hypothesis IV: Clients with ten years or more of pre- vious employment experience will experience significantly greater impact from counseling than those clients with less than five years of work experience. Hypothesis V: The degrees of positive impact of counseling upon clients with some post- high school education will be greater than for clients who did not complete high school. Hypothesis VI: The degree of positive impact of coun- seling upon clients who terminated counseling within the year preceding this evaluation will be significantly less than for those clients who termi— nated counseling more than one year preceding it. Assumptions of the Study Assumptions concerning the counseling process, the nature of women's problems and needs, sources of interven- tion, and the processes of evaluating counseling are described in the review of the literature. The techniques developed for the evaluation of the guidance center were based on the following underlying assumptions: 1. That a reliable and unidimensional measure of client attitudes toward the guidance center could be designed. l3 2. That valid and reliable information concerning client attitudes, expectations, and decision— making and post-counseling behavior could be obtained by questionnaire and interview tech- niques. 3. That an experienced panel of professional counselors could assess, with an acceptable degree of reliability and objectivity, the degree of impact counseling had on the clients in the sample. A. That research concerning techniques to assess counseling outcomes is essential to the development of counseling technology and to the administration, planning, and improvement of counseling services. Operational Definitions of Terms Because of the unique nature of a community guidance center and in consideration of the techniques employed to evaluate the outcomes of counseling, the following defini— tions were provided to add clarity to the study. The definitions include: 1. Counseling. A personal, face-to-face rela— 'tionship between two people, in which the counselor, by Jmeans of this relationship and with special competencies arui human skills, assists the client in self-evaluation, auialysis of interests and needs, and planning, to achieve 21 relevant decision (or plan) concerning educational and/or career activities . 2. Client. Any adult who received counseling ser- viJces including at least one interview with a professional ccnlnselor on the guidance center's staff. 3. Guidance Services. Those services offered to clJJents by the center which include primarily: I. It 1A a. Educational and vocational (career) information. b. Counseling (see #1). 0. Testing services. A. Counseling Disposition. Because of the experi- mental nature of the guidance center, detailed records of' each client case were maintained by the staff for the pur— pose of accountability and follow-up research. The two .r- --—.-—- "N I I major counseling disposition classifications were: a. Incomplete Cases: client-initiated termination of counseling prior to the development of a plan. b. Complete Cases: termination of counseling by mutual agreement because the client developed a plan of action, decided to defer action, or was referred to another more appropriate agency. Delimitations There were several limitations in the design of this research. The study was confined to the client population (761 women, 55 men) who were classified as "clients" by the guidance center staff. The size of the sample repre- sented only 15 percent of the total population, and while tfliere is evidence of some homogeneity within the population, true sample may not accurately represent the population on zall variables included in the study. Another limitation was the time lapse between those cilients who received counseling-services at the time the Geniter was opened and those clients who completed counseling 15 just prior to the investigation. The study encompassed only the first twenty—two months of the center's opera- tion. Thus there were clients who received counseling during the early stages of the center's development when services were not yet fully developed and the staff was new, and clients who received the benefits of an experi— enced staff and complete guidance services after several months of operation. The limitations of questionnaire studies and atti— tude scale techniques are well established and need no further elaboration. The use of telephone interviews, while they enabled larger sampling than would have been possible with personal interviews, were also a limitation to the study. For some respondents, discussing their counseling experience and subsequent behavior was more relaxing and easier over the telephone; while others may have considered the telephone interview an invasion of privacy and as involuntary participation in the research. Since no before-after measurements were made, no aactual changes in client behavior were observed that could be: attributed directly to counseling. Rather, the basic hypothesis was that clients who have been differentially e)qaosed to various kinds and amounts of counseling would Vattain predetermined objectives in differential amounts or-the Center was ignorance of the educational and vocatunml opportunities available to them. This condi- tionvnm possibly the result of the span of years devoted to domestic activities which restricted their contact with recent developments in educational and employing institu- tions. It was also the result of ever increasing numbers and variety of educational and occupational opportunities. But for most of the women who sought the counseling services of the Center, lack of information was a lesser problem to them than lack of clear goals and a resistance to undergo changes in basic life style patterns to achieve more productive and perhaps more satisfying activities. The registration forms used by the Center were designed to assist prospective clients in identifying their particular problem or need. Since many of the clients were referred to the Center by other agencies and organizations, additional information was available to the staff prior to the intake interview. During the first months of opera- tion, all intake interviews were conducted by a single counselor» However, because of staff scheduling problems, this pnmocedure was discontinued and intake interviews were conducted.by the counselor assigned to the case. All counseling and testing sessions were arranged on a strdxrt appointment basis because of the staff scheduling arrangement described earlier. The assignment of new clients was the function of a paraprofessional staff member 28 whoaflso was responsible for administering and scoring all tests. Clients generally remained with the same counselor Inudl counseling was completed. If testing was indicated, clients scheduled appro- gndate time for testing followed by a testing interpreta— tion session with the assigned counselor. A fee of $2.00 was charged for each test administration unless the client was unable to pay. Counseling and all other services of the Center were free of charge. Extensive records were maintained on all clients. Client folders included considerable background information provided by the client when she registered, elaborate and very detailed interview summaries prepared after each interview by the counselor, test results and client pro— files, and the counselor's summary report prepared for each client after counseling was terminated. One of the major responsibilities of the Center's director involved the supervision of the professional staff. Since part-time counselors were used, the staff was considerably larger and therefore demanded extensive communication and more personalized supervision. The standardization of operational procedures and the mainten- ance»ted that with the exception of the investigator, all Jlldges were former colleagues in a community college Ccaunseling center. A pre-interview orientation session was conducted by true investigator to acquaint the clinicians with the pur- Fnoses and procedures of the interview process. A semi- Stzructured interview guide5 was used for this phase of true study. The instrument was designed to assess, on the 'béisis of self-report data, four dimensions considered on 811 a priori basis to be related to the degree of impact ¥ “The judges were Miss Barbara Stephenson, Flint Junior Cchlege Counseling Center, Flint, Michigan, Dr. Marie R. IEPalfl, Associate Professor and Dr. Max R. Raines, Professor, COllege of Education, Michigan State University, East Lansing. 5Appendix D. 75 counseling had on client behavior. The criterion vari- ables were as follows: a. level of client satisfaction; b. number of counseling sessions; c. development of a plan of action; and d. implementation of a plan or development of alternatives. The level of client satisfaction was not identified specifically within the interview guide. Each clinician judged the level of client satisfaction on the basis of all responses during the interview and the expression of attitudes toward the guidance center. Information concern- ing the number of counseling sessions and the development and implementation of a plan of action was obtained directly from the interview guide. It was a responsibility of the judges to make clinical judgments of client counseling and post-counseling behavior on the basis of client self- reports and information made available through the counsel- ing protocols on each client. Because of the similarity between the interview guide and the questionnaire, the interview guide was not pre-tested. The Questionnaire and Attitude Scales The items for the client questionnaire, including the attitude scales, were developed to achieve the following set of objectives: 1. To identify the important sources of informa- tion and/or referral which initially linked the client with the Guidance Center. 76 2. To assess client perceptions of the Center as reflected in their entry expectations and evaluation of counseling services. 3. To determine the client's *eneral attitude toward the Guidance Center. A. To determine the client's attitude toward specific aspects of the counseling experience. 5. To ascertain the client's perception of decision-making (or planning) and post- counseling behavior. Both scaled and non-scaled items were developed to achieve the preceding objectives. The questionnaires used in pre-testing and on the final sample are presented in Appendix A. A review of several attitude scales reported in the research literature revealed that no standardized measure of client attitudes toward counseling or a counseling agency was available. However, in a study of the Coun- seling Center at Michigan State College in 1952,6 the 7 attitude scale methods of Guttman and Likert8 were employed to develop an instrument using the scale discrimination method to measure student attitudes toward the counseling center and staff. The instrument consisted of twenty-two items which represented the final selection from 122 items chosen because of their high discriminatory power. The 6Form, op. cit. 7Louis Guttman, et al., Measurement and Prediction (Princeton: Princeton University Press, 1950). 8Rensis Likert and Gardner Murphy, Public Opinion and the Individual (New York: Russell & Russell, 1938). 77 items selected for the attitude scale in this study were revised to correspond with the goals of the New York State Guidance Center and the clientele served by the Center. A second attitude scale, using a semantic differen- tial technique, was devised to measure a related but different variable—-client attitudes toward their coun- seling experience. A list of twenty bi—polar adjectives I I». 1..- hi ’I .. which describe various features of the counseling experi- ence was compiled from basic textbooks on counseling. The list was reduced to seven adjectives by eliminating those which have similar connotations and those which were inappropriate for adult clients. Copies of the question- naire and attitude scales were reviewed by three directors of women's guidance centers9 and the instrument was subse— quently revised on the basis of their recommendations. Pre-test procedures and results are reported in Appendix A. Attitude Scale Analysis Of the total of seventy-six respondents, several subjects failed to complete all items or mismarked the questionnaire. A scale analysis was carried out for both scales using Guttman's Cornell Technique.lo 9The directors included: Mrs. Priscilla Jackson, Continuum Center for Women, Oakland University, Michigan; Dr. Esther Westervelt, New York State Guidance Center for Women, and Miss Stephenson. 10Guttman, op. cit. 78 A coefficient of reproducibility for client attitudes toward the Guidance Center, Scale A, was computed for sixty—eight subjects. There were sixty-five usable responses on Scale B, client attitudes toward their per- sonal counseling experience. Tables 3 and A indicate the frequency, percentage of error, and the coefficient of reproducibility for each scale. Although both scales met the minimum requirements for unidimensionality, the "error factor" in Scale A was considerably smaller which suggests that this scale provided a more accurage measurement of client attitudes than did Scale B. Findings on the non-scaled items of the questionnaire are tabulated, analyzed, and described in Chapter V. Statistical Treatment of the Data The statistical techniques employed in the analysis of data are non-parametric. This mode of analysis was selected because the following assumptions regarding the use of parametric statistics could not be met: a. Responses of the representative sample for the variables, client satisfaction and degrees of impact of counseling, were not known to be normally distributed. Thus, there is no guarantee that the population is normally distributed on these two variables. b. The variables under investigation were measured on an ordinal scale. There is no guarantee of equal distance between the points of value included in the measure- ment devices and methods. 79 TABLE 3.-—Item Analysis of Scale A by Frequency and Percentage of Error. Item No. of No. of Percentage Coefficient of No. Errors Responses of Error Reproducibility # 9 2 68 2.94% 1 - (gagg) = #10 A 68 5.88% ' #11 A 68 5.88% #12 O 68 1.00% 1 _ ( ) = #13 1 68 l.A7% 612 #1A 2 68 2.9A% #15 8 68 11.76% 1 _ (.039) = #16 2 68 2.9A% #17 l 68 1.A7% .96 Totals 2A 612 TABLE A.--Item Analysis of Scale B by Frequency and Percentage of Error. Item No. of No. of Percentage Coefficient of No. Errors Responses of Error Reproducibility #18 A 25 6.§6% (76 5) #20 9 65 13.85% #21 17 65 26.15% 1 _ ( ) = #22 8 65 12.31% E% #23 8 65 12.31% #2A 8 65 12.31% 1 - (.138) = Totals 63 455 .86 r 4-:- a... an rnarrPS~ . i. 80 The Mann-Whitney test of significant differences between two groups was used to test hypothesis 1. The Chi Square analysis was used to test the remaining hypotheses. Corresponding contingency coefficients were computed to determine the degree of association between each demo- graphic variable and the "impact" variable. The .05 alpha level was selected for defining the critical region of rejection for all statistical analyses. PART II The Clinical Judging Process This part contains a description of the procedures followed in the clinical judging process. Because the judging process is so inextricably interwoven in the revealed characteristics of the sample, this section also includes a breakdown of the impact classification by various criterion categories. A total of ninety-five subjects, representing 83 percent of the revised sample, were interviewed by the four judges. Each interviewer was aSsigned approximately one- fourth of the sample and the interviews were conducted over a four-day period. An effort was made to contact every client in the sample, and several calls were made at different times during the day and evening to reach every client in the sample. 81 The time of interviews ranged from 15 to A5 minutes. All responses to the interview guide were recorded during or immediately following each interview. Although the interview guide was intended to standardize the collection of relevant data, each interviewer exercised discretion in obtaining more "in depth" responses to the items on the guide. This feature of the interview process was parti- cularly important in obtaining reliable clinical judgments of the degree of impact the Center had on clients. The judges also relied upon the counseling protocols of clients in formulating a clinical judgment of each client. Following a review of the interview data and counsel- ing protocols of the assigned clients, the judges classi— fied clients according to the degree of positive impact the Center had upon them. The four "impact" categories were: substantial positive impact, moderate positive impact, limited positive impact, and no (or negative) impact. The decision to consider primarily the "positive" side of the impact continuum was based on the return pat- terns of clients and evidence obtained through earlier research findings conducted by the Center, which indicated that the agency had a generally positive influenCe on its clientele. Because of the desirability of evaluating the Center's impact upon clients based on a relatively large sample, it was impossible to obtain multiple ratings of each client. 82 In view of this factor, and in consideration of possible variations in the interpretation of the criterion variables among the panel of clinicians, six subjects from each of the clinicians' sub-sample were selected randomly for the purpose of determining the interjudge reliability of the classification technique. The counselor's summary report and interview data for each case were reviewed and ana- lyzed independently by each clinician and subjects were classified into the "impact" categories for all twenty-four cases. The test for interjudge reliability, using Snedecor's formula,11 resulted in a reliability coefficient of .78. The distribution of clients by categories of positive impact is reported in Appendix E-2. Table 5 presents the distribution of clinical ratings by classification criteria and degrees of positive impact for the client sample. The table indicates that over 75 percent of the clients interviewed expressed moderate to high satisfaction with the counseling services ‘Uuey received. In contrast, 58 percent of the subjects Vfiare judged by the panel of clinicians as clients for whom the Guidance Center had moderate to substantial positive impact. Approximately one-fourth of the clients expressed dissatisfaction with the services and A2 percent llWilliam A. Mehrens and Robert L. Ebel, Principles: 0f Educational and Psychological Measurement (Chicago: Rand McNally and Company, 1967), p. 120. 83 \ a. emu mew emm mam mom we gem mam men was mam Rem was en: mam new am: eam caeocoocco NH mm om mm mH w mm am on Om mm mm mm m: mm mm m: om mm mHMpOB m m m o o m z c z m a o m H H d m H H H H x. m D m m m a m H m m m. a. o o a a a m m H m o m o m a m m z m a m m m o m n N i x m m mH m m m m e m o s o m o s HH : 2H 3 0 NH 5 am < ”MN m... by do) MW JUN .ru. ”7 .1 .d O a .rl. A,” A k h.. at O .. u nu. H "H a o I o n o a a o m a won 0 n T. u e o o I or m D. u. u 3 f. 1 .3 J I u G. a o _ a 3 M D. on E B I. 8 S 8 a a . .L 3 .d .L a n B J P. a U. 1 U n4 J n4 J O nu” 8 I. T. 9 J Cc \) 3 O J .L. p a Do 9 J a.» U m 8 by .11 “.1“ TL TL. J B A./ D 1 u w I J a I u m o /\ A 1 a o a . a o a u .d J a a J U U T. 1 T. 8 nlfl / o o pomQEH LoH>mcom coHnHooz n:oHunom m:H coHuomumemm muoofinsm o>HpHmom mo moopuoa wcHHonczoulpmom Lo :mHm IHemczoo .o: ucoHHo mo .02 mcmHOHcHHo .uoadeH ¢>prucd an asthma; can cHLQDHLc :cwpmceawuuch a: mmcwpmm HmoHCHHo ac >occzdondll.m mqm 0.0m. Hm O O O m em HH OO em HOOHO a z u z a z a z u z pogonmm Hepoa oz oopHEHH mumnopoz HmHucmumnsm wCHccmHm no wcmez poerH o>HpHmom Ho moonwon acoHnHooo OOOHHO .uomQEH w>HuHmom mo momhwom an L0H>m£om wcmezlconHoom ucmHHo we COHHSDthmHQII.m mamHpHmom mo moonwoa .powaeH o>HpHmom _ mo moopwom an mcmHm co COHpo< wcHHmmcsoonpmom pcoHHo mo QOHHSQHHpmHQII.> mqmHom .0H>Ho O.O O O H O m m H OH O Osmpwonm oHOOm O.Om Om OO O OO HH OH O OH O opoamonsoz, 0.0m Om OH O Om O OO OH mm HH pcoHHo Honpoc< Ho OHHEmm\UcoHHm a z O 2 O 2 O z a z QOHumELOHCH mHmpos oz oopHqu opmnoooz HOHpcmumnsm mo moonsow pomdsH o>HpHmom no moopwoa .pomQEH o>HuHmom mo moopwoa On moopsom coHmeLomcH pcoHHo mo :oHuanHumHQII.O mHmHuHmom mo moopwom .uomQEH o>HuHmom mo woopwom On mcoprpoodxm pcoHHo mo coHOSQHmeHQI|.m mqmHeom OO.H om Om O N O OH Om Hoopmo H0\ch HOCOHumosco COHm HOOO HOHOO HOOHO HOOOO HOOOO ocoosom OOH: OHoO Om.m mm Hm O HH O OH OH Ipsos pzonw wau on OHHCSQHOQQO HOOO HOOHO HOHOO OOOHO HOOOO opus OOOopHo :on OO.N HO OO H O OH O O nHocO tom Onoaasm HOOO HOOOO HOOHO HOONO HOOHO :onHooo HO.m OO HO H OH O HH O OpoOoOOchmn a no pcoao>oH£o< xcmm mmfifixmwm M m 2 m N H *mm0003m :moz Hmpoe mmco mwm wcHHomcsoo pom mHHopHHo *OOOOHOOOO ecmHHO .mwooozm wcHHomcsoo Lou OHLoquo mo mwcchwm OCOHHO mo COHuanppmHQ mocosvonmna.OH mgmOOO one on: no: OHzoz OO OH H mm O OO OH OOH OH :Hmwm mo0H>Hom on» om: OHsoz z ; u z a z a 2 O z Opowoumo Hmpoe poOQEH oz OouHEHH opmpoeoz HmHucmpmnsm oncoamom poerH wcHHmmcsoo m>HpHmom mo mmoawom .moHHowmumo powdeH OcHHomcsoo On mucoEmmLOOcm ucoHHo mo :oHpanHpmHa Occosooamll.HH mqmo O O O O O N O N O N OOnOO OO O NO O OO HH ON O NO O OOuOO OO O NO O ON O OO OH OO NH OOIOO OH O OH N OH O OH O OH O OO Hope: om< OHH OH NH ON OO ON mHOOoeunsm OOH OH NO HH OOH ON OO ON OOH ON OHmsom O O O H O O m H O O onz xmm 2 O 2 O 2 O 2 O z OOHOOHHOHoOtOnO OOHOOO OcoHHO OHOOoO oz ocoz OcpHsHH OOOHmOoz HOHOOOOOOOO pomQEH wcHHomcsoo no mompwoa .OoeosH O>HOHOoO Oo mompmoa Op OOHOnHHoOoOOOOO OcoHHO Oo :oHOOOHpOnHO-:.NH OHOOB 101 _a - I253! 1L OHH OH NH ON OO ON OHOOoeupsm O O O O O O OH O OH O O cane cpoz OH O O H O H OH O HN O O-O OO O ON O OO HH OO OH OO OH OuN OO O OO O NO OH ON O OH O mco mconmom wcHHowcsoo mo ponezz OHH OH NH ON OO ON nHmOoeupsm NO O NO O OO OH OO OH OO OH OOOHHoO OO O OO O OO HH OO OH OO HH OsoHOHO .O .O OH O O H OH O OH O O N OEoHOHO .O .O can» mmpH OOOHOOOO HOOOH Hoocom OHH OH NH ON OO ON mHmeoeupsm OH N OO O ON O OH O HH O .OHO OH Ho>o OO O NO O ON O OO OH NO O .OOO OHuO OO NH ON O NO OH OO OH OO OH .OHO O cane OmoH :Lmupmm whoEOOHQEm 102 judged by a panel of clinicians. The table shows that the distribution is heavily skewed. Over 61 percent of the clients were judged to be in the "moderate" and "substan- ti a1" impact categories. Nearly 13 percent of the clients were judged as persons for whom the Center had no or negative impact. A total of nineteen clients were not interviewed in the revised sample. §p§.--A total of 108 clients (95%) in the sample were women. Exactly 60 percent of these clients who were classified by the panel into the four categories of posi- tive impact were judged to be clients for whom the Center had moderate or substantial impact. Agg.--The frequency distribution for the age variable reveals that over Al percent of the total sample were in the age interval, 30-39. Seventy-five percent of the Client sample were between 30 and A9 years of age. Of the twenty-eight clients classified into the substantial impact category, twenty-one clients were in the 30 to A9 age group. That age group also contained 8A percent of those Clients who were classified in the "no impact" category. Over half of the clients classified in the moderate and substantial impact categories were between 30 and 39 years of age. Over one—fourth of the clients in those 1mPact categories were in the A0-A9 age interval. Clients between A0 and A9 years of age represented one—third of the sample who were classified into impact categories but 103 they accounted for A3 percent of the clients in the "limited" and "no impact" categories. Over 50 percent of the clients in the AO-A9 age group were judged by the clinicians as clients for whom the Center had limited or no positive impact. Over A6 percent of the clients under 29 years of age were classified into the same impact categories. The clients over 50 years of “v-Iur -Ii age were uniformly distributed with no clients classified 1- .§f~ 82.4... 1" ." a in the lowest impact category. Marital Status.--The number of clients who were single or married without children living at home represent approximately 12 percent of the clients in the sample who were classified into positive impact categories. Over half of the clients in this group were judged to be in the moderate or substantial impact category. A total of 85 percent of the clients in the sample were married with at least one child living at home. Fifty-two clients (61%) who were married with children were judged as persons for whom the Center had moderate or substantial positive impact. The table shows that there was a proportional distribution of clients in the four impact categories. Employment Pattern.--Table 12 shows that over half of the clients in the sample had been employed for less than five years. Two-thirds of the clients who had been employed for less than five years were judged to be in the moderate or substantial impact categories. Approxi- mately 18 percent of the client sample had been employed 10A for ten years or more. Fifty-nine percent of this group were judged by the panel as clients for whom the Center had limited or no positive impact. A total of nineteen cli- ents (63%) who had been employed between 5 and 10 years were classified into the moderate and substantial impact categories. The client group which had been employed over ten years were judged to have experienced the lowest degree of positive impact. Educational Background.-—The frequency distribution on the educational variable reveals that clients with post-high school education comprised the largest propor- tion of the sample. A total of forty-three clients representing A5 percent of those classified into impact categories reported some post—high school education. The educational levels attained by clients ranged from a few college courses to course work beyond the masters degree level. Over 65 percent of the clients with some college education were classified in the moderate and substantial impact categories. A total of forty—one clients classified by the panel possessed a high school diploma. Nearly 60 percent of this group were judged to be in the moderate-and substan- tial impact categories. A total of eleven clients repre- senting 12 percent of the classified clients reported that they had not completed high school. While there were no significant differences between clients in the four impact categories on the educational variable, the group of 105 clients who did not complete high school had the highest percentage of persons in the limited and no impact cate- gories. Number of Counseling_Sessions.—-Nearly half of the clients in the sample had two to three counseling sessions. Approximately one-third of the clients classified into impact categories had one counseling session. Almost 68 percent of those with one counseling session were judged to be in the limited and no positive impact categories. However, three clients with only one counseling session were judged as persons for whom the Center had substantial positive impact. A total of thirty-one clients (69%) in the 2 to 3 counseling sessions interval were classified in the sub- stantial and moderate impact categories. Clients with over three counseling sessions had the highest percentage of representation in the moderate and substantial positive impact categories. Client Attitudes Toward the Guidance Center It was noted in Chapter IV that while the two atti- tude scales administered to the pre-test sample had comparable reliability coefficients, there was a large difference in the coefficient of reproducibility between the two attitude scales. Because the scale which measured the attitudes of clients toward the Guidance Center (Scale A) had fewer "errors" than the measurement of client 106, attitudes toward their personal counseling experience, (Scale B), and because of the assumed greater unidimen- sionality of Scale A, the statistical tests were conducted using the data from Scale A. Table 13 describes the frequency distribution and percentages of attitude scale scores by degrees of positive impact. Of the fifty-six clients who completed the atti- tude scale and who were also interviewed, twenty-four of them, representing A3 percent of the sub-sample, had scores on the attitude scale ranging from A1 to A5. On a nine item scale with unfavorable to very favorable responses weighted from 1 to 5, scores in the Al to A5 interval reflect very favorable attitudes toward the Center. Almost 80 percent of the clients in this score interval were clinically judged as persons for whom the Guidance Center had moderate or substantial positive impact. Five clients whose scores reflected very favorable attitudes were judged to be in the limited positive impact category. Of the nineteen respondents who had scores in the 36-A0 interval, twelve clients (63%) were judged to be in the moderate and substantial impact categories. Clients who were judged by the panel of clinicians as persons for whom the Center had limited or no positive impact generally expressed the greatest level of dissatisfaction. FEES? twawm‘. «IQ-fl 107 mm O O OH OH wprOB 0.0H O m.mm m 0.00 O o 0 cm 30Hmm m.mH O 0.0N m o H.Om : m.:H H mmlom m.mm mH m.OH Hm m.Om m H.NO w H.Hm O oalmm m.m: ON 0 0.0N m o.mm O m.Om MH mOIHO O 2 O 2 O 2 O 2 O z wohoom HOOOO OOOHEOH Oempmeoz HOHOOOOOOOO OHOOO OOOOHOOO podeH o>HuHmom mo moopwom .OoOOsH O>HchoO Oo moopmoa Op mmnoom OHOoO OOOOHOOO Oo coHOOOHnOmHOIn.OH mHOOO 108 Part lI--Statistical Analyses hypothesis I Clients who completed counseling will express a significantly higher level of satisfaction with counseling than those who did not complete counseling. The results of the Mann Whitney U Test (corrected for ties), Figure 1, reveal a U value of 432.5. The corresponding 2 value, .82, fails to equal or exceed the .05 level of significance. These findings indicate that although there is a slight differenCe between the counseling disposition sub- groups on the satisfaction index, this difference is not statistically significant. U 2 Correction Level of for Ties Significance “32.5 .82 3UO.5 .19 Figure l.--Results of the Mann-Whitney U Test for Two Sub- Groups Classified According to Counseling Disposition on the Counseling Satisfaction Scale. Source: Sidney Siegel, Nonparametric Statistics for the Behavioral Sciences (New York: McGraw—Hill Book Company, Inc., 1955), pp. 116-127. 109 Hypothesis II The degree of positive impact of counseling upon clients over “0 years of age will be significantly greater than for clients under 40 years of age. The findings are presented in Figure 2. The results of the Chi Square analysis revealed no significant differ- ences among the four "impact" categories on the basis of client age. Obtained Chi Square value (X2) failed to equal or exceed the .05 level of significance. Corres- ponding contingency coefficients (C) were not found to be statistically significant. All data concerning client characteristics are included in Table 12. hypothesis Ill The impact of counseling upon clients who are married with children at home will be greater than upon clients who are single or married with no children at home. The results of the Chi Square analysis, Figure 3, revealed that differences in the degrees of positive impact of counseling upon clients are not significant for those groups of clients classified according to marital status and children at home. Obtained Chi Square value (X2) failed to equal or exceed the .05 level of significance and corresponding contingency coefficients (C) were not significant. 110 a Level of Client Characteristic x‘ C d.f. Significance Age of Clients .041 .02 3 .99 Figure 2.--Chi Square Analysis for Differences in Client Age for Groups Classified According to the Degrees of Positive Impact of Counseling. 2 Level of Client Characteristic x C d.f. Significance Marital Status .115 .04 l .80 Figure 3.--Chi Square Analysis for Differences in Marital Status for Client Groups Classified by Degrees of Positive Impact of Counseling. hypothesis IV Clients with ten years or more of previous employ- ment experience will experience significantly greater impact from counseling than those clients with less than five years of work experience. The findings are presented in Figure A. The results of the Chi Square analysis revealed no significant differ- ences among the four categories of positive impact for those groups classified according to the number of years of previous work experience. Obtained Chi Square value lll (x2) failed to equal or exceed the .05 level of signifi- cance and corresponding contingency coefficients (C) were not found to be statistically significant. 2 Level of Client Characteristic x C d.f. Significance Employment Pattern .401 .06 2 .90 Figure U.—-Chi Square Analysis for Differences in Employ- ment Background for Client Groups Classified by Degrees of Positive Impact. Hypothesis V The degrees of positive impact of counseling upon clients with some post-high school education will be greater than for clients who did not complete high school. The results of the Chi Square analysis, Figure 5, revealed that differences in the degrees of positive impact of counseling upon clients are not significant for those clients grouped according to educational attain— ment. The obtained Chi Square value (x2) failed to equal or exceed the .05 level of significance. Corresponding contingency coefficients (C) was also found not to be statistically significant. 112 2 Level of Client Characteristic x C d.f. Significance Educational Attainment .093 .03 3 .99 Figure 5.--Chi Square Analysis for Differences in Educational Attainment for Client Groups Classified by Degrees of Positive Impact of Counseling. Hypothesis VI The degree of positive impact of counseling upon clients who terminated counseling within the year preced— ing this evaluation will be significantly less than for those clients who terminated counseling more than one year preceding it. Table 14 shows the frequency distribution of clients classified according to the degrees of positive impact on the basis of the number of months which elapsed between termination of counseling and the evaluation. Clients were uniformly distributed among the "impact" categories on the time lapse variable. The results of the Chi Square analysis, Figure 6, revealed that differences in the degrees of impact of counseling upon clients were not significant for the cli- ents classified according to the time lapse since counsel- ing was terminated. The obtained Chi Square value failed to equal or exceed the .05 level of significance and the 113 _hfiikt?:3-zu OOH mm OOH OH OOH mm OOH om OOH Om . OHOOOB OO MO OO O OO OH mO OH OO OH .moz NH Om>o Om mm mm m mm O mm HH Om OH mango: mHnO O 2 O 2 O 2 O 2 O z OOOOO HOOOO OOOOEH oz OOOHEOO OOOOOOoz HOHOOOOOOOO mcpcoz .oz poquH o>HuHmom mo mmmpmoa .cofiumsHm>m Ucm cofipmcfispoe wcHHmmczoo cmomen oomqum mnucoz no LmnEsz mnp op wcHULoOo< mmfipowopmo pomQEH an mucoHHo mo soapsnfipumfim mocmsvopmnu.OH mAmOB 114 2 Level of Time Lapse Variable x C d.f. Significance Time Lapse .031 .02 3 .99 Figure 6.-—Chi Square Analysis for Differences in Time Lapse since Counseling Termination for Client Groups Classified by Degrees of Positive Impact of Counseling. r7. :‘T—Tf’r‘w u I7) ' corresponding contingency coefficient was not statistically significant. These findings suggest that impact groups do not differ on the basis of the time lapse by number of months since counseling was terminated. Summary This chapter has been devoted to a descriptive ana- lyses of data obtained from client interviews, a ques- tionnaire, an attitude scale, and from client records of the New York State Guidance Center for Women. The analysis involved statistical descriptions and comparisons of variables considered to be related to counseling outcomes. Such factors as sources of client information, client expectations, and client rankings of criteria for coun- sueling success were analyzed on the basis of their rela— tionship to the four "impact" categories. Part II included a statistical description of client <flmaracteristics within each of the categories of positive 115 impact. Results of the tests of the research hypotheses indicated that there were no differences in client- measured satisfaction between clients who completed counseling and those who did not complete counseling. No significant differences were found among clients classified by degrees of positive impact and client age, marital status, employment background, and educational attainment. Differences did not occur between clients in: “A unfit-.I'V ”Wm classified by degrees of positive impact and the time lapse since termination of counseling. CHAPTER VI SUMMARY AND CONCLUSIONS S ummarv E Purpose of the Study s 3 The purpose of this study was to assess the impact 2 a community guidance center for women had on its clientele; and to analyze the relationship between the degrees of impact and selected variables: client expectations, client-expressed criteria of counseling success, the decision-making and post-counseling follow—up behavior of clients, and client endorsement of the Guidance Center. The approach to this study involved two distinct but related concerns. First, the Guidance Center was estab— lished and funded by the State of New York in response to the unique problems encountered by mature women in their identification and pursuit of educational and/or career objectives. The task of the Center was to provide counseling and other supportive services to meet the needs of this client population and then to perform necessary evaluative functions to determine to what extent and for iMhom such intervention was effective in generating decision- making and follow—up behavior on behalf of clients. 116 117 The second concern emerged from the realization that little effort has been exerted in counseling research to [evaluate counseling in terms of its behavioral impact upon clients. Related to this concern for behavioral outcomes of counseling was the recognition that such personal char- acteristics of clients as age, marital status, educational and employment background, act as "inputs" to the counsel- ing process which serve as determinants of the impact ’1 .‘nud .-;L..:h3|- 0W counseling will have on clients. Several hypotheses were developed to empirically examine the relationship between the degrees of impact of counseling upon clients and these personal characteristics. It was also hypothesized that client satisfaction was an important outcome to be evaluated. Guidance centers providing counseling services for the entire adult community must depend upon client satisfaction for their continued support and complete utilization. Client sat- isfaction was therefore viewed as an important index of the effectiveness of the Center, not only for those who visited the Center ten times but for those who terminated counseling after one visit. Methodology The population under investigation consisted of 816 clients of the New York State Guidance Center for Women. 11:5ample of 11“ clients, drawn randomly from the population 118 stratified according to the disposition of counseled clients, provided the respondents for the study. In order to assess the degree of impact counseling had upon clients, it was necessary to collect data which were considered, on an a priori basis, to be relevant to the determination of impact. These data were collected by a panel of clinicians employed from outside the Center using a semi-structured interview guide. Interview data were analyzed independently by each clinician and clients were classified into categories by the degrees of impact the Center was judged to have had on each one. A questionnaire consisting of two attitude scales and a number of forced-choice items was also employed in the study. However, because most of the data obtained from the interviews were duplicated by the questionnaire, and in consideration of the high percentage of clients in the sample who were interviewed, the data which were analyzed came primarily from interviews. The attitude scales included in the questionnaire were pre—tested on a sample of clients from a comparable guidance center and were found to be reliable and unidimensional. A coeffi- cient of reproducibility using Guttman's Cornell techni- que was obtained for each scale and analyses were com- pleted for client-favorableness toward the Center because of its high coefficient of reproducibility. Additional personal information and counseling interview data were obtained from client records at the Center. I - “ J R (2.2!. i; 119 Findings of the Study The first hypothesis stated in Chapter I, that clients who completed counseling will express a signifi- cantly higher level of satisfaction with counseling than those who did not complete counseling, was rejected. While slight differences between the two counseling dis- position sub-groupsvmnwaobserved, the differences were not statistically significant. These findings suggest that {for WW "1 counseling closure is not a significant factor in client satisfaction and that termination of counseling by cli- ents is not necessarily an expression of dissatisfaction with counseling services. Findings from the second, third, fourth, and fifth hypotheses revealed that clients in the four positive impact categories do not differ on the basis of age, marital status, employment background, and educational attainment. While differences were observed between impact categories on the basis of these four variables, the differences were not statistically significant. The final research hypothesis, that the degree of positive impact of counseling upon clients who terminated counseling within the year preceding this evaluation would be significantly less than for those clients who termin- ated counseling more than one year preceding it, was rejected. It was theorized that because most mature women clients would assume a "dual role," post-counseling behavior or follow-up action on the decision or plan would 120 necessarily be slower and somewhat delayed. Thus, the assessment of impact conducted within a few months follow- ing termination of counseling would reveal generally only partial implementation of the plan of action, at best. The findings, however, revealed that the number of months which elapsed since counseling was terminated was not a significant factor in the degrees of impact the Guidance Center was judged to have had upon clients. In addition to the research hypotheses there were other relevant concerns to which this study was addressed. The following represent the more important findings: 1. The group of clients for whom the Center was judged to have had the greatest amount of positive impact were those persons who reported a friend, a member of the family, or another client as their primary source of information about the Center. 2. Clients generally revealed expectations which were congruent with the stated functions and objectives of the Guidance Center. 3. Clients perceived educational and career decision— making as a secondary outcome of counseling. These find- ings supported the theory that women lack external criteria for evaluating themselves and that they tend to value counseling more for its self-assessment benefits than for its outcomes as reflected in decision-making or planning behavior. 121 A. Counseling was perceived by many clients as a supportive service for decisions (or plans) made 2319; to counseling. 5. While decision-making or planning behavior was clearly an outcome of the counseling process, client decision-making was not always a critical factor in the clinical assessment of the Guidance Center's impact on clients; however, client decision-making can serve as an objective and reliable criterion for assessing the behav- EO ioral outcomes of counseling when it is considered with client satisfaction, and the return patterns and post— counseling behavior of clients. I 6. Most (75%) of the clients interviewed were judged to have been satisfied with the results of counseling; and over half (58%) of the sample were clinically judged as persons for whom the Center had moderate or substantial positive impact. (These results were very similar to those in the Yates Study, University of Missouri, see pp. 59-60). 7. While it was beyond the scope of this investiga- tion to analyze the counselor's influence on the client's tendency to make a decision, the findings concerning the decision—making patterns of clients indicates that nearly 70 percent of the clients sampled were judged to have made a decision concerning an educational and/or career objective. 122 Implications of the Study The primary objective of the New York State Guidance Center for Women was to provide counseling services to mature adults planning to pursue educational and/or career activities. The Center's information, testing, and counseling services were designed to achieve one major (and‘ measurable) objective-~to assist clients in the development of a plan of action or a decision concerning educational— career related objectives. The major focus of the study described in the pre— ceding chapters was on the clinical assessment of the impact of counseling using a multifactor criteria approach to determine the impact the Center had on clients. The evaluation included not only the decision-making criteria but the return patterns and satisfaction levels of the Center's clientele. Also included was a clinical assess— ment of the degree to which clients implemented their plans of action. It has already been noted in this regard, that some clients developed a plan of action but failed to implement their plans. It can be argued that to judge counseling on the basis of post-counseling behavior, when the counselor's influence may have dissipated, is inappropriate and based on faulty assumptions. While the immediate outcomes at counseling termination may in no way serve as predictors of future client behavior, a substantial portion of the effectiveness of counseling must be based on the 123 counseling-related behavior of clients during the period following termination of counseling. This prOposition pro- vided the rationale for using post-counseling behavior as a criterion variable in the determination of the degrees of positive impact the Center had on clients. The important implications drawn from the findings of this study are as follows: 1. Because of the critical relationship between client expectations and counseling outcomes, it is impor- tant that the Center develop a closer working relation- ship with public and private referral agencies and the community college. 2. Findings on the post-counseling behavior of clients suggest that the Center's staff may appropriately focus more attention on client follow-up activities. Some clients classified as "incomplete" reported making a decision or plan sometime after terminating counseling. Others who completed counseling with a plan of action either deferred action or were unable to adequately pur- sue their plans. 3. The analyses of client characteristics indi- cates that the New York State Guidance Center for Women attracted a generally homogeneous clientele and that a selection bias reported in earlier studies of women's programs was also operating in this Center. A. The results of this investigation indicate that the age, marital status, educational, and employment 124 background of clients were not important determinants of the impact of counseling upon the post-counseling behavior of clients. In concluding this section, it is important to the evaluation and implication of these findings that some general statements be made concerning the extent to which the Guidance Center achieved its objectives. In accord- ance with the limitations of this study, it seems reason— :1 ;‘ ... :7ow able to conclude that: (a) not all clients achieved a «—, satisfactory decision concerning educational and vocational objectives; (b) a large majority of clients were satisfied with the services of the Center although there was evidence of limited behavioral change among many of the clients; (c) a significant majority of clients were clinically judged as persons for whom the Center had moderate to sub— stantial impact; and (d) while educational and vocational decision—making was not rated as the most beneficial aspect of counseling, the results of this study demonstrate that a significant majority of clients did, in fact, develop an educational and/or vocational decision or plan of action. Suggestions for Further Research The most apparent problem revealed in this study is the need for more precise criteria by which to evaluate the outcomes of counseling. While decision—oriented coun— seling does provide a theoretically sound basis for 125 assessing the behavioral outcomes of counseling, future research should focus on additional decision-related effects of counseling. Particular attention should be given to the learning theorists' approach to counseling to determine whether decision—making behavior generalizes to non-counseling—related activities. Related to the problem of counseling outcomes is the question of how outcomes are reflected in overt human behavior and the determination of the degrees of impact counseling actually has on client behavior. Counseling is essentially a catalytic process intended to bring about changes in the behavior of clients. Does the client per— ceive behavioral changes more accurately than the coun- selor? Are client perceptions of behavioral change or satisfaction with counseling related to actual outcomes and real changes? And can we exclude the possibility that a professional counselor could "observe" changes in clients which may not be occurring? Additional experimentation should be conducted with modifications of the clinical approach to evaluation used in this study. Personal rather than telephone interviews should be used and a different interview guide format might be employed. In addition to using counseling protocols for background information, each of the client's counselors might also rate the impact of counseling at the point of termination. 126 Other variables such as personality factors should be examined to determine the effectiveness of various counseling methods on outcomes. The investigator would also suggest that a similar future study include an assessment of the client-counselor relationship. It may well be that the quality of the client-counselor relation- ship is an important determinant of counseling outcomes. This study involved a clinical appraisal of the impact of counseling upon client behavior using a multi- factor criterion approach. Would further investigation reveal more important variables than those examined in this research? Are there, for example, several possible interpretations to such client responses as "deferred action on plans," "decided to make no decision," and other examples of reality testing by clients? Are these responses indications of behavioral change? Finally, there is the question concerning the gen- eralizability of the findings. Would a replication of the study on a comparable community guidance center reveal similar results? Would similar findings also be revealed 1J1 a study which included agencies operated and supported gnmivately or ones which charge fees for counseling ser- vices? These and many other questions merit further investigation if the problems associated with the evalua- tiCHl of counseling and counseling outcomes are to be fully explicated. 127 Conclusions One of the assumptions stated earlier was that mature women are seeking competitive and self-actualizing roles in increasing numbers but that many of them lack external criteria by which to evaluate themselves for the purpose of pursuing educational and/or career activities. It was further assumed that the community college might be a logical "agency" of intervention to sponsor counseling ser- vices for adults in the community. The findings of this research indicate that such services can be effective in assisting women in the decision-making process, particularly in educational and vocational-related activities. While decision-making is clearly one outcome of educational/vocational counseling, there is no evidence that counseling expands the client's capability for subsequent decision-making. Mature women may value counseling more for its self- assessment and supportive functions to decisions made prior to counseling than for its outcomes as reflected in decision-making or planning behavior. Clients generally express a high degree of satis— faction with counseling. Client satisfaction, however, provides a limited index of the effectiveness of counseling. Clients for whom counseling was judged to have limited or IND impact may express a high degree of satisfaction with counseling and vice versa. 128 The age, marital status, educational, and employment background of clients is not a significant factor in deter- mining the degree of impact counseling has upon clients. The amount of time lapse between the termination of coun- seling and action on plans, and the number of counseling sessions are not significant determinants to the impact counseling is judged to have had upon clients. It has already been noted that the Guidance Center r: ew—n— 1*...” 1 ‘.~ , was unique in several ways. Perhaps the most serious limitation to the generalizability of the findings was the uniqueness of the Center. While the conclusions presented above represent the major inferences from the findings of this study, there are other concerns which deserve further investigation. Our present research on innovative forms of counseling services to adults needs to be supplemented by additional inquiries into the influence of technology on child- parental relationships, feminine perceptions of vocational counseling, longitudinal career studies of successful women, and additional "impact" studies of adult or com- munity guidance centers and other counseling services. Recent trends in this country to provide continuing education and counseling for adults pose new and exciting challenges demanding the best that scientific method, professional resources and skills, and human understand— ing can bring to bear. The challenge of helping individuals relate more effectively to their time can be 129 met only by the concerted effort of all those individuals, agencies, and organizations committed to helping people—- men and women--fulfill their potential. I :7: ...‘r— ‘ BIBLIOGRAPHY 1 4 I 130 BIBLIOGRAPHY Books Blocker, Clyde E., Plummer, Robert H., and Richardson, Richard C. The Two-Year College: A Social Synthesis. Englewood Cliffs, N. J.: Prentice- Hall, Inc., 1965. Borg, Walter R. Educational Research. New York: David McKay Company, 1963. Bross, Irwin D.F. Design for Decision. New York: The Macmillan Company, 1963. Cain, Glen G. Married Women in the Labor Force. Chicago: University of Chicago Press, 1966. Committee on the Education and Employment of Women. New York Women. New York: The Committee, 1964. Dember, William N. The Psychology of Perception. New York: Henry Holt and Company, 1960. Fields, Ralph R. The Communipy College Movement. New York: McGraw-Hill Book Company, Inc., 1962. Goldman, Leo. Usinngests in Counseling. New York: Appleton-Century—Crofts, 1961. Guttman, Louis, et a1. Measurement and Prediction. Princeton: Princeton University Press, 1950. Hillway, Tyrus. The American Two-Year College. New York: Harper & Brothers, Publishers, 1958. Katz, Martin. Decisions and Values. New York: College Entrance Examination Board, 1963. Kleis, Russell J. An Area Approach to Continuing Educa- tion. East Lansing:' Educational Publication Services, College of Education, Michigan State University, Number 16, August, 1967. Likert, Rensis and Murphy, Gardner. Public Opinion and the Individual. New York: Russell and Russell, 1938. 131 132 Maslow, Abraham H. Motivation and Personalipy. New York: Harper & Brothers, Publishers, 1954. Medsker, Leland L. The Junior College: Progress and Prospect. New York: McGraw-Hill Book Company, Inc., 1960. Mehrens, William A. and Ebel, Robert L. Principles of Educational and Psychological Measurement. Chicago: Rand McNally and Company, 1967. Patterson, C. H. Theories of Counseling and Psychotherapy. New York: Harper & Row, Publishers, 1966. Pepinsky, H. and Pepinsky, P. Counseling Theory and Practice. New York: Ronald Press Company, 1954. Seashore, Carl E. The Junior College Movement. New York: Henry Holt and Company, 1940. Sexson, John A. and Harbeson, John W. The New American College. New York: Harper & Brothers, 1946. Siegel, Sidney. Nonparametric Statistics for the Behavioral Sciences. New York: McGraw-Hill Book Company, Inc., 1956. Super, Donald E. The Psychology of Careers. New York: Harper & Brothers, 1957. Tyler, Leona E. The Work of the Counselor. New York: Appleton—Century—Crofts, 1953. Volsky, T., Magoon, T. M., Norman, W. T., and Hoyt, D. P. The Outcomes of Counseling and Psychotherapy: Theory and Research. Minneapolis: University of Minnesota Press, 1965. Weitz, Henry. Behavior Change Through Guidance. New York: John Wiley and Sons, Inc., 1964. Williamson, E. G. Vocational Counseling: Some Histor- ical, Philospphicalyyand Theoretical Perspectives. New York: McGraw-Hill Book Company, 1965. Wrenn, Charles G. The Counselor in a Changing World. Washington, D. C.: American Personnel and Guidance Association, 1962. Zeran, Franklin N., Lallas, John E., and Wegner, Kenneth W. Guidance: Theory and Practice. New York: American Book Company, 1964. .z. —-.'|' "P new '! i :I-L .. 2. 133 Articles and Periodicals Cartwright, DesMond, W. S. "Success in Psychotherapy as a Function of Certain Actuarial Variables." Journal of Consulting Psychology, Vol. 19 (1955). Collins, Charles C. "Junior College Counseling: A Critical View." Personnel and Guidance Journal (Feb., 1965), pp. Engisso. Committee on Education. "Report of the Committee on Education." Washington, D. C.: President's Commission on the Status of Women (October, 1963). Dilley, Josiah S. "Decision—Making: A Dilemma and a Purpose for Counseling." Personnel and Guidance Journal, Vol. 45, No. 6 (February, 1967), pp. 547- 551. Forgy, Edward W. and Black John D. "A Follow-up After Three Years of Clients Counseled by Two Methods." Journal of Counseling Psychology, Vol. 1, No. l rm “fit any”? a. (1954), l- 7. Gass, Gertrude Z. "Identity: A Contemporary Problem for Women." The University in Motion: The Status of Women, Urbana, Illinois: Bevier Lecture Series (November, 1967), pp. 14-31. Gelatt, H. B. "Decision-Making: A Conceptual Frame of Reference for Counseling." Journal of Counseling Psychology, Vol. 9, No. 3 (Fall, 1962), p. 244. Ginzberg, E. "Towards a Theory of Occupational Choice," Occupations, Vol. 30 (1952), p. 491. Goodstein, Leonard D. and Grigg, Austin E. "Client Satisfaction, Counselors, and the Counseling Process." Personnel and Guidance Journal, Vol. 38 (1959) pp. 19-24. Harlacher, Ervin L. "Effective Junior College Programs of Community Services: Rationale, Guidelines, Prac— tices." Los Angeles: University of California Junior College Leadership Program, Occasional Report No. 10 (September 1967). Hoover, Edgar M. "Population and Labor Force Projections for 1985." Women's Education, Washington, D. C.: AAUW Educational Foundation (December, 1967). 134 Kerr, William D. and Johnston, Robert L. "Self-Actualiza- tion for Women through Continuing Education." Adult Leadership, Vol. 13, No. 6 (December, 1964), p. 177. Keyserling, Mary D. "Facing the Facts about Women's Lives Today." In New Approaches to Counseling Girls in the 1960's, Report of the Midwest Regional Pilot Conference, Washington, D. C.: Office of Education, 1965. Krumboltz, John D. "Behavioral Counseling: Rationale and Research." Personnel and Guidance Journal, Vol. 43, No. 4 (December, 1965), pp. 383—387. Metzler, John H. "Evaluating Counseling and Guidance Pro- grams." Vocational Guidance Quarterly, Vol. 12 (Summer, 1964), pp. 285-289. Mueller, Kate Hevner. "Counseling Mature Women for Employ- ment." Women's Education, Vol. V, No. 1 (March, 1966). Nelson, A. Gordon. "Vocational Maturity and Client Sat- isfaction." Journal of CounselingyPsychology, Patterson, D. G. and Clark, K. E. "Student Judgments of Counseling." Journal of Higher Education, Vol. 14 (1943), p. 141. Pemberton, Wilfred A. "Psychology for Decision-Making." In Great Expectations for Women, Newark: University of Delaware, Educational Services for Women (1967), pp. 40-52. Porter, E. H. "Clients' Evaluation of Services at the University of Chicago Counseling Center." Journal of Counseling Psychology, Vol. 4 (1957), pp. 274-282. Ryan, T. Antoinette and Krumboltz, John D. "Effect of Planned Reinforcement Counseling on Client Decision— Making Behavior." Journal of Counseling Psychology, Vol. 11, No. 4 (1964), pp. 315—323. Seeman, Julius. "Counselor Judgments of Therapeutic Pro- cess and Outcome." In C. R. Rogers and Rosalind F. Dymond (ed.) Psychotherapyyand Personality Change, Chicago: University of Chicago Press (1954),pp. 99-10 . ‘ Senders, Virginia L.. "Continuing Education for Women--The Third Revolution." The University in Motion: The Status of Women, Bevier Lecture Series, Urbana: University of Illinois (1967). Ej 135 Sullivan, P. L., Miller, Christine, and Smelser, W. "Factors in Length of Stay and Progress in Psycho- therapy." Journal of Consulting Psychology, Vol. 23 (1958), pp- 1-9- Tinker, Anne Hall. "Programs for Mature Coeds." Adult Education (March, 1965), pp. 283—285, 301-304. Westervelt, Esther M. "Report on Operation of New York State Guidance Center for Women." Suffern, New York: New York State Guidance Center for Women, Brochure, 1968. Women's Bureau. "Continuing Education Programs and Ser— vices for Women." U. S. Department of Labor Pamphlet #10 (prepared by Jean A. Wells), 1968. Women's Bureau. "15 Years after College-~A Study of Alumnae of the Class of 1945." U. S. Department of Labor, Bulletin #283 (1962) cited in "Continuing Education Programs and Services for Women," Pamph- let #10, 1968. Unpublished Material Collie, Rosalie M. "Personality Characteristics of Mature Women Seeking Interests Beyond the Home." Unpublished Masters' Thesis, Detroit, Wayne State University, 1968. Form, Arnold L. Student Attitudes Toward Counselors and the Counseling Center at Michigan State College. Unpublished Doctoral Dissertation, East Lansing, Michigan: Michigan State University, 1952. Self, Gerald. "Women on the Move: Some Common Psycholog- ical Problems." A paper presented to the Governor's Commission on the Status of Women, Las Vegas, Nevada, June 13-14, 1969. Westervelt, Esther M. "Guidance Centers for Women: Some Background and a Pilot Project." Suffern, New York: A brochure prepared for dissemination to interested citizens and community groups, March 6, 1967. Yates, J. W. An Evaluative Follow—up of Clients of the Universipy of Missouri Counseling Bureau. Unpublished Doctoral Dissertation, Columbia, Missouri: University of Missouri, 1951. 5 . i ‘1 . APPENDICES 136 APPENDIX A PRE—TEST AND FINAL CLIENT QUESTIONNAIRE LETTERS OF TRANSMITTAL TO CLIENT SAMPLE PRE-TEST PROCEDURES AND RESULTS 137 ‘ .l:.9\“_'#—’. .’ l ._‘| 138 MICHIGAN STATE UNIVERSITY am LANSING- MICHIGAN 48323 CW COLLEGE COOMTION - OFFICE OF THE DIRECTOR 0 KILLOGG cm April 18, 1969 Since World War II, an increasing number of women, particularly I married women, have returned to school or have sought careers in the labor market. - ’ .03-"'1 J‘s-9 Aurl': ’ In; . .L. Accompanying this trend has been an increased concern among educational institutions to provide counseling services to women interested in continuing their education and/or preparing for a career. Because you received such services from the Flint Junior College Counseling Office, Miss Barbara Stephenson has provided me with your name and address in the hope that you would be willing to assist me in an important research project. Enclosed is a short questionnaire which has been designed to obtain opinions and attitudes of women toward counseling services. I would appreciate very much if you would complete the questionnaire prior to April 23 and return it in the stamped, self—addressed envelope enclosed. I am particularly desirous of obtaining your responses because your experiences with the women's counseling program will contribute significantly toward future improvement in counseling services for women. You will notice on the questionnaire that reference is made to "the guidance center." This refers to the counseling service for adult women provided by Miss Stephenson or ‘Hrs. Jordon at Flint Junior College. I am hopeful that you will be honest and frank in your opinions. Your completed questionnaire will not be seen by the counselors at the College and your comments will be held in strict confidence. Since other phases of this research cannot be carried out until I have analyzed the questionnaires, I am hopeful that you can find time in your busy schedule to complete it and return it to me within the next day or so. I would welcome any comments you wish to make concerning items in the questionnaire. Please accept in advance my sincere thanks for your assistance with the study. With.warmest personal regards, I remain, Sincerely, J. G. Solloway Resident Director of the Study 3. Other (specify): 139 CLIENTjggESTIONNAIRE How did you find out about the services of the Guidance Center for women? (Check the one most important source.) Newspapers Relatives/friends Radio Program Another client The Guidance Center Other (Specify): Which one of the following best describes what you had hoped to receive from the Guidance Center? (Check only one.) Help in solving personal problems Help in finding a job Help in making a decision about Career planning/sources of job continuing my education training In general, did you receive what you had expected from the Guidance Center? Yes No Uncertain Comments: A list of the principal services of the Guidance Center is given below. Rate your satisfaction/dissatisfaction with those services you received on the 5-point scale. Encircle #l ... If you were very satisfied Encircle #2 ... If you were satisfied Encircle #3 ... If you are uncertain Encircle #4 ... If you were dissatisfied Encircle #5 ... If you were vegy dissatisfied MAKE ougr ONE RATING FOR EACH SERVICE Educational Information Satisfied l 2 3 4 S Dissatisfied Career Information Satisfied l 2 3 4 5 Dissatisfied Personal Counseling Satisfied l 2 3 4 5 Dissatisfied Testing Services Satisfied 1 2 3 4 S I Dissatisfied Comments: 10. 11. 12. 13. 140 Directions: We are interested in your feelings about the following statements concerning the Guidance Center for women. Read each statement and decide how you feel about it. Encircle the response which best describes your feelings. If you strongly agree, encircle SA .... If you just agree, encircle A ......... If you are undecided, encircle ? ...... If you disagree, encircle D ........... If you strongly disagree, encircle SD . Talks with counselors at the Guidance Center are helpful in makingadec181on 0.0...OOOOOOOOOOIOO......OIOCOOOOOOOOOOCO I regard the Guidance Center as a "helping" agency serving people with various problems .............................. I feel the Guidance Center is totally unable to assist persons in making an educational/career decision .......... I think more women should take advantage of the services of the Guidance Center .................................... I feel that it is a complete waste of time to go to the Gu1dance center .....IOOOOOOO.......IOOOOOOOOOOOOIOOOIOCOI. I believe that the Guidance Center does enough good work to deserve continued support .............................. The Guidance Center is not effective in assisting persons in solving personal problems .............................. I recommend the services of the Guidance Center to anyone who needs help in educational and/or career planning ...... I think the Guidance Center is a great asset to this county .....OOOCOOOCOOOOOOOOOOO......OOOOIOOOOOOOOOCO...... Comments: {-3 O SA SA SA SA SA SA SA SA SA SA SA SA SA SD SD SD SD SD SD SD SD 141 Directions: we are interested in your general impressions and feelings about your counseling experience at the Guidance Center. In the box below are listed several alternatives which describe various aspects of the counseling experience for the client. Carefully examine the examples given below and then encircle the number :hich expresses your rating of each alternative of items 14 - 20. Example: (I found the counseling experience to be:) Stimulating 1 Q.) 3 4 5 ‘ Unstimulating ENCIRCLE ONLY ONE RESPONSE FOR EACH ITEM I FOUND THE COUNSELING EXPERIENCE TO BE: 14. Interesting l 2 3 4 5 Uninteresting 15. Unrewarding l 2 3 4 5 Rewarding 16. Satisfying l 2 3 4 5 Dissatisfying l7. Tense l 2 3 4 5 Relaxing 18. Unhurried l 2 3 4 5 Rushed 19. Confusing l 2 3 4 5 Clear 20. Helpful 1 2 3 4 5 Hindering ' 21. Did you make a decision (or plan) as a result of counseling? ___Xes ___No Comments: 22. If you have continued your education since receiving counseling services at the Guidance Center, are your studies in: (Check only one response) The field you chose as a result of the decision you made during counseling. A different but related field. An unrelated field. Comments: 23. 24. 25. 26. 27. 28. 29. 30. 142 If you have been employed since receiving counseling services at the Guidance Center, is your work in: (Check only one response) The field you chose as a result of the decision yOu made during counseling. A different but related field. An unrelated field. Comments: Directions: In an earlier evaluation of the counseling services of the Center, clients reported several criteria for counseling success. 0n the basis of your experience with the counseling service, rank the following in terms of their pgrsonal benefit to you. (Rank #1 the item which was most beneficial, # 2 the next most beneficial, etc.) In the event that you wish to list an item which you rate above the four listed, use item 28 (other) and specify. Achievement of a satisfactory decision. Support for a decision you had already made. _____Opportunity to talk about yourself with someone. Encouragement to plan and pursue educational and/or career activities. Other (specify): would you use the counseling service of the Guidance Center again if you needed it? Yes No Uncertain Comments: You are encouraged to use the following space to make any additional comments, suggestions or recommendations which, in your opinion, would be helpful to the Guidance Center staff in the evaluation of their services. 143 an agenCy of Rockland Common-ty College ‘- 2 Campbell Avenue ' \ New York State Gundance Center for Women Super". New York 1090, . ~-_O_——_——_—.—._.u—. —_..-..-_._...-- __—.—_ telephone 357-5225 area code 914 We need your help. We have been asked to evaluate the Rockland County Guidance Center. As one who has used its services, we need your judg- ment about the assistance you received. We have enclosed a questionnaire and a self-addressed stamped envelope. Please complete the questionnaire and return it at your earliest convenience. As a consultant from Michigan State University, I assure you that no one but masters of w team (all from Michigan) will read your responses. Your answers will be combined with others to determine how the Center has helped and how it can be improved. Early in June More of the evalua team will be placing telephone calls to former clients of the Center like yourself) to obtain follow- up information. Each interviewer will introduce himself (herself) on the phone and if you have aw doubts about the caller, tell him (her) to hang up. Dial the Guidance Center, 357-5225 and ask for the interviewer by name. The following team members will be participating as callers: Dr. Marie Prahl, Research Associate Miss Barbara Stephenson, Director Michigan State University Women's Guidance Center Flint Commmity College, Michigan Mr. Jerry Solloww, Research Associate Dr. Max Raines, Professor Michigan State University Michigan State University It will help us considerably if you will provide your name and phone number on the enclosed card and return it with your questionnaire. If you prefer to be called at a particular time, you W indicate it on the card and we will tryto oomplywithyourwishes. Thank you for your assistance. Sincerely, Max B. Raines, Professor Michigan State University 14 4 ROCKLAND GUIDANCE CENTER FOR WOMEN SUFFERN, NEW YORK CLIENT QUESTIONNAIRE 1. How did you find out about the services of the Guidance Center for Women? (Check the <_>_n_e_ most important source). 22 Newspapers 21 Relatives/friends 7 Radio Program 9 Another client Lt The Guidance Center 10 Other (Spec-11V): 1 No Response 2. Which one of the following best describes what you had hoped to receive from the Guidance Center? (Check only one). 11 Test Information about myself 7 Help in finding a job 1"" Help in making a decision about 12 Help in planning a career continuing my education 26 Educational and/or Career information 4 No Response Other (specify): 3. In general, did you receive what you had expected from the Guidance Center? 38 Yes 2’4: No 12 Uncertain Comments: Directions: In an earlier evaluation of the counseling services of the Center, clients reported several criteria for counseling success. On the basis of your experience with the counseling service, rank the following in terms of their personal benefit to you. (Rank #1 the item which was most beneficial, #2 the next most beneficial, etc, etc). In the event that you wish to list an item which you rate above the four listed, use item 8 (other) and specify. Achievement of a satisfactory decision.#1-6; #2-11;#3-8; flat-17; #5-1 . Support for a decision you had already made.#1-9;#2-8 ;#3-17;#1+-6;#5-1 Encouragement to plan and pursue educational and/or career activities. I; 5 6. Opportunity to talk about yourself with someone#1-16;#$§1g;#3-8 ;#’+-11; 7 8 #1-27 ;#2-15 ;#3 -6 ;#’+-2 ;#5-0 Other (specify): #l-B‘fi‘Z-Z; 643-st #‘+-0; #5-0 Form: C-225 145 .Directions: ‘We are interested in.your feelings about the following statements __- concerning the Guidance Center forlJomen. Read each statement and decide how you feel about it. Encircle the response which best describes your feelings. If you strongly agree, encircle SA. . 65* A ? D SD If you just agree, encircle A .. -.. . A<§> ? D SD If you are undecided, encircle ? ..... SA A (i) D SD If you disagree, encircle D .......... SA A ? ® SD If you strongly disagree, encircle SD. SA A ? D 9. Talks with counselors at the Guidance Center are helpful in making an educational/career decision.. SA :9 o U 8 10. I feel the Guidance Center is totally unable to assist persons in making an educational/career decision ............................... .... ....... SA A ? D SD 11. I think more women should take advantage of the services of the Guidance Center ...... . ........... SA A ? D SD 12. I regard the Guidance Center as a "helping" agency serving those in need of assistance in planning a career ................................ SA A ? D SD 13. I feel that it is a complete waste of time to go to the Guidance Center ..... . .................... SA A ? D SD lb. I believe that the Guidance Center does enough good work to deserve continued support ........... SA A ? D SD 15. The Guidance Center is not effective in assisting persons in solving problems related to educa- tional and vocational planning ................. SA A ? D SD 16. I recommend the services of the Guidance Center to anyone who needs help in educational and/or career planning ....... ..... ................... SA A ? D SD 17. I think the Guidance Center is a great asset to Rockland County .......... ...... ...... ...... SA. A ? D SD Comments: r... ..--- .-...-_—._—A-...n 1&6 Dirggtiggs: We are interested in your general impressions and feelings about your gpunseling experience at the Guidance Center. In the box below are listed several alternatives which describe various aspects of the counseling experience for the client. Carefully examine the example given below and then encircle the number which expresses your rating of each alternative of items #18 - 21:. Example: (I found the counseling experience to be): Stimulating 1 © 3 I: S Unstimulating ENCIRCLE ONLY ONE RESPONSE FOR EACH ITEM I FOUND THE COUNSELING EXPERIENCE TO BE: , ; l . - ~ I - . ‘ ‘ I . 18. Interesting ; l ' 2 . 3 )4 5 i Uninteresting IF L A L - l _J —‘ - r.- 19. Unrewarding i l 2 § 3 l: i 5 Rewarding L1 20. Satisfying % 1 2 i 3 l h S T Dissatisfying ' __L L L :1: .... .4 21. Tense ' 1 2 7 3 L: S f Relaxing : _+ ; L ‘ 1+ -..—.4 22. Personal ‘ 1 g 2 3 h S 5 Impersonal L 1 - L ,3 3 23. Confusing } l 2 L 3 h ' 5 3 Clear L L E WTL L ' t . ’ '7 2h. Helpful J 1 5 2 l 3 h is I Hindering 1 25. Did you make a decision (or plan) as a result of counseling: 39Yes 12310 3 No Resp If Yes, briefly. describe: 26. If you have continued your education since receiving counseling services at the Guidance Center, are your studies in: (Check only 9339 response) 15_ The field you chose prior to counseling. 7___ The field you chose as a result of the decision vou made during counseling. 2 .A different but related field. 6 An unrelated field. #1 No Response Comments: 27- 28. 29. 1&7 If you have been employed since receiving counseling services at the Guidance Center, is your work in: (Check only one response) _MIJL_The field you chose prior to counseling. 7 The field you chose as a result of the decision you made during counseling. _ 9_ A different but related field ___ZL_An.unrelated field 36 No Response Comments: WOuld you use the counseling service of the Guidance Center again if you needed it? __ 53 Yes __ 9 No 1Q Uncertain N s onse Contents: 2 0 Re p You are encouraged to use the following space to make any additional comments, suggestions or recommendations which, in your Opinion, would be helpful to the Guidance Center staff in the evaluation of their services. ”WW .— 1511 I PRE—TEST PROCEDURES AND RESULTS Two guidance centers for women, the Flint Junior College Counseling Center and the Continuum Center for Women at Oak- land University, were considered for pre-testing the ques- tionnaire and attitude scales. The Flint Center was selected because both the services and the client population more closely approximated those of the New York State Guidance Center for Women. A list containing 230 names and addresses of clients who had received counseling during the past two years was provided by the Flint Center. A total of 50 clients was selected randomly for participation in the pre—test. The questionnaire and attitude scales, a cover letter explaining the purposes of the study, and a stamped, self-addressed return envelope was mailed to all 50 subjects. Within a two-week period, a total of 32 questionnaires had been returned as well as two original letters which the post office returned because of no forwarding address. The total return represented 67 percent of those who were reached by mail. No follow-up questionnaires were sent out and no attempt was made to analyze the non-responding subjects in the sample. The results of the non-scaled items (items #1-3, 21-29) on the questionnaire pre-test were compiled and are reported 1&8 1A9 in Appendix B. The above items were reviewed for clarity, correctness of response, and to determine the need for additional categories and/or possible deletions. The results of the pre—test revisions can be examined on pages 1AA—1A7. The scoring of attitude scale items (items #5-13) was done using the Likert technique. Weights from one through five were assigned to the five categories (strongly disagree, disagree, undecided, agree, strongly agree). A weight of l was assigned to the "strongly agree" responses for items expressing unfavorable opinion toward the Guid- ance Center and a weight of 5 was assigned to the "strongly agree" responses for items eXpressing favorable opinion, and so on. A total score was then obtained for each subject which ranged from S to #5. The scoring of attitude scale items (items #lA-20) was done in a similar manner. Responses which were fayprable toward the counseling eXperience were asSigned a weight of 5 while responses which were unfavorable were assigned a weight of l. A total score, which ranged from 5 to 35, was also obtained for each respondent. Both attitude scales were then subjected to a test of reliability using the total scores on each scale for the entire sample. Because of the preponderance of favorable responses on both scales, comparability of the two halves of the scales was lacking and therefore the Spearman-Brown -.....” I a . “A..- .r. " 150 formula was considered inappropriate. For scales which 7 appear to possess unidimensionality, Guttman advocates the application of a lower bound reliability test. He states: The split-half lower bound, LA’ resembles somewhat the traditional Spearman split-half formula, corrected for test length . . . The lower bound, LA’ assumes only that the two half sample scores are experimentally independent of each other and that the computations are based on a large population of individuals. It does not assume that the two halves belong to the same scale or anything else of the kind . . . For the scale scores then, as well as for the qualitative responses to the separate items, we have assurance that if the items are approximately scalable, then they necessarily have very substantial test-retest reliability. Scalogram analysis provides as an automatic by product the assurance that responses to individual items and total scores both have relatively little error of measurement if the reproduc- ibility is high. The lower-bound reliability coefficient (LA) was com- puted for both attitude scales for the 32 subjects in the sample and it was found to be as follows: 1. Attitude Scale A Lu = .70 (Guidance Center) 2. Attitude Scale B L4 = .84 (Counseling Experience) For the nine attitude scale items in Scale A, the reliability coefficient for the total score is not less than 0.70. It may be anywhere between .70 and unity. For the seven attitude scale items in Scale B, the reliability lLouis Guttman, et al., Measurement and Prediction (Princeton: Princeton University Press, 1950), p. 311. coefficient for the total score is not less than 0.84 and may be anywhere between .84 and unity. Following the determination of the reliability co— efficient, it was then necessary to determine whether the items formed a scale for the pre—test sample. The measure- ment of an attitude(s) is considered scalable for the population if it is possible to rank subjects on the basis 0 f total response scores in such a fashion that from a sub- ject's rank alone, it is possible to predict his response to any item on the scale. While such perfect scales are seldom achieved, items are considered sufficiently scalable if they are 85 percent reproducible. The item analysis for both attitude scales was con— ducted by the Cornell Technique2. By means of this technique, it is possible to obtain the coefficient of reproducibility and thereby affirm the unidimensionality of the attitude scale. To obtain this coefficient, the total scores of all subjects were ranked from high (most favorable) to low (least favorable) for each attitude scale. The number of "errors" for each item was determined by establishing "cutting points" in the rank order of total scores thus separating individual responses according to categories in which they would fall if the scale were perfect. Table A-1 indicates the frequency and percentage of "error" for each item on Scales A and B. Since it is 2Ibido, pp. 91—121. 152 permissable to "collapse" data into fewer categories to reduce the frequency of "errors", the table provides the coefficient of reproducibility using data in both its original and collapsed forms. Attitude Scale A had a coefficient of reproducibility of 0.86 and 0.94 respectively, and attitude Scale B had a coefficient of reproducibility of 0.84 and 0.92. The ob— served value of the coefficient is moderately high and suggests that the scale is measuring a single attitude variable. Although the coefficient for Scale B represents less value than the minimum of 85 percent stipulated by Guttman, there is ample evidence to indicate, on the basis of reproducibility alone, that the scale tends to be uni- dimensional. 153 by L . ’ Fates—nth... E., .. y L mmd u meH. u H .mmd u mac. : H mmmv I H umpHHHoHoSpOLQom mo ocoHOHmmooo u Almmwv I H ”szHHoHosposdom no ucoHonmooo mommmH mHmpoe mommmm mHmpoB mm mm\H 0mm EopH mm mm\H own EopH &:H mm\: mHm EopH ng mm\: mHm EopH RNH mm\m wa EopH Ram mm\n mH* EmuH Rm mm\H NH» EopH &:H mm\: NH» EopH $5 mm\m wa EopH &~H mm\m mH§ EopH as mm\m mHe EooH RNH mm\m mHm aopH em mm\H :He aeeH sew mmxs HHe seeH m onom mmd u Heo. : H mm. n mmH. u H u émwwvl H "onHHoHosoopdom no HCoHOHmmooo n Almmwv I H HszHHoHozoosQom no pcoHonmooo m m H mHmeoe . msm\mm mHmeoe Rm Hm\H MHm EouH mmH Hm\o MHm EopH mo Hm\o mHa EouH Rm Hm\H me EmuH fiMH Hm\: HH* EopH as Hm\m HHa EopH RQH Hm\m OHe EouH &OH Hm\m OHm EopH Rm Hm\H on EopH ROH Hm\m mm EopH as Hm\m ma EopH fimm Hm\m we EopH as Hm\m we EopH as Hm\m we EopH RMH Hm\: we EopH RmH Hm\o mm EopH moo Hm\o ma sooH emm Hm\m ma EopH nonsm mo mponpm mama oomdeHoo Lonpm mo whoppm mama HmcHwHLo mwmpcoopom mo .02 .oz EopH ommpcoopom mo .02 .oz EouH * ryv! (y / 7 r F I I L L LL. ' y L! LrV ’ r r .Humoulopmv m ocm < monom moduHup< pom mpHHHoHosoopdo: mo pcoHOHmmooo paw .LOLLM mo owmpcoopom .zocozdome|.Hl< mqmHpom poonmo p0\ocm HmcoHpmosoo mampsuocm cmHQ on acoEowwpsooco pom moms homopHm conHoop m tom uponSm peso umowmsm mpHSmop one .HwHonocon omoE mm: cOHcs ooH>pom wcHHomcsoo on» go mp0powm mmocp scan on mucoHHo Umxmm LQH£3 mmuzmm wEopH on noncommop mo mucoscopm on» mopMoHpCH oHomu o>oom one L D L L L L L o o H o m mm mm& o o m NH HH m wma H mH m H 0 HH mmm o m m m 0H 0H mma H m s m a m :ma ma ooxcmm an ooxcmm mm ooxcmm mm oncmm He poxcmm noncommom .02 1+ .L l; rT » 1, mo EouH omcoommm oncommmm omCOQmom encoumwm oncommom Looszz no mo go no mo accosvopm mucoSUmpm zocoSUopm mocmzdonm mucosvopm " PL?!’ r . LLLLL LL r7 . L LLPLV’V'. 'Lr'rr LLLL 'L 'L L 'I' 1" 'II L L .HpmoBtmpm .chHmv mucoHHo mo mmooosm wcHHomcsoo pom mHnoquo mo mmcchmmnl.Hlm mqmHpmwoz O>HpHmom O>HuHmom O>Hprom mHmpoe LO\o:m ocoz UOOHEHH mpmpoooz Hprcmpmosm AOHomcsoo ' 77 [yrrvrryrv rur’ L’VVLLLI' L ’77 L' L L '7'7rr 'V'l’lry717777f V A. r' 7 7. I'll L .mpOHomcooo mo mOHpomopmo pomQEH mo COszoprwHQII.HIm mqmHpmwoz LO\o:m oz m.mm mm emm \: emH \s emm \w esm \m powdeH esHeHmom eeeHqu m.Hm om emm \e emm \m emm \e AHm \m eeadeH o>HpHmom commoooz m.mm mm emm \e emm \m emm \w Rem \e semesH e>HeHm0d HeHecaempzm mowmpcoopom mHmpoe N omosm » owosm x owpzw 3 owOSh :oHmeHmHmmmHo pomQEH 7L! ' A L7 .mowUSh mo Hocmm < mm mOHpowmpmo pomQEH wcHHowczoo Och mp:OHHo mo SOHpsonpmHQ zoomsdommll.mlm mqmo m N O O OOH H m O O O mm H mm H mm H mmuom OH O :m m OO O OH H mm : Om O s H s H Oslo: OH O :H H OO O NH m OH H om m O: : om m amuom O 2 mm H mm m O m :m m OO m O O OH H mm some: ow¢ o: OH O OH O: m O OH O . m Hmuoelosm em NH om : OO OH em m NH O s: OH Hm s OH O OHmsOm m m OOH H O O m m OOH H O O O O O O OHOS xom z 2 R z a z z z a z a z a z a 2 TO mu SUN S I Mn N T W S O o poo e o o o 1: o n 3 11. 1 1 u m D. G. B H T. I. B H a I. a «+8 I B S S I E 1 J 1.1 s 1 .J J s n+ e 9 use I. I. T.. I. D. 3, Tu u e e u e _ B p P B mOHpmHtouomLmno coHpowpmHuwm mo HO>OH poOQsH wcHHomcsoo mo mooswmm ucmHHO .OSOLOIOSO OCOHHO =OpOHOEOOcH= OOprHLouompwno SEEHHO am coHeeeemHeem new powdeH e>HeHmOE co meesmeo Oo coHeeeHsemHOIIHIO mHmae 169 ’ I O: OH O, OH OH O O OH O O OHOOOO:OOO OH O OH H OO O OH N N H :O O OO O ON O eOeHHOO OH OH O: O NO O OH H NO O OO O O H O H NEOHOHO .O.m O O ON H ON O O N OH H HO O ON N OH H OSOHOHO .O.m can» mmeq campumm HOCOprosnm OO OH O OH O: O O OH O O OHOOOOIOOO H H O O O O H O O O O O OOH H O O .O can» who: O N O O OOH H O H O O OO H O O OO H OIH HH O ON N ON O HH H OH H OO O ON N ON N OIN ON OH ON O OO O ON O ON O O: OH OH O O N mco OCOOmmom wcHHomcsoo no Lonezz OH OH O OH OH O O OH O O mHeeoennsm OH O NO O OO O OH H OO O OO O HH H O O OH can» who: O N O OOH N O O OO O O: O O NN N meme» OHIO HN O O H NO HH HN O O H H: O OO O OH O OEOOO O can» mmeq camppmm pcoEOoHQEm OO OH O OH O: O N OH O O OHOOOOIOOO OO NH ON O NO OH OO N HN O O: OH HN O HH O cmEOHHne OOH: OOHELOE N H O O OOH O N H O O OO O OH H OO N OeHsEaz O O O O O O O N OOH H O O O O O O eHOcHO msemem HOOHLNO I I'll“ (All. ‘1'. [Valli'i l: l III... 17O ON NN O mm ON OH O m MN mm mHmpOBInsm H O O O OOH H H O O O O O O O OOH H mm pm>o O H OO H OO H O O O O mm H OO H mm H OOIOO ON N NH O NO OH ON N O H OH O ON O NO O OOIOO OO OH ON O ON OH OO O OH O NH O OO OH HO OH OOIOO HH O O O OOH N HH O O O OH H m: m m: m ON LOCCD Om< ON NN O OO ON OH O O ON ON mHmpoennsm HN ON ON m om Om HN NH O O OH O Nm NN mm MN OHMEmm m H O O OOH N m N O O O O OOH H O O OHOE xow z z N z N z z z N z N z N z N 2 TO N SN 8 L N N ..l W S o O poo B o O o T: o n 3. 11. 0. 1. u m D. O. B H I. I. B H a I. a 1.8 ..L B S S I 9 1. J Trfl. s 1 .J .J s 1 a 9 OS? Tr T: I. I. p n.4, TLU u e e u e _ on D. D. On OOHpmHLOOOmLOQO pCmHHo coHpomOmemm mo HO>OH OOOQEH O>HpHmom mo OOONOO I L L r .QSOLOIOSO OCOHHO ampOHQEOO: OOHumHLOuomLmno OCOHHO NO COHpommmemm Ocm OOOQEH O>HuHmom mo moommoo mo :OHOSOHLOOHOII.NIO mqm