A MYCHQMETRQC STUDY 0*? TIME) lMDfiCES 3F 30$ SATI$FAU€3CN flash for the: chm of M. A. MEI-{56AM STATE UNBV‘ERSWY Moria Lee Chm-k 1955 TH. £515 HHIIUHIIUIIIIHIIHHIHHHHHIWUI’HIIHllJllHlHl 293 10543 9875 This is to certify that the thesis entitled A Psychometric Study of Two Indices of Job Satisfaction. presented by Gloria Cheek has been accepted towards fulfillment of the requirements for L degree in W J Major professor Date May 19. 1955 0-169 )V1ESI_J RETURNING MATERIALS: PIace in book drop to LIBRAfiJES remove this checkout from “ your record. FINES w1'11 be charged if book is returned after the date stamped be10w. i/ Tfifiblé A PSYCHOMETRIC STUDY OF TWO INDICES 0? JOB SATISFACTION By Gloria Lee Cheek AN ABSTRACT Submitted to the School of Graduate Studies of Michigan State University of Agriculture and Applied Science in partial fulfillment of the requirements for the degree of MASTER OF ARTS Department of Psychology 1955 7‘1 j I 1* ,7 It $ i . ‘ ._, _ I" 9 A Approved by .__!I_ I "f 3‘24 “'1 /""~~._.:l‘ -:‘:,,,5d_fi_‘ ;, _:"~‘ “ A ' ULUL’LG U00 UliL-IUA 1 Two Job satisfaction inventories and five criterion questions were admdnistered non-anonymously to 165 workbrs in a Michigan furniture factory. The purpose of the study was to compare the inventories with each other, establish‘ reliability and validity coefficients for them, examine the criterion, and to explore the possibility of constructing shorter forms of the inventories. A method of stratified random.sampling was used to separate the 165 workers into a lll-worker validation group and a Sh-worker cross-validation group. Appropriate statis- tical procedures were then followed to carry out the purpose of the study. The findings indicated that the inventories correlated significantly with each other, and significantly with a three, a five, and a four item criterion. Cross-validation was successful for both inventories separately on the five and four item criteria, and in combination on the three, five, and four item criteria. The inventories were both \ .- found to have high internal conSistency. The criteria were improved by removal of one item.which did not seem.to measure the same thing as the other four items. New forms of the inventories were made up on the basis of item reliability and on the basis of item.validity as established on the four item criterion. The new forms were found to have validity coefficients which were not Gloria Lee Cheek 2 significantly different from validity coefficients found for the original forms. Internal consistency of the new forms of the inventories remained high although the item numbers of the inventories were greatly reduced. ACKNOWLEDGMENTS The writer of this thesis would like to eXpress her sincere gratitude for the aid and helpful advice given to her throughout this study by Dr. James S. Karslake, her major professor, and Dr. Carl F. Frost. Without the ex- perienced guidance of these professors, the task of carrying out this project and writing the thesis would have been much more difficult. This thesis is one of several being written on various aspects of Job satisfaction testing. The writer would like to eXpress her appreciation for the assistance and moral support given her by one of the other graduate students working in this area, Mr. William A. Schell. TABLE OF CONTENTS 'U D CG 0 INTRODUCTION . . . . . . . . . . . . DEFINITIONS 0 O i. O O .. O O O O O O O 0 O O O O O O 0 BACKGROUND . . . . . . . . . . . . . . . . . . . . . . . Recent Test-Analysis Literature Recent Test-Analysis Research HYPOTHESES . . . . . . . . . . . . . . . . . . . . . . . PROCEDURE . . . . . . . . . . . . . . . . . . . . . . . so ~o a> o~ tr \» u: re The Inventories p p The Criteria H N The Subjects H b.) Statistical Analysis H U'l FINDINGS N P RESULTS 0 O O O O O O O O O O O O O O O O O O O O O O O N N COWTS O O O O O O O O O O O O O O O O O O O O O O O O E’- DISCUSSION AND CONCLUSIONS . . . . . . . . . . . . . . . b) p BI BLI OGRAP m 0 O O O O O O O O O O O O O O O O O O O O 0 APPENDIX A . . . . . . . . . . . . . . . . . . . . . . APPENDIX B . . . . . . . . . . . . . . . . . . . . . 0 APPENDIX C . . . . . . . . . . . . . . . . e . . . . 0 APPENDIX D . . . . . . . . . . . . . . . . . APPENDIX E . . . . . . . . . . . . . . . . . . . . . . APPENDIX F . . . . . . . . . . . . . . . . . . . . . . APPENDIX.G . . . . . . . . . . . . . . . . . . o . . . APPENDIX H . . . . . . . . . . e . . . . . . . . . . . APPENDIX I . . . . . . . . . . . . . . . . . . . . . . “PMDIX J O O O O O O O O O O O O O O O O O O O O O O APPm-DIX K O O O O O O O O O O O 0 O O O O O O O O O O 0 U1 Uh) ofigfifififififie: TABLE I. II. III. IV. LIST OF TABLES Page Comparison of means scores obtained by Groups I and II on the inventories and criteria . . . . . . 17 Validity and cross-validity findings for all forms of the job satisfaction inventories . . . . . . . 18 Kuder-Richardson reliability coefficients for all fonms of the inventories . . . . . . . . . . . . l9 Spearman-Brown inflation and deflation of original reliability and validity coefficients for differing inventory lengths . . . . . . . . . . . . . . . . 20 INTRODUCTION The plan for this study grew out of an interest by the writer in how job satisfaction is currently being measured in industry and in whether or not the measuring instruments now in use might be improved. The problem of this study was to select one or more inventories of Job satisfaction in current use and do a psychometric study on them. The purpose of such a study was speci- fically to compare the inventories with.each other, es- tablish their reliability and validity coefficients, and to explore the possibility of constructing them in shorter form. A ‘ A perusal of the literature concerning the measure- ment of Job satisfaction led to the selection of two in- ventories in current use for analysis. The inventories chosen were the Hoppock Job satisfaction scale as revised by Bullock, and an employee attitude inventory designed by the Science Research Associates. (Appendices A and B). Three criterion questions used by Bullock and two criterion questions added by this writer formed the composite of questions used in the examination of validity in this study. (Appendix C). DEFINITIONS The following definitions apply to this study: Validity - An item.or inventory is valid to the extent that it measures what it is supposed to measure. gaggs-Validity - An item or an inventory has cross- validity to the extent that validity will hold from sample to sample of the parent population. Reliability - An item.or an inventory is reliable to the extent that it measures the same thing if applied over and over in the same situation. Job Satisfaction - Job satisfaction is a positive feeling held to some degree by an employee towards his job and all factors that he sees as related to his job. BACKGROUND During the last few decades, there has been a growing interest in the human relations approach to better produc- tivity in industry. Numerous studies have led to the inference that there is a high, positive relationship be- tween worker satisfaction with a job, and productivity. (h, 6, 8, 9, ll, 1h, 16, 1?, 18, 19, 20, 21, 22, 25, 26, 27, 28, 33, 3h, 35, 36, 38). Because of this inferred relation- ship, interest has grown in the problem.of how Job satis- faction can be measured. Publication of research attempting to analyze Job satisfaction dates mainly from the time of world War I. These publications have not generally provided tools of practical value for measuring job satisfaction. On the whole, the early research has contributed many lists of factors "felt” to be important components of morale. Only recently has any work been done in actual factor analysis of inventories which are supposed to measure Job satisfac- tion. Using the Science Research Associates Employee In- ventory, Baehr (3) found four basic factors which seemed to be held in common by widely different groups of emw ployees. The names given to these factors were, Immediate Supervision, Job Satisfaction, Integration in the Organiza- tion, and Friendliness and Cooperation of Fellow Employees. Ash (2) also did a factor analysis on categories within the Science Research Associates Employee Inventory. He found five factors which he called,Personality Integration, Job Rewards, Management Effectiveness, Imediate Supervision, and General Job Satisfaction. Wherry (36) re-worked the same data used by Baehr and Ash. He reported the following factors: a General Factor, Working Conditions and Environment, Financial Reward, Super- vision, and Effective Management and Administration. Both early and recent research concerning factors imp portant in Job satisfaction contain many areas of agreement in the factors found, although validation of the factors statistically is not reported. The research to date in this area is limited, but is certainly not without merit, since the similarity in factors found can form a base for the design of more objective research on Job satisfaction. Recent Test-Analysis Literature 'Hithin the last few years, the writers of some publica- tions have expressed problems encountered in validation re- search and have suggested various methods and procedures to be used in such research. Concerning methods, Long and Sandiford (2h) report twenty-two methods which may be used for analysis of reliability or validity of tests. Anastasi (1) has pointed out problems that may be encountered in criterion selection for validation studies. After a thorough analysis of current literature on test _validation, she notes that, "...validity is not a function of the test but of the use to which the test is put. A test may have high validity for one criterion and low or negligible validity for another." She quotes Guilford's statement that a test may be valid for anything with which it correlates. In other words, Anastasi brings out the point that a test is valid for use only to the extent that it measures the behavior we are in- terested in. The problem.pointed out here is that of selecting a criterion for validation which will be in line with the intended use of the test. Nagle (29). McConnel (27), Sanford (2h), and Bullock (7) all state that objective measures of behavior are best for I criteria when the inventories being validates are subjective in nature. McConnel (27) notes that, "Attitude surveys, whether conducted by paper and pencil tests or interviews, are essentially reactions to artificial situations. Both the paper and pencil and the interviewer‘s questions are stimuli, but they are not the same stimuli which call forth the kind of behavior which is ultimately the thing of real interest.” Concerning the problem of cross-validation of inven- torie , the Psychological Corporation 131) states that cross- alidation is necessary ”to protect us from being fooled to putting confidence in a relationship which happens 0 hold true for the group we started with but which will let s down in the long run." Cureton (10) also brings out the idea that to establish the validity of a revised in- ventory, by again using the same group the original inventory was validated upon, is a highly risky procedure.‘ Recent Test-Analysis Research On all of the job satisfaction inventories reported in the literature, where any sort of statistical analysis was attempted, some form.of reliability coefficient was established, whether in the form of test-retest reliability or internal consistency of the scale. Bullock (7) reported a split-half reliability, for his version of the Hoppock scale, of 0.81. The Science Research Associates Employee Inventory (12) was reported to have a test-retest reliability of 0.89. i There have been a few publications in the last few years concerning attempts to validate job satisfaction inventories. The Thurstone technique of validation by the judgment of ”experts” is reported by Wood (38) and by Bullock (7). Bray- field and Rothe (6) and Bullock (T) have used t-tests to de- termine whether or not there is a significant mean difference between scores obtained by the most satisfied workers and scores obtained by the least satisfied workers. Brayfield and Rothe (6) validated an inventory by correlating it with another job satisfaction inventory. They found a correlation of 0.92 between the fioppock job satisfaction inventory and their own. The use of criterion questions for the validation of job satisfaction inventories has been reported by Hoppock (15), Kerr (16, 17): and Bullock(7). Hoppock used "self-estimate" criterion questions for the validation, Kerr (16, 71) used A job-tenure rate for his criterion, and Bullock (7) used three objective data criterion questions. i i The University of Chicago Research Group (12) reported a “good correspondence" between scores obtained on the Science Research Associates Inventory and the "considered judgments of experienced observers.” They also reported establishment of validity for the inventory by comparison of test results with the results of non-directive interviews on a cross-section of employees. This writer could not find evidence of cross validation studies on job satisfaction inventories reported in the literature. HYPOTHESES l. The two job satisfaction inventories used in this study will correlate highly with each other and with the criteria. 2. Validity coefficients obtained for each of the two inventories will be significantly other than zero and will be upheld when they are cross-validated. 3. Short forms of the inventories made up on the basis of the items on each inventory which agree best with the criteria will be more valid than short forms of the inven- tories made up on the basis of the items which agree best with each inventory as a whole. PROCEDURE The procedure followed in this study was to administer two job satisfaction inventories and five criterion questions to the workers in a furniture factory. The findings were then statistically analysed. A detailed description of the inventories, the criterion questions, the subjects used, and the statistical procedure follows. The Inventories The two job satisfaction inventories chosen for use in; this study were, the Employee Inventory published by the Science Research Associates in 1952 (and hereafter in this study referred to as the "SRA") and the Bullock version of the Hoppock job satisfaction scale published by the Bureau of Business Research at Ohio State University in 1952 (and hereafter in this study referred to as the "OSU"). The SRA has enjoyed wide application as a tool for measuring employee attitudes concerning satisfaction with various aspects of the work situation. The General Manual of the SBA (12) contains the ftrllowing statement concerning the test: ”The SRA Employee Inventory was developed to provide an accurate measure of employee attitudes toward the work environment. It is an inexpensive, easily. 10 interpreted, quickly scored questionnaire designed for use in all types of companies, including fac- tories, offices, and retail stores." I "The seventy-eight items in the SBA Employee Inven- tory reflect the kinds of things employees say about their jobs in a wide range of business and indus- trial situations.” "It is phrased in simple language that is understandable to all employees with a fourth grade education or better." From.information derived in non-directive interviews by the Industrial Research group at the University of Chicago, fifteen major categories were chosen and then item construction took place within the chosen categories. The items were not arranged on the inventory proper according to category. The item.arrangement was such, however, that scoring could be done from.the answer pads according to cate- gory. The possible responses to each item were, "Agree", "?”, and "Disagree". The items were worded so that on some, a response of "Agree" would indicate satisfaction, and on some a response of "Disagree" would indicate satisfaction. A response of "?" to any item indicated other than satisfac- tion. By the selective placement of carbon on the answer pads, only satisfied responses were recorded, and scores were computed.by adding the number of satisfied responses. The highest possible score indicating greatest satisfaction was seventy-eight. The OSU inventory, according to Bullock (7), "is com- posed of ten items requiring evaluations of the employing organization, the job itself, or the respondent's own position in the work group." A scale of the type used by .|. . .. Ili‘liillil‘liil'l} l‘i,‘ 11 Likert (23) was used for the five alternative responses to each item. Each set of five alternatives was arbitrarily given values of l, 2, 3, h, and 5 with 5 indicating the greatest amount of satisfaction and 1 the least on each ques- tion. The highest possible score indicating greatest satis- faction on the job was 50. The Criteria Five questions were administered which were assumed to be~ objective measures of job satisfaction.j)The first three were designed by Bullock (7) (Appendix D), and the last two were designed in connection with this study (Appendix E). Each question had three possible responses. "Yes", "?”, and "No". For some of the questions "Yes” was the answer to indicate . satisfaction and for some of the questions "No" was the answer to indicate satisfaction. "?” was always considered to indi- cate other than satisfaction. The five questions were used in the following three _’ ways: First, as a three question criterion to partially replicate Bullock's attempt to validate the Hoppock material, (Appendix D). Second, as a five question criterion on the assumption that five were a more adequate criterion than thmce, (Appendix E). Third, as a four question criterion lubon finding through item analysis that one question was &Saentia11y irrelevant and should be discarded. (Appendix F). 12 {The hypotheses were examined primarily with reference to the four item criterion. In every instance the respondents were divided into two groups, the satisfied and less satisfied, on the basis of their responses to the criterion questions. (See Appendix G Lfor the division). The Subjects "I ’A f The two job satisfaction inventories and five criteriond questions were administered to 168 of the 175 employees of} a furniture manufacturing company in a small town in Michigan. Seven ill, night, or part-time workers were not present during the testing and an opportunity was given to these employees to respond by mail. Three of these seven responded. A total of six responses had to be thrown out because they were in- complete. The total sample with complete test results was 165. A The entire company participated in the study, including executives, foreman, office, and factory workers. The execu- tives were given the inventories first, and then the foreman took the inventories in a group. Following administration O a M M (:1 3 7 D ISAGREE DE] 7 DISAGREE DD 7 DISAGREE DE] 7 DISAGREE DC] 7 DISAGREE [:JD 7 DISAGREE DC] 7 DISAGREE DD 7 DISAGREE CID 7 DISAGREE [3C] 7 DISAGREE DE] 7 D I SAGREE DE] 7 DISAGREE DE] 7 D|SAGREE 7 DISAGREE DD 7 DISAGREE DD 7 DISAGREE CID 7 D ISAGREE DC} 7 DISAGREE 7 DISAGREE DD 7 DISAGREE DC] 7 DISAGREE DE] 7 DISAGREE DC] 7 DISAGREE 7 DISAGREE 7 DISAGREE DE] 7 DISAGREE C1D AGREE 7 DISAGEEE C] [:1 [:1 AGREE 7 DISAGREE E] [:1 E] AGREE 7 DISAGREE D E] El AGREE 7 DISAGREE D E] E] AGREE 7 DISAGREE D D D AGREE 7 DISAGREE [:1 Cl C] AGREE 7 DISAGREE C] E] C] AGREE 7 DISAGREE E] [:J E] AGREE 7 DISAGREE DE] AGREE El 1:] E] AGREE 7 DISAGREE C] D C] AGREE 7 DISAGREE D [:1 D AGREE 7 DISAGREE E] D C] AGREE 7 DISAGREE C] D [:1 AGREE 7 DISAGREE E] El D AGREE 7 DISAGREE C] C] D AGREE 7 DISAGREE E] D D AGREE 7 DISAGREE D [:1 E] AGREE 7 DISAGREE [:1 C] E] AGREE 7 DISAGREE Cl [:1 C] AGREE 7 DISAGREE D 1:] Cl AGREE 7 DISAGREE Cl C] AGREE 7 DISAGREE [:1 E] El AGREE 7 DISAGREE [:1 C] C] AGREE 7 DISAGREE D [3 El AGREE 7 DISAGREE DEC] 7 DISAGREE ‘ > O a m m > O a m M D > 9 as rn m > 2 i: D > G" a M M ' D E] 1 7 DISAGREE DC] 7 DISAGREE 7 DISAGREE [1D 7 DISAGREE [:JD 7 DISAGREE DC] 7 DISAGREE DC] 7 DISAGREE DE] 7 DISAGREE DD 7 DISAGREE DC] 7 DISAGREE CID 7 DISAGREE 7 DISAGREE DD 7 DISAGREE DD 7 DISAGREE [JD 7 DISAGREE 7 DISAGREE DC] .7 DISAGREE DE] 7 DISAGREE .7 DISAGREE DE] 7 DISAGREE .7 DISAGREE DD 7 DISAGREE DC] ' 7 DISAGREE 7 DISAGREE DD 7 DISAGREE DD 7 DISAGREE DD ANSWER sugar I 7 AGREE EDD 1 17 5' I 2 It 54 ,' n 3 2’ ‘5 OISAGREE 3 so II . 56 5 31 51 III to :54. 32 5‘ INSAGREE IV Cl P ‘ ‘ , 7 33 59 'i :1 msmntt L, V s 34 so D : as 61 t2 DISAGREE 10 35 VI 62 D i L_ n n a, 53 omens: :2 3t _ s4 1%.; VII 34 .i 0mm: ‘3 ” “ D 14 to if“ u DISAGREE .fi VIII 15 41 67 [6 42 CR “ ‘ IX DISAGREE L— . ‘ n a .. Cl is 44 X 70 u omens: I_.—— 19 ‘5 . ’1 [::] 20 4s 12 XI " DISAGREE Ex 47 73 [:1 22 4a 74 '9 ‘ DISAGREE . x11 ' Cl 23 49 75 . i it c i; so 76 XIII . “aw," h__ lig- {15“ h, :5 51 n so ,f . ' OISAGREE I I. i 97.7... . "yx— XIV XV [:3 25 52 n .- ,v . q , iiisi' s ‘1 7 AGREE 7. AGREE DD 7 AGREE DC] 7 AGREE DE] 7 AGREE 7 AGREE [:1 7 ' AGREE . a l i General Informatics; I. clout ! l 2.!)ATB d [3 U, General Information 2. DATE l. (mour- III- unmn-rn Ann-Ivor Dal-l 1“. Lain Please write your comments here. h2 APPENDIX C THE CRITERION The next five questions may be answered in the following way: Yes Yes Yes Yes Yes Draw a circle around "Yes" if your answer is "yes", or a circle around "No“ if your answer is "no". If you don't know or are not sure draw a circle around the question mark. Circle only one answer for each question. ? No No No No No 1. 2. 3. 5. Since working here, have you had any pay raise or promotion? Have you ever recommended this organi- zation or a job with this organization to one of your friends? Since working here, have you registered with any employment agency or applied fora.job with any other organization? Since working here, have you had any grievance in connection with your job? Have you ever tried to transfer to another job or department? Yes Yes Yes No No No #3 APPENDIX D THE THREE ITEM CRITERION 1. 2. 3. Since working here, have you had any pay raise or promotion? Have you ever recommended this organi-7 zation or a job with this organization to one of your friends? Since working here, have you registered with an employment agency or applied for a job with any other organization? Yes Yes Yes Yes Yes No No No No No Mr APPENDIX E THE FIVE ITEM CRITERION 1. 2. 3. Se Since working here, have you had any pay raise or promotion? Have you ever recommended this organi- zation or a job with this organization to one of your friends? Since working here, have you registered with an employment agency or applied for a job with any other organization? Since working here, have you had any grievance in connection with your job? Have you ever tried to transfer to another Job or department? Yes Yes Yes Yes No No No No 1. 2. 3. hS APPENDIX.F THE FOUR ITEM CRITERION Have you ever recommended this organi- zation or a Job with this organization to one of your friends? Since working here, have you registered with an employment agency or applied for a job with any other organization? Since working here, have you had any grievance in connection with your job? Have you ever tried to transfer to another Job or department? APPENDIX G R6 NUMBER or weakens SATISFIED OR LESS THAN SATISFIED ACCORDING TO THE THREE CRITERION FORMS 3 Item, 5 Item A Item Criterion Criterion Criterion Crit. for 3 out of 3 h or more 3 or more satisfied out of 5 out of h Number satisfied 65 6O 58 Number less than satisfied R6 51 S3 APPENDIX H 53 ITEM SBA Items 3 20 27 6 21 28 8 22 29 9 23 30 11 214. 32 12 25 33 15 26 36 Items 4?me H OOCD‘QO‘ APPENDIX I 9 ITEM OSU LLB Items: in 9, 12 15, 17, 23, 22+, 28 29. 1L9, 50, 71. 76 APPENDIX J 15 ITEM SRA 1+9 Items: 1: 2: 1+, 7, 8. 10 APPENDIX K 6 ITEM OSU SO ’E‘OOM USE Obi?! i. 12117-211; . xi , r “In“: Luduhut LCI‘ILN {Nyg FE c.24356 “AA-:Widl .5"!th 13:\~"~'- " 1- \ MAE 1 1, r5 A ’ 1W , “131.. -Am' 4 ctr x , _1 ‘ y L, M ._ “Zr—Aha» AG 1‘: r ’P/ /_:(‘;'g-"' "- I .. ”1.; frflhr‘ 1131111111 111 "‘11111111111111111111111113 . é‘y