lllllllllllflfllllllflllllllljlllljllfllllll ._ Michigan State University This is to certify that the thesis entitled On Structure Preserving Groups of Latin Squares And Their Applications To Statistics presented by SH I N-SUN CHOW has been accepted towards fulfillment of the requirements for Ph. D. Aegean Statistics and Probability 54:2th get 0‘ (e ., Major professor Date August 17,1979 I 0-7639 ON STRUCTURE PRESERVING GROUPS OF LATIN SQUARES AND THEIR APPLICATIONS TO STATISTICS By Shin-Sun Chow A DISSERTATION Submitted to Michigan State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Department of Statistics and Probability 1979 ABSTRACT ON STRUCTURE PRESERVING GROUPS OF LATIN SQUARES AND THEIR APPLICATIONS TO STATISTICS By Shin-Sun Chow We consider a symmetric property, invariance of probability distribution under a group of transformations of the sample space, of Latin square designs. The group of transformations of the sample space will be called "the structure preserving group for a Latin square design." We show that Latin square designs from the same transformation set have isomorphic structure preserving groups. The commutator algebras of the representation of the structure preserving groups are then studied. The structure preserving group and commuta- tor algebra are computed for one Latin square design from each trans- formation set of Latin square designs of orders three, four and five. Associated with the symmetric property, random assignment of treat- ments (Latin square design as a fractional three factor design) to subjects and randomization tests for Latin square designs are then studied. ACKNOWLEDGEMENTS I would like to thank all the faculty members in the Department of Statistics and Probability at Michigan State University for their help during my four years (l975-1979) of study here. I am especially grateful to my advisor, Dr. Esther Seiden, for giving me encouragement during my frustrating days. I must also thank my wife, Shu-In Huang and my parents for giving me morale support. I should also thank Emily Groen-White and Noralee Burkhardt for their excellent typing job of my dissertation. ii TABLE OF CONTENTS Page INTRODUCTION ........................ l Section 1 A SYMMETRIC PROPERTY OF LATIN SQUARE DESIGNS AND SOME OF ITS RELATED CONCEPTS . . . 5 2 COMMUTATOR ALGEBRAS OF LATIN SQUARE DESIGNS .................... l7 3 DIFFERENT SCHEMES FOR ASSIGNING TREATMENTS TO SUBJECTS ............ 34 4 RANDOMIZATION TEST FOR THE LATIN SQUARE DESIGN ANALYSIS ............ 46 BIBLIOGRAPHY ........................ 54 iii INTRODUCTION Latin square designs are used in agricultural experiments. Suppose we wish to find out by experiments whether there is any signi- ficant difference among yields of m different varieties v1....,vm. The experimental field is subdivided into m2 plots laid out in m rows and m columns and each plot is assigned to one of the m varieties. If each variety appears once and only once in each row and each column, we have a Latin square arrangement. Latin square designs are also used in biological experiments to provide a method of controlling individual differences among experimental units. Another important use of Latin square designs is in the area of beha- vioral sciences to counterbalance order effects in repeated measure- ments plans. The dual balance, i.e. the varieties or treatments to be compared are equally represented across each row and each column, makes the statistical analysis for Latin square designs more precise than those designs without such balance. Wald [l5] and Ehrenfeld [3] studied the problem of testing linear hypotheses for a linear regres- sion model. With respect to the problem, Wald [15] stated an optimality criterion (called D-optimality by Kiefer [l0]) for designs in the setting of two-way heterogeneity (m treatments are assigned to a In>wN-:o\ d-DwN 23 [(1.1)] = {(1.1).(2.2).(3.3).(4.4).(5.5).(6.6).(7.2).(8.8).(9.9). (10,10),(11,11),(12,12),(13,13),(14,14),(15,15),(16,16)} [(192)] = {(192),(]94)9(2,])9(293)9(3’2)9(394)9(49])9(493)9(5’6)9 (598)9(695)9(697)9(796)9(798)9(895)3(897)9(9910)9(9912)9 (10.9).(10.11).(11.10).(11.12).(12.9).(12.11).(13.l4). (13,16),(14,13).(14,15),(15,14),(15,16),(16,13).(16,15)} [(1,3)] = {(193)!(294)9(331)9(492)9(597)9(6’8)9(7’5)9(896)9(9911)9 (10,12),(11,9),(12,10),(13,15),(14,16),(15,13),(16,14)} [(1,5)] = {(1,5),(1,13),(2,6),(2,14),(3,7),(3,15),(4,8),(4,16),(5,1), (5,9),(6,2),(6,10),(7,3),(7,11),(8,4),(8,12),(9,5),(9,13), (10,6),(10,14),(11,7),(11,15),(12,8),(12,16),(13,1), (13,9),(14,2),(14,10),(15,3),(15,11),(16,4),(16,12)} [(1,6)] = {(1 ,6).(1 ,16),(2,7),(2,13),(3,8),(3,14),(4,5),(4,15),(5,4), (5,10),(6,1),(6,11),(7,2),(7,12),(8,3),(8,9),(9,8),(9,14), (10,5),(10,15),(11,6),(11,16),(12,7),(12,13),(13,2), (13,12),(14,3),(14,9),(15,4),(15,10),(16,1),(16,11)} [(1.7)] = {(1,7).(1.15).(2,8),(2,16),(3,5),(3,13),(4,6),(4,14),(5,3), (5,11),(6,4),(6,12),(7,1),(7,9),(8,2),(8,10),(9,7),(9,15), (10,8),(10,16),(11,5),(11,13),(12,6),(12,l4),(13,3), (13,11),(l4,4),(l4,12),(15,1),(15,9),(16,2),(16,10)} {(1,8),(1,14),(2,5),(2,15),(3,6),(3,16),(4,7),(4,13),(5,2), (5,12),(6,3),(6,9),(7,4),(7,10),(8,1),(8,11),(9,6),(9,16), (10,7),(10,13),(11,8),(11,14),(12,5),(12,15),(13,4), (13,10),(14,1),(14,11),(15,2),(15,12),(16,3),(16,9)} [(1.8)] 24 {(1.9).(2.10).(3.11).( 4.12).(5.13).(5.14).(7.15).(8.16). (9.1).(10.2).(11.3).(12.4).(13.5).(14.6).(15.7).(16.8)} [(1,9)] {(1,10),(1,12),(2,9),(2,11),(3,10),(3,12),(4,9),(4,11), (5,14),(5,16),(6,13),(6,15),(7,14),(7,16),(8,13),(8,15), (9,2),(9,4),(10,1),(10,3),(11,2),(11,4),(12,1),(12,3), (13,6),(13,8),(14,5),(14,7),(15,6),(15,8),(16,5),(16,7)} [(1.10)] {(1.11).(2.12).(3.9).(4.10).(5.15).(5.16).(7.13).(8.14). (9.3).(10.4).(11.1).(12.2).(13.7).(14.8).(15.5).(16.5)} [(1.11)] The images of the ten equivalence classes under the mapping (g'],g']) are as follows: (9".9'111um11) [(1.111 {(8.6) .(8.7) .(6.8).(6.5) .(5.6).(5.7).(7.8) .(7.5) . (4.2).(4.3).(2.4).(2.l).(1.2).(1.3).(3.4).(3.1). (12,10),(12,11),(1o,12),(1o,9),(9,10),(9,11), (11,12),(11,9),(16,14),(16,15),(14,16),(l4,13), (13,14),(13,15) ,(15,16) ,(15,13)} (9".9")(t<1.211) {(8.5).(6.7).(5.8).(7.6).(4.1).(2.3).(1.4).(3.2). (12.9).(10.11).(9.12).(11.10).(16.13).(14.15). (13,16),(15,14)} (g".g“1 x yk) (3.4) Var(nx) = 1(H(X)(k) x YE) - (Enxlz (3.5) Cov(nx.ny) = kzk.(n(x:Y)(k.k'1 x vk x yk.) - (Enx)(Eny) where summations are over all possible k and k'. Some theorems concerning Enx, Var(nx) and Cov(nx,ny) will be shown next. Lemma 3.1: a) K(x)(k) = H(y)(k) for all k if x = g(y) for some 9 E G b) K(X’Y)(k.k') = n‘x'11'11k.k') for all k.k'. if (x.y) = (9(X').9(y')) for some 9 6 6. Proof: a) The probability distribution of K(x)(k) is completely dependent on Gx = {g(x)lg 6 G}, the orbit of x under G. We also know that x = g(Y) with g E G implies that Gx = Gy. H(X)(k) = H(y)(k) for all k, if x = g(y) for some 9 6 G. b) Similarly, the probability distribution of H(x’y)(k,k') is com- pletely determined by the set {(g(x),g(y))|g 6 G}. Also, if (x,y) = (g(x'),g(y')) for some 9 e G, then 37 {(9(X).9(y))|9 E G} = {(9(X').9(y'))|9 6 G}. n‘x’Y)(k.k') = n(x"yi)(k.k') for all k,k' if (x.y) = (9(X').9(y')) for some 9 5 G. Q-E-D~ Theorem 3.1: a) If x = g(y) for some 9 E G then Enx = Eny and Var(nx) = Var(ny). b) If (x,y) = g(x'),g(y')) for some 9 E G then Cov(nx,n ) = Cov(nx..ny.)- Y Proof: Theorem 3.1 follows directly from lemma 3.1. Q.E.D. Theorem 3.2: If G is a subgroup of the symmetric group S 2 which m induces one and only one orbit on {l,2,...,m2} then Enx = 0 for x = l,2,...,m2. (A group of transformations which induces one and only one orbit on its domain is called a transitivegroup.) Proof: From the assumption that G is transitive, we have that {1.2.....m21 = {9(1119 e 61. Let H] = {919(1) = 1}. -H2 = {g|g(l) = 21,...,H 2 = {g|g(l) = m2} and then H1 is a subgroup m G. Next, we prove the following equalities: (*1 Hi = g-H1 for some 9 E G, i = 2,3,...,m2. Proof of (*): iff g(l) = 1 iff g(l) = 90(1) for some 90 E G g 6 Hi -1 iff g0 og(l) = l for some 90 6 G iff g E gO-H1 for some 90 E G 38 (*) is thus proved. From (*), we have that |H1| = [HZ] = ... = |H 2I, thus m n(‘)(1) = n(‘)(2) = ... = n(‘)(m) = l/m En-I = er/m = O k En] = En2 = ....... = En 2 = O m follows from theorem 3.1. Q.E.D. Theorem 3.3: If we choose G = Gr n Gc Fth, the structure preserving group of the given Latin square design, and let '6 = (n1...-.n 2), m then Cov(fi) 6 C (where C is the commutator algebra of Definition 1.6). Proof: From Theorem 3.1, Cov(ni,nj) = Cov(ni..nj.) if (i,j) = (g(i'),g(j')) for some 9 e Gr n Gc n Gt and i,j,i',j' e {l,2,...,m2}. :. Cov(6) e 6 follows from the definition of c. Q.E.D. Let g e Gr 0 Gc and (9,9) be a function defined on {l,2,...,m2} X {l,2,...,m2} as in the proof of Theorem 1.5. Let [(i,j)] = {(9:9)(1.j)|g E Gr n Gc}’ it is the orbit of (i,j) under the set of transformations {(g.g)lg G Gr n Gc}' We have that ' {l,2,...,m2} x {l,2,...,m2} = [(1,1)] 0 [(1,2)] U [(1,m+1)] u [(1,m+2)]. From Lemma 3.1, the next theorem completely specifies the value 2 n(x”)(k',k') for all x,y = l,2,...,m and k,k' = l,2,...,m. Theorem 3.4: If we choose G = Gr n GC for our randomization scheme, then 39 a) K(x)(l) = H(x)(2) = ... = K(x)(m) = l/m for x = l,2,...,m2 b) n("2)(i,j) = 1/m(m-1) for i e j and i,j = l,2,...,m = 0 for i = j and i = l,2,...,m c) 11“'""'”(i.i) l/m(m-l) for i f j and i,j = l,2,...,m 0 for i = j and i = l,2,...,m d) n("m+2)(i (m-2)/m(m-1)2 1/m(m-l) for i = j and i = l,2,...,m for i f j and i,j l,2,...,m .1) Proof: a) It follows from the proof in Theorem 3.2 and Lemma 3.1 (2’ Gr n Gc is a transitive group) b), c), d) Let 3 I 1 - {(i,j)li e j and i,j = l,2,...,m} 2 {(k.j)|i # j and i,j m+l,m+2,...,2m} 3 II M = {(1.1111 f j and 1.3 N] = {(isj711fj and in]. 21 (m-l)m+1,...,m 1,m+1 ,2m+1 ,. . . ,(m-1)m+1} N2 = {(i,j)li # j and i,j = 2,m+2,2m+2,...,(m-l)m+2} Nm = {(i,j)li f i and i,j = m,2m,...,m2} R1 = {(1,j)|j a l,j f 2,...,j a m,j r 1,j # m+l,j r 2m+1,..., j # (m-1)m+l} R = {(2,j)|j f1,j as 2,...,j ,1 m,j ,1 2,j ,1 m+2,j ,1 2m+2...., j? hrlMHZ} 4O Rm=umnwr1dizaunrmnrzmiimhudrmh Rm,1 = {(m+l..1')lj 1‘ m+l.3' 1‘ m+2.....3' 7‘ 2m..i 21.1 i‘ m+1..... .1' 1‘ (m-l)m+l} mm=HMJHirmLiimauuiimnimnrzmuuiimi $121.3? m+1......1' 1‘ (m-1)m+1} R 2 = {(m2.i)lj f (m—1)m+1.i r (m-l)m+2.....j i m2.j r m.i # 2m. 111 ...,j #112} where M1,...,Mm,N],...,Nm,R],R2,...,Rm2 are disaoint sets. Note that [(1,2)] = M1 u M2 u ... u Mm [(l,m+l)] = N] U N2 U ... U Nm [(l,m+2)] = R1 u R2 U ... U Rm2 and 111.1 - 11121 = -- lel = rum-11 1N1} = 1N2} = = lel = m(m'1) 181 181 =18 1=2 - 1 2 2 m l[(l,2)]| = m2(m-l), l[(l,m+l)]l = m2(nrl) and l[(1,m+2)]l = m2(m-l)2 41 LEt [(1,2)] = {(1:2)9(129j2)s(139j3)90009(i )} m2(m-1)’jm2(m-l) (1.2)} I ll 1 {919 E Gr 0 Gc and (9(1).9(2)) I ll 2 {9|9 E G, n GC and (9(1).9(2)) = (12.32)} H = {9|9 6 G, 0 GC and (9(1).9(2)) = (i .1 ) m2(m-1) m2(m-l) m2(m-l) then H1,H2,...,H 2 are disjoint sets and m (m-l) m2(m-1) (1) Gr n Gc = i3] Hi‘ Moreover, H1 is a subgroup of Gr n GC. Next, we prove the following equalities: 2 (2) Hk = 9 H1 for some 9 6 Gr 0 Gc’ k = 2,3,...,m (m-l). Proof of (2): iii (9111,9121) = (1k..ik) iff (901.9(2)) (900159091) [0" 5°“ 90 6 Gr “ Ge 9 6 H iff (galog(1),gBIog(2)) = (1,2) for some 90 E Gr n GC iff g E gO-H.l for some 90 E G (2) is thus proved. [H | = |H I = ... = [H l follows from (2). Note that 42 (3) { N—‘Otw 52 21 8 17 9 10 3 12 20 10 15 21 4 15 3 9 U1 The analysis of variance table is as follows: Source Sum of Squares d.f. Mean Square F ratio Row 240.25 3 80.08 Column 28.25 3 9.42 Treatment 216.25 3 72.08 4.55 Error 95.00 6 15.83 Total 579.75 15 The significance probability 3 .07 The computed F* values, using designs from 18 equivalence classes 2 1 4 3 of the transformation set containing the design are as ‘90) #00“) com-4 ,N—I-t: follows: (4.1) F*values: .096, .207, .231, .284, .318, .390, .422, .485, .638, 1.051, 1.242, 2.07, 2.61, 2.75, 4.55, 4.62, 4.92 Mean value of F* = 1.53 Standard Deviation of F* values = 1.67 The computed F* values using designs from six equivalence classes of the other transformation set are as follows: (4.2) F*values: .128, .318, .441, .594, 4.29, 4.92 Mean Value of F* = 1.78, Standard Deviation of F* = 2.20 53 Example 4.3: The observed values from a randomly chosen Latin square 1.1 1.5 1.0 1.7 design are arranged in a matrix 1.4 1.9 1.6 1.5 2.8 2.2 2.7 2.1 .4 2.5 2.9 2.7 * The computed F values, using designs from eighteen equivalence classes of the transformation set containing the design I 3 Z I g 1 2 3 are as follows: (4.3) F* values: .0905, .127, .155, .155, .205, .205, .3095, .332. .378, 1.03, 1.19, 1.44, 1.67, 1.85, 2.85, 7.33. 10.76, 11.1 Mean Value of F* value = 2.29 Standard Deviation of F*va1ue = 3.58 * The computed F values, using designs from six equivalence classes of the other transformation set are as follows: (4.4) F* values: .0905, .155, .205, .377, 5.95, 15.34 Mean Value of F* value = 3.67 Standard Deviation of F* value = 6.15 The computed F* values, using designs from different transfor- mation sets in the above two examples suggest that distributions of computed F* values for different transformation sets might be quite different for Latin square designs of order greater than 4. It indi- cates again, that the randomization test should be performed using only those designs in the same transformation set as the design actually used. BIBLIOGRAPHY [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] BIBLIOGRAPHY Dubenko, T.I., Sysoev, L.P. and Shaikin, M.E. Symmetry proper- ties and characterization of the covariance matrices in the randomized-block experimental design problem with randomized blocks. Automation and Remote Control (1976), 378-376. Translated from Avtomatika i Telemekhanika, No. 3 (March 1976). 73-82. Dubenko, T.I., Sysoev, L.P. and Shaikin, M.E. Sufficient statistics and estimates of covariance matrices of specially structured covariance matrices for two experimental design models. Automation and Remote Control (1976), 492-500. Trans- ggtgg from Avtomatika i Telemekhanika, No. 4 (April 1976). Ehrenfeld, S. On the efficiency of experimental designs. Ann. Math. Statist. Z§.(1953): 247-255. Fisher, R.A. The Design of Experiments. Oliver and Boyd, Edinburgh, 1935 (rev. ed., 1960). Fisher, R.A. and Yates, F. Statistical Tables for Biological Agricultural and Medical Research. Oliver and Boyd, Edinburgh, 1938 (rev. ed., 1957). James, A.T. The relationship algebra of an experimental design. Ann. Math. Statist. 2§_No. 4 (1957), 993-1002. Kempthorne, O. The Design and Analysis of Experiments. John Wiley & Sons, New York, 1952. Kempthorne, O. The randomization theory of experimental inference. J. Am. Statist. Assoc. §Q_(l955), 946-967. Kempthorne, O. Inference from experiments and randomization. A Survey of Statistical Design and Linear Models (J.N. Srivastava, ed.), North-Holland Publishing Company, 1975, 303-331. Kiefer, J. On the nonrandomized optimality and randomized nonoptimality of symmetrical designs. Ann. Math. Statist. 29_ (1958), 675-699. Kiefer, J. Optimum experimental designs. J. Roy. Statist. Soc., Ser. B, 21_(1959), 272-319. 54 [12] [13] [14] [15] 55 Sysoev, L.P. and Shaikin, M.E. Algebraic methods of investi- gating the correlation connections in incompletely balanced block schemes for experiment design. I. Characterization of covariance matrices in the case of asymmetric block schemes. Automation and Remote Control (1976), 696-705. Translated from Avtomatika i Telemekhanika, No. 5 (May 1976), 64-73. Sysoev, L.P. and Shaikin, M.E. Algebraic methods of investi- gating the correlation connections in incompletely balanced block schemes for experiment design. II. Relationship algebras and characterization of covariance matrices in the case of symmetric block-schemes. Automation and Remote Control (1976), 1022-1031. Translated from Avtomatika i Telemekhanika, No. 7 (July 1976), 57-67. Van Der Waerden, B.L. Modern Algebra, Vol. 2. ‘Springer, Berlin, 1940. English translation, Ungar, New York, 1950. Wald, A. On the efficient design of statistical investigations. Ann. Math. Statist. 14_(1943), 134-140. MIC "1111111111111111i