INDAL: A Computer Program for Comparing Multiple Independent Coefficient Alphas
*N. Clayton Silver and Nicholas S. Thaler
Department of Psychology, University of Nevada, Nevada
Submission: December 16, 2015; Published: January 04, 2016
*Corresponding author: N. Clayton Silver, Department of Psychology, University of Nevada, Las Vegas, Nevada, Fax: 7028950195; Tel: 7028950191; Email: fdnsilvr@unlv.nevada.edu
How to cite this article: Silver NC, Thaler NS. INDAL: A Computer Program for Comparing Multiple Independent Coefficient Alphas. Psychol Behav Sci Int J. 2016; 1(1): 555552. DOI: 10.19080/PBSIJ.2016.01.555552
Abstract
There are times when one might want to compare the coefficient alphas of three or more tests measuring the same construct. The computer program, INDAL, is introduced which compares multiple coefficient alphas using the omnibus Fisher-Bonett approach followed by subsequent pairwise comparisons using F tests.
Keywords: Coefficient alpha; Computer program
Review Article
Suppose an industrial psychologist, striving to be economically practical, compared the coefficient alphas of three tests measuring the same construct given varying numbers of items. Second, suppose a test is translated into several languages. In this case, some items may be eliminated or modified based upon incomparable meanings across languages. Finally, suppose different types of participants (e.g., different classes of high school students) complete a particular test (e.g., self-esteem). In all three cases, a test of multiple independent coefficient alphas might be of interest.
Comparing multiple independent coefficient alphas has been addressed by Feldt et al. [1] among others. Kim and Feldt [2] simulated the Hakstian and Whalen TE [3] and the Fisher-Bonett statistics, which they modified from Bonett [4] to test the difference among more than two coefficient alphas, and found that both were similar in terms of Type I error, power, and their robustness to heteroscedasticity. Moreover, Feldt et al. [1] and Charter [5] explained that subsequent F tests could be used to compare pairwise alphas. However, because these comparisons are not independent, a Bonferroni correction would be appropriate. Therefore, the purpose of the program was to compute the Fisher-Bonett statistic and subsequent F tests for comparing multiple independent coefficient alphas.
Description
The user is queried interactively for the number of coefficient alphas, the magnitude of each, sample size, and number of items. The output consists of a restatement of the input, the Fisher-Bonett value, its degrees of freedom, and probability using the algorithm by Dunlap and Duffy [6]. Next, the user provides the number of subsequent pairwise F tests and is queried for the two coefficient alphas and sample sizes. The program responds with the values of the coefficient alphas, the degrees of freedom, F ratio, and probability for each subsequent comparison as explained by Charter and Feldt [7]. Moreover, the Bonferroni correction is provided at the .05 and .01 levels for comparing probability levels. The program is written in FORTRAN 90 and runs on an IBM-PC or compatible. The output is contained in INDAL.OUT.
Example
The Eating Attitudes Test [8] has gone through a couple of iterations. Initially, the scale consisted of 40 items (EAT40). However, a few years later, a shorter 26-item scale was developed [9]. Garner et al. [9] provided the coefficient alphas for EAT26 and EAT40 for both anorexia nervosa and female comparison participants. Because one is comparing independent coefficient alphas, only the EAT26 data will be used. Likewise, in a separate study, Lane et al. [10] computed the coefficient alpha of the EAT26 with athletes. Finally, Mukai et al. [11] developed the Japanese version of the EAT26 and administered it to Japanese females along with the English version of the scale to American females [11]. The coefficient alphas and sample sizes for these studies are presented in Table 1.
As shown in the output from Table 2, the Fisher-Bonett statistic (which distributes out as a chi-square on k-1 df) was 45.91 with a p<.0001 indicating that there was a statistically significant difference among the coefficient alphas. Suppose one is subsequently interested in determining if there was a statistically significant difference between the coefficient alphas of athletes and anorexia nervosa participants on the EAT26. Moreover, suppose a second question concerned testing the difference between the coefficient alphas of the Japanese and American females in the Mukai et al. [12] study. A third comparison examined the difference between the coefficient alphas of the anorexia nervosa and female comparison groups of the Garner et al. [9] study. Because these are non-independent comparisons, a Bonferroni approach would be more viable. As indicated from the output, there was a significantly higher coefficient alpha on the EAT26 for anorexia nervosa participants than for athletes and the female comparison group, ps <.01. However, there was no statistically significantly significant difference between coefficient alphas on the EAT26 for the American and Japanese females, p >.05.
Availability
INDAL.FOR and the executable version (INDAL.EXE) may be obtained at no charge by sending an e-mail request to N. Clayton Silver, Department of Psychology, University of Nevada, Las Vegas, Las Vegas, NV 89154-5030 at fdnsilvr@unlv.nevada.edu.
References
- Feldt LS, Woodruff DJ, Salih FA (1987) Statistical inference for coefficient alpha coefficients. Applied Psychological Measurement 11: 93-103.
- Kim S, Feldt LS (2008) A comparison of tests for equality of two or more independent alpha coefficients. Journal of Educational Measurement 45(2): 179-193.
- Hakstian RA, Whalen Tem (1976) A k-sample significance test for independent alpha coefficients. Psychometrika 41(2): 219-231.
- Bonett DG (2003) Sample size requirements for comparing two alpha coefficients. Applied Psychological Measurement 27: 72-74.
- Charter RS (1997) Testing the difference between two or more independent coefficients alpha: An example. Perceptual and Motor Skills 84: 464-466.
- Dunlap WP, Duffy JA (1975) FORTRAN IV functions for calculating exact probabilities associated with z, χ 2, t, and F tables. Behavior Research Methods 7(1): 59-60..
- Charter RS, Feldt LS (1996) Testing the equality of two coefficient alphas. Perceptual and Motor Skills 82: 763-768.
- Garner DM, Garfinkel PE (1979) The eating attitudes test: An index of the symptoms of anorexia nervosa. Psychological Medicine 9(2): 273-279.
- Garner DM, Olmsted MP, Bohr Y, Garfinkel PE (1982) The eating attitudes test: Psychometric features and clinical correlates. Psychological Med 12(4): 871-878.
- Lane HW, Lane AM, Matheson H (2004) Validity of the eating attitude test among exercisers. Journal of Sports Science and Medicine 3: 244-253.
- Mukai T, Crago M, Shisslak CA (1994) Eating attitudes and weight preoccupation among female high school students in Japan. J Child Psychol Psychiatry 35(4): 677-688.
- Mukai T, Kambara A, Sasaki Y (1998) Body dissatisfaction, need for social approval, and eating disturbances among Japanese and American college women. Sex Roles 39(9): 751-763.