PSYCHOMETRIC EVALUATION OF THE STUDENTS’ ATTITUDES TOWARD STATISTICS AND TECHNOLOGY SCALE (SASTSc)
DOI:
https://doi.org/10.52041/serj.v21i3.29Keywords:
Statistics education research, Attitudes toward statistical technology, Statistics attitudes, Scale development, Statistical software, AssessmentAbstract
The current study sought to evaluate the SASTSc in two samples of students taking a statistics course that incorporates statistical software. The SASTSc was given at two time points, once at the beginning of the semester and then again at the end of the semester. Our evaluation included examining competing factor analytic models, examining convergent validity, test-retest reliability, and assessing internal consistency. Our results in both samples replicate the scale’s proposed factor structure; however, not all items were useful and we propose some changes to the wording of items to improve the scale. Data, analysis scripts, and results are publicly available at https://osf.io/rv64m/?view_only=6dfbf883f0d841b69c238773cee6e62e.
References
Anastasiadou, S. D. (2011). Reliability and validity testing of a new scale for measuring attitudes toward learning statistics with technology. Acta Didactica Napocensia, 4(1), 1–10.
Bond, M., Perkins, S., & Ramirez, C. (2012). Students’ perceptions of statistics: An exploration of attitudes, conceptualizations, and content knowledge of statistics. Statistics Education Research Journal, 11(2), 6–25. https://doi.org/10.52041/serj.v11i2.325
Brezavscek, A., Sparl, P., & Znidarsic, A. (2016). Factors influencing the behavioural intention to use statistical software: The perspective of the Slovenian students of social sciences. EURASIA Journal of Mathematics, Science and Technology Education, 13(3), 953–986. https://doi.org/10.12973/eurasia.2017.00652a
Chance, B., Ben-Zvi, D., Garfield, J., & Medina, E. (2007). The role of technology in improving student learning of statistics. Technology Innovations in Statistics Education, 1(1), 1–26. https://doi.org/10.5070/T511000026
Chew, P. K. H., & Dillon, D. B. (2014). Statistics anxiety update: Refining the construct and recommendations for a new research agenda. Perspectives on Psychological Science, 9(2), 196–208. https://doi.org/10.1177/1745691613518077
Counsell, A., & Cribbie, R. (2020). Student attitudes toward learning statistics with R. Psychology Teaching Review, 26(2), 36–56. https://doi.org/10.31234/osf.io/76w2p
Costello, A. B., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(1), 1–9. https://doi.org/10.7275/jyj1-4868
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555
Davidson, H., Jabbari, Y., Patton, H., O’Hagan, F., Peters, K., & Cribbie, R. (2019). Statistical software use in Canadian university courses: Current trends and future directions. Teaching of Psychology, 46(3), 246–250. https://doi.org/10.1177/0098628319853940
Dempster, M., & McCorry, N. K. (2009). The role of previous experience and attitudes toward statistics in statistics assessment outcomes among undergraduate psychology students. Journal of Statistics Education, 17(2). https://doi.org/10.1080/10691898.2009.11889515
Eccles, J. S., & Wigfield, A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53(1), 109–132. https://doi.org/10.1146/annurev.psych.53.100901.135153
Emmioglu, E., & Capa-Aydin, Y. (2012). Attitudes and achievement in statistics: A meta-analysis study. Statistics Education Research Journal, 11(2). https://doi.org/10.52041/serj.v11i2.332
Evans, B. (2007). Student attitudes, conceptions, and achievement in introductory undergraduate college statistics. The Mathematics Educator, 17(2), 24–30.
Flora, D. B. (2020). Your coefficient alpha is probably wrong, but which coefficient omega is right? A tutorial on using R to obtain better reliability estimates. Advances in Methods and Practices in Psychological Science, 3(4), 484-501. https://doi.org/10.1177/2515245920951747
GAISE College Report ASA Revision Committee. (2016). Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report 2016. American Statistical Association. http://www.amstat.org/education/gaise
Gal, I., & Ginsburg, L. (1994). The role of beliefs and attitudes in learning statistics: Towards an assessment framework. Journal of Statistics Education, 2(2). https://doi.org/10.1080/10691898.1994.11910471
Griffith, J. D., Adams, L. T., Gu, L. L., Hart, C. L., & Nichols-Whitehead, P. (2012). Students’ attitudes toward statistics across the disciplines: A mixed-methods approach. Statistics Education Research Journal, 11(2), 45–56. https://doi.org/10.52041/serj.v11i2.328
Hernandez, O. (2006). Teaching statistics to undergraduate students of the social sciences. In A. Rossman & B. Chance (Eds.), Working cooperatively in statistics education. Proceedings of the 7th International Conference on Teaching Statistics (ICOTS7), Salvador, Bahia, Brazil, July. 2–7. International Statistical Institute.
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Jatnika, R. (2015). The effect of SPSS course to students attitudes toward statistics and achievement in statistics. International Journal of Information and Education Technology, 5(11), 818–821. https://doi.org/10.7763/IJIET.2015.V5.618
Johnson, J. A. (2005). Ascertaining the validity of individual protocols from Web-based personality inventories. Journal of Research in Personality, 39(1), 103–129. https://doi.org/10.1016/j.jrp.2004.09.009
Lavidas, K., Barkatsas, T., Manesis, D., & Gialamas, V. (2020). A structural equation model investigating the impact of tertiary students’ attitudes toward statistics, perceived competence at mathematics, and engagement on statistics performance. Statistics Education Research Journal, 19(2), 27–41. https://doi.org/10.52041/serj.v19i2.108
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. https://doi.org/10.1037//1082-989X.1.2.130
Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519
Marjanovic, Z., Holden, R., Struthers, W., Cribbie, R., & Greenglass, E. (2015). The inter-item standard deviation (ISD): An index that discriminates between conscientious and random responders. Personality and Individual Differences, 84, 79–83. https://doi.org/10.1016/j.paid.2014.08.021
McDonald, R. P. (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23(1), 1–21. https://doi.org/10.1111/j.2044-8317.1970.tb00432.x
McDonald, R. P. (1999). Test theory: A unified approach. Lawrence Erlbaum Associations, Publishers.
McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
Nasser, F. M. (2004). Structural model of the effects of cognitive and affective factors on the achievement of Arabic-speaking pre-service teachers in introductory statistics. Journal of Statistics Education, 12(1). https://doi.org/10.1080/10691898.2004.11910717
Nolan, D., & Temple Lang, D. (2010). Computing in the statistics curricula. The American Statistician, 64(2), 97–107. https://doi.org/10.1198/tast.2010.09132
Nolan, M. M., Beran, T., & Hecker, K. G. (2012). Surveys assessing students’ attitudes toward statistics: A systematic review of validity and reliability. Statistics Education Research Journal, 11(2), 103–123. https://doi.org/10.52041/serj.v11i2.333
Onwuegbuzie, A. J. (2004). Academic procrastination and statistics anxiety. Assessment and Evaluation in Higher Education, 29(1), 3–19. https://doi.org/10.1080/0260293042000160384
Onwuegbuzie, A. J., & Wilson, V. A. (2003). Statistics anxiety: Nature, etiology, antecedents, effects, and treatments—A comprehensive review of the literature. Teaching in Higher Education, 8(2), 195–209. https://doi.org/10.1080/1356251032000052447
Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics: Statistical Issues in Psychology, Education, and the Social Sciences, 2(1), 13–43. https://doi.org/10.1207/S15328031US0201_02
Ramirez, C., Schau, C., & Emmioglu, E. (2012). The importance of attitudes in statistics education. Statistics Education Research Journal, 11(2), 57–70. https://doi.org/10.52041/serj.v11i2.329
Revelle, W. (2020) psych: Procedures for personality and psychological research. Northwestern University. R package version 2.0.9. https://CRAN.R-project.org/package=psych
Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of Statistical Software, 48(2), 1–36.
Saki, A., Tabesh, H., Yousefi, R., & Khalili, S. (2016). Clustering the attitudes towards statistics and technology among medical post graduate students. British Journal of Applied Science and Technology, 18(4), 1–11. https://doi.org/10.9734/BJAST/2016/29673
Schau, C. (2003). Survey of Attitudes Toward Statistics—36. CS Consultants, LLC. www.evaluationandstatistics.com
Schau, C., Stevens, J., Dauphinee, T. L., & Del Vecchio, A. (1995). The development and validation of the Survey of Attitudes Toward Statistics. Educational and Psychological Measurement, 55(5), 868–875. https://doi.org/10.1177/0013164495055005022
Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120. https://doi.org/10.1007/s11336-008-9101-0
Velicer, W. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321–327. https://doi.org/10.1007/BF02293557
Walker, E. R., & Brakke, K. E. (2017). Undergraduate psychology students’ efficacy and attitudes across introductory and advanced statistics courses. Scholarship of Teaching and Learning in Psychology, 3(2), 132–140. https://doi.org/10.1037/stl0000088
Wolf, M. G., Ihm, E., Maul, A., & Taves, A. (2019). Survey item validation. PsyArXiv Preprints. https://doi.org/10.31234/osf.io/k27w3
Yang, Y., & Green, S. B. (2011). Coefficient alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29(4), 377–392. https://doi.org/10.1177/0734282911406668
Yuan, K.-H., Chan, W., Marcoulides, G. A., & Bentler, P. M. (2016). Assessing structural equation models by equivalence testing with adjusted fit indexes. Structural Equation Modeling: A Multidisciplinary Journal, 23(3), 319–330. https://doi.org/10.1080/10705511.2015.1065414
