Interactive oral assessment for statistical literacy
DOI:
https://doi.org/10.52041/iase25.121Abstract
In the quest to distinguish fact from fiction in a world awash with misinformation and disinformation, statistical literacy is more crucial than ever. One of the key characteristics of a statistically literate citizen is their ability to communicate and justify their reaction to data-based information encountered in various contexts. An interactive oral assessment (IOA) can be a valuable and authentic way of assessing these skills. IOAs involve genuine, unscripted conversations, facilitating opportunities for an instructor to query responses to evaluate students’ understanding more fully and allowing students flexibility in demonstrating their knowledge. IOAs are also less prone to academic misconduct than their more traditional written or online counterparts. This paper presents the rationale for introducing an IOA in an introductory statistical literacy course, outlines the implementation process, and shares reflections from course instructors alongside preliminary student feedback.References
Budgett, S., & Pfannkuch, M. (2010). Assessing students’ statistical literacy. In P. Bidgood, N. Hunt & F. Jolliffe (Eds.), Assessment methods in statistical education: An international perspective (pp. 103–121). Wiley. https://doi.org/10.1002/9780470710470.ch9
Carver, R., Everson, M., Gabrosek, J., Horton, N., Lock, R., Mocko, M., Rossman, A., Roswell, G. H., Velleman, P., Witmer, J., & Wood, B. (2016). Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report. American Statistical Association. https://www.amstat.org/docs/default-source/amstat-documents/gaisecollege_full.pdf
Engel, J., & Ridgway, J. (2023). Back to the future: Rethinking the purpose and nature of statistics education. In J. Ridgway (Ed.), Statistics for empowerment and social engagement: Teaching Civic Statistics to develop informed citizens (pp. 17–36). Springer. https://doi.org/10.1007/978-3-031- 20748-8_2
Gal, I. (2002). Adults’ statistical literacy: Meanings, components, responsibility. International Statistical Review, 70(1), 1–51. https://doi.org/10.2307/1403713
Gal, I. (2023). Critical understanding of Civic Statistics: Engaging with important contexts, texts, and opinion questions. In J. Ridgway (Ed.), Statistics for empowerment and social engagement: Teaching Civic Statistics to develop informed citizens (pp. 323–343). Springer. https://doi.org/10.1007/978-3-031-20748-8_13
Gulikers, J., Bastiaens, T., & Kirschner, P. (2004). A five-dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–86. https://doi.org/10.1007/BF02504676
Harari, Y., Harris, T., & Raskin, A. (2023, March 24). Opinion: You can have the blue pill or the red pill, and we’re out of blue pills. The New York Times. https://www.nytimes.com/2023/03/24/opinion/yuval-harari-ai-chatgpt.html
Harford, T. (2021). The data detective: Ten easy rules to make sense of statistics. Riverhead Books.
Hoernig, S., Ilharco, A., Pereira, P. T., & Pereira, R. (2024). Generative AI and higher education: Challenges and opportunities. Institute of Public Policy Lisbon. https://www.ipp-jcs.org/wp- content/uploads/2024/09/Report-AI-in-Higher-Education-IPP-1.pdf
Klein, E. (2023, March 12). Opinion: This changes everything. The New York Times. https://www.nytimes.com/2023/03/12/opinion/chatbots-artificial-intelligence-future- weirdness.html
Lanier, J. (2023, April 20). Annals of Artificial Intelligence: There is no AI. The New Yorker. https://www.newyorker.com/science/annals-of-artificial-intelligence/there-is-no-ai
Martens, R., Bastiaens, T., & Kirschner, P. A. (2007). New learning design in distance education: The impact on student perception and motivation. Distance Education, 28(1), 81–93. https://doi.org/10.1080/01587910701305327
Piper, K. (2022, November 29). The Highlight: AI experts are increasingly afraid of what they’re creating. Vox. https://www.vox.com/the-highlight/23447596/artificial-intelligence-agi-openai- gpt3-existential-risk-human-extinction
Shaeri, S., Logan, D., & Krautloher, A. (2021). Evaluating competency development using interactive oral assessments. In Research in Engineering Education Symposium and Australasian Association for Engineering Education Conference (pp. 103–112). Engineers Australia. https://search.informit.org/doi/10.3316/informit.345915443844801
Sotiriadou, P., Logan, D., Daly, A., & Guest, R. (2020). The role of authentic assessment to preserve academic integrity and promote skill development and employability. Studies in Higher Education, 45(11), 2132–2148. https://doi.org/10.1080/03075079.2019.1582015
Theobold, A. S. (2021). Oral exams: A more meaningful assessment of students’ understanding. Journal of Statistics and Data Science Education, 29(2), 156–159. https://doi.org/10.1080/26939169.2021.1914527
Utts, J. (2015). Seeing through statistics (4th edition). Cengage Learning.
Wallace-Wells, D. (2023, March 27). Opinion: AI is being built by people who think it might destroy us. The New York Times. https://www.nytimes.com/2023/03/27/opinion/ai-chatgpt-chatbots.html
Ward, M., O’Riordan, F., Logan-Fleming, D., Cooke, D., Concannon-Gibney, T., Efthymiou, M., & Watkins, N. (2024). Interactive oral assessment case studies: An innovative, academically rigorous, authentic assessment approach. Innovations in Education and Teaching International, 61(5), 930– 947. https://doi.org/10.1080/14703297.2023.2251967
Yanchenko, E. (2025). Oral exams in introductory statistics class with non-native English speakers. Teaching Statistics. https://doi.org/10.1111/test.70015
