Studying teachers’ knowledge by the use of multiple-choice items: the case of ”I’m not sure”

Authors

Janne Fauskanger
Reidar Mosvold

Abstract

The mathematical knowledge for teaching (MKT) measures have been widely adopted by researchers in several countries. This article reports on a study on the connection between teachers’ responses to multiple-choice MKT items, and in particular where they select the suggested solution ”I’m not sure”, and their written responses to corresponding open-ended questions (long responses). The findings from our analysis of 15 teachers’ responses indicate that their long responses and their multiple-choice responses do not always correspond. Some teachers who selected ”I’m not sure” showed uncertainty also in their long responses, whereas other teachers revealed instrumental and even relational understanding of the content.

References

Ball, D. L. & Hill, H. C. (2008). Mathematical knowledge for teaching (MKT) measures. Mathematics released items 2008. Retrieved from http://sitemaker.umich.edu/lmt/files/LMT_sample_items.pdf

Ball, D. L., Thames, M. H. & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journal of Teacher Education, 59 (5), 389-407. https://doi.org/10.1177/0022487108324554

Beswick, K., Callingham, R. & Watson, J. (2012). The nature and development of middle school mathematics teachers' knowledge. Journal of Mathematics Teacher Education, 15 (2), 131-157. https://doi.org/10.1007/s10857-011-9177-9

Blömeke, S. & Delaney, S. (2012). Assessment of teacher knowledge across countries: a review of the state of research. ZDM, 44 (3), 223-247. https://doi.org/10.1007/s11858-012-0429-7

Davis, B. & Simmt, E. (2006). Mathematics-for-teaching: an ongoing investigation of the mathematics that teachers (need to) know. Educational Studies in Mathematics, 61 (3), 293-319. https://doi.org/10.1007/s10649-006-2372-4

Delaney, S. (2012). A validation study of the use of mathematical knowledge for teaching measures in Ireland. ZDM, 44 (3), 427-441. https://doi.org/10.1007/s11858-012-0382-5

Drageset, O. G. (2009). Exploring mathematical knowledge for teaching. In M. Tzekaki, M. Kaldrimidou & C. Sakonidis (Eds.), Proceedings of the 33rd Conference of the International Group for the Psychology of Mathematics Education (Vol. 1, pp. 487-480). Thessaloniki: PME.

Fauskanger, J., Jakobsen, A., Mosvold, R. & Bjuland, R. (2012). Analysis of psychometric properties as part of an iterative adaptation process of MKT items for use in other countries. ZDM, 44 (2), 387-399. https://doi.org/10.1007/s11858-012-0403-4

Fauskanger, J. & Mosvold, R. (2012). "Wrong, but still right". Teachers reflecting on MKT items. In L. R. van Zoest, J.-J. Lo & J. L. Kratky (Eds.), Proceedings of the 34th annual meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education (pp. 423- 429). Kalamazoo: Western Michigan University.

Fauskanger, J., Mosvold, R., Bjuland, R. & Jakobsen, A. (2011). Does the format matter? How the multiple-choice format might complicate the MKT items. Nordic Studies in Mathematics Education, 16 (4), 45-67.

Graeber, A. & Tirosh, D. (2008). Pedagogical content knowledge. Useful concept or elusive notion. In P. Sullivan & T. Wood (Eds.), Knowledge and beliefs in mathematics teaching and teaching development (pp. 117-132). Rotterdam: Sense Publishers.

Haertel, E. (2004). Interpretive argument and validity argument for certification testing: Can we escape the need for psychological theory? Measurement: Interdisciplinary Research and Perspectives, 2 (3), 175-178.

Haladyna, T.M. (2004). Developing and validating multiple-choice test items (3 ed.). New Jersey: Lawrence Earlbaum Associates. https://doi.org/10.4324/9780203825945

Hill, H. C., Ball, D. L. & Schilling, S. G. (2008). Unpacking "pedagogical content knowledge": conceptualizing and measuring teachers' topic-specific knowledge of students. Journal for Research in Mathematics Education, 39 (4), 372-400. https://doi.org/10.5951/jresematheduc.39.4.0372

Hill, H. C., Blunk, M., Charalambous, C. Y., Lewis, J. M., Phelps, G. et al. (2008). Mathematical knowledge for teaching and the mathematical quality of instruction: an exploratory study. Cognition and Instruction, 26 (4), 430-511. https://doi.org/10.1080/07370000802177235

Hill, H. C., Rowan, B. & Ball, D. L. (2005). Effects of teachers' mathematical knowledge for teaching on student achievement. American Educational Research Journal, 42 (2), 371-406. https://doi.org/10.3102/00028312042002371

Hill, H. C., Schilling, S. G. & Ball, D. L. (2004). Developing measures of teachers' mathematical knowledge for teaching. The Elementary School Journal, 105 (1), 11-30. https://doi.org/10.1086/428763

Hill, H. C., Sleep, L., Lewis, J. M. & Ball, D. L. (2007). Assessing teachers' mathematical knowledge. What knowledge matters and what evidence counts? In F. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 111-156). Charlotte: Information Age Publishing.

Hollingworth, L., Beard, J. J. & Proctor, T. P. (2007). An investigation of item type in a standards-based assessment. Practical Assessment Research & Evaluation, 12 (18), 1-13.

Hsieh, H.-F. & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15 (9), 1277-1288. https://doi.org/10.1177/1049732305276687

Jones, G. A., Thornton, C. A., Putt, I. J., Hill, K. M., Mogill, T. A. et al. (1996). Multidigit number sense: a framework for instruction and assessment. Journal for Research in Mathematics Education, 27 (3), 310-336. https://doi.org/10.2307/749367

Mosvold, R., Fauskanger, J., Jakobsen, A. & Melhus, K. (2009). Translating test items into Norwegian - without getting lost in translation? Nordic Studies in Mathematics Education, 14 (4), 101-123.

Osterlind, S. J. (1997). Constructing test items: multiple-choice, constructed- response, performance and other formats (2 ed.). Hingham: Kluwer Academic Publishers.

Schoenfeld, A. H. (2007). Commentary: the complexities of assessing teacher knowledge. Measurement: Interdisciplinary Research and Perspectives, 5 (2), 198-204. https://doi.org/10.1080/15366360701492880

Shulman, L. S. (1986). Those who understand: knowledge growth in teaching. Educational Researcher, 15 (2), 4-14. https://doi.org/10.2307/1175860

Shulman, L.S. (1987). Knowledge and teaching: foundations of the New reform. Harvard Educational Review, 57 (1), 1-22. https://doi.org/10.17763/haer.57.1.j463w79r56455411

Skemp, R.R. (1976). Relational understanding and instrumental understanding. Mathematics Teaching, 77, 20-26.

Tchoshanov, M. A. (2011). Relationship between teacher knowledge of concepts and connections, teaching practice, and student achievement in middle grades mathematics. Educational Studies in Mathematics, 76 (2), 141-164. https://doi.org/10.1007/s10649-010-9269-y

Downloads

Published

2024-11-19

How to Cite

Fauskanger, J., & Mosvold, R. (2024). Studying teachers’ knowledge by the use of multiple-choice items: the case of ”I’m not sure”. NOMAD Nordic Studies in Mathematics Education, 19(3-4), 41–55. Retrieved from https://tidsskrift.dk/NOMAD/article/view/148647