ANALYSIS OF CTT AND IRT ON NON-TEST MEASUREMENT INSTRUMENTS: MATHEMATICAL MINDSET SCALE

Priarti Megawanti, Nurimani Nurimani, Meyta Dwi Kurniasih

Abstract


Purpose – This study aims to determine empirically the appropriate number of items that meet all item selection criteria, from classical test theory to item response theory.

Methodology – This study used the Mathematical Mindset Scale (MMS) as an instrument for a non-test. It was conducted on 259 Mathematics Education students in Indonesia to determine the appropriate number of items that meet all item selection criteria, from classical test theory to item response theory. This quantitative research has been analyzed, including sample adequacy tests, construct validity and reliability, the goodness of fit, model suitability to polytomous data, assumption tests (unidimensional, invariance, local independence), characteristic curve graphs, information function graphs, and standard error graphs.

Findings – After several trials, 11 items passed the classical tests and item response theory criteria. It is also known from this study that non-test instruments can be less than 20 as long as they meet the analysis criteria at each stage.

Contribution – This research contributes to helping increase insight and knowledge for researchers in the fields of education and psychology, especially those interested in non-test measurement tools and IRT and classical analysis.

Keywords


mathematical mindset., item response., theory classical., test theory non-test., instrument development

Full Text:

PDF

References


Aiken, L. R. (1996). Rating Scales and Checklists: Evaluating Behavior, Personality, and Attitudes. John Wiley & Sons.

Aka, K. A. (2019). Integration Borg & Gall (1983) and Lee & Owen (2004) models as an alternative model of design-based research of interactive multimedia in elementary school. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1318/1/012022

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066

Apiola, M., & Sutinen, E. (2020). Mindset and Study Performance: New Scales and Research Directions. ACM International Conference Proceeding Series. https://doi.org/10.1145/3428029.3428042

Arlinwibowo, J., Retnawati, H., & Hadi, S. (2024). Aplikasi Teori Respon Butir dengan R dan R Studio. Cahaya Harapan.

Arthur, W., Hagen, E., & George, F. (2021). The Lazy or Dishonest Respondent: Detection and Prevention. Annual Review of Organizational Psychology and Organizational Behavior, 8, 105–137. https://doi.org/10.1146/annurev-orgpsych-012420-055324

Ayebo, A., & Mrutu, A. (2019). An Exploration of Calculus Students’ Beliefs about Mathematics. International Electronic Journal of Mathematics Education, 14(2), 385–392. https://doi.org/10.29333/iejme/5728

Azwar, S. (1994). Seleksi Aitem dalam Penyusunan Skala Psikologi. Buletin Psikologi, 2(2), 26–33. https://doi.org/ISSN: 0854-7106

Azwar, S. (1995). Human Attitude: Theory and Measurement. Pustaka Pelajar.

Azwar, S. (2024). Penyusunan Skala Psikologi. Pustaka Pelajar.

Boaler, J. (2016). A Mathematical Mindset. Jossey-Bass. https://doi.org/10.1088/2058-7058/32/12/32

Chen, S., Ding, Y., & Liu, X. (2021). Development of the Growth Mindset Scale: Evidence of Structural Validity, Measurement Model, Direct and Indirect Effects in Chinese Samples. Current Psychology. https://doi.org/10.1007/s12144-021-01532-x

Chestnut, E. K., Lei, R. F., Leslie, S. J., & Cimpian, A. (2018). The myth that only brilliant people are good at math and its implications for diversity. Education Sciences, 8(2). https://doi.org/10.3390/educsci8020065

Cutler, C. S. (2020). Preservice Teachers’ Mathematical Mindsets During Pandemic-Induced Pivot to Online Learning. Frontiers in Education, 5(November), 1–6. https://doi.org/10.3389/feduc.2020.595264

Daly, I., Bourgaize, J., & Vernitski, A. (2019). Mathematical Mindsets Increase Student Motivation: Evidence from the EEG. Trends in Neuroscience and Education, 15, 18–28. https://doi.org/10.1016/j.tine.2019.02.005

Dweck, C S. (2014). Mindsets and math/science achievement. rpforschools.net. http://www.rpforschools.net/articles/Mindsets/Dweck 2008 Mindsets and Maths Science Achievement.pdf

Dweck, Carol S. (2022a). Mindset (Updated). Ballantine Books.

Dweck, Carol S. (2022b). Self-theories: Their role in motivation, personality, and development. Routledge -Taylor & Francis Group, LLC.

Dweck, Carol S. (2008). Mindsets and Math / Science Achievement. The Opportunity Equation: Transforming Mathematics and Science Education for Citizenship and the Global Economy, 1–17. www.opportunityequation.org

Furr, R. M. (2014). Scale Construction and Psychometrics for Social and Personality Psychology. Scale Construction and Psychometrics for Social and Personality Psychology, 3–15. https://doi.org/10.4135/9781446287866

Gall, M. D., Gall, J. P., & Borg, W. R. (2003). Educational Research: An Introduction. In Qualitative Voices in Educational Research. Pearson Education. https://doi.org/10.4324/9781003008064-1

Hair, Joe F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM : Indeed, a Silver Bullet. Journal of Marketing Theory and Practice, 19(2), 139–151. https://doi.org/10.2753/MTP1069-6679190202

Hair, Joseph F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis (Seventh). Pearson Prentice Hall.

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory (D. S. Foster (ed.)). Sage Publication.

Haryono, S. (2016). SEM Methods for Management Research with AMOS, LISREL, PLS. Intermedia Personalia Utama.

Heyder, A., Weidinger, A. F., Cimpian, A., & Steinmayr, R. (2020). Teachers’ Belief that Math Requires Innate Ability Predicts Lower Intrinsic Motivation Among Low-Achieving Students. Learning and Instruction. https://doi.org/10.1016/j.learninstruc.2019.101220

Hutajulu, J. M. J., Djunaidi, A., & Triwahyuni, A. (2021). Properti Psikometri Beck Hopelessness Scale pada Populasi Non-Klinis Indonesia. Intuisi: Jurnal Psikologi Ilmiah, 13(1), 24–37. https://doi.org/10.15294/intuisi.v13i1.28037

Im, S., & Park, H. J. (2023). A Mathematical Mindset Scale using the positive norms. Psychology in the Schools, 60(8), 2901–2918. https://doi.org/10.1002/pits.22904

Limeri, L. B., Carter, N. T., Choe, J., Harper, H. G., Martin, H. R., Benton, A., & Dolan, E. L. (2020). Growing a growth mindset: characterizing how and why undergraduate students’ mindsets change. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00227-2

Lynn, M. R. (1986). Determination and quantification of content validity. In Nursing Research (Vol. 35, Issue 6, pp. 382–386). http://ijoh.tums.ac.ir/index.php/ijoh/article/view/26

Mardapi, D., Kumaidi, & Kartowagiran, B. (2011). Pengembangan Instrumen Pengukur Hasil Belajar Nirbias dan Terskala Baku. Jurnal Penelitian Dan Evaluasi Pendidikan, 15(2), 326–341. https://doi.org/http://dx.doi.org/10.21831/pep.v15i2.1100

Meierdirk, C., & Fleischer, S. (2022). Exploring the mindset and resilience of student teachers. Teacher Development, 26(2), 263–278. https://doi.org/10.1080/13664530.2022.2048687

Midkiff, B., Langer, M., Demetriou, C., & Panter, A. T. (2018). An IRT analysis of the growth mindset scale. In Springer Proceedings in Mathematics and Statistics (Vol. 233). Springer International Publishing. https://doi.org/10.1007/978-3-319-77249-3_14

Mills, I. M., & Mills, B. S. (2018). Insufficient evidence: Mindset intervention in developmental college math. Social Psychology of Education. https://doi.org/10.1007/s11218-018-9453-y

OECD. (2020). Growth mindset. In PISA 2018 Results (Volume III) (pp. 199–209). OECD. https://doi.org/10.1787/bd69f805-en

Rahmah, N. (2018). The Nature of Mathematics Education. Al-Khwarizmi, 1(2), 1–10. https://doi.org/10.24256/jpmipa.v1i2.88

Ramirez, G., Hooper, S. Y., Kersting, N. B., Ferguson, R., & Yeager, D. (2018). Teacher Math Anxiety Relates to Adolescent Students’ Math Achievement. AERA Open, 4(1), 1–13. https://doi.org/10.1177/2332858418756052

Rammstedt, B., Gruning, D. J., & Lechner, C. M. (2022). Measuring Growth Mindset: Validation of a Three-Item and a Single-Item Scale in Adolescents and Adults. European Journal of Psychological Assessment, 1, 1–12. https://doi.org/10.1027/1015-5759/a000735

Rammstedt, B., Grüning, D. J., & Lechner, C. M. (2021). Measuring Growth Mindset: A Validation of a Three-item and Single-item Scale in Youth and Adults. Center for Open Science. https://doi.org/10.31234/osf.io/rs43g

Retnawati, H. (2014). Teori respons butir dan penerapannya (Item Response Theory and its aplication). Nuha Medika.

Retnawati, H. (2016). Analisis Kuantitatif Instrumen Penelitian (Quantitative Analysis of Research Instruments). Parama Publishing.

Rizdanti, S., & Akbar, S. (2022). Hubungan Religiusitas dengan Tingkat Stres Dalam Menyusun Skripsi di Fakultas Kedokteran Universitas Islam Sumatera Utara. Jurnal Kedokteran STM (Sains Dan Teknologi Medik), 5(2), 94–100. https://doi.org/10.30743/stm.v5i2.318

Saefudin, A. A., Wijaya, A., Dwiningrum, S. I. A., & Yoga, D. (2023). The characteristics of the mathematical mindset of junior high school students. Eurasia Journal of Mathematics, Science and Technology Education, 19(1). https://doi.org/10.29333/ejmste/12770

Santoso, S. (2014). Basic concepts and applications of SEM with AMOS 22. Jakarta: Elex Media Komputindo.

Shen, C., Miele, D. B., & Vasilyeva, M. (2016). The Relation between College Students’ Academic Mindsets and Their Persistence during Math Problem Solving. Psychology in Russia: State of the Art, 9(3), 38–56. https://doi.org/10.11621/pir.2016.0303

Simanjuntak, M., & Hamimi, U. K. (2019). Penanganan Komplain dan Komunikasi Word-of-Mouth. Jurnal Ilmu Keluarga Dan Konsumen, 12(1), 75–86. https://doi.org/DOI: http://dx.doi.org/10.24156/jikk.2019.12.1.75

Stohlmann, M. (2022). Growth mindset in K-8 STEM education: A literature review since 2007. Journal of Pedagogical Research, 6(2), 149–163. https://doi.org/10.33902/JPR.202213029

Suh, J. M., Graham, S., Ferranone, T., Kopeinig, G., & Bertholet, B. (2011). Developing persistent and flexible problem solvers with a growth mindset. In Motivation and Disposition: Pathways to Learning Mathematics (Issue 2006, pp. 169–184). NCTM 2011 Yearbook.




DOI: https://doi.org/10.36987/jes.v12i3.6542

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Priarti Megawanti

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Lisensi Creative Commons
Jurnal Eduscience (JES) by LPPM Universitas Labuhanbatu is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY - NC - SA 4.0)