VALIDITY AND RELIABILITY OF TEST QUESTIONS TO MEASURE THE INFORMATION LITERACY SKILLS OF PROSPECTIVE TEACHER STUDENTS

Nur Rahmi Akbarini, Arun Anggrawal

Abstract


This study aims to describe the quality of information literacy instruments as seen from the aspects of validity, reliability, and difficulty level of questions. This research is a quantitative descriptive research. Data were obtained through documentation method in the form of 22 items of multiple choice questions with four answer options and tested on 224 students majoring in teacher education in a university. The data were analyzed using the classical test theory approach and Rasch model with JMetric software. Validity was assessed by content validity which relies on the use of a panel of experts to evaluate the elements of the instrument and rate them based on their relevance and representativeness to the content domain. To measure the experts' judgment, several indices have been discussed in this paper such as content validity ratio (CVR) and content validity index (CVI). From the CVR results, it is known that 20 questions are valid and 2 questions are considered invalid. From the results of the CVR value, the CVI index of 0.935 was calculated. The reliability value using the KR-20 formula through the classical test theory approach is 0.740 in the sufficient category and the reliability value in the Rasch model is 0.720 (sufficient) for Person Reliability Item Reliability of 0.97 (high). The results of the analysis of the level of difficulty based on the Rasch model show that there are 2 items with difficulty levels (10%), 7 items with moderate difficulty (35%), and 11 items with easy difficulty (55%).

Full Text:

PDF

References


ACRL, B. (2019). Information Literacy Framework for Higher Education. Library Waves, 36. http://librarywaves.com/index.php/lw/article/view/84%0Ahttp://librarywaves.com/index.php/lw/article/download/84/86

Aksu, G., Güzeller, C. O., & Eser, M. T. (2019). Jmetrik: Classical test theory and item response theory data analysis software. Journal of Measurement and Evaluation in Education and Psychology, 10(2), 165–178. https://doi.org/10.21031/epod.483396

Alam, U. F. (2013). Kemampuan Literasi Informasi Mahasiswa Dan Peranan Perpustakaan Dalam Proses Belajar Mengajar Di Perguruan Tinggi. Pustakaloka, 5(1), 92–105. http://download.portalgaruda.org/article.php?article=441372&val=7255&title=Kemampuan Literasi Informasi Mahasiswa dan Peranan Perpustakaan Dalam Proses Belajar Mengajar di Perguruan Tinggi

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066

American Library Association. (2000). Information Literacy For Higher Education. http://www.ala.org/acrl/sites/ala.org.acrl/files/con%0Atent/standards/standards. pdf.

Arikunto, S. (2010). Prosedur Penelitian Suatu Pendekatan Praktik (Edisi Revi). Rineka Cipta.

Bashooir, K., & Supahar. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran Fisika berbasis STEM. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(2), 219–230. https://doi.org/10.21831/pep.v22i2.20270

Beile, P. M. (2007). The ILAS-ED: A standards-based instrument for assessing pre-service teachers’ information literacy levels. Society for Information Technology & Teacher Education International Conference, 2007(1), 1–27. http://eprints.rclis.org/16928/

Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Tes Klasik Dan Model Rasch. Indonesian Journal of Educational Research and Review, 3(1), 11–19. https://ejournal.undiksha.ac.id/index.php/IJERR/article/view/24080/pdf

Eynon, A. (2013). Welsh Information Literacy Project. Library and Information Research, 37(114), 17–22.

Fatimah, L. U., & Alfath, K. (2019). Analisis Kesukaran Soal, Daya Pembeda dan Fungsi Distraktor. Jurnal Komunikasi Dan Pendidikan Islam, 8(2), 37–64.

Fitriyanto, J. N., Widjanarko, D., & Khumaedi, M. (2019). Validity and Reliability Test of Assessment Instrument of the Suitability of Electric Power Steering Media. Journal of Vocational Career Education (Jvce), 4(1), 61–69. https://journal.unnes.ac.id/nju/index.php/jvce

Hanbidge, A. S., Tin, T., & Sanderson, N. (2018). Information literacy skills on the go. Journal of Information Literacy, 12(1), 118. https://doi.org/10.11645/jil.v12i1.2322

Ibnu, M., Indriyani, B., Inayatullah, H., & Guntara, Y. (2019). Aplikasi Rasch Model: Pengembangan Instrumen Tes untuk Mengukur Miskonsepsi Mahasiswa. Prosiding Seminar Nasional Pendidikan FKIP, 2(1), 205–210.

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575.

Livingston, S. . (2018). Test Reliability—Basic Concepts. In Research Memorandum No. RM-18-01. Princeton, NJ: Educational Testing Service.

Magdalena, I., Nurul Annisa, M., Ragin, G., & Ishaq, A. R. (2021). Analisis Penggunaan Teknik Pre-Test Dan Post-Test Pada Mata Pelajaran Matematika Dalam Keberhasilan Evaluasi Pembelajaran Di Sdn Bojong 04. Jurnal Pendidikan Dan Ilmu Sosial, 3(2), 150–165. https://ejournal.stitpn.ac.id/index.php/nusantara

Manfaat, B., & Nurhairiyah, S. (2021). Pengembangan Instrumen Tes untuk Mengukur Kemampuan Penalaran Statistik. Jurnal Pembelajaran Matematika, 1(1), 1–19.

Mardapi, D. (2012). Pengukuran, penilaian dan evaluasi pendidikan. Nuha Medika.

Mohajan, H. K. (2017). Two Criteria for Good Measurements in Research: Validity and Reliability. Annals of Spiru Haret University, 17(3), 58–82.

Mok, M., & Wright, B. (2004). Overview of Rasch Model Families. In Introduction to Rasch Measurment: Theory, Models and Application (hal : 1-24). Jam Press.

Muntashir. (2016). Standar Kompetensi Literasi Informasi Mahasiswa Ilmu Perpustakaan Pada Perguruan Tinggi Agama Islam. JIPI (Jurnal Ilmu Perpustakaan Dan Informasi), 1(1), 102–124. http://jurnal.uinsu.ac.id/index.php/jipi/article/view/194

Nurfadillah, T., Elvia, R., & Elvinawati. (2023). Pengembangan Instrumen Tes Kimia Berbasis Literasi Sains untuk Mengukur Literasi Sains Siswa. Alotrop, 7(1), 44–56. https://doi.org/10.33369/alo.v7i1.28253

Nusantari, D. O. (2016). Meningkatkan Estimasi Reliabilitas Instrumen Pilihan Ganda dengan Memperhatikan Probabilitas Guessing. Formatif: Jurnal Ilmiah Pendidikan MIPA, 6(2), 100–109. https://doi.org/10.30998/formatif.v6i2.943

Prihandoko, L. (2021). Self-Assessment on Information Literacy Competency of Students in Indonesia-Papua New Guinea Border Area During The COVID-19 Epidemic. ICOPE. https://doi.org/10.4108/eai.16-10-2020.2305235

Puger, I. G. N. (2021). PENGUJIAN VALIDITAS ISI TES HASIL BELAJAR YANG DINILAI OLEH SUBJECT MATTER EXPERT (SME). Daiwi Widya, 8(3).

Puspitasari, W. D., & Febrinita, F. (2021). Pengujian Validasi Isi (Content Validity) Angket Persepsi Mahasiswa terhadap Pembelajaran Daring Matakuliah Matematika Komputasi. Journal Focus Action of Research Mathematic (Factor M), 4(1), 77–90. https://doi.org/10.30762/factor_m.v4i1.3254

Ranaweera, P. (2020). Importance of Information Literacy skills for an Information Literate society CORE View metadata, citation and similar papers at core.ac.uk provided by E-LIS. Senior Lecturer, National Institute of Library & Information Sciences, University of Colombo, 1–13.

Retnawati, H. (2016). Validitas reliabilitas dan karakteristik butir: (panduan untuk peneliti, mahasiswa, dan psikometrian). Parama Publishing.

Segal, D. ., & Coolidge, F. . (2018). Reliability. SAGE Publications. https://doi.org/http://dx.doi.org/10.4135/9781506307633.n683

Sudijono, A. (2011). Pengantar Evaluasi PEndidikan. Rajagrafindo persada.

Taherdoos, H. (2016). Validity and Reliability of the Research Instrument; How to Test the Validation of a Questionnaire/Survey in a Research. International Journal of Academic Research in Management (IJARM), 5(3), 28–36.

Wati, M., & Mahtari, S. (2017). Pengembangan Instrumen Kognitif Fisika Siswa SMP. Jurnal Penelitian Dan Pengkajian Ilmu Pendidikan: E-Saintika, 1(1), 45. https://doi.org/10.36312/e-saintika.v1i1.5

White, A. M. J. (2019). Handbook of Research on Critical Thinking and Teacher Education Pedagogy. Handbook of Research on Critical Thinking and Teacher Education Pedagogy: Global. https://doi.org/10.4018/978-1-5225-7829-1.ch020

Whitley, B. E. (2002). Principals of Research and Behavioural Science. McGraw-Hill.

Zaenab, S., Khasanah, N., & Salimi, M. (2017). Literasi Informasi Untuk Mahasiswa Kependidikan. Universitas Sebelas Maret, 2003, 260–265.

Zeeshan, M., Siddique, N., & Idrees, H. (2020). Measuring Information literacy skills of graduate students of Lahore University of Management Sciences (LUMS). Library Philosophy and Practice, 2020.




DOI: https://doi.org/10.36987/jes.v11i1.5640

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Nur Rahmi Akbarini

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Lisensi Creative Commons
Jurnal Eduscience (JES) by LPPM Universitas Labuhanbatu is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY - NC - SA 4.0)