Abstract
[English]: The study aims to analyze the quality of problem-solving test items and a self-efficacy questionnaire using the AnBuso application as an analytical tool. The problem-solving test items were developed to measure the students’ cognitive abilities ranging from understanding (C2) to evaluating (C5) in statistical topics. This study employed a quantitative descriptive approach focusing on eight-grade students at a public school SMP Negeri 1 Mlati. The sample consisted of 32 students selected as research subjects. The analysis examined the test item characteristics, including discriminative power, difficulty level, expert validity, and item reliability. The findings indicated that 53.33% of the items had good discriminative function, 20% had fairly good function, and 26.67% had poor function. A total of 33.33% of the items were classified as easy, 66.67% as moderate, and none as difficult. The validity was 0.90 (highly valid), and the reliability of multiple-choice items was 0.51 (moderate), while open-ended items reached 0.72 (high). Meanwhile, the self-efficacy questionnaire had a validity of 0.89 (highly valid) and a reliability of 0.83 (very high). Overall, the test instruments and questionnaire showed high validity and adequate reliability. It is hoped that the research finding can serve as a reference for educators and curriculum developers in designing better evaluation tools so that the learning objectives can be optimally achieved.
[Bahasa]: Penelitian ini bertujuan untuk menganalisis kualitas butir soal kemampuan pemecahan masalah dan angket self-efficacy dengan memanfaatkan aplikasi AnBuso sebagai alat bantu analisis. Soal kemampuan pemecahan masalah dikembangkan untuk mengukur kemampuan kognitif siswa pada level memahami (C2) hingga mengevaluasi (C5) dalam konteks materi statistika. Metode penelitian ini menggunakan pendekatan deskriptif kuantitatif dengan fokus utama pada siswa kelas VIII di SMP Negeri 1 Mlati pada materi statistika. Sampel penelitian terdiri atas 32 orang siswa yang dipilih sebagai subjek penelitian. Proses analisis dilakukan dari segi karakteristik soal yaitu daya pembeda, tingkat kesulitan kemudian validitas ahli, dan reliabilitas soal. Temuan penelitian menunjukkan bahwa instrumen pemecahan masalah memiliki daya pembeda yaitu 53.33% soal memiliki fungsi pembeda yang baik, 20% cukup baik, dan 26.67% tidak baik. Sebanyak 33.33% soal tergolong mudah, 66.67% sedang, dan tidak ada soal yang tergolong sulit. Kevalidan sebesar 0.90 (sangat valid) dan reliabilitas soal pilihan ganda sebesar 0.51 (sedang), soal uraian 0.72 (tinggi). Sementara angket self-efficacy memiliki kevalidan sebesar 0.89 (sangat valid) dan reliabilitas sebesar 0.83 (sangat tinggi). Secara keseluruhan, instrumen tes dan angket yang digunakan menunjukkan tingkat kevalidan yang sangat valid serta reliabilitas yang memadai. Hasil analisis ini diharapkan dapat menjadi acuan bagi pendidik dan pengembang kurikulum dalam menyusun alat evaluasi yang lebih baik, sehingga tujuan pembelajaran dapat tercapai secara optimal.
Downloads
References
- Alifia, N. N., & Rakhmawati, I. A. (2018). Kajian kemampuan self-efficacy matematis siswa dalam pemecahan masalah matematika. Jurnal Pembelajaran Matematika, 5(1), 44–54. Retrieved from https://jurnal.uns.ac.id/jpm/article/view/26024
- Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Monterey, CA: Brooks/Cole Publishing Company.
- Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives (Complete ed.). New York, NY: Longman.
- Andersson, B., & Wiberg, M. (2017). Item response theory observed-score kernel equating. Psychometrika, 82(1), 48–66. https://doi.org/10.1007/s11336-016-9528-7
- Arifin, Z. (2012). Evaluasi pembelajaran. Bandung: Remaja Rosdakarya.
- Arikunto, S. (2019). Dasar-dasar evaluasi pendidikan. Jakarta: Bumi Aksara.
- Astuti, A. P., Aziz, A., Sumarti, S. S., & Bharati, D. A. L. (2019). Preparing 21st century teachers: Implementation of 4C character’s pre-service teacher through teaching practice. Journal of Physics: Conference Series, 1233(1). https://doi.org/10.1088/1742-6596/1233/1/012109
- Azwar, S. (2019). Reliabilitas dan validitas (Edisi 4). Yogyakarta: Pustaka Pelajar.
- Balqis, Patmawati, H., & Yulianto, E. (2024). Perbedaan kemampuan siswa dalam memecahkan masalah matematika berdasarkan tingkat self-confidence pada materi statistika. Jurnal Kongruen, 3(2), 162–169. Retrieved from https://jurnal.unsil.ac.id/index.php/kongruen/article/view/12336
- Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NY: W. H. Freeman and Company.
- Căprioară, D. (2015). Problem solving - purpose and means of learning mathematics in school. Procedia - Social and Behavioral Sciences, 191, 1859–1864. https://doi.org/10.1016/j.sbspro.2015.04.332
- Ebel, R. L., & Frisbie, D. A. (1991). Essentials of educational measurement. Englewood Cliffs, NJ: Prentice Hall.
- Farida, F., & Musyarofah, A. (2021). Validitas dan reliabilitas dalam analisis butir soal. Al-Muarrib Journal of Arabic Education, 1(1), 34–44. https://doi.org/10.32923/al-muarrib.v1i1.2100
- Florea, N. M., & Hurjui, E. (2015). Critical thinking in elementary school children. Procedia - Social and Behavioral Sciences, 180, 565–572. https://doi.org/10.1016/j.sbspro.2015.02.161
- Inoue, N., Asada, T., Maeda, N., & Nakamura, S. (2019). Deconstructing teacher expertise for inquiry-based teaching: Looking into consensus building pedagogy in Japanese classrooms. Teaching and Teacher Education, 77, 366–377. https://doi.org/10.1016/j.tate.2018.10.016
- Istiyono, E. (2020). Pengembangan instrumen penilaian dan analisis hasil belajar fisika dengan teori tes klasik dan modern. Yogyakarta: UNY Press.
- Kartowagiran, B. (2012). Penulisan butir soal. Yogyakarta: Universitas Negeri Yogyakarta.
- Khotimah, N. H., Khoirunnisa, A., & Bilda, D. W. (2020). Pengaruh self-efficacy siswa SMP terhadap pemecahan masalah pada materi aritmetika sosial. EDISI: Jurnal Edukasi Dan Sains, 2(2), 285–291. Retrieved from https://ejournal.stitpn.ac.id/index.php/edisi
- Mardapi, D. (2012). Pengukuran, penilaian, dan evaluasi pendidikan. Yogyakarta: Nuha Medika.
- Mataheru, W., Laurens, T., Moma, L., & Sampulawa, H. (2019). Analysis of student thinking processes in mathematical problem solving using saintificial approach. Proceedings of the 1st International Conference on Advanced Multidisciplinary Research (ICAMR 2018). Presented at the Proceedings of the 1st International Conference on Advanced Multidisciplinary Research (ICAMR 2018), Makassar, Indonesia. https://doi.org/10.2991/ICAMR-18.2019.51
- Muhson, A., Lestari, B., Supriyanto, S., & Baroroh, K. (2014). Pengembangan software analisis butir soal yang praktis dan aplikatif. Jurnal Ilmu Pendidikan Universitas Negeri Malang, 20(2), 110163. https://doi.org/10.17977/JIP.V20I2.4618
- NCTM. (2000). Standards for school mathematics. Reston, VA: The National Council of Teachers of Mathematics. National Council of Teachers of Mathematics, 7(2), 1–16. Retrieved from https://books.google.com/books/about/Principles_and_Standards_for_School_Math.html?hl=id&id=BkoqAQAAMAAJ
- Nortvedt, G. A., & Buchholtz, N. (2018). Assessment in mathematics education: Responding to issues regarding methodology, policy, and equity. ZDM 2018 50:4, 50(4), 555–570. https://doi.org/10.1007/S11858-018-0963-Z
- Nuutila, K., Tapola, A., Tuominen, H., Molnár, G., & Niemivirta, M. (2021). Mutual relationships between the levels of and changes in interest, self-efficacy, and perceived difficulty during task engagement. Learning and Individual Differences, 92, 102090. https://doi.org/10.1016/j.lindif.2021.102090
- OECD. (2019). PISA 2018 results (Volume I) what students know and can do. https://doi.org/10.1787/5f07c754-en
- Okyranida, I. Y., Mayanty, S., & Widiyatun, F. (2024). Analisis butir soal kemampuan berpikir kritis siswa SMAIT Nururrohmah Depok. Jurnal Penelitian Pembelajaran Fisika, 15(1), 73–79. https://doi.org/10.26877/jp2f.v15i1.17057
- Ormonoy, T. (2022). The importance of solving math problems in elementary school: Pentingnya memecahkan masalah matematika di sekolah dasar. Indonesian Journal of Education Methods Development, 17(4), 10.21070/ijemd.v20i.628-10.21070/ijemd.v20i.628. https://doi.org/10.21070/IJEMD.V20I.628
- Pardimin, P., Widodo, S. A., & Purwaningsih, I. E. (2017). Analisis butir soal tes pemecahan masalah matematika. WACANA AKADEMIKA: Majalah Ilmiah Kependidikan, 1(1). https://doi.org/10.30738/WA.V1I1.1084
- Polya, G. (1945). How to solve it. Princeton, NJ Princeton University Press. Scientific Research Publishing.
- Purba, Y. O., Fadhilaturrahmi, Purba, J. T., & Siahaan, K. W. A. (2021). Teknik uji instrumen penelitian pendidikan. Bandung: Widina Bhakti Persada.
- Putri, W. K. H. W., & Prabawanto, S. (2019). The analysis of students’ self-efficacy in learning mathematics. Journal of Physics: Conference Series, 1157(3), 032113. https://doi.org/10.1088/1742-6596/1157/3/032113
- Retnawati, H. (2016). Analisis kuantitatif instrumen penelitian. Yogyakarta: Parama Publishing.
- Retnawati, H., Hadi, S., Nugraha, A. C., Ramadhan, M. T., Apino, E., Djidu, H., … Sulistyaningsih, E. (2017). Menyusun laporan hasil asesmen pendidikan di sekolah. Yogyakarta: UNY Press.
- Rodriguez, M. C. (2005). Three options are optimal for multiple-choice items: A meta-analysis of 80 years of research. Educational Measurement: Issues and Practice, 24(2), 3–13. https://doi.org/10.1111/j.1745-3992.2005.00006.x
- Saputri, H. A., Zulhijrah, Larasati, N. J., & Shaleh. (2023). Analisis instrumen assesmen: Validitas, reliabilitas, tingkat kesukaran dan daya beda butir soal. Didaktik: Jurnal Ilmiah PGSD STKIP Subang, 9(5), 2986–2995. https://doi.org/10.36989/DIDAKTIK.V9I5.2268
- Sudaryono, Rahayu, Wardani., & Margono, Gaguk. (2013). Pengembangan instrumen penelitian pendidikan. 174. Yogyakarta: Graha Ilmu.
- Sudijono, Anas. (2017). Pengantar evaluasi pendidikan. Jakarta: RajaGrafindo Persada.
- Syaiful, S., Kamid, K., Muslim, M., & Huda, N. (2020). Identifiying of problem-solving abilities in mathematics among junior high school students. Journal of Education and Learning (EduLearn), 14(2), 176–182. https://doi.org/10.11591/edulearn.v14i2.14861
- Talsma, K., Schüz, B., Schwarzer, R., & Norris, K. (2018). I believe, therefore I achieve (and vice versa): A meta-analytic cross-lagged panel analysis of self-efficacy and academic performance. Learning and Individual Differences, 61, 136–150. https://doi.org/10.1016/j.lindif.2017.11.015
- Wong, T. T. Y., & Yip, E. S. K. (2023). What is the unknown? the ability to identify the semantic role of the unknown from word problems longitudinally predicts mathematical problem-solving performance. Contemporary Educational Psychology, 73, 102183. https://doi.org/10.1016/j.cedpsych.2023.102183
- Yousuf, Ms. I., & Rajeswari, G. (2024). Relationship between mathematics self-efficacy and mathematics achievement. International Journal of Emerging Knowledge Studies, 03(10), 797–802. https://doi.org/10.70333/IJEKS-03-10-011
