Developing SDG 13 Based Instruments for Critical Thinking and Sustainability Consciousness on Climate Change: A Rasch Model Approach
DOI:
https://doi.org/10.38035/jpsn.v4i3.683Keywords:
Sustainability Consciousness, Critical Thinking (Skill-Disposition), Climate Change, SDG 13, Rasch ModelAbstract
Abstract: The escalation of the global climate crisis emphasizes the urgency of strengthening Sustainability Consciousness (SC), Critical Thinking Dispositions (CTD), and Critical Thinking Skills (CTS) through education, as emphasized in SDG 13.3. However, integrated measurement instruments for all dimensions in the context of climate change are still limited. This study developed three SDG 13-based instruments (SC, CTD, CTS) for climate change material in 10th grade Biology using the Rasch model approach. Content validation was tested by two biology experts, while empirical trials involved 115 students, with 75 respondents analyzed after misfit elimination. Winsteps analysis showed that all three instruments met unidimensionality (raw variance 38.6%-62.5%; unexplained first variance contrast 6.8%-7.4%) with high reliability (cronbach alpha 0.94-0.97). After item elimination based on fit (valid items) and local independence, 20 SC items, 14 CTD items, and 9 CTS items were obtained with an ideal distribution of difficulty. This instrument is valid, reliable, and supports integrated assessment for ESD climate action learning.
References
Abidin, Z., & Fatimatuzzaro, F. (2025). Development of a critical thinking skills assessment instrument for students on diffusion and osmosis subject. Mangifera Edu Journal, 9(2), 86–95.
Aji, GP, & Nugraheni, BI (2023). Critical thinking skills of high school and vocational school students in Indonesia: A literature review. International Journal of Education and Social Science Research, 6(3), 353–367.
Ariza, M.R., Boeve-de Pauw, J., Olsson, D., Van Petegem, P., Parra, G., & Gericke, N. (2021). Promoting environmental citizenship in education: The potential of the Sustainability Consciousness Questionnaire to measure the impact of interventions. Sustainability, 13(20), 11420.
Avinç, E., & Doğan, F. (2024). Digital literacy scale: Validity and reliability study with the Rasch model. Education and Information Technologies, 29, 22895–22941.
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Lawrence Erlbaum Associates.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. Springer.
Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for Yen's Q3: Identification of local dependence in the Rasch model. Educational and Psychological Measurement, 77(3), 518–531.
Dar, SR, Emiliannur, Festiyed, Riyasni, S., & Winarno, N. (2025). The importance of integrating Education for Sustainable Development in global warming assessments to improve students' critical thinking skills. Journal of Physics Learning Research (JPPF), 11(2), 223–234.
DeVellis, R.F. (2017). Scale development: Theory and applications (4th ed.). SAGE Publications.
Dwyer, C. P., Hogan, M. J., & Stewart, I. (2014). An integrated critical thinking framework for the 21st century. Thinking Skills and Creativity, 12, 43–52.
Ennis, R.H. (1996). Critical thinking. Prentice Hall.
European Commission, Joint Research Center (JRC). Emissions Database for Global Atmospheric Research (EDGAR). 2025.
Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction (The Delphi Report). California Academic Press.
Facione, P. A., & Facione, N. C. (1992). The California Critical Thinking Disposition Inventory (CCTDI) and the CCTDI test manual (The Delphi Report). California Academic Press.
Fisher, WP, Jr. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1), 1095.
Gericke, N., Boeve-de Pauw, J., Berglund, T., & Olsson, D. (2018). The sustainability consciousness questionnaire: The theoretical development and empirical validation of an evaluation instrument for stakeholders working with sustainable development. Sustainable Development, 26(6), 613–627.
Kioupi, V., & Voulvoulis, N. (2019). Education for Sustainable Development: A systemic framework for connecting the SDGs to educational outcomes. Sustainability, 11(21), 6104.
Kollmuss, A., & Agyeman, J. (2002). Mind the gap: Why do people act environmentally and what are the barriers to pro-environmental behavior? Environmental Education Research, 8(3), 239–260.
Kusumawati, AE, Supahar, S., & Pebriana, IN (2024). Development of a global warming theme assessment instrument to measure high school students' science process skills and collaboration skills. Journal of Science Education, 6(2), 105–113.
Linacre, J. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85–106.
Linacre, JM (2010). Winsteps® Rasch measurement computer program user's guide. Winsteps.com.
Mahanal, S., Tendrita, M., Ramadhan, F., Ismirawati, N., & Zubaidah, S. (2018). The analysis of students' critical thinking skills on biology subject. Anatolian Journal of Instruction, 3(2), 21–39.
Kemendikbudristek. (2022). Learning Outcomes of Biology Subject Phase E for Senior High Schools (SMA/MA). Ministry of Education, Culture, Research, and Technology of the Republic of Indonesia.
Mohamad Saleh, MS, Mehellou, A., Huang, M., & Briandana, R. (2022). The influence of sustainability knowledge and attitude on sustainable intention and behavior of Malaysian and Indonesian undergraduate students. Research in Comparative and International Education, 17(4).
OECD. 2023. PISA 2022 Assessment and Analytical Framework. OECD Publishing.
Purwianingsih, W., Novidsa, I., & Riandi, R. (2022). Efforts to enhance sustainable consciousness and critical thinking in high school students through learning projects. Indonesian Journal of Teaching in Science, 2(2). https://ejournal.upi.edu/index.php/IJoTis/article/view/55447
Setianingsih, ES, Purwianingsih, W., & Riandi. (2024). Critical thinking as a foundation for sustainable consciousness in biology education. Indonesian Journal of Biological Education, 8(1), 45–58.
Sumintono, B., & Widhiarso, W. (2014). Application of the Rasch model to social science research (revised edition). Trim Komunikata Publishing House.
Sumintono, B., & Widhiarso, W. (2015). Application of Rasch modeling in educational assessment. Trim Komunikata Publishing House.
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J.-M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., Feybesse, C., Sundquist, D., & Lubart, T. (2023). Creativity, critical thinking, communication, and collaboration: Assessment, certification, and promotion of 21st century skills for the future of work and education. Journal of Intelligence, 11(3), 54.
UNESCO. (2020). Education for sustainable development: A roadmap (ESD for 2030). UNESCO Publishing.
United Nations Sustainable Development Goals [UN SDGs]. (2024). Goal 13: Take urgent action to combat climate change and its impacts. https://sdgs.un.org/goals/goal13
United Nations. (2015). Transforming our world: The 2030 agenda for sustainable development (A/RES/70/1). https://sustainabledevelopment.un.org/post2015/transformingourworld
Voulvoulis, N., Burgman, M. A., & Alquier, A. M. (2022). Critical thinking for sustainability: Moving beyond disciplinary boundaries. One Earth, 5(3), 225–228.
World Meteorological Organization. (2025). State of the global climate 2024 (WMO-No. 1368). https://wmo.int/publication-series/state-of-global-climate/state-of-global-climate-2024
Wright, B.D., & Linacre, J.M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.
Wright, B.D., & Masters, G.N. (1982). Rating scale analysis. MESA Press.
Yulisharyasti, L., Nurdin, A., Aulia, N., Arfa, FAH, & Fadjryani. (2023). Analyzing the quality of measurement instruments of multiple choice questions on Class XI Economics material in Public High School 3 Gorontalo through Classical Test Theory and Rasch Models. Parameters: Journal of Statistics, 3(1), 28–38.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Najwa Syafaatul Fadhilah, Widi Purwianingsih, Amprasto Amprasto
This work is licensed under a Creative Commons Attribution 4.0 International License.
Hak cipta :
Penulis yang mempublikasikan manuskripnya di jurnal ini menyetujui ketentuan berikut:
- Hak cipta pada setiap artikel adalah milik penulis.
- Penulis mengakui bahwa JPSN berhak menjadi yang pertama menerbitkan dengan lisensi Creative Commons Attribution 4.0 International (Attribution 4.0 International CC BY 4.0) .
- Penulis dapat mengirimkan artikel secara terpisah, mengatur distribusi non-eksklusif manuskrip yang telah diterbitkan dalam jurnal ini ke versi lain (misalnya, dikirim ke repositori institusi penulis, publikasi ke dalam buku, dll.), dengan mengakui bahwa manuskrip telah diterbitkan pertama kali di JPSN.
