VALIDATION OF CRITICAL THINKING SKILLS SCALE (CTSS) FOR UNIVERSITY STUDENTS
DOI:
https://doi.org/10.37231/apj.2025.8.1.669Abstract
Abstract: The cultivation of critical thinking skills is paramount for students, notably at the tertiary education level. The objective of this study is to determine the factor structure of an instrument, the Critical Thinking Skill Scale (CTSS henceforth) . The instrument utilised in this study encompasses five skills that are important in students’ critical thinking skills, namely (1) interpretation, (2) analysis, (3) inference, (4) evaluation, (5) explanation. A two-stage sampling procedure was implemented, and the first stage involved selecting undergraduates to build a pool of samples. Subsequently, snowball sampling was employed in the second stage. Collectively, a total of one hundred eighty-two responses were obtained. The data underwent descriptive analysis, reliability analysis, and exploratory factor analysis (EFA). This 49-item instrument obtained a reliability score of 0.982, which translates as an excellent measure of critical thinking skills. The exploratory factor analysis revealed that the scale retained one component only, instead of the original five, which explains 53.714%. Another notable finding in this study was that one item was removed from the first component. The validation of this instrument will not only deepen the critical thinking skills measurement literature, but also sheds light on the critical thinking sub-skills that need to be cultivated across all learning programmes.
Keywords: Critical Thinking; Critical Thinking Skills Scale; CTSS; Exploratory Factor Analysis; EFA
References
Abu Bakar, A. Y. (2023). Fulfilling the spirations of Malaysian Education Blueprint 2013-2025: Issues and challenges. Journal for ReAttach Therapy and Developmental Diversities, 6(6s), 13–17.
Ab Rahman, Z. (2019). Critical thinking skills in group discussion using the Peer Socratic Questioning (PSQ) technique (Doctoral dissertation, Universiti Teknologi MARA (Kampus Puncak Alam)).
Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015). Strategies for teaching students to think critically. Review of Educational Research, 85(2), 275–314.
Ahmed, S. A. M., & Ibrahim, M. E. E. (2023). The impact of critical thinking in improving students' learning: A case study of students in the English Department, College of Science and Arts, Tanumah, King Khalid University. European Journal of English Language and Literature Studies, 11(1), 10-16.
Alsaleh, N. J. (2020). Teaching Critical Thinking Skills: Literature Review. Turkish Online Journal of Educational Technology-TOJET, 19(1), 21-39.
Altun, E., & Yildirim, N. (2023). What does critical thinking mean? Examination of pre-service teachers’ cognitive structures and definitions for critical thinking. Thinking Skills and Creativity, 49, 101367.
Amir Johan, S. J., Satimin, O., Mohd Daud, K., Khairuddin, Z., Anuar, N., Sabri, S., & Mohd Yusof, F. H. (2023). ESL Students’ Perception Towards Their Level of Critical Thinking Skills. Malaysian Journal of Social Sciences and Humanities (MJSSH), 8(11), e002592.
Asyari, A., & Melia Andari. (2023). Enhancing critical thinking skills through project-based learning image- assisted in elementary school. El Midad: Jurnal Jurusan PGMI, 15(2).
Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives: Complete Edition. Longman.
Anuar, N., Muhammad, A. M., & Awang, Z. (2020). An exploratory factor analysis of elicited students’ salient beliefs toward critical reading. International Journal of Modern Languages and Applied Linguistics (IJMAL), 4(4), 101-114.
Anuar, N., Muhammad, A. M., & Awang, Z. (2023). Development and Validation of Critical Reading Intention Scale (CRIS) for University Students using Exploratory and Confirmatory Factor Analysis. Asian Journal of University Education, 19(1), 39-52.
Anuar, N., & Sidhu, G. K. (2017). Critical reading skills: A survey of postgraduate students’ perspective of critical reading. Pertanika Journals Social Sciences & Humanities, 25, 163-172. http://www.pertanika.upm.edu.my/resources/files/Pertanika%20PAPERS/JSSH%20Vol.%2025%20(S)%2 0Feb.%202017/17%20JSSH(S)-0356-2016-4thProof.pdf
Atabaki, A. M. S., Keshtiaray, N., & Yarmohammadian, M. H. (2015). Scrutiny of critical thinking concept. International Education Studies, 8(3), 93-102.
Awang, Z. (2010). Research methodology for business and social science. Universiti Teknologi MARA Publication Centre (UPENA).
Awang, Z. (2012). A handbook on structural equation modelling using AMOS. Universiti Teknologi MARA Press.
Bachtiar. (2024). Strategies and challenges in encouraging students' critical thinking skills in online learning: A literature review. International Journal For Multidisciplinary Research, 6(2), 1-14.
Baki, N., Rafik-Galea, S. & Nimehchisalem, V. (2016). Malaysian Rural ESL Students Critical Thinking Literacy Level: A Case Study. International Journal of Education & Literacy Studies, 4, 2202-9478.
Bahkia, A. S., Awang, Z., Afthanorhan, A., Ghazali, P. L., & Foziah, H. (2019). Exploratory factor analysis on occupational stress in context of Malaysian sewerage operations. AIP Conference Proceedings, 2138(1). AIP Publishing.
Bezanilla, M. J., Domínguez, H. G., & Ruiz, M. P. (2021). Importance and possibilities of development of critical thinking in the university: The teacher's perspective. REMIE: Multidisciplinary Journal of Educational Research, 11(1), 20-48.
Bloom, B. S. (1956). Taxonomy of Educational Objectives, Handbook: The Cognitive Domain. David McKay.
Carracedo, J. M. C. (2025). Inquiry-based learning in phonetics and phonology: Promotion of critical thinking skills in an EFL higher education context. International Journal of Instruction, 18(1), 1-22.
Chen, T., Hsu, H. M., Stamm, S. W., & Yeh, R. (2019). Creating an instrument for evaluating critical thinking apps for college students. E-Learning and Digital Media, 16(6), 433-454.
Comrey, A.L., & Lee, H.B. (1992). A First Course in Factor Analysis (2nd ed.). Psychology Press.
Conti, G., Frühwirth‐Schnatter, S., Heckman, J., & Piatek, R. (2014). Bayesian exploratory factor analysis. Journal of Econometrics, 183(1), 31-57.
Costello, A. B., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(1), 7.
Dimmitt, N. J. (2017). The power of project-based learning: Experiential education to develop critical thinking skills for university students. CBU International Conference Proceedings, 5, 575-579.
Dissen, A. (2023). A critical issue: assessing the critical thinking skills and dispositions of undergraduate health science students. Discover Education, 2(1), 21.
Etemadzadeh, A., Seifi, S., & Far, H. R. (2013). The role of questioning technique in developing thinking skills: The ongoing effect on writing skill. Procedia-Social and Behavioral Sciences, 70, 1024-1031.
Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction—The Delphi report. California Academic Press.
Farhana Abd Kadir. (2024, January 24). 'Malaysian education needs critical thinking, not test scores': The missing pieces in Malaysian education? Sinar Daily. https://www.sinardaily.my/article/215028/focus/malaysian- education-needs-critical-thinking-not-test-scores
Gürsan, S., Tapan-Broutin, M. S., & İpek, J. (2022). Implementing and evaluating critical thinking skills developing lesson plans for prospective teachers. Open Journal for Educational Research, 6(1), 69-88.
Hair, J. F., Black, W. C., Babin, B. J. & Anderson, R. E. (2014). Multivariate Data Analysis (7th Ed.). Pearson Education.
Hasanah, H. & Malik, M. N. (2020). Blended learning in improving students’ critical thinking and communication skills at university. Cypriot Journal of Educational Sciences, 15(5), 1295-1306.
Hikmawati, H., Gunawan, G., Sahidu, H., & Kosim, K. (2021). Effect of local culture-based learning in science on critical thinking and student communication skills. Journal of Science and Science Education, 2(1), 8-16.
Hoque, A. S. M. M., Siddiqui, B. A., Awang, Z. B., & Baharu, S. M. A. T. (2018). Exploratory factor analysis of Entrepreneurial orientation in the context of Bangladeshi small and medium Enterprises (SMEs). European Journal of Management and Marketing Studies, 3(2), 81-94.
Hussin, W. N. T. W., Harun, J., & Shukor, N. A. (2018). Problem based learning to enhance students critical thinking skill via online tools. Asian Social Science, 15(1), 14.
Ismail, N. M. (2023). Developing The Learning of Critical Thinking in Higher Education: A Case Study based on an International University in Egypt (Doctoral dissertation, The University of Liverpool (United Kingdom)). https://livrepository.liverpool.ac.uk/3168785/1/201167740_Mar2023_NIsmail.pdf
Jais, A., Yahaya, N., Ibrahim, N. H., & Mohammad, N. B. (2021). Exploratory factor analysis in teacher questioning elements for critical thinking among Form 4 students in some selected schools in the state of Sarawak. International Journal of Academic Research in Business and Social Sciences, 11(8).
Janssen, E. M., Mainhard, T., Buisman, R. S., Verkoeijen, P. P., Heijltjes, A. E., Van Peppen, L. M., & Van Gog, T. (2019). Training higher education teachers’ critical thinking and attitudes towards teaching it. Contemporary Educational Psychology, 58, 310-322.
Kuhn, D. (2019). Critical thinking as discourse. Human Development, 62(3), 146-164.
Mahanal, S., Zubaidah, S., Sumiati, I. D., Sari, T. M., & Ismirawati, N. (2019). RICOSRE: A Learning Model to Develop Critical Thinking Skills for Students with Different Academic Abilities. International Journal of Instruction, 12(2), 417-434.
Mahmood, M. S., & Othman, M. K. H. (2020). Learning style practices and critical thinking of students in Malaysia. Universal Journal of Educational Research, 8(8), 3570 - 3578.
Menold, N. (2020). Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality. Journal of Official Statistics, 36, 855-886. https://doi.org/10.2478/jos-2020-0041.
Menold, N., & Raykov, T. (2022). On the relationship between item stem formulation and criterion validity of multiple-component measuring instruments. Educational and psychological measurement, 82(2), 356-375.
Mihail, R. (2022). The relevance of critical thinking from the perspective of professional training. Postmodern Openings, 13(2), 499-513.
Ministry of Education Malaysia (2013). Malaysia Education Blueprint 2013-2025. Ministry of Education Malaysia.
Mohd Abeden, N. A., & Siew, N. M. (2022). Assessing Students’ Critical Thinking and Physics Problem-Solving Skills in Secondary Schools. Malaysian Journal of Social Sciences and Humanities (MJSSH), 7(6), e001584- e001584.
Mohebbi, Z., Haftador, A., Tehranineshat, B., & Keshtkaran, Z. (2023). A study of the effects of blended learning on university students' critical thinking: A systematic review. Journal of Education and Health Promotion, 12(1), 95.
Ng, Q. Y., & Jeyaraj, J. J. (2023). Evaluating Critical Thinking Elements in a Secondary School English Language Textbook in Malaysia. International Journal of Academic Research in Progressive Education and Development, 12(2), 1733–1747.
Noris, M., & Saputro, S. (2022). The Virtual Laboratory Based on Problem Based Learning to Improve Students' Critical Thinking Skills. European Journal of Mathematics and Science Education, 3(1), 35-47.
Nurhidayah Mohd Sharif, Shazwani Abdul Rahman, Awis Rumaisya Azizan, Faizal Yamimi Mustaffa & Abdul Rahim
Haji Salam (2022). Students’ level of critical thinking skills (CTS) in writing problem statement (PS) in theses. LSP International Journal, 9(1), 61-73.
Okolie, U. C., Nwajiuba, C. A., Binuomote, M. O., Ehiobuche, C., Igu, N. C. N., & Ajoke, O. S. (2020). Career training with mentoring programs in higher education: facilitating career development and employability of graduates. Education+ Training, 62(3), 214-234.
O'Reilly, C., Devitt, A., & Hayes, N. (2022). Critical thinking in the preschool classroom: A systematic literature review. Thinking skills and creativity, 46, 101110.
Paul, R. (1993). Critical Thinking: What every person needs to survive in a rapidly changing world. Foundation for Critical Thinking.
Paul, R., & Elder, L. (2006). Critical Thinking: Learn the Tools the Best Thinkers Use. Pearson Prentice Hall.
Quraishah, A., Singh, S. K. S., & Sulaiman, F. (2022). Al Ghazali’s dialogue: A case-based & critical thinking communicative language teaching approach. Journal of Positive School Psychology, 2147-2156.
Rahlin, N. A., Awang, Z., Afthanorhan, A., & Aimran, N. (2019). The art of covariance based analysis in behaviour- based safety performance study using confirmatory factor analysis: Evidence from SMES. International Journal of Innovation, Creativity and Change, 7(10), 351-370.
Ramsook, L. (2023). Critical thinking at the tertiary level: Individual and collective intentionality. European Journal of Applied Sciences, 11(3). 739-749.
Rios, J. A., Ling, G., Pugh, R., Becker, D., & Bacall, A. (2020). Identifying critical 21st-century skills for workplace success: A content analysis of job advertisements. Educational Researcher, 49(2), 80-89.
Rosellini, A. J., & Brown, T. A. (2021). Developing and validating clinical questionnaires. Annual review of clinical psychology, 17(1), 55-81.
Sapnas, K. G., & Zeller, R. A. (2002). Minimizing sample size when using exploratory factor analysis for measurement. Journal of nursing measurement, 10(2), 135–154.
Sarwanto, S., Fajari, L. E. W., & Chumdari, C. (2021). Critical thinking skills and their impacts on elementary school students. Malaysian Journal of Learning and Instruction, 18(2), 161-187.
Setia M. S. (2016). Methodology series module 3: Cross-sectional studies. Indian journal of dermatology, 61(3), 261–264.
Sheergojeri, A. (2023). Development of critical thinking as the primary goal of educational process. Anvesak, 52(4), 63-69.
Shkeer, A. S., & Awang, Z. (2019). Exploring the items for measuring the marketing information system construct: An exploratory factor analysis. International Review of Management and Marketing, 9(6), 87.
Siti Aisyah Mohamad (2024, January 1). Dependence on AI causes humans to lose critical thinking skills. IIUM in the News. https://newsroom.iium.edu.my/index.php/2024/01/02/dependence-on-ai-causes-humans-to-lose- critical-thinking-skills/
Suryani, Y., Nurfadilah, E., Setiawan, I., & Suhartini, C. (2021). The effect of round table cooperative learning model and learning motivation on students’ critical thinking skills. Proceedings of the 1st Universitas Kuningan International Conference on Social Science, Environment and Technology. UNiSET 2020.
Tang, K. N. (2020). The importance of soft skills acquisition by teachers in higher education institutions. Kasetsart Journal of Social Sciences, 41(1), 22-27.
Teo, C. C., Wang, X., Tan, S. C., & Lee, J. W. Y. (2023). Enhancing critical thinking in operations management education: a framework with visual-based mapping for interdisciplinary and systems thinking. Higher Education Pedagogies, 8(1), 2216388.
Toulmin, S. (1958). The uses of argument. Cambridge University Press.
Velayati, N., Muslem, A., Fitriani, S., Samad, I. (2017). An exploration of students’ difficulties in using critical thinking skills in reading. Al-Talim Journal, 24, 195.
Watkins, M. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219- 246.
Widiastuti, I. A. M. S., Bagus Nyoman Mantra, I., Utami, I. G. A. L. P., Sukanadi, N. L., & Susrawan, I. (2023). Implementing problem-based learning to develop students' critical and creative thinking skills. JPI (Jurnal Pendidikan Indonesia), 12, 658-667.
Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian journal of paramedicine, 8, 1-13.
Zanden, P. v. d., Denessen, E., Cillessen, A. H. N., & Meijer, P. C. (2020). Fostering critical thinking skills in secondary education to prepare students for university: Teacher perceptions and practices. Research in Post- Compulsory Education, 25(4), 394-419.
Zhang, Y. (2022). The research on critical thinking teaching strategies in college English classroom. Creative Education, 13(4), 1469-1485.
Zakaria, M. A., Ahmad, M. F., & Rahman, M. K. A. (2021). Higher Order Thinking Skills (HOTs): Acting Method as Approach of Critical Pedagogy in Education Culture. International Journal of Academic Research in Progressive Education and Development, 10(2), 502–516.
Downloads
Published
Issue
Section
License
Upon acceptance of an article, authors will be asked to transfer copyright. This transfer will ensure the widest possible dissemination of information. A notification will be sent to the corresponding author confirming receipt of the manuscript. If excerpts from other copyrighted works are included, the author(s) must obtain written permission from the copyright owners and credit the source(s) in the article.
