FRAMEWORK FOR DEVELOPING INTELLECTUAL SKILLS USING COLLABORATIVE LEARNING TOOLS: THE EXPERTS’ CONSENSUS
DOI:
https://doi.org/10.24200/jonus.vol6iss1pp284-308Abstract
Background and Purpose: Students in higher education need intellectual skills for critical thinking, problem-solving and creating new knowledge. Social interactions during collaborative learning (CL) encourage these cognitive processes. However, instructors lack the skill to develop intellectual skills using appropriate pedagogy and CL tools. Hence, this study seeks to develop a framework for developing intellectual skills.
Methodology: The Fuzzy Delphi Method (FDM) was employed to identify and determine consensus on elements to teach intellectual skills among 16 panel of experts in educational technology and continuous professional development. In the first round, semi-structured interviews were conducted among four experts and the themes emerging from the interviews were used to develop the FDM questionnaire. The questionnaire was used in the second round of the FDM to determine consensus among the experts based on calculations of the defuzzification value.
Findings: The consensus among the experts is that resources for teaching intellectual skills are videos, interactive slides, animation/graphics and quizzes while the corresponding assessments are student-generated contents (i.e videos, infographic posters, interactive slides and designed products).
Contribution: The framework with the instructional strategies, resources and assessment provides a guideline for instructors to plan instruction for developing intellectual skills and generating new knowledge.
Keywords: intellectual skills, collaborative learning, collaborative learning tools, Fuzzy Delphi, Merrill’s First Principles of Instruction
Cite as: Vasodavan, V., DeWitt, D., & Alias, N. (2021). Framework for developing intellectual skills using collaborative learning tools: The experts’ consensus. Journal of Nusantara Studies, 6(1), 284-308. http://dx.doi.org/10.24200/jonus.vol6iss1pp284-308
References
Adler, M., & Ziglio, E. (1996). Gazing into the oracle: The Delphi method and its application to social policy and public health. Jessica Kingsley Publishers.
Akbari, R., & Yazdanmehr, E. (2014). A critical analysis of the selection criteria of expert teachers in ELT. Theory and Practice in Language Studies, 4(8), 1653–1658.
Anderson, J. R. (2005). Cognitive psychology and its implications. Worth Publishers.
Bates, W. (2015). Teaching in a digital age: Guidelines for teaching and learning. Tony Bates Associates Ltd.
Belland, B. (2016). Instructional scaffolding in STEM education: Strategies and efficacy evidence. Instructional Scaffolding in STEM Education: Strategies and Efficacy Evidence. Springer International Publishing.
Berliner, D. C. (2001). Learning about and learning from expert teachers. International Journal of Educational Research, 35(1), 463-482.
Biasutti, M., & El-Deghaidy, H. (2012). Using Wiki in teacher education: Impact on knowledge management processes and student satisfaction. Computers and Education, 59(3), 861–872.
Bishop, J., & Elen, J. (2014). Emerging technologies. In M. Spector, M. Merrill, M. Bishop, & J. Elen (Eds.), Handbook of research on educational communications and technology (pp. 673–674). Taylor & Francis Group.
Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals. Retrieved from https://books.google.com.my/books?id=hos6AAAAIAAJ
Bower, M. (2016). Deriving a typology of Web 2.0 learning technologies. British Journal of Educational Technology, 47(4), 763–777.
Bruner, J. (1960). The process of education. Harvard University Press.
Çetin, E., & Solmaz, E. (2020). Gamifying the 9 events of instruction with different interactive response systems: The views of social sciences teacher candidates. Malaysian Online Journal of Educational Technology, 8(2), 1–15.
Chang, P.-L., Hsu, C.-W., & Chang, P.-C. (2011). Fuzzy Delphi method for evaluating hydrogen production technologies. Fuel and Energy Abstracts, 36(21), 14172–14179.
Cheng, C.-H., & Lin, Y. (2002). Evaluating the best main battle tank using fuzzy decision theory with linguistic criteria evaluation. European Journal of Operational Research, 142(1), 174–186.
Cummins, S., Beresford, A. R., & Rice, A. (2016). Investigating engagement with in-video quiz questions in a programming course. IEEE Transactions on Learning Technologies, 9(1), 57–66.
DeWitt, D., Alias, N., Siraj, S., & Hutagalung, F. (2014). Knowledge management in education: Designing instruction for using Wikis. In F. Gaol, W. Mars, & H. Saragih (Eds.), Management and technology in knowledge, service, tourism & hospitality (pp. 45–50). CRC Press.
DeWitt, D., Alias, N., & Siraj, S. (2015). Collaborative learning: Interactive debates using Padlet in a higher education institution. Turkish Online Journal of Educational Technology, 1(1), 88–95.
DeWitt, D., & Alias, N. (2017). Infographic posters for enhancing 21st century communication skills. Retrieved from http://eprints.um.edu.my/18115/1/DeWitt_Full_paper_Infographic.pdf
DeWitt, D., & Koh, E. H. Y. (2020). Promoting knowledge management processes through an interactive virtual wall in a postgraduate business finance course. Journal of Education for Business, 95(4), 255–262.
Di, M., Ranieri, M., & Bruni, I. (2019). Assessing is not a joke: Alternative assessment practices in higher education. Form@re, 19(3), 106–118.
Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014). Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of Clinical Epidemiology, 67(4), 401–409.
Dias, S. B., Hadjileontiadou, S. J., Diniz, J. A., & Hadjileontiadis, L. J. (2017). Computer-based concept mapping combined with learning management system use: An explorative study under the self- and collaborative-mode. Computers and Education, 107(1), 127–146.
Dick, W., Carey, L., & Carey, J. O. (2014). The systematic design of instruction. Pearson Education.
Donohoe, H. M., & Needham, R. D. (2009). Moving best practice forward: Delphi characteristics, advantages, potential problems, and solutions. International Journal of Tourism Research, 11(5), 415–437.
Driscoll, M. P. (2005). Psychology of learning for instruction (3rd ed.). Allyn & Bacon.
Duan, Y. (2006). Selecting and applying taxonomies for learning outcomes: A nursing example. International Journal of Nursing Education Scholarship, 3(1), 1-12.
Fırat, E. A., & Koksal, M. S. (2017). The relationship between use of Web 2.0 tools by prospective science teachers and their biotechnology literacy. Computers in Human Behavior, 70(1), 44–50.
Fu, Q., & Hwang, G. (2018). Trends in mobile technology-supported collaborative learning: A systematic review of journal publications from 2007 to 2016. Computers and Education, 119(1), 129–143.
Gagné, M. (1977). Conditions of learning (3rd ed.). Holt, Rinehart and Winston.
Gagné, M. (1984). Learning outcomes and their effects: Useful categories of human performance. American Psychologist, 39(4), 377–385.
Gagné, R. (1971). Learning hierarchies. Prentice Hall.
Gagné, R. (1985). The conditions of learning and theory of instruction (4th ed.). Holt, Rinehart, and Winston.
Gagné, M., Wager, W., Golas, K., & Keller, M. (2005). Principles of instructional design (5th ed.). Thomson/Wadsworth.
Gamage, S. H. P. W., Ayres, J. R., Behrend, M. B., & Smith, E. J. (2019). Optimising Moodle quizzes for online assessments. International Journal of STEM Education, 6(27), 1-14.
Gast, I., Schildkamp, K., & Veen, J. T. Van Der. (2017). Team-based professional development interventions in higher education: A systematic review. Review of Educational Research, 87(4), 736–767.
Gašević, D., Adesope, O., Joksimović, S., & Kovanović, V. (2015). Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions. Internet and Higher Education, 24(1), 53–65.
Goh, D., & Kale, U. (2015). The urban–rural gap: Project-based learning with Web 2.0 among West Virginian teachers. Technology, Pedagogy and Education, 25(1), 1–22.
Haagsman, M. E., Scager, K., Boonstra, J., & Koster, M. C. (2020). Pop-up questions within educational videos: Effects on students’ learning. Journal of Science Education and Technology, 29(6), 713–724.
Hadjerrouit, S. (2017). A conceptual framework for using and evaluating web-based learning resources in school education. Journal of Information Technology Education: Research, 9(1), 053–079.
Herrera-Pavo, M. Á. (2020). Collaborative learning for virtual higher education. Learning, Culture and Social Interaction, 28(1), 1-11.
Hew, K. F., & Cheung, W. (2013). Audio-based versus text-based asynchronous online discussion: Two case studies. Instructional Sciences, 41(2), 365–380.
Hobbs, R., & Tuzel, S. (2017). Teacher motivations for digital and media literacy: An examination of Turkish educators. British Journal of Educational Technology, 48(1), 7–22.
Hong, J., Pi, Z., & Yang, J. (2016). Learning declarative and procedural knowledge via video lectures: Cognitive load and learning effectiveness. Innovations in Education and Teaching International, 55(1), 74–81.
Hsu, Y-L, Lee, C-H, & Kreng, V. B. (2010). The application of Fuzzy Delphi method and Fuzzy AHP in lubricant regenerative technology selection. Expert Systems with Applications, 37(1), 419-425.
Huizen, P., Oers, B., & Wubbels, T. (2005). A Vygotskian perspective on teacher education. Journal of Curriculum Studies, 37(3), 267–290.
Hussain, F. N., Al-Mannai, R., Diab, M. I., & Agouni, A. (2020). Investigating the use of a lecture capture system within pharmacy education: Lessons from an undergraduate pharmacy program at Qatar University. International Journal of Educational
Technology in Higher Education, 17(40), 1-14.
Huang, H. (2015). From web-based readers to voice bloggers: EFL learners’ perspectives. Computer Assisted Language Learning, 28(2), 145–170.
Jamil, M., Hussin, Z., Noh, N., Sapar, A., & Alias, N. (2013). Application of Fuzzy Delphi method in educational research. In Saedah Siraj, N. Alias, D. DeWitt, & Z. Hussin (Eds.), Emergent trends in educational research (pp. 86–92). Pearson.
Jen, T. H., Yeh, Y. F., Hsu, Y. S., Wu, H. K., & Chen, K. M. (2016). Science teachers’ TPACK-Practical: Standard-setting using an evidence-based approach. Computers and Education, 95(1), 45–62.
Jeong, A. (2019). Comparing instructional event sequences in audio podcasts with low versus high user satisfaction. TechTrends, 63(5), 559–563.
Jimoyiannis, A. (2010). Developing a technological pedagogical content knowledge framework for science education: Implications of a teacher trainers’ preparation program. Proceedings of Informing Science & IT Education Conference, 1(1), 597–
607.
Johnson, D., & Johnson, R. (2004). Cooperation and the use of technology (2nd ed.). Erlbaum.
İsmailoğlu, E. G., Orkun, N., Eşer, İ., & Zaybak, A. (2020). Comparison of the effectiveness of the virtual simulator and video-assisted teaching on intravenous catheter insertion skills and self-confidence: A quasi-experimental study. Nurse Education
Today, 95(1), 1-6.
Jones, H., & Twiss, B. (1978). Forecasting technology for planning decisions. Palgrave Macmillan.
Kaufmann, A., & Gupta, M. M. (1988). Fuzzy mathematical models in engineering and management science. Elsevier Science.
Khalil, M. K., & Elkhider, I. A. (2016). Applying learning theories and instructional design models for effective instruction. Advances in Physiology Education, 40(2), 147–156.
Kear, K. (2011). Online and social networking communities: A best practice guide for educators. Routledge.
Kent, C., Laslo, E., & Rafaeli, S. (2016). Interactivity in online discussions and learning outcomes. Computers and Education, 97(1), 116–128.
Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to newmethods of training evaluation. Journal of Applied Psychology, 78(1), 311–328.
Krathwohl, D., Bloom, B. S., & Masia, B. (1964). Taxonomy of educational objectives. The classification of educational goals, handbook ii: Affective domain. David McKay Company, Inc.
Khadjooi, K., Rostami, K., & Ishaq, S. (2011). How to use Gagne’s model of instructional design in teaching psychomotor skills. Gastroenterology and Hepatology From Bed to Bench, 4(3), 116–119.
Kuo, Y., Belland, B., & Kuo, Y. (2017). Learning through blogging: Students’ perspectives in collaborative blog-enhanced learning communities. Educational Technology & Society, 20(2), 37–50.
Lehmann, R., Lutz, T., Helling-Bakki, A., Kummer, S., Huwendiek, S., & Bosse, H. M. (2019). Animation and interactivity facilitate acquisition of pediatric life support skills: A randomized controlled trial using virtual patients versus video instruction.
BMC Medical Education, 19(1), 1-7.
Leng, C., Siraj, S., Naimie, Z., Abedalaziz, N., DeWitt, D., & Darulsalam, G. (2013). Delphi technique. In S Siraj, N. Alias, D. DeWitt, & Z. Hussin (Eds.), Designa and developmental research: Emergent trensds in educational research (pp. 71–84). Pearson
Malaysia.
Merrill, D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43–60.
Merrill, D. (2006). Levels of instructional strategy. Educational Technology, 46(4), 5–10.
Merrill, D. (2013). First principles of instruction: Identifying and designing effective, efficient, and engaging instruction. Pfeiffer (John Wiley & Sons).
Ministry of Higher Education (MOHE). (2015). Malaysia education blueprint 2015-2025 (Higher Education). Ministry of Education Malaysia (Vol. 2025).
Mustapha, R., & Darulsalam, G. (2018). Aplikasi kaedah Fuzzy Delphi dalam penyelidikan sains sosial. Universiti Malaya Press.
Manakandan, S. K., Ismai, R., Jamil, M. R. M., & Ragunath, P. (2017). Pesticide applicators questionnaire content validation: A Fuzzy Delphi method. Medical Journal of Malaysia, 72(4), 228–235.
Miner, A., Mallow, J., Theeke, L., & Barnes, E. (2015). Using Gagné’s 9 events of instruction to enhance student performance and course evaluations in undergraduate nursing course. Nurse Educator, 40(3), 152–154.
Mullen, P. (2003). Delphi: Myths and reality. Journal of Health Organization and Management, 17(1), 37–52.
Murray, T. J., Pipino, L. L., & Gigch, J. P. (1985). A pilot study of Fuzzy set modification of Delphi. Human System Management, 5(1), 76-80.
Needham, R., & Loë, R. (1990). The policy Delphi: Purpose structure and application. Canadian Geographer-Geographe Canadien, 34(1), 133–142.
Norris, D., Kalm, K., & Hall, J. (2020). Chunking and redintegration in verbal short-term memory. Journal of Experimental Psychology: Learning Memory and Cognition, 46(5), 872–893.
Oliver, K. (2010). Integrating Web 2.0 across the curriculum. Techtrends: Linking Research & Practice to Improve Learning, 54(2), 50–60.
Özçinar, H. (2015). Scaffolding computer-mediated discussion to enhance moral reasoning and argumentation quality in pre-service teachers. Journal of Moral Education, 7240(1), 1–20.
Peterson, A. T., & Roseth, C. J. (2015). Effects of four CSCL strategies for enhancing online discussion forums: Social interdependence, summarizing, scripts, and synchronicity. International Journal of Educational Research, 76(1), 147–161.
Picciano, A. G. (2015). Planning for online education: A systems model. Online Learning, 19(5), 142-158.
Ponce, H. R., Mayer, R. E., López, M. J., & Loyola, M. S. (2018). Adding interactive graphic organizers to a whole-class slideshow lesson. Instructional Science, 46(6), 973–988.
Roberts, T. (2015). Online collaborative learning: Theory and practice. Information Science Publishing.
Ronen, T., & Pasher, E. (2011). Complete guide to knowledge management a strategic plan to leverage your company’s intellectual capital. Wiley.
Ross, A., Dlungwane, T., & Van Wyk, J. (2019). Using poster presentation to assess large classes: A case study of a first-year undergraduate module at a South African university. BMC Medical Education, 19(432), 1-9.
Seel, N., Lehmann, T., Blumschein, P., & Podolskiy, O. (2017). What is Instructional Design? Instructional Design for Learning.
Shanteau, J., Weiss, D. J., Thomas, R. P., & Pounds, J. C. (2002). Performance-based assessment of expertise: How to decide if someone is an expert or not. European Journal of Operational Research, 136(2), 253–263.
Sheriff, R. E. (2015). An evaluation of students’ and lecturers’ use of technologies: An engineering case study. Engineering Education, 7(1), 33–46.
Shelton, C. (2017). Giving up technology and social media: Why university lecturers stop using technology in teaching. Technology, Pedagogy and Education, 26(3), 303–321.
Smith, L., & Ragan, J. (2005). Instructional design (3rd ed.). Wiley.
Spector, M. (2016). Foundations of educational technology: Integrative approaches and interdisciplinary perspectives (2nd ed.). Routledge/Taylor & Francis Group.
Stoddart, A., Chan, J. Y. Y., & Liu, G. Z. (2016). Enhancing successful outcomes of wiki-based collaborative writing: A state-of-the-art review of facilitation frameworks. Interactive Learning Environments, 24(1), 142–157.
Thalmann, M., Souza, A., & Oberauer, K. (2019). How does chunking help working memory? Journal of Experimental Psychology. Learning, Memory, and Cognition, 1(45), 37–55.
Tibi, M. H. (2018). Computer science students’ attitudes towards the use of structured and unstructured discussion forums in fully online courses. Online Learning Journal, 22(1), 93–106.
Tsai, H. C., Lee, A. S., Lee, H. N., Chen, C. N., & Liu, Y. C. (2020). An application of the Fuzzy Delphi method and Fuzzy AHP on the discussion of training indicators for the regional competition, Taiwan national skills competition, in the trade of joinery.
Sustainability (Switzerland), 12(1), 1-19.
Vangrieken, K., Dochy, F., Raes, E., & Kyndt, E. (2015). Teacher collaboration: A systematic review. Educational Research Review, 15(1), 17–40.
Vásquez-Bravo, D.-M., Sanchez-Segura, M.-I., Medina-Dominguez, F., & de Amescua, A. (2014). Knowledge management acquisition improvement by using software engineering elicitation techniques. Computers in Human Behavior, 30(1), 721–730.
Vasodavan, V., Dewitt, D., & Alias, N. (2019). TPACK in higher education: Analysis of the collaborative tools used by lecturers. The Asia Pacific Journal of Curriculum & Teaching, 7(1), 9–17.
Vygotsky, S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Wallihan, R., Smith, K. G., Hormann, M. D., Donthi, R. R., Boland, K., & Mahan, J. D. (2018). Utility of intermittent online quizzes as an early warning for residents at risk of failing the pediatric board certification examination. BMC Medical Education,
18(287), 1-7.
West, J., & Turner, W. (2016). Enhancing the assessment experience: Improving student perceptions, engagement and understanding using online video feedback. Innovations in Education and Teaching International, 53(4), 400–410.
Xie, K. (2013). What do the numbers say? The influence of motivation and peer feedback on students’ behaviour in online discussions. British Journal of Educational Technology, 44(2), 288–301.
Yakob, M., Saiman, Sofiyan, Sari, R. P., & El Islami, R. A. Z. (2020). The effectiveness of science experiment through multimedia teaching materials to improve students’ critical thinking. Journal of Physics: Conference Series, 1567(1), 1-5.
Zanjani, N., Edwards, S. L., Nykvist, S., & Geva, S. (2017). The important elements of LMS design that affect user engagement with e-learning tools within LMSs in the higher education sector. Australasian Journal of Educational Technology, 33(1), 19–
31.