Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: J2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Benjamin MOORHOUSE, Assistant Professor, Department of Education Studies, Hong Kong Baptist University

Abstract

The public release of ChatGPT sent shock waves through the education community. Since then, many generative AI (GenAI) tools that perform various human tasks have been launched. It is essential that higher education institutions are at the forefront of preparing graduates for the productive and responsible use of these tools. To make this a reality, instructors, as models of practice, must have the skills and knowledge to use GenAI tools. They need to understand how AI works (technological proficiency); they need to consider the ethical issues of the tools (critical and ethical awareness); they need the pedagogical awareness of how and when to use them (pedagogical capability); and they need prepare their students to use them. These skills can be considered ‘Professional Generative AI competence’ (P-GenAI-C). The Inter-institutional Collaborative Activities for Fund for Innovative Technology-in Education project presented in this poster aims to: (1) Identify the P-GenAI-C in different university subject disciplines; (2) Contextualize the P-GenAI-C within each universities’ policies and guidelines; (3) Develop training and continuous support for university instructors, and (4) Develop a developmental framework and reflective tool for evaluating P-GenAI-C. The first aim and discussion of the actualization of the remaining aims are presented.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: E2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Grace NGAI, Head, Service-Learning and Leadership Office, The Hong Kong Polytechnic University

– Dr Stephen CHAN, Principal Project Fellow and Founding Head, Service-Learning and Leadership Office, The Hong Kong Polytechnic University

– Dr Perry LEE, Manager, Service-Learning and Leadership Office, The Hong Kong Polytechnic University

– Dr Angel LUO, The Hong Kong Polytechnic University

– Dr Shuheng LIN, Project Fellow, Service-Learning and Leadership Office, The Hong Kong Polytechnic University

– Mr Kenneth LO, Senior Manager, Service-Learning and Leadership Office, The Hong Kong Polytechnic University,

Abstract

In Hong Kong, internationalization is a key performance indicator for the higher education section in response to the policy goal of establishing the city as a regional education hub (University Grants Committee, 2017). Resources have been allocated to universities for various initiatives including the recruitment of international faculty and students, inter-institutional collaboration in research, and students’ overseas learning experiences. A document analysis study on 6 universities in Hong Kong showed a notable increase of institutional focus on internationalization, intercultural skills, culture, diversity, equality, and inclusion post-pandemic (Lai, 2022). Besides its contribution to global connectivity, knowledge exchange, and institutional development (Lane, 2014), internationalizing higher education is also important to prepare students for a globalized world (Egron-Polak, 2011). Given the increasing diversity within universities and societies, prioritizing the cultivation of students’ intercultural sensitivity (IS) has become essential as it enhances students’ academic and personal success and fosters harmony and development within communities. Different strategies have been implemented in higher education institutes to provide intercultural opportunities for students. These include student mobility programmes, including short and long-term immersive learning activities that bring students outside of their home country to study abroad. At the Hong Kong Polytechnic University, this includes international service-learning (ISL), with a university target of 50% of students having an ISL experience by 2027-28. In this poster presentation, we will study the impact of ISL on students’ intercultural sensitivity from multiple dimensions, including knowledge, skills, and attitudes.

Theme: 2. Thematic Exploration

Sub-theme: 2.3  Community Engaged Learning

Poster Presentation Time: 1500-1600; 1700-1800

Venue: D3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Kin WAN, Teaching Fellow, School of Optometry, The Hong Kong Polytechnic University

– Dr Jeffrey LEUNG, Teaching Fellow, School of Optometry, The Hong Kong Polytechnic University

Abstract

This study assesses an inter-professional training program aimed at improving the skills of optometry and education students in addressing the visual needs of children with special educational needs (SEN). Due to communication and behavioral challenges, SEN children are at a higher risk of having undetected visual problems, necessitating effective collaboration between optometrists and educators. The program included lectures, workshops, and practical vision screenings at special schools. Pre- and post-program surveys, using a Likert scale, measured participants’ understanding of SEN and confidence in managing visual issues in these children. Thirty-seven optometry and 21 education students participated in the study. Results showed a significant enhancement in the understanding of SEN characteristics and the importance of pediatric eye care (p < 0.001 and p < 0.023 respectively). Optometry students reported increased confidence in building rapport with SEN children, conducting eye exams, and making professional judgments (p ≤ 0.006). The findings suggest that inter-professional training can effectively improve the competence of future professionals in providing comprehensive eye care to SEN children, showcasing the benefits of collaborative educational approaches between healthcare and special education sectors.

Theme: 2. Thematic Exploration

Sub-theme: 2.2 Diversity and Inclusion Education

Poster Presentation Time: 1220-1400; 1500-1600

Venue: J3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Ryan MAN, Associate Dean (Undergraduate Studies), School of Business, Hong Kong Baptist University

Abstract

The Fund for Innovative Technology-in-Education (FITE) has catalyzed a transformative initiative within our School to future-proof business education. Our approach is three-pronged, with a focus on curriculum development, personalized e-learning, and pedagogical innovation. In anticipation of the 2024/25 academic year, a dedicated programme review team has been tasked with integrating AI across the BBA curriculum, introducing new core courses such as Business Coding, AI for Business, and AI Ethics and Governance. This integration extends to embedding AI applications into functional areas like marketing human resources management and finance. Besides, we have instituted a personalized e-learning graduation requirement, leveraging Industries 4.0 principles of IoT and AI in MOOCs, particularly LinkedIn Learning, to enhance engagement and digital literacy. Our metrics indicate promising uptake and substantial engagement in technology courses, underscoring the relevance of data analytics and AI in contemporary education. Supporting our pedagogical shift, the FITE-backed Fostering AI-Incorporated Learning team is pioneering AI and blended learning integration to elevate teaching quality. Our experimental initiatives range from incorporating Generative AI into Business Analytics education and piloting AI in HR teaching. These efforts signify our commitment to driving pedagogical transformation and curriculum innovation, preparing students for the evolving demands of the digital economy.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: G1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yuk Ming TANG, Senior Lecturer, Department of Indusial and System Engineering, The Hong Kong Polytechnic University

Abstract

STEM education is essential in today’s curriculum even for university students. However, traditional classroom-based instruction methods often lack interactivity and tailored experiences that foster student engagement and comprehension. The integration of Virtual Reality (VR) and Artificial Intelligence (AI) generative chatbots has emerged as a transformative influence on the teaching and learning process. Despite this, limited research has explored the impact of advanced technology on STEM learning outcomes. This study explores the potential of employing VR and AI as tools to facilitate teaching to enhance students’ learning outcomes. 120 university students are involved in this study to examine the difference in learning outcomes by utilizing three instructional approaches for learning projectile motion: (1) a traditional didactic classroom, (2) a game-based VR metaverse, and (3) a game-based VR metaverse enriched with a generative chatbot-based pedagogical agent. The study prudently evaluated alterations in student motivation, cognitive benefit, and learning outcomes. Preliminary findings suggest that incorporating VR and AI into teaching considerably enhances student engagement and cognitive participation. This study demonstrates how the integration of VR with AI can elevate student engagement, comprehension, and skill acquisition in STEM education, paving the way for a more captivating and effective learning environment in the Edu-metaverse.

Theme: 2. Thematic Exploration

Sub-theme: 2.1 Community of Practice (CoP)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: E1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Bess Yue WANG, Senior Lecturer, Department of Journalism, School of Communication, Hong Kong Baptist University

– Dr Angela Dan WANG, Research Assistant Professor, Department of Journalism, School of Communication, Hong Kong Baptist University

Abstract

The proposed course equips students with cutting-edge skills in AI and cloud-based solutions to address real-world media management challenges faced by NGOs. Through a dynamic, experiential learning approach, students will become digitally competent, industry-ready, and socially responsible professionals. Partnering with the Institute of Endurance Science and Technology (IEST) and Huawei, the course offers a unique opportunity to bridge the gap between technological expertise and social impact. Students will gain hands-on experience by developing cloud-based solutions for IEST’s data management, publicity, and digital governance needs. The curriculum emphasizes: 1. Understanding NGO media challenges and translating them into practical cloud-based solutions. 2. Utilizing Huawei’s cloud infrastructure and receiving expert training from their engineers. 3. Developing a comprehensive cloud solution proposal addressing a real-world problem faced by IEST. Student competency will be assessed through a Huawei Cloud Practitioner certification exam and a final project proposal evaluated by industry experts and IEST. This ensures the learning experience is not only relevant but also potentially impactful, with successful proposals considered for adoption by IEST. This course exemplifies the power of technology in driving positive social change while providing students with invaluable skills for the future.

Theme: 2. Thematic Exploration

Sub-theme: 2.3  Community Engaged Learning

Poster Presentation Time: 1500-1600; 1700-1800

Venue: L1, Tai Po-Shek-O Room, Lower Level I

– Dr Joseph Yui-yip LAU, Interim Head of Student Affairs and Senior Lecturer, Division of Business and Hospitality Management, College of Professional and Continuing Education, The Hong Kong Polytechnic University

Abstract

Strengthening diversity and inclusion education may foster Hong Kong to establish a regional education hub in the Asia Pacific region. To align with the dual objectives of internationalization and the integration of the Greater Bay Area, the admission policy and strategy have been fundamental changes in the past few decades. As expected, the student population is not only local students but also mainland students, ethics minorities, and other foreign students jointly enroll in the programme, participate in the student activities, and use the campus facilities for learning and social networking purposes. In response, the Student Affairs Office plays a crucial role in building diversity and inclusion education on the campus. This study aims to investigate the current context of the higher education sector, to identify the challenges of building diversity and inclusion education on campus, and to propose possible future trends of building diversity and inclusion education in the higher education sector in the forthcoming years.

Theme: 2. Thematic Exploration

Sub-theme: 2.2 Diversity and Inclusion Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K1, Tai Po-Shek-O Room, Lower Level 1

Presenter(s)

– Dr Laura ZHOU, Education Development Officer, Education Development Centre, The Hong Kong Polytechnic University

– Mr Leo WONG, Project Associate, Education Development Centre, The Hong Kong Polytechnic University

Abstract

The flipped learning and teaching approach redefines the traditional classroom dynamic by swapping the order of direct instruction and homework activities. In a flipped classroom, students engage with instructional materials (such as videos, readings, or podcasts) outside of class, freeing up valuable in-class time for active learning, collaborative activities, and deeper understanding. In our quest to promote effective flipped learning and teaching practices, we conducted comprehensive interviews with experienced teaching staff at PolyU, who have successfully integrated this methodology into their course. Their valuable insights were collected and compiled into case studies, which were then disseminated to all teaching staff members through e-newsletters and experience sharing workshops. These teaching cases serve as compelling examples, showcasing the versatility and impact of flipped learning and teaching. They underscore the significance of adapting pedagogical methods to enhance student learning experiences. By shifting the locus of content consumption outside the classroom, educators empower students to actively engage with the material during face-to-face sessions, fostering a deeper understanding and more meaningful interactions.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)