Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: B4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Frankie Tsz Ki FAN, Executive Officer, Talent and Education Development Office, City University of Hong Kong

Abstract

CityUHK launched the CityU Tiger Programme for nurturing the talents of tomorrow and transforming students into future global leaders. The Programme targets both newly-admitted undergraduate students with outstanding academic performance as well as high-achieving first-year students and have approximately 1,000 members in 2023/24. With constant guidance and support from faculty members, the Programme organised various tailored activities for these elite students, allowing them to navigate the challenges of the fast-changing world, cultivate their talents in their respective fields of study, contribute to their communities, and ultimately emerge as future leaders and change-makers.

Theme: 2. Thematic Exploration

Sub-theme: 2.4  Whole-Person Development

Oral Presentation Time: 1400-1500

Venue: Peony Room, Lower Level II

Presenter(s)

– Dr Angela LI, Associate Professor, Division of Science, School of Medical and Health Sciences, Tung Wah College

– Dr Monica CHOW, Project Manager, Division of Science, School of Medical and Health Sciences, Tung Wah College

Abstract

Aiming to enhance the job-readiness of our students, an electronic teaching and learning kit for job-ready skill training (e-JR kit) is developed. This e-JR kit consists of three teaching modules that cover the topics of core skills needed for a paraprofessional job as a clinical assistant, including Module 1 Communication skills in the workplace, Module 2 safety and ethical issues in the workplace and Module 3 professional skills in the workplace. The regular industry involvement is a key feature of this e-JR kit project. Different industry stakeholders are continuously consulted, help with the design of real workplace scenarios, and give feedback on the effectiveness of the training. To accommodate the learning preferences of the current generation of students, the content of this e-JR kit is presented in bite-sized topics, such as case scenarios, short videos and small quizzes, and the design is highly visual and interactive. This well-designed kit will help students integrate their skills before employment, and to equip them with skills for a range of possible scenarios in the workplace. To promote the use of the e-JR kit, the completed kit will be shared with other local institutions and our industry partners in the pre-job training of their students and new staff.

Theme: 1: Showcase Project Achievements

Sub-theme: Quality Education Fund (QEF), and Quality Enhancement Support Scheme (QESS)

Oral Presentation Time: 1600-1700

Venue: Fanling Room, Lower Level I

Presenter(s)

– Professor Rick KWAN, Associate Dean (Programme) & Professor, School of Nursing, Tung Wah College

Abstract

In the professionalisation of healthcare services, many healthcare professions emerged. These healthcare professions become highly specialised to care for specific health issues, although their common goal is to promote human health. In the era of the increasing complexity of diseases and health issues, knowledge from a specific profession might not suffice to solve the complex health issues of humans. However, the knowledge generated from different healthcare professions may conflict. As a result, the healthcare plans including inputs from various healthcare professions lead to incongruent treatment practices. The derived conflicts jeopardize the health outcomes of people. Interprofessional education (IPE) occurs when (learners) from two or more professions learn about, from and with each other to enable effective collaboration and health outcomes. IPE is a necessary step in preparing a “collaborative practice-ready” health workforce that is better prepared to respond to local health needs. Tung Wah College offers training for the second-largest number of healthcare professionals in Hong Kong, including nursing, physiotherapy, occupational therapy, radiotherapy, and medical laboratory science. These programmes are all accredited by the related professional regulating bodies in Hong Kong. However, interprofessional education is not a mandatory training requirement stipulated by these professional regulating bodies. Since 2023, TWC developed a Community of Practice of Healthcare Professional Health Education. We work closely together to share a common goal of strengthening interprofessional healthcare teamwork through integrated education across programmes.

Theme: 2: Thematic Exploration

Sub-theme: Community of Practice (CoP)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)