Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1600-1700

Venue: Fanling Room, Lower Level I

Presenter(s)

– Professor Carmen WONG, Assistant Dean (Faculty Development) and Clinical Professional Consultant, The Jockey Club School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong

Abstract

Many industries have adopted design thinking as a powerful approach to problem-solving and innovation. A Community of Practice on Design Thinking can enhance experience sharing, ideas development and collectively enrich design thinking capabilities. For educators this can facilitate sharing of curricula concerns and problems, topical interests, and deepen their knowledge and experience of design thinking in education. The HKTEA Design Thinking Community of Practice in Higher Education was established in November 2023. The presentation aims to explore the process and challenges of setting up a community of practice on design thinking within the education arena. The session will begin by providing an overview of community of practice and design thinking considerations. The journey in setting up the Design Thinking community of practice from developing design thinking educational resources, exploring educator challenges in different institutions and disciplines and fostering network and exchange will be discussed. Key steps involved in establishing a community of practice and ongoing development will be highlighted. Attendees will be equipped with practical insights and actionable strategies to initiate and nurture a community of practice in their own and/or across institutions.

Theme: 2. Thematic Exploration

Sub-theme: Community of Practice (CoP)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: L6, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Professor Gladys Wai Lan TANG, Centre Director, Centre for Sign Linguistics and Deaf Studies, The Chinese University of Hong Kong – Mr Jafi YF LEE, Research Associate, Centre for Sign Linguistics and Deaf Studies, The Chinese University of Hong Kong – Dr Chris KM YIU, Senior Programme Officer, Centre for Sign Linguistics and Deaf Studies, The Chinese University of Hong Kong

Abstract

The Centre for Sign Linguistics and Deaf Studies is building a Community of Practice to support deaf and hard-of-hearing (d/hh) students pursuing tertiary education. The d/hh students face different barriers to information accessibility because of their diverse backgrounds and learning needs. Possible types of educational support including captioning & AI summaries, subtitles for videos, note-taking/stenography, wireless transmission system, sign interpretation, and other accommodations should be explored to address their respective needs. The project will lead to 1) an improved understanding of the learning needs of the d/hh students, 2) a raised awareness of the physical learning environment/hardware accommodations, 3) the development of new teaching strategies and practices, 4) the deployment of new tools and aids, and 5) the design of a support system with accommodation for in-class and course-end assessments. The project will host seminars to facilitate the dissemination of effective strategies for supporting d/hh students among members of the CoP. The ultimate goal is to recommend an effective and operable support system to EDB and UGC.

Theme: 2. Thematic Exploration

Sub-theme: 2.1 Community of Practice (CoP)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)