Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1400-1500

Venue: Rose Room, Lower Level II

Presenter(s)

– Dr Aftab AMIN, Teaching Associate, Division of Life Science, The Hong Kong University of Science and Technology

Abstract

Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) empower educators to develop active-learning pedagogical approaches that motivate students to simultaneously engage, develop knowledge, social skills, and subject interest. To initiate VR/AR learning at the Division of Life Science (LIFS), HKUST, LIFS1904 Laboratory for General Biology II (comprising four experiments, ~300 diverse learners) was selected. In recent years, increasing enrollment has created manpower and space shortages, while post-pandemic issues have made student learning and the acquisition of resources, such as rat cadavers for teaching anatomy, physiology, and dissection more challenging. To address pressing issues, enhance active-learning, and make practical transitions fluid and cohesive, gamification is being used to develop a customizable, Virtual Reality Platform (VRP). A story-based narrative has also been implemented to create immersive, engaging, memorable and impactful pedagogy. In this presentation we will examine the deliverables of the project. Some of the findings from our student surveys, focus groups and interviews will also be shared to provide a better understanding of how technology-driven pedagogical innovations can facilitate active learning, information literacy, enhance student support, and facilitate peer-teaching, so that graduate attributes can be delivered.

Theme: 1: Showcase Project Achievements

Sub-theme: Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Sean MCMINN, Director, Center for Education Innovation, The Hong Kong University of Science and Technology

Abstract

This project aims to develop a Co-Instructrional Designer platform to assist instructors in creating course materials. By leveraging Generative AI, the platform will support faculty members in designing course outlines, content, learning activities, assignments, and rubrics aligned with learning outcomes. The platform will connect to a Center for Education Innovation (CEI)-managed knowledge base containing curated pedagogies and best practices. Instructors will interact with the platform through pre-defined prompts, receiving tailored guidance that they can evaluate and adapt to meet their specific course needs. Key features of the platform include front-end interfaces for instructors and system administrators, robust technical architecture for file storage, and conversation history management. Having completed the Proof-of-Concept phase, implementation will proceed with structuring the knowledge base, developing the frontend, integrating the system, and conducting testing, with the final rollout planned for Fall 2025/26. The project will benefit approximately 750 faculty members and teaching staff at HKUST. This tool has multiple applications: it can serve as a co-designer for faculty, support quality assurance, assist with faculty development, and aid in Teaching and Learning Innovation Pedagogy and Blended Learning Projects. Success will be measured by the quality of responses in testing scenarios, training participation and satisfaction, and overall platform usage.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: H4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Isaac Ka Chun WAN, Instructional Designer, Centre for Education Innovation, The Hong Kong University of Science and Technology

Abstract

The use of videos in asynchronous learning significantly enhances the educational experience, especially for intricate or abstract concepts. Videos allow students to adapt their learning pace, fostering a more flexible and personalized process. However, traditional video lectures often promote passive learning, making it hard for instructors to monitor students’ progress effectively. To address these challenges and help instructors create an interactive video-based learning environment, a strategic workflow has been developed. This workflow incorporates two customized digital tools that facilitate the creation of engaging video elements and provide detailed analytics on student engagement and progress. As a result, students are empowered in their asynchronous learning journey.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Kin Yat LIU, Lecturer, Statistics, The Chinese University of Hong Kong

Abstract

“Correlation does not imply causation” is an important concept that is included in almost all introductory statistics courses. Comprehending this concept is crucial for students to grasp advanced statistical concepts like multivariate analysis, Simpson’s paradox, and causal inference. However, the intricacies of this principle are often not explored in depth. To address this, we employ simulated experiences and the use of Monte Carlo simulation to provide students with an understanding of the significance and fundamental nature of the idea that “correlation does not imply causation.”

Theme: 1. Showcase Project Achievements

Sub-theme: 1.4  Other UGC grants, Quality Education Fund (QEF), and Quality Enhancement Support Scheme (QESS)

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Mr Jac LEUNG, Lecturer, Division of Integrative Systems and Design, The Hong Kong University of Science and Technology

Abstract

This project explores the intersection of Generative AI, reflection and experiential learning, highlighting GenAI’s pivotal role in fostering deeper cognitive processes and the attainment of complex knowledge structures. In recognition of the multifaceted dimensions of reflection, we aim to examine GenAI’s role in promoting different focuses of reflection including technical reflection on efficiency of attaining goals; practical reflection on challenging assumptions and establishing identities; and critical reflection on reflecting within a broader consideration of socio-historical and political-cultural context. GenAI is widely praised for its ability to serve as agent to writing and agent to knowledge. This study explores GenAI’s potential as agent to reflect, offering a perspective transformation devoid of judgement and social bias. We adopt an action research approach to accommodate both the rapidly growing research area and state-of-the-art teaching innovations. To examine the roles of GenAI in various types of experiential learning contexts, a 3-year collaboration project consists of four local universities in Hong Kong was initiated in early 2024. Participating students are of diverse background in science, social science, engineering, business, and health profession (radiography). Reflective exercises are designed according to the course context and the type of experiences within entrepreneurship education, social innovation, and health professional training.

Theme: 1. Showcase Project Achievements

Sub-theme: Innovative Technology-in-Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: L5, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Janet Ching Man TSE, Assistant Programme Administrator, School of Continuing and Professional Studies, The Chinese University of Hong Kong

Abstract

InternVision envisages to be an ingenious and resourceful Virtual Reality (VR) platform with interactive contents of real-life workplace simulations for enhancing practical skills and professional related concepts, reaction and decision making at a multitude of careers. Encompassing a series of VR simulations, the dual platforms of InternVision – a VR Head-Mounted Display System and a Mobile Application (app), will host internship scenarios for preparing and fostering the readiness of students of CUSCS full-time programmes at their future workplace. By integrating with the use of VR technology, InternVision enables students to gain exposure and understanding from an immersive environment where an array of tasks are assigned in each virtual simulation. Students can gain confidence and familiarity with a ‘re-try’ opportunity for self-reflection and get further improvement before the commencement of actual internship and future career. Appending with its mobile app, InternVision allows greater flexibility, convenience and user-friendliness for students of different disciplines to maneuver the VR simulations freely without time limit, to develop a deeper understanding of their roles related to their own profession and to achieve the intended learning outcomes. Self-learning materials and guidelines will also supplement the platform to support their internship training and experiential learning, especially at the recurrent waves of pandemic when internship arrangement may be affected. This presentation endeavours to share ideas on how InternVision can blend in and enrich internship preparation with a sample illustration and how it can enhance experience exchange by connecting students with internship supervisors and peer groups via technologies.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.4  Other UGC grants, Quality Education Fund (QEF), and Quality Enhancement Support Scheme (QESS)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: L4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Kevin CHEUNG, Assistant Head of Academic Programmes (Full-time), School of Continuing and Professional Studies, The Chinese University of Hong Kong

Abstract

The iLearn English mobile application, developed by School of Continuing and Professional Studies, The Chinese University of Hong Kong (CUSCS) with QESS funding, is a sustainable mobile-assisted language learning (MALL) platform designed to enhance English proficiency among learners. Addressing the need for dynamic and engaging language learning tools, iLearn English incorporates daily reading, vocabulary, grammar exercises, and extended reading experiences to foster self-directed learning and sustain learner engagement. Research on student preferences and educational trends underscores a growing appetite for technology-enhanced learning. iLearn English meets this need by offering a personalised, accessible and multi-modal learning environment. Since its launch in February 2020, the app has logged over 10,000 users, affirming its success in enriching English language proficiency. The app has significantly improved learning experiences, fostering self-learning habits among users. Nearly 90% of students surveyed report satisfaction, noting enhanced language skills and increased motivation. iLearn English exemplifies a sustainable language education model through its diversity, flexibility, autonomy and connectedness. Moreover, it supports environmental sustainability by promoting technology integration in education. This initiative highlights the transformative potential of mobile applications in delivering accessible and efficient language learning solutions.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.4  Other UGC grants, Quality Education Fund (QEF), and Quality Enhancement Support Scheme (QESS)

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Mr Jungjin PARK, PhD student, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technology

– Professor Larry LI, Associate Head & Associate Professor, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technolog

Abstract

Immersive technologies come in various forms and names, such as virtual reality (VR), augmented reality (AR), and recently spatial computing. While higher education has always been at the forefront of experimenting with such technologies in the classroom, the ubiquity of smartphones and tablets – capable of creating robust AR experiences – has made it possible for wider adoption in recent years. In this presentation, we highlight lessons learned from a pilot project that leveraged AR to enhance aerospace laboratory training at the Hong Kong University of Science and Technology, and how this effort is being expanded across multiple disciplines such as pulmonary physiotherapy and forensic pathology. In particular, we share our vision to combine AR and large language models (LLMs) to design truly immersive learning experiences that can be effectively deployed into classrooms. When combined, the two technologies mutually benefit and supplement their respective advantages and limitations, thereby overcoming many of the current challenges faced by educators when deploying either on their own.

Theme: 1. Showcase Project Achievements

Sub-theme:  Innovative Technology-in-Education

Oral Presentation Time: 1400-1500

Venue: Peony Room, Lower Level II

Presenter(s)

– Ms Carrie Ka Yee CHENG, Head of Academic Programmes (Full-time), School of Continuing and Professional Studies, The Chinese University of Hong Kong

Abstract

Encompassing 20 Virtual Reality (VR) simulations across 15 academic disciplines for pre-internship training, InternVision – a dual platform of a VR head-mounted display system and a mobile application (app), is developed and launched for enhancing the work-readiness of all full-time students at School of Continuing and Professional Studies, The Chinese University of Hong Kong (CUSCS). InternVision envisages to be an ingenious and resourceful platform with interactive contents of real-life workplace scenarios for elevating job competency, enhancing professional related concepts, reactions and decision making at internships, and thus formulating an insightful immersive experience for empowering learners to a multitude of careers. This oral presentation endeavours to share ideas and success factors on how InternVision is designed, constituted and operated in line with our expected high effectiveness and promising satisfaction. Via seamlessly integrating technologies at the VR system and appending with its user-friendly mobile app, InternVision brings forth greater flexibility, confidence and motivation for students to gear up for their internships and maneuver their learning more freely beyond time and location constraints. By visualising the simulations, a deeper understanding of their roles regarding their own profession can be yielded for further self-reflection, and hence achieving the intended learning outcomes. InternVision can be framed as a comprehensive and impactful solution for enhancing internship preparation and consolidating student success for a world of future profession.

Theme: 1. Showcase Project Achievements

Sub-theme: Quality Education Fund (QEF), and Quality Enhancement Support Scheme (QESS)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Professor Apple Pui Yi CHUI, Research Assistant Professor, School of Life Sciences, The Chinese University of Hong Kong

Abstract

Coral reef restoration is a rapidly growing public engagement by many marine scientists, citizen scientists, NGOs and the public worldwide prompted by the accelerating degradation of global coral reefs along with the associated losses in the key ecosystem services. The Coral Academy at The Chinese University of Hong Kong is a scientific research team led by Dr. Apple Chui, which aims to explore interventions to enhance coral resilience and develop effective coral restoration techniques in Hong Kong. Leveraging this knowledge and unique expertise, the Academy also dedicates efforts to environmental education programmes that cultivate ocean literacy among local communities. The Academy’s flagship programme, the School Coral Nursery Education Programme, is a hands-on stewardship initiative that engages students in coral restoration activities, connecting them to the conservation of these marine ecosystems. Additionally, the Academy organizes a range of engaging learning experiences aimed at increasing participants’ knowledge and awareness, empowering them to take actions in support of coral conservation. These efforts also foster partnerships between academia, government, and non-governmental organizations in Hong Kong. This poster will highlight examples of the experiential learning methods adopted by the Academy to promote ocean literacy and public stewardship for local coral conservation.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.4  Other UGC grants, Quality Education Fund (QEF), and Quality Enhancement Support Scheme (QESS)