Poster Presentation Time: 1225-1400; 1500-1600

Venue: F1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Ka Yee Shirley CHAN, Lecturer, Centre for Language in Education, The Education University of Hong Kong

– Miss Mandy Xiao Ming YE, Research Assistant and student participant, Centre for Language in Education, The Education University of Hong Kong

Abstract

This poster-sharing session shares the outcomes collected in the first phase of a TDG project, “AI for Formative Assessment”, exploring how the Automated Speech Recognition (ASR) function in AI can possibly provide formative feedback in speaking assessments. In this phase of the project, language teachers from the Centre for Language in Education at the Education University of Hong Kong have applied the ASR function on Whatsapp, a daily social messenger platform for Hong Kong students, to provide formative feedback during a consultation session in a University speaking course: Skills for Language Test I. This project explores the effectiveness, challenges, and implications of using AI to provide formative feedback on pronouncing words and phrases.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: J4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Beatrice CHU, Head, Professional Development, Center for Education Innovation, The Hong Kong University of Science and Technology

Abstract

The “Co-Creating the Future of Education” project, a collaborative effort led by the Hong Kong University of Science and Technology (HKUST), alongside the University of Hong Kong (HKU) and Hong Kong Baptist University (HKBU), advances the Student as Partners (SaP) approach within Hong Kong’s higher education sector. This initiative aims to transform pedagogical models by embedding student engagement in the learning process. Key objectives include enhancing professional development programs, enabling faculty and staff to collaborate effectively with students, and establishing a standardized evaluation framework to measure the impact of SaP initiatives. The project also emphasizes the creation of a Community of Practice for Student Partnership, facilitating the exchange of successful strategies and supporting ongoing SaP projects. Additionally, the Student Partnership Co-Creation Program is a cornerstone objective, fostering innovative ideas and collaborative efforts between students and faculty. Progress to date includes the successful implementation of five key focus areas: organizing professional development seminars, establishing a resource hub, and initiating the Student Partnership Co-Creation Program. Notably, 20 teams from various institutions participated in this program, yielding high satisfaction rates and valuable insights. Ultimately, this project seeks to create a sustainable, collaborative ecosystem that enhances student agency, faculty development, and curriculum innovation across participating institutions.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Sean MCMINN, Director, Center for Education Innovation, The Hong Kong University of Science and Technology

Abstract

This project aims to develop a Co-Instructrional Designer platform to assist instructors in creating course materials. By leveraging Generative AI, the platform will support faculty members in designing course outlines, content, learning activities, assignments, and rubrics aligned with learning outcomes. The platform will connect to a Center for Education Innovation (CEI)-managed knowledge base containing curated pedagogies and best practices. Instructors will interact with the platform through pre-defined prompts, receiving tailored guidance that they can evaluate and adapt to meet their specific course needs. Key features of the platform include front-end interfaces for instructors and system administrators, robust technical architecture for file storage, and conversation history management. Having completed the Proof-of-Concept phase, implementation will proceed with structuring the knowledge base, developing the frontend, integrating the system, and conducting testing, with the final rollout planned for Fall 2025/26. The project will benefit approximately 750 faculty members and teaching staff at HKUST. This tool has multiple applications: it can serve as a co-designer for faculty, support quality assurance, assist with faculty development, and aid in Teaching and Learning Innovation Pedagogy and Blended Learning Projects. Success will be measured by the quality of responses in testing scenarios, training participation and satisfaction, and overall platform usage.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Yi LI, Lecturer, Centre for Language in Education, The Education University of Hong Kong

Abstract

To enhance students’ proficiency in Putonghua and facilitate their integration into the workplace and life in the Greater Bay Area, the Centre for Language in Education at The Education University of Hong Kong is undertaking a Teaching Development Grant (TDG) project for 2023-2024. This project aims to engage professionals from various industries in the Greater Bay Area to conduct interviews on topics related to “work” and “life.” The interviews are categorized into four sections: “Job Hunting,” “Workplace Communication,” “Workplace Culture,” and “Life,” comprising a total of 20 topics. To provide comprehensive learning resources, the project team has recorded video interviews with experts, accompanied by textbook explanations. These valuable resources have been uploaded to EdUHK’s online learning platform, ensuring accessibility for all students. By utilizing this platform, students can enhance their learning experience and foster their understanding of the workplace environment in the Greater Bay Area. Through this initiative, students will gain valuable insights into the practical aspects of working and living in the Great Bay Area. The project aims to equip students with the essential language skills and cultural understanding required to excel in their future careers. This TDG project is designed to create an immersive and engaging learning environment by collaborating with industry professionals and leveraging an online platform. Collaborating with industry professionals and leveraging online platforms aims to create an immersive and engaging learning environment for students, preparing them for success in the dynamic Greater Bay Area.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Mr Jac LEUNG, Lecturer, Division of Integrative Systems and Design, The Hong Kong University of Science and Technology

Abstract

This project explores the intersection of Generative AI, reflection and experiential learning, highlighting GenAI’s pivotal role in fostering deeper cognitive processes and the attainment of complex knowledge structures. In recognition of the multifaceted dimensions of reflection, we aim to examine GenAI’s role in promoting different focuses of reflection including technical reflection on efficiency of attaining goals; practical reflection on challenging assumptions and establishing identities; and critical reflection on reflecting within a broader consideration of socio-historical and political-cultural context. GenAI is widely praised for its ability to serve as agent to writing and agent to knowledge. This study explores GenAI’s potential as agent to reflect, offering a perspective transformation devoid of judgement and social bias. We adopt an action research approach to accommodate both the rapidly growing research area and state-of-the-art teaching innovations. To examine the roles of GenAI in various types of experiential learning contexts, a 3-year collaboration project consists of four local universities in Hong Kong was initiated in early 2024. Participating students are of diverse background in science, social science, engineering, business, and health profession (radiography). Reflective exercises are designed according to the course context and the type of experiences within entrepreneurship education, social innovation, and health professional training.

Theme: 1. Showcase Project Achievements

Sub-theme: Innovative Technology-in-Education

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Mr Jungjin PARK, PhD student, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technology

– Professor Larry LI, Associate Head & Associate Professor, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technolog

Abstract

Immersive technologies come in various forms and names, such as virtual reality (VR), augmented reality (AR), and recently spatial computing. While higher education has always been at the forefront of experimenting with such technologies in the classroom, the ubiquity of smartphones and tablets – capable of creating robust AR experiences – has made it possible for wider adoption in recent years. In this presentation, we highlight lessons learned from a pilot project that leveraged AR to enhance aerospace laboratory training at the Hong Kong University of Science and Technology, and how this effort is being expanded across multiple disciplines such as pulmonary physiotherapy and forensic pathology. In particular, we share our vision to combine AR and large language models (LLMs) to design truly immersive learning experiences that can be effectively deployed into classrooms. When combined, the two technologies mutually benefit and supplement their respective advantages and limitations, thereby overcoming many of the current challenges faced by educators when deploying either on their own.

Theme: 1. Showcase Project Achievements

Sub-theme:  Innovative Technology-in-Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Crystal LUO, Teaching and Learning Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Miss Pui Ying WONG, Educational Development Officer, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

The global pandemic prompted academic institutions to shift from traditional test-based assessments to alternative assessments, including methods such as self-assessments, peer evaluations, and digital technology-enhanced tasks. The effectiveness of alternative assessment hinges on students’ perceptions, which may subsequently influence their degree of engagement. This study was thus designed to investigate the relationship between students’ perceptions and their involvement in alternative assessment in a Hong Kong university. An online survey was administered to 177 students between November 2022 and February 2023, with the collected data undergoing quantitative analysis. The results show that students generally maintain moderate levels of positive perceptions and active involvement towards alternative assessments. Moreover, a statistically significant correlation was observed between their perceptions and involvement. Our findings not only provide evidence to support the relationship between students’ perceptions and their involvement in alternative assessment practices, but also provide insights into the importance of understanding the real-life applicability of such assessments, the facilitating role of technological tools, and the practical implementation of these assessments into courses.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)