Poster Presentation Time: 1225-1400; 1500-1600

Venue: F1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Ka Yee Shirley CHAN, Lecturer, Centre for Language in Education, The Education University of Hong Kong

– Miss Mandy Xiao Ming YE, Research Assistant and student participant, Centre for Language in Education, The Education University of Hong Kong

Abstract

This poster-sharing session shares the outcomes collected in the first phase of a TDG project, “AI for Formative Assessment”, exploring how the Automated Speech Recognition (ASR) function in AI can possibly provide formative feedback in speaking assessments. In this phase of the project, language teachers from the Centre for Language in Education at the Education University of Hong Kong have applied the ASR function on Whatsapp, a daily social messenger platform for Hong Kong students, to provide formative feedback during a consultation session in a University speaking course: Skills for Language Test I. This project explores the effectiveness, challenges, and implications of using AI to provide formative feedback on pronouncing words and phrases.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: F2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Professor Paul Lai Chuen LAM, Associate Professor, Centre for Learning Enhancement And Research, The Chinese University of Hong Kong

– Mr Wikie Wai Kei CHAN, Research Coordinator, Centre for Learning Enhancement And Research, The Chinese University of Hong Kong

– Miss Ka Yan LAU, Research Assistant, Centre for Learning Enhancement And Research, The Chinese University of Hong Kong

Abstract

Artificial Intelligence (AI) is rapidly transforming the educational landscape, presenting both opportunities and challenges for educators. This poster presentation showcases the work of two UGC-funded projects: “AI in Education” and “Generative AI for Teaching and Education (GATE).” These initiatives aim to bridge the gap between AI technologies and educators. By familiarizing educators with AI applications, empowering them with research insights, and providing professional development opportunities, these projects enable teachers to harness the power of AI as a tool for enhancing teaching and learning experiences. The presentation highlights the journey of supporting teachers in exploring, understanding, and applying AI in their own teaching contexts and calls for active participation in the broader AI community.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: H2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Pauli LAI, Lecturer, Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University

– Dr Julia CHEN, Director, Educational Development Centre, The Hong Kong Polytechnic University

Abstract

A common assessment in university is the oral presentation, and students are often required to deliver presentations in English. Two challenges arise. First, many students mainly focus on the discipline content in the assessment preparation process rather than the communication or use of English in their presentations. Second, lecturers of large classes (e.g. around 200 engineering students in one course) hardly have time to give feedback to each student on the English communication aspect of their oral presentations. A baseline survey reveals students’ need for assistance with presentation skills and a hope for having AI-generated feedback among both students and discipline teachers. To address these needs and hope, a team of educators from PolyU and BU with expertise in language and AI technology collaboratively developed an online English oral presentation platform called SmartPresenter. SmartPresenter provides students with presentation tips, learning materials, and extensive AI-generated feedback on the communication-related aspects of delivering oral presentations in English, including eye contact, facial expressions, vocal fillers, pronunciation, and fluency. This presentation describes the development and features of SmartPresenter, and the evaluation results of the effectiveness of the platform in facilitating independent learning practices for English oral presentations and assisting teachers in grading presentation assessment.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: G2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Florence Mei Kuen TANG, Lecturer, Division of Education, School of Biomedical Sciences, The Chinese University of Hong Kong

– Dr Charis Yuk Man LI, Lecturer, School of Life Sciences, The Chinese University of Hong Kong

– Mr Kenneth Chung Hin LAI, Centre for eLearning Innovation and Technology, The Chinese University of Hong Kong

Abstract

The metaverse offers unique attributes that differentiate it from other educational tools, particularly its “Interactivity, Corporeality, and Permanence” within an immersive unreal space. Active learning, a dynamic educational approach, encourages students to engage in learning rather than passively receiving information. We aim to harness the metaverse concept to create interior architectural design virtual spaces where learners can interact in real-time, computer-generated environments. Methods and Results Our team is currently developing innovative Metaverse Learning Environments (MetaL). Since early 2023, we have transitioned health-related tertiary education to active metaverse-based pedagogy for teaching and learning activities. This approach includes in-class teaching, flipped classes, after-class learning, virtual hands-on practice, and AI tutoring. A preliminary observational study of in-class activities reveals that teachers can reinforce knowledge delivery while students enhance their learning through positive class interactions. Discussion and Conclusion The MetaL showcases the importance of leveraging technology to revolutionize traditional learning environments. Such transformation boosts students’ confidence in self-directed learning, communication skills, collaborative learning, problem-solving, innovation, critical reflection, and proficiency in professional training, but with challenges. Take Home Message In the future, the rapid advancements in online-based communication and generative AI technologies will transform the academic landscape, contributing to metaverse digital learning resources. Additionally, interior architecture and design are critical for students to experience psychological and emotional relaxation when engaging in virtual learning environments for ethical interaction.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: L6, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Professor Gladys Wai Lan TANG, Centre Director, Centre for Sign Linguistics and Deaf Studies, The Chinese University of Hong Kong – Mr Jafi YF LEE, Research Associate, Centre for Sign Linguistics and Deaf Studies, The Chinese University of Hong Kong – Dr Chris KM YIU, Senior Programme Officer, Centre for Sign Linguistics and Deaf Studies, The Chinese University of Hong Kong

Abstract

The Centre for Sign Linguistics and Deaf Studies is building a Community of Practice to support deaf and hard-of-hearing (d/hh) students pursuing tertiary education. The d/hh students face different barriers to information accessibility because of their diverse backgrounds and learning needs. Possible types of educational support including captioning & AI summaries, subtitles for videos, note-taking/stenography, wireless transmission system, sign interpretation, and other accommodations should be explored to address their respective needs. The project will lead to 1) an improved understanding of the learning needs of the d/hh students, 2) a raised awareness of the physical learning environment/hardware accommodations, 3) the development of new teaching strategies and practices, 4) the deployment of new tools and aids, and 5) the design of a support system with accommodation for in-class and course-end assessments. The project will host seminars to facilitate the dissemination of effective strategies for supporting d/hh students among members of the CoP. The ultimate goal is to recommend an effective and operable support system to EDB and UGC.

Theme: 2. Thematic Exploration

Sub-theme: 2.1 Community of Practice (CoP)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: C4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr John Alexander WRIGHT, Senior Lecturer, Department of Statistics, The Chinese University of Hong Kong

– Dr Kin Chi WONG, Research Associate, Centre for Learning Enhancement and Research, Centre for Learning Enhancement and Research, The Chinese University of Hong Kong

– Ms Irene Yuet Shan LEUNG, Research Assistant, Centre for Learning Enhancement and Research, Centre for Learning Enhancement and Research, The Chinese University of Hong Kong

Abstract

The project involves having research postgraduates in statistics (Stat RPgs) teach statistical methods to research postgraduates without a statistical background to support their research studies. During their training, they view our in-house developed videos. These videos include the learning challenges faced by students without a background in statistics. The videos also provide tips for effective statistics teaching, interviews with students without a statistics background, as well as shared experiences from previous Stat RPgs. After this, the RPgs finalize a teaching plan, prepare pre-workshop videos, and ultimately deliver two sections of a 3-hour in-person, hands-on workshop on a specific statistical method. The main challenge to the project’s success is formulating effective training strategies to align Stat RPgs’ expectations with those of students who lack a statistics background. Based on feedback from workshop participants and Stat RPgs, we recommend a bespoke approach to the training. This approach prioritizes learning from personal and shared experiences, as opposed to solely focusing on hard facts, theory, and data. The training includes observing the instant reactions of non-background students to math notations and basic statistics concepts, reviewing past experiences of Stat RPgs, observing how professors conduct workshops for students without a statistics background, facilitating discussions between Stat RPgs and instructors about draft teaching materials, and reflecting on teaching experiences after hands-on workshops. These activities prompt Stat RPgs to adapt their teaching methods to better accommodate students without a statistics background. Stat RPgs have discovered that modifying their teaching styles to suit the students’ needs is more effective than attempting to change the students. We discovered that our training program even enhances the teaching of Stat RPgs for statistics major students. This suggests the potential to develop sustainable, in-house training modules for teaching assistants within the department.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Yi LI, Lecturer, Centre for Language in Education, The Education University of Hong Kong

Abstract

To enhance students’ proficiency in Putonghua and facilitate their integration into the workplace and life in the Greater Bay Area, the Centre for Language in Education at The Education University of Hong Kong is undertaking a Teaching Development Grant (TDG) project for 2023-2024. This project aims to engage professionals from various industries in the Greater Bay Area to conduct interviews on topics related to “work” and “life.” The interviews are categorized into four sections: “Job Hunting,” “Workplace Communication,” “Workplace Culture,” and “Life,” comprising a total of 20 topics. To provide comprehensive learning resources, the project team has recorded video interviews with experts, accompanied by textbook explanations. These valuable resources have been uploaded to EdUHK’s online learning platform, ensuring accessibility for all students. By utilizing this platform, students can enhance their learning experience and foster their understanding of the workplace environment in the Greater Bay Area. Through this initiative, students will gain valuable insights into the practical aspects of working and living in the Great Bay Area. The project aims to equip students with the essential language skills and cultural understanding required to excel in their future careers. This TDG project is designed to create an immersive and engaging learning environment by collaborating with industry professionals and leveraging an online platform. Collaborating with industry professionals and leveraging online platforms aims to create an immersive and engaging learning environment for students, preparing them for success in the dynamic Greater Bay Area.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: F3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Professor Paul Lai Chuen LAM, Associate Professor, Centre for Learning Enhancement And Research, The Chinese University of Hong Kong

Abstract

This poster presentation illustrates how a teaching and learning community of practice (T&L CoP) is leveraged as a platform to bring together knowledge workers across The Chinese University of Hong Kong. The T&L CoP explores a variety of teaching and learning topics, ranging from the application of innovative technologies, curriculum, student engagement, pedagogy, and pedagogic research. In particular, the T&L CoP is versatile in two ways. First, it highlights the multifaceted nature of the community. Such overarching T&L CoP encompasses ten special interest groups (SIGs), such as artificial intelligence for education, education for social responsibility, educational research, students as partners, and service learning. Underlying most of these SIGs is a core teacher structure, meaning that teachers serve as convenors who initiate tasks and events while receiving support from the project team. Second, the T&L CoP is versatile in the sense of adaptability. Specifically, these SIGs are constantly evolving, with new groups being formed and old ones gradually phased out, following the pedagogic needs for current and future education. In this way, the T&L CoP serves as a dynamic, interconnected hub that enables the university community to collectively navigate pedagogical innovations, share insights, and elevate teaching and learning practice across disciplines.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: G1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yuk Ming TANG, Senior Lecturer, Department of Indusial and System Engineering, The Hong Kong Polytechnic University

Abstract

STEM education is essential in today’s curriculum even for university students. However, traditional classroom-based instruction methods often lack interactivity and tailored experiences that foster student engagement and comprehension. The integration of Virtual Reality (VR) and Artificial Intelligence (AI) generative chatbots has emerged as a transformative influence on the teaching and learning process. Despite this, limited research has explored the impact of advanced technology on STEM learning outcomes. This study explores the potential of employing VR and AI as tools to facilitate teaching to enhance students’ learning outcomes. 120 university students are involved in this study to examine the difference in learning outcomes by utilizing three instructional approaches for learning projectile motion: (1) a traditional didactic classroom, (2) a game-based VR metaverse, and (3) a game-based VR metaverse enriched with a generative chatbot-based pedagogical agent. The study prudently evaluated alterations in student motivation, cognitive benefit, and learning outcomes. Preliminary findings suggest that incorporating VR and AI into teaching considerably enhances student engagement and cognitive participation. This study demonstrates how the integration of VR with AI can elevate student engagement, comprehension, and skill acquisition in STEM education, paving the way for a more captivating and effective learning environment in the Edu-metaverse.

Theme: 2. Thematic Exploration

Sub-theme: 2.1 Community of Practice (CoP)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: C3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Yangzhi LI, PhD student, School of Architecture, The Chinese University of Hong Kong – Prof Adam FINGRUT, Director, Master of Architecture Programme, School of Architecture, The Chinese University of Hong Kong

Abstract

The paper presents an investigation into the integration of robotic fabrication technologies within architectural pedagogy, aiming to develop effective teaching methods and curricula tailored for a diverse group of students, including both postgraduate and undergraduate students. Robotics is an important technology in Industry 4.0, providing a wide range of capabilities in the manufacturing field. The rapid advancement of robotic arms in various industries has opened new possibilities for architectural education. Many architecture schools worldwide have established experimental laboratories equipped with robotic arms, creating opportunities for students to explore beyond the traditional scope of CNC manufacturing, however, professional courses focused on integrating robotic construction technologies into architectural education are currently scarce in the field. This research aims to explore the use of robots as an open interface for student problem-solving, geometry exploration, and programming in architectural education, catering to the students’ diverse backgrounds and skill levels. By utilizing robotic construction technologies, students can engage in hands-on experimentation, fostering the adoption of digital fabrication techniques.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: G4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Hung-lin CHI, Associate Professor, Department of Building and Real Estate, The Hong Kong Polytechnic University

– Ms Junyu CHEN, Ph.D Student, Department of Building and Real Estate, The Hong Kong Polytechnic University

– Mr Haolei LIN, Ph.D Student, Department of Building and Real Estate, The Hong Kong Polytechnic University

Abstract

KnowLearn is an interactive learning assistant system designed for architecture, engineering, and construction (AEC) education, where personalized recommendations for students in virtual learning environments remain under-explored. An educational knowledge graph (KG) was constructed to contain multifaceted information by connecting pedagogical, learning performance, and learning feedback data as sub-graphs. A heterogeneous graph attention network (HAN) was implemented to infer latent information in the educational KG and identified essential factors shaping students’ acceptance of virtual learning environments. Based on sampling data of 107 students from the Hong Kong Polytechnic University, Department of Building and Real Estate, we found students’ self-efficacy, intention to use, and in-class quiz performance were significant predictors of final learning outcomes in subjects that adopt virtual learning environments. This project further deployed a local-based large language model (LLM) Qwen-7B and built an interactive graphical user interface (GUI) with Gradio. Utilizing the information preserved in the educational KG and learned from HAN as the basis, this LLM facilitated conversations between students and KnowLearn, enhancing personalized recommendations while securing student privacy. The developed system contributed to helping improve the learning experiences and performances of AEC students within virtual learning environments.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: C1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Alex KOON, Senior Lecturer, School of Life Sciences, The Chinese University of Hong Kong

Abstract

This poster-sharing session shares the outcomes collected in the first phase of a TDG project, “AI for Formative Assessment”, exploring how the Automated Speech Recognition (ASR) function in AI can possibly provide formative feedback in speaking assessments. In this phase of the project, language teachers from the Centre for Language in Education at the Education University of Hong Kong have applied the ASR function on Whatsapp, a daily social messenger platform for Hong Kong students, to provide formative feedback during a consultation session in a University speaking course: Skills for Language Test I. This project explores the effectiveness, challenges, and implications of using AI to provide formative feedback on pronouncing words and phrases.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Crystal LUO, Teaching and Learning Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Miss Pui Ying WONG, Educational Development Officer, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

The global pandemic prompted academic institutions to shift from traditional test-based assessments to alternative assessments, including methods such as self-assessments, peer evaluations, and digital technology-enhanced tasks. The effectiveness of alternative assessment hinges on students’ perceptions, which may subsequently influence their degree of engagement. This study was thus designed to investigate the relationship between students’ perceptions and their involvement in alternative assessment in a Hong Kong university. An online survey was administered to 177 students between November 2022 and February 2023, with the collected data undergoing quantitative analysis. The results show that students generally maintain moderate levels of positive perceptions and active involvement towards alternative assessments. Moreover, a statistically significant correlation was observed between their perceptions and involvement. Our findings not only provide evidence to support the relationship between students’ perceptions and their involvement in alternative assessment practices, but also provide insights into the importance of understanding the real-life applicability of such assessments, the facilitating role of technological tools, and the practical implementation of these assessments into courses.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K1, Tai Po-Shek-O Room, Lower Level 1

Presenter(s)

– Dr Laura ZHOU, Education Development Officer, Education Development Centre, The Hong Kong Polytechnic University

– Mr Leo WONG, Project Associate, Education Development Centre, The Hong Kong Polytechnic University

Abstract

The flipped learning and teaching approach redefines the traditional classroom dynamic by swapping the order of direct instruction and homework activities. In a flipped classroom, students engage with instructional materials (such as videos, readings, or podcasts) outside of class, freeing up valuable in-class time for active learning, collaborative activities, and deeper understanding. In our quest to promote effective flipped learning and teaching practices, we conducted comprehensive interviews with experienced teaching staff at PolyU, who have successfully integrated this methodology into their course. Their valuable insights were collected and compiled into case studies, which were then disseminated to all teaching staff members through e-newsletters and experience sharing workshops. These teaching cases serve as compelling examples, showcasing the versatility and impact of flipped learning and teaching. They underscore the significance of adapting pedagogical methods to enhance student learning experiences. By shifting the locus of content consumption outside the classroom, educators empower students to actively engage with the material during face-to-face sessions, fostering a deeper understanding and more meaningful interactions.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)