Poster Presentation Time: 1225-1400; 1500-1600

Venue: I1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Selena YAN, Senior E-learning Assistant, Li Ka Shing Faculty of Medicine, The University of Hong Kong

– Ms Leah LI, Senior E-learning Assistant, School of Clinical Medicine, The University of Hong Kong

Abstract

Generative Artificial Intelligence (GenAI) is a transformative technology that fosters creativity, problem-solving, and critical thinking skills in various industries, including healthcare and medical education. At HKU Medicine, we appreciate the importance of advancing GenAI literacy and propose to develop and deliver a new online course that covers the latest advances, pitfalls, ethical and professional aspects of GenAI. We aim to advance AI and digital competency for all students, professoriates and clinicians at HKU Medicine and the Hong Kong medical community. To evaluate the effectiveness of this online GenAI literacy course, an assessment study will be conducted. We will use a mixed methods approach to collect both quantitative and qualitative data through pre- and post- surveys, individual interviews and practical exercises. The survey will be adapted from the “Scale for the Assessment of Non-Experts’ AI Literacy” (SNAIL), while the interviews will provide additional context and insights into participants’ experiences and challenges with GenAI. Practical exercises will provide objective data for evaluation. Target participants will be recruited through convenience sampling, and data analysis will include both statistical and thematic analyses. The study has already obtained ethical approval. Results from this study will be used to identify improvement needs for the online course and inform the integration of GenAI in medical and health sciences education and clinical practices. Overall, the project will contribute to the advancement of GenAI literacy in medical education and healthcare professions, supporting the ethical and effective application of GenAI technology in these fields.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: F1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Ka Yee Shirley CHAN, Lecturer, Centre for Language in Education, The Education University of Hong Kong

– Miss Mandy Xiao Ming YE, Research Assistant and student participant, Centre for Language in Education, The Education University of Hong Kong

Abstract

This poster-sharing session shares the outcomes collected in the first phase of a TDG project, “AI for Formative Assessment”, exploring how the Automated Speech Recognition (ASR) function in AI can possibly provide formative feedback in speaking assessments. In this phase of the project, language teachers from the Centre for Language in Education at the Education University of Hong Kong have applied the ASR function on Whatsapp, a daily social messenger platform for Hong Kong students, to provide formative feedback during a consultation session in a University speaking course: Skills for Language Test I. This project explores the effectiveness, challenges, and implications of using AI to provide formative feedback on pronouncing words and phrases.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: F4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Chun Hoi CHEUNG, Assistant Professor of Practice, School of Chinese Medicine, Hong Kong Baptist University

– Miss Hoi Yan FONG, Hong Kong Baptist University

– Miss Judith WONG, Hong Kong Baptist University

– Mr Conrad Kwan Ho CHAN, Hong Kong Baptist University

– Mr Shu Kin FONG, Hong Kong Baptist University

Abstract

Background: Led by Hong Kong Baptist University in collaboration with the University of Hong Kong, the project initiated the first-of-its-kind non-conventional simulation practicum in a realistic setting using Virtual Reality(VR) technology. Aim: The aim is to enhance students’ first-hand experiences with TCM diagnosis and consultations, thereby optimize the effectiveness of service-learning and equip students with necessary attributes such as self-learning ability and communication skills as future practitioners. Method The project encompassed (1)scriptwriting for VR development, (2)VR application with debriefing sessions held to explain the rationales of diseases and relevant physical examinations(PE) to students, and (3)skills contribution in service-learning. Numerical data was obtained through pre and post VR survey for analysis. The statistical test used was Wilcoxon signed-rank test, a paired difference test for comparing the pre-post scores of two matched samples. Post-VR focus group interviews were conducted to collect students’ views on the pros and cons of VR. Evaluation results Quantitatively, 51students completed the VR activity and responded the pre and post VR survey. Under 10-mark scoring scale with 10 as the largest extent, students’ self-evaluation on professional knowledge improved significantly. The medians of the mastery of diagnostic criteria, typical symptoms and physical examinations all increased from 6 to 7 with p<0.001. Students’ self-learning ability, understanding towards consultation procedures, technique in verbal consultation and skills in communicating with patients elevated from 6 to 7 in median, with p-values of 0.009,<0.001,<0.001 and p<0.05 respectively. Qualitatively, students mentioned in focus group that they got insights on the choices of physical examinations to be done in service-learning through VR. Yet, some students reported dizziness and nausea caused by VR headsets as the main barrier of the project, making it inapplicable to all students. Conclusion: This innovative approach is proven to improve clinical knowledge, foster self-learning ability, and develop generic attributes of students.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: J2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Benjamin MOORHOUSE, Assistant Professor, Department of Education Studies, Hong Kong Baptist University

Abstract

The public release of ChatGPT sent shock waves through the education community. Since then, many generative AI (GenAI) tools that perform various human tasks have been launched. It is essential that higher education institutions are at the forefront of preparing graduates for the productive and responsible use of these tools. To make this a reality, instructors, as models of practice, must have the skills and knowledge to use GenAI tools. They need to understand how AI works (technological proficiency); they need to consider the ethical issues of the tools (critical and ethical awareness); they need the pedagogical awareness of how and when to use them (pedagogical capability); and they need prepare their students to use them. These skills can be considered ‘Professional Generative AI competence’ (P-GenAI-C). The Inter-institutional Collaborative Activities for Fund for Innovative Technology-in Education project presented in this poster aims to: (1) Identify the P-GenAI-C in different university subject disciplines; (2) Contextualize the P-GenAI-C within each universities’ policies and guidelines; (3) Develop training and continuous support for university instructors, and (4) Develop a developmental framework and reflective tool for evaluating P-GenAI-C. The first aim and discussion of the actualization of the remaining aims are presented.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1400-1500
Poster Presentation Time: 1225-1400;1500-1600

Oral Presentation Venue: Rose Room, Lower Level II
Poster Presentation Venue: H1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ir Dr H H CHEUNG, Senior Lecturer, Department of Industrial and Manufacturing Systems Engineering, The University of Hong Kong

– Mr Derek TONG, Tutor, Department of Industrial and Manufacturing Systems Engineering, The University of Hong Kong

– Mr Like WEN, Research Assistant, Department of Industrial and Manufacturing Systems Engineering, The University of Hong Kong

Abstract

The past social events and COVID-19 pandemic posed huge challenges to teaching and learning. The teaching team seized these challenges as opportunities to develop and incorporate e-learning in experiential projects and capstone courses, which otherwise mandate intensive face-to-face interactions. The team has developed the Digital Design House – An e-learning platform for collaborative product development – to facilitate experiential learning and hands-on projects in various courses that carry substantial components of innovative product design and development. The Digital Design House is a cloud-based experiential e-learning platform that provides remote access to CAD facilities for students to interact among group members and with teachers in virtual environments to share their ideas for product design and development. This e-learning platform integrates a set of advanced information and computing, 3D Hologram devices, virtual reality, mixed reality, and mobile devices with a suite of in-house developed applications for stereoscopic visualisation of virtual objects in an immersive virtual environment to facilitate systematic training and development of students’ innovative abilities through experiential learning. It not only allows students at different geographical regions and teachers to ubiquitously conduct teaching and learning, but also facilitates online lectures via video conferencing like Zoom or Microsoft Teams with more interactions in a virtually face-to-face environment. Indeed, this platform helps students understand what and how various knowledge and feasible technologies can be effectively integrated to create a feasible design/solution in a practical-and-innovative approach. As such, students are inspired with a stronger desire, self-initiative, and enthusiasm for exploring their potential in innovative creations.

Theme: 1. Showcase Project Achievements

Sub-theme: Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Yi LI, Lecturer, Centre for Language in Education, The Education University of Hong Kong

Abstract

To enhance students’ proficiency in Putonghua and facilitate their integration into the workplace and life in the Greater Bay Area, the Centre for Language in Education at The Education University of Hong Kong is undertaking a Teaching Development Grant (TDG) project for 2023-2024. This project aims to engage professionals from various industries in the Greater Bay Area to conduct interviews on topics related to “work” and “life.” The interviews are categorized into four sections: “Job Hunting,” “Workplace Communication,” “Workplace Culture,” and “Life,” comprising a total of 20 topics. To provide comprehensive learning resources, the project team has recorded video interviews with experts, accompanied by textbook explanations. These valuable resources have been uploaded to EdUHK’s online learning platform, ensuring accessibility for all students. By utilizing this platform, students can enhance their learning experience and foster their understanding of the workplace environment in the Greater Bay Area. Through this initiative, students will gain valuable insights into the practical aspects of working and living in the Great Bay Area. The project aims to equip students with the essential language skills and cultural understanding required to excel in their future careers. This TDG project is designed to create an immersive and engaging learning environment by collaborating with industry professionals and leveraging an online platform. Collaborating with industry professionals and leveraging online platforms aims to create an immersive and engaging learning environment for students, preparing them for success in the dynamic Greater Bay Area.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1220-1400; 1500-1600

Venue: J3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Ryan MAN, Associate Dean (Undergraduate Studies), School of Business, Hong Kong Baptist University

Abstract

The Fund for Innovative Technology-in-Education (FITE) has catalyzed a transformative initiative within our School to future-proof business education. Our approach is three-pronged, with a focus on curriculum development, personalized e-learning, and pedagogical innovation. In anticipation of the 2024/25 academic year, a dedicated programme review team has been tasked with integrating AI across the BBA curriculum, introducing new core courses such as Business Coding, AI for Business, and AI Ethics and Governance. This integration extends to embedding AI applications into functional areas like marketing human resources management and finance. Besides, we have instituted a personalized e-learning graduation requirement, leveraging Industries 4.0 principles of IoT and AI in MOOCs, particularly LinkedIn Learning, to enhance engagement and digital literacy. Our metrics indicate promising uptake and substantial engagement in technology courses, underscoring the relevance of data analytics and AI in contemporary education. Supporting our pedagogical shift, the FITE-backed Fostering AI-Incorporated Learning team is pioneering AI and blended learning integration to elevate teaching quality. Our experimental initiatives range from incorporating Generative AI into Business Analytics education and piloting AI in HR teaching. These efforts signify our commitment to driving pedagogical transformation and curriculum innovation, preparing students for the evolving demands of the digital economy.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1400-1500
Poster Presentation Time: 1225-1400; 1500-1600

Oral Presentation Venue: Fanling Room, Lower Level I
Poster Presentation Venue: I2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Ting Leung Albert LEE, Lecturer, Department of Electrical and Electronic Engineering, The University of Hong Kong

– Dr Victor LEE, Lecturer, Department of Electrical and Electronic Engineering, The University of Hong Kong

– Dr Zhengyuan WEI, Research Associate, Department of Electrical and Electronic Engineering, The University of Hong Kong

– Mr Alex KIANG, The University of Hong Kong

Abstract

Retrieval-augmented generation (RAG) has been demonstrated to be highly effective in generative AI applications, resulting in substantial improvement in accuracy and reliability of large language model responses. The success of this approach is accomplished through seamless integration of AI capabilities and practical knowledge base, which fosters an interactive learning mechanism conducive to automatic question-answering augmented with references and refined prompts, leading to a more vibrant and connected learning environment. Communication portals enable effective inquiry and prompt responses while the course-specific chatbot helps reduce teachers’ workload and streamline classroom management. In this project, the RAG approach is applied to a discipline-core course named Integrated Design Project (IDP) in the second semester 2023-24. This project-based course consists of 78 EEE undergraduate students with diverse programming experience. The IDP-specific AI chatbot is developed using the Coze platform with a Discord server. To name a few, the main contents of practical knowledge base include the procedures for setting up a Raspberry Pi webcam, the installation process of Jetson Inference library on Jetson Nano, how to use YOLO model for object detection, how to install Jetson inference library on Jetson Nano, etc. The anonymous feedback survey conducted at the end of the course shows high utilization and satisfaction of the chatbot, confirming the effectiveness of this approach in facilitating students’ learning.

Theme: 1. Showcase Project Achievements

Sub-theme: Innovative Technology-in-Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: G3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Professor Fraide A. Jr GANOTICE, Assistant Professor, Bau Institute of Medical and Health Sciences Education, Li Ka Shing Faculty of Medicine, The University of Hong Kong

Abstract

Disciplinary silos often perpetuate hierarchical relationships and competition, creating a significant barrier to teamwork and collaboration in healthcare. Students who are exclusively trained within the confines of their discipline and university miss out on opportunities to develop the interprofessional competencies necessary for managing complex medical conditions of patients. Therefore, cross-institutional interprofessional education is crucial to promote the sharing of expertise among professionals from different universities and to prepare students for clinical practice. This presentation will highlight the significant achievements of the project titled “Promoting cross-institutional collaboration through interprofessional education: Forging alliances in healthcare education.” Initiated by the University of Hong Kong (HKU) in partnership with the Hong Kong Polytechnic University (PolyU), this innovative project aims to break down educational silos and foster interprofessional competencies among healthcare students. The project’s core objective is to enhance patient-centered care by developing and implementing a model of interprofessional education that integrates various healthcare disciplines. Throughout the four phases of the project—Program Development, Pilot Testing, Actual Implementation, and Evaluation and Dissemination—numerous achievements have been documented. These include the successful integration of interprofessional education into the curricula, enhanced collaborative competencies among students. The project also pioneered the development of an evidence-based cross-institutional IPE Model, setting a benchmark for future educational endeavors in the healthcare sector. This presentation will delve into the methodologies employed, the collaborative initiatives between HKU and PolyU, and the positive impact on healthcare education highlighted by reduced medical errors and improved healthcare outcomes. By showcasing these achievements, the session aims to inspire continued progress in interprofessional education and collaboration across healthcare institutions globally.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Crystal LUO, Teaching and Learning Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Miss Pui Ying WONG, Educational Development Officer, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

The global pandemic prompted academic institutions to shift from traditional test-based assessments to alternative assessments, including methods such as self-assessments, peer evaluations, and digital technology-enhanced tasks. The effectiveness of alternative assessment hinges on students’ perceptions, which may subsequently influence their degree of engagement. This study was thus designed to investigate the relationship between students’ perceptions and their involvement in alternative assessment in a Hong Kong university. An online survey was administered to 177 students between November 2022 and February 2023, with the collected data undergoing quantitative analysis. The results show that students generally maintain moderate levels of positive perceptions and active involvement towards alternative assessments. Moreover, a statistically significant correlation was observed between their perceptions and involvement. Our findings not only provide evidence to support the relationship between students’ perceptions and their involvement in alternative assessment practices, but also provide insights into the importance of understanding the real-life applicability of such assessments, the facilitating role of technological tools, and the practical implementation of these assessments into courses.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: H3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Henry Tsz Yeung FUNG, Lecturer cum Programme Director of ORGC Concentration, Communication Studies, Hong Kong Baptist University

Abstract

The outbreak of the COVID-19 pandemic had a profound impact on university students’ learning, necessitating a sudden shift from face-to-face learning to virtual learning. This sudden shift disrupted student-teacher interactions and cut off access to vital resources like libraries and media labs, leaving students scrambling in an unfamiliar digital landscape. Recognizing the need for accessible learning tools in these uncertain times, this study centres on the curation of a digital video archive featuring exemplary student works to facilitate peer-to-peer learning in the context of the COVID-19 pandemic. Fifty high-achieving students majoring in communication were invited to discuss their learning experiences and the processes involved in creating distinct class projects. These interviews were then turned into thirty short peer-learning videos and stored in a digital archive. The archive was advertised to over 200 students via mass email, in-class promotions, and school web pages during the Fall 2022 and Spring 2023 semesters. To gain a better understanding of student engagement with the digital archive as a means of active learning and knowledge construction, three focus group interviews were conducted. Findings reveal that the archive positively impacts student learning by providing an accessible, flexible platform for understanding course materials outside of the traditional classroom setting. This is particularly useful during the add/drop period when students want to learn more about the course before enrolment. Additionally, the peer advice and work samples shared in the videos provide a grounded perspective on instructor expectations, hence enabling students to produce higher-quality work.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)