Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Dr Richard Wing Cheung LUI, Senior Lecturer, Department of Computing, The Hong Kong Polytechnic University

Abstract

This presentation introduces the design and implementation of GPTutor, a Generative AI (GenAI) powered Intelligent Tutoring System (ITS) developed at the Hong Kong Polytechnic University (PolyU). GPTutor aims to enhance student learning experiences through personalised tutoring and interactive exploration. It helps students gain a deeper understanding of the course materials provided by their instructors. During the first phase of our implementation, we developed features for instructors to upload and manage their course content and to create learning scenarios based on the learning content. The system includes a conversational interface for students to ask questions and explore course content to deepen their understanding. As the answers are generated based on the instructor-uploaded content, GPTutor provides more factual responses, reduces hallucinations, and aligns better with the instructors’ intended learning outcomes (ILO). We will also share findings from our pilot study, which involved approximately 200 undergraduate and postgraduate students at PolyU. Finally, we will discuss our future plans for further development and enhancement of the platform.

Theme: 1. Showcase Project Achievements

Sub-theme: Innovative Technology-in-Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: F1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Ka Yee Shirley CHAN, Lecturer, Centre for Language in Education, The Education University of Hong Kong

– Miss Mandy Xiao Ming YE, Research Assistant and student participant, Centre for Language in Education, The Education University of Hong Kong

Abstract

This poster-sharing session shares the outcomes collected in the first phase of a TDG project, “AI for Formative Assessment”, exploring how the Automated Speech Recognition (ASR) function in AI can possibly provide formative feedback in speaking assessments. In this phase of the project, language teachers from the Centre for Language in Education at the Education University of Hong Kong have applied the ASR function on Whatsapp, a daily social messenger platform for Hong Kong students, to provide formative feedback during a consultation session in a University speaking course: Skills for Language Test I. This project explores the effectiveness, challenges, and implications of using AI to provide formative feedback on pronouncing words and phrases.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: H2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Pauli LAI, Lecturer, Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University

– Dr Julia CHEN, Director, Educational Development Centre, The Hong Kong Polytechnic University

Abstract

A common assessment in university is the oral presentation, and students are often required to deliver presentations in English. Two challenges arise. First, many students mainly focus on the discipline content in the assessment preparation process rather than the communication or use of English in their presentations. Second, lecturers of large classes (e.g. around 200 engineering students in one course) hardly have time to give feedback to each student on the English communication aspect of their oral presentations. A baseline survey reveals students’ need for assistance with presentation skills and a hope for having AI-generated feedback among both students and discipline teachers. To address these needs and hope, a team of educators from PolyU and BU with expertise in language and AI technology collaboratively developed an online English oral presentation platform called SmartPresenter. SmartPresenter provides students with presentation tips, learning materials, and extensive AI-generated feedback on the communication-related aspects of delivering oral presentations in English, including eye contact, facial expressions, vocal fillers, pronunciation, and fluency. This presentation describes the development and features of SmartPresenter, and the evaluation results of the effectiveness of the platform in facilitating independent learning practices for English oral presentations and assisting teachers in grading presentation assessment.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yanjie SONG, Associate Professor, Department of Mathematics and Information Technology, The Education University of Hong Kong

– Mr Kaiyi WU, Department of Mathematics and Information Technology, The Education University of Hong Kong

Abstract

Integrating artificial intelligence (AI) into educational settings is crucial for developing innovative teaching methods that enhance student learning. This study investigates the development and application of Learningverse, a 2D/3D metaverse platform that integrates digital humans with advanced Large Language Model Operations (LLMOps) to create AI teaching agents. Leveraging the capabilities of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), we designed intelligent digital human teachers. These LLMOps system-constructed multi-agents, including Communication Encoder, Body Movement Coding Encoder, Eye Gaze Coding Encoder, and Expression Coding Encoder, provide personalized and strategic scaffolding to students, offering real-time feedback and support to improve their learning outcomes. Additionally, the platform utilizes GPT-SoVITS trained TTS to clone real teachers’ voices, enhancing the realism of digital human teachers. The platform can customize digital teachers and build scenarios based on different subject courses, adapting them to various thematic curricula. A pilot study evaluated the effectiveness of these digital teachers in enhancing student engagement and performance in Learningverse. Preliminary findings reveal a significant improvement in students’ interactions, motivation, and overall learning achievements. This research highlights the potential of LLMOps-integrated digital human teachers in transforming teaching practices and enriching educational experiences in the metaverse.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1400-1500

Venue: Rose Room, Lower Level II

Presenter(s)

– Dr Aftab AMIN, Teaching Associate, Division of Life Science, The Hong Kong University of Science and Technology

Abstract

Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) empower educators to develop active-learning pedagogical approaches that motivate students to simultaneously engage, develop knowledge, social skills, and subject interest. To initiate VR/AR learning at the Division of Life Science (LIFS), HKUST, LIFS1904 Laboratory for General Biology II (comprising four experiments, ~300 diverse learners) was selected. In recent years, increasing enrollment has created manpower and space shortages, while post-pandemic issues have made student learning and the acquisition of resources, such as rat cadavers for teaching anatomy, physiology, and dissection more challenging. To address pressing issues, enhance active-learning, and make practical transitions fluid and cohesive, gamification is being used to develop a customizable, Virtual Reality Platform (VRP). A story-based narrative has also been implemented to create immersive, engaging, memorable and impactful pedagogy. In this presentation we will examine the deliverables of the project. Some of the findings from our student surveys, focus groups and interviews will also be shared to provide a better understanding of how technology-driven pedagogical innovations can facilitate active learning, information literacy, enhance student support, and facilitate peer-teaching, so that graduate attributes can be delivered.

Theme: 1: Showcase Project Achievements

Sub-theme: Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: F4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Chun Hoi CHEUNG, Assistant Professor of Practice, School of Chinese Medicine, Hong Kong Baptist University

– Miss Hoi Yan FONG, Hong Kong Baptist University

– Miss Judith WONG, Hong Kong Baptist University

– Mr Conrad Kwan Ho CHAN, Hong Kong Baptist University

– Mr Shu Kin FONG, Hong Kong Baptist University

Abstract

Background: Led by Hong Kong Baptist University in collaboration with the University of Hong Kong, the project initiated the first-of-its-kind non-conventional simulation practicum in a realistic setting using Virtual Reality(VR) technology. Aim: The aim is to enhance students’ first-hand experiences with TCM diagnosis and consultations, thereby optimize the effectiveness of service-learning and equip students with necessary attributes such as self-learning ability and communication skills as future practitioners. Method The project encompassed (1)scriptwriting for VR development, (2)VR application with debriefing sessions held to explain the rationales of diseases and relevant physical examinations(PE) to students, and (3)skills contribution in service-learning. Numerical data was obtained through pre and post VR survey for analysis. The statistical test used was Wilcoxon signed-rank test, a paired difference test for comparing the pre-post scores of two matched samples. Post-VR focus group interviews were conducted to collect students’ views on the pros and cons of VR. Evaluation results Quantitatively, 51students completed the VR activity and responded the pre and post VR survey. Under 10-mark scoring scale with 10 as the largest extent, students’ self-evaluation on professional knowledge improved significantly. The medians of the mastery of diagnostic criteria, typical symptoms and physical examinations all increased from 6 to 7 with p<0.001. Students’ self-learning ability, understanding towards consultation procedures, technique in verbal consultation and skills in communicating with patients elevated from 6 to 7 in median, with p-values of 0.009,<0.001,<0.001 and p<0.05 respectively. Qualitatively, students mentioned in focus group that they got insights on the choices of physical examinations to be done in service-learning through VR. Yet, some students reported dizziness and nausea caused by VR headsets as the main barrier of the project, making it inapplicable to all students. Conclusion: This innovative approach is proven to improve clinical knowledge, foster self-learning ability, and develop generic attributes of students.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: J4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Beatrice CHU, Head, Professional Development, Center for Education Innovation, The Hong Kong University of Science and Technology

Abstract

The “Co-Creating the Future of Education” project, a collaborative effort led by the Hong Kong University of Science and Technology (HKUST), alongside the University of Hong Kong (HKU) and Hong Kong Baptist University (HKBU), advances the Student as Partners (SaP) approach within Hong Kong’s higher education sector. This initiative aims to transform pedagogical models by embedding student engagement in the learning process. Key objectives include enhancing professional development programs, enabling faculty and staff to collaborate effectively with students, and establishing a standardized evaluation framework to measure the impact of SaP initiatives. The project also emphasizes the creation of a Community of Practice for Student Partnership, facilitating the exchange of successful strategies and supporting ongoing SaP projects. Additionally, the Student Partnership Co-Creation Program is a cornerstone objective, fostering innovative ideas and collaborative efforts between students and faculty. Progress to date includes the successful implementation of five key focus areas: organizing professional development seminars, establishing a resource hub, and initiating the Student Partnership Co-Creation Program. Notably, 20 teams from various institutions participated in this program, yielding high satisfaction rates and valuable insights. Ultimately, this project seeks to create a sustainable, collaborative ecosystem that enhances student agency, faculty development, and curriculum innovation across participating institutions.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Oral Presentation Time: 1600-1700

Venue: Peony Room, Lower Level II

Presenter(s)

– Dr Pui Pui Phoebe CHEUNG, Assistant Professor (Occupational Therapy), Academic Team, Yew Chung College of Early Childhood Education

– Dr Anna Aracelly OLGUIN, Assistant Professor, Academic Team, Yew Chung College of Early Childhood Education

Abstract

The United Nation Convention on the Rights of Child (UNCRC 1989) ensures the right of all children to have their basic needs taken care of, to be protected at all times, and to participate in decisions that will affect their lives. Unfortunately, millions of children around the world are deprived of these rights. As countries adopt, adapt, and uphold Child’s Rights and Protection protocols, there is a palpable need for information. Practices such as mandated reporting, enacted as law in some Western countries since the 1960’s, are now making their way to places in Hong Kong and teachers will be accountable to report. This presentation has dual objectives. One is to understand pre-service teachers’ knowledge and attitudes regarding child rights and protection pre and post course taking utilizing a co-design thinking approach. The second objective is to share information about a project aiming at co-constructing a culturally relevant Child’s Rights and Protection educational framework with parents who are Ethnic Minorities and/or parents of Special Education Needs children. From these perspectives, the knowledge and attitudes about child rights & protection among the preservice teachers and the voice of the caregivers are of immense importance towards the wellbeing of children in vulnerable populations.

Theme: 2. Thematic Exploration

Sub-theme: Whole-person Development & Diversity and Inclusion Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Sean MCMINN, Director, Center for Education Innovation, The Hong Kong University of Science and Technology

Abstract

This project aims to develop a Co-Instructrional Designer platform to assist instructors in creating course materials. By leveraging Generative AI, the platform will support faculty members in designing course outlines, content, learning activities, assignments, and rubrics aligned with learning outcomes. The platform will connect to a Center for Education Innovation (CEI)-managed knowledge base containing curated pedagogies and best practices. Instructors will interact with the platform through pre-defined prompts, receiving tailored guidance that they can evaluate and adapt to meet their specific course needs. Key features of the platform include front-end interfaces for instructors and system administrators, robust technical architecture for file storage, and conversation history management. Having completed the Proof-of-Concept phase, implementation will proceed with structuring the knowledge base, developing the frontend, integrating the system, and conducting testing, with the final rollout planned for Fall 2025/26. The project will benefit approximately 750 faculty members and teaching staff at HKUST. This tool has multiple applications: it can serve as a co-designer for faculty, support quality assurance, assist with faculty development, and aid in Teaching and Learning Innovation Pedagogy and Blended Learning Projects. Success will be measured by the quality of responses in testing scenarios, training participation and satisfaction, and overall platform usage.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: B2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Iain KILLOUGHERY, Lecturer, Sport, Physical Education and Health, Hong Kong Baptist University

Abstract

Graduate attributes (GAs), formally adopted by higher education institutions for some time, describe the skills and competences that students should develop over the course of their studies. GAs are considered important to universities as they act as a means to represent and extend their brand, while also providing a channel to maintain connection with industry. However, despite regular engagement with industry, employers remain unsatisfied with graduate transferable skills. This may be caused by a lack of a common theoretical underpinning to develop such attributes. Therefore, the aim of this study was to provide an evidence-based methodology which develops transferable skills in university graduates. Two classes were used in this study; one class received a 12-week intervention incorporating a variety of coaching activities. The second class acted as a control group. Students completed pre-intervention surveys providing self-reports of ratings in GAs and resourcefulness behaviours. Post-intervention, students again complete surveys reporting self-ratings on the same topics. Survey data was analysed to identify changes in student scores, which highlighted improvements in all graduate attribute ratings post-intervention. Furthermore, help-seeking behaviours were shown to have significant improvement post-intervention. This study suggests that coaching practices may provide an effective method to develop transferable skills in students.

Theme: 2. Thematic Exploration

Sub-theme: 2.4  Whole-Person Development

Poster Presentation Time: 1225-1400; 1500-1600

Venue: J2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Benjamin MOORHOUSE, Assistant Professor, Department of Education Studies, Hong Kong Baptist University

Abstract

The public release of ChatGPT sent shock waves through the education community. Since then, many generative AI (GenAI) tools that perform various human tasks have been launched. It is essential that higher education institutions are at the forefront of preparing graduates for the productive and responsible use of these tools. To make this a reality, instructors, as models of practice, must have the skills and knowledge to use GenAI tools. They need to understand how AI works (technological proficiency); they need to consider the ethical issues of the tools (critical and ethical awareness); they need the pedagogical awareness of how and when to use them (pedagogical capability); and they need prepare their students to use them. These skills can be considered ‘Professional Generative AI competence’ (P-GenAI-C). The Inter-institutional Collaborative Activities for Fund for Innovative Technology-in Education project presented in this poster aims to: (1) Identify the P-GenAI-C in different university subject disciplines; (2) Contextualize the P-GenAI-C within each universities’ policies and guidelines; (3) Develop training and continuous support for university instructors, and (4) Develop a developmental framework and reflective tool for evaluating P-GenAI-C. The first aim and discussion of the actualization of the remaining aims are presented.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1600-1700

Venue: Peony Room, Lower Level II

Presenters(s)

– Dr Joseph Yui-yip LAU, Interim Head of Student Affairs and Senior Lecturer, Division of Business and Hospitality Management, College of Professional and Continuing Education, The Hong Kong Polytechnic University

Abstract

A large number of students enrolled in sub-degree programmes and self-financing degree programmes in self-financing post-secondary institutions each year. As such, self-financing post-secondary institutions perform a significant role in the higher education sector in Hong Kong. To the best of the author’s knowledge, most of the students are eager to achieve whole-person development to equip themselves before graduation. In other words, they strive toward becoming a preferred graduate to establish a career path or articulate to the ‘desirable’ universities for further study. This study illustrates the Student Affairs Office to address the key challenges of developing whole person development programme, deliver successful cases of the formation of a structured whole-person development programme, and point out the roadmap to the future whole-person development programme in the forthcoming years. As expected, the study may provide valuable insights to policymakers, educators, higher education institutions, and researchers to develop a future research agenda and policy.

Theme: 2. Thematic Exploration

Sub-theme: Whole-person Development & Diversity and Inclusion Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Yi LI, Lecturer, Centre for Language in Education, The Education University of Hong Kong

Abstract

To enhance students’ proficiency in Putonghua and facilitate their integration into the workplace and life in the Greater Bay Area, the Centre for Language in Education at The Education University of Hong Kong is undertaking a Teaching Development Grant (TDG) project for 2023-2024. This project aims to engage professionals from various industries in the Greater Bay Area to conduct interviews on topics related to “work” and “life.” The interviews are categorized into four sections: “Job Hunting,” “Workplace Communication,” “Workplace Culture,” and “Life,” comprising a total of 20 topics. To provide comprehensive learning resources, the project team has recorded video interviews with experts, accompanied by textbook explanations. These valuable resources have been uploaded to EdUHK’s online learning platform, ensuring accessibility for all students. By utilizing this platform, students can enhance their learning experience and foster their understanding of the workplace environment in the Greater Bay Area. Through this initiative, students will gain valuable insights into the practical aspects of working and living in the Great Bay Area. The project aims to equip students with the essential language skills and cultural understanding required to excel in their future careers. This TDG project is designed to create an immersive and engaging learning environment by collaborating with industry professionals and leveraging an online platform. Collaborating with industry professionals and leveraging online platforms aims to create an immersive and engaging learning environment for students, preparing them for success in the dynamic Greater Bay Area.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: H4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Isaac Ka Chun WAN, Instructional Designer, Centre for Education Innovation, The Hong Kong University of Science and Technology

Abstract

The use of videos in asynchronous learning significantly enhances the educational experience, especially for intricate or abstract concepts. Videos allow students to adapt their learning pace, fostering a more flexible and personalized process. However, traditional video lectures often promote passive learning, making it hard for instructors to monitor students’ progress effectively. To address these challenges and help instructors create an interactive video-based learning environment, a strategic workflow has been developed. This workflow incorporates two customized digital tools that facilitate the creation of engaging video elements and provide detailed analytics on student engagement and progress. As a result, students are empowered in their asynchronous learning journey.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Mr Jac LEUNG, Lecturer, Division of Integrative Systems and Design, The Hong Kong University of Science and Technology

Abstract

This project explores the intersection of Generative AI, reflection and experiential learning, highlighting GenAI’s pivotal role in fostering deeper cognitive processes and the attainment of complex knowledge structures. In recognition of the multifaceted dimensions of reflection, we aim to examine GenAI’s role in promoting different focuses of reflection including technical reflection on efficiency of attaining goals; practical reflection on challenging assumptions and establishing identities; and critical reflection on reflecting within a broader consideration of socio-historical and political-cultural context. GenAI is widely praised for its ability to serve as agent to writing and agent to knowledge. This study explores GenAI’s potential as agent to reflect, offering a perspective transformation devoid of judgement and social bias. We adopt an action research approach to accommodate both the rapidly growing research area and state-of-the-art teaching innovations. To examine the roles of GenAI in various types of experiential learning contexts, a 3-year collaboration project consists of four local universities in Hong Kong was initiated in early 2024. Participating students are of diverse background in science, social science, engineering, business, and health profession (radiography). Reflective exercises are designed according to the course context and the type of experiences within entrepreneurship education, social innovation, and health professional training.

Theme: 1. Showcase Project Achievements

Sub-theme: Innovative Technology-in-Education

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Dr Theresa KWONG, Director, Centre for Holistic Teaching and Learning, Hong Kong Baptist University

Abstract

HKBU leads two UGC-funded projects to enhance digital citizenship education and promote digital ethics. The first project, “Enhancing Learning and Teaching of Digital Citizenship through Scenario-based AR Learning Trails”, pioneers innovative approaches, developing scenario-based AR learning trails to engage students as active partners in digital citizenship. With six university partners, the project team created a revised Digital Citizenship Framework and over 85 scenarios, implemented in the “AR-Trails” app. Initial findings from 2,045 students on a learning trail reveal a strong digital citizenship foundation. These insights led to the second initiative, the “Digital Ethics and Responsibilities (DEAR) Campaign”, which empowers stakeholders to make informed, responsible decisions in the digital world. The DEAR project leverages the Digital Citizenship project, creating a DEAR Hub, organizing digital ethics events, designing a micro-credential program, and curating educational content. Since January 2024, DEAR has made significant progress, including securing research ethics approval, developing an introductory micro-credential, and recording podcasts. The DEAR Hub is being established as a comprehensive digital ethics resource. These interlinked projects provide educators with professional development opportunities and resources. The presentation offers an overview of their progression and advancements, providing insights into digital citizenship education and promoting ethical, responsible digital practices.

Theme: 1. Showcase Project Achievements

Sub-theme: Innovative Technology-in-Education

Poster Presentation Time: 1220-1400; 1500-1600

Venue: J3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Mr Ryan MAN, Associate Dean (Undergraduate Studies), School of Business, Hong Kong Baptist University

Abstract

The Fund for Innovative Technology-in-Education (FITE) has catalyzed a transformative initiative within our School to future-proof business education. Our approach is three-pronged, with a focus on curriculum development, personalized e-learning, and pedagogical innovation. In anticipation of the 2024/25 academic year, a dedicated programme review team has been tasked with integrating AI across the BBA curriculum, introducing new core courses such as Business Coding, AI for Business, and AI Ethics and Governance. This integration extends to embedding AI applications into functional areas like marketing human resources management and finance. Besides, we have instituted a personalized e-learning graduation requirement, leveraging Industries 4.0 principles of IoT and AI in MOOCs, particularly LinkedIn Learning, to enhance engagement and digital literacy. Our metrics indicate promising uptake and substantial engagement in technology courses, underscoring the relevance of data analytics and AI in contemporary education. Supporting our pedagogical shift, the FITE-backed Fostering AI-Incorporated Learning team is pioneering AI and blended learning integration to elevate teaching quality. Our experimental initiatives range from incorporating Generative AI into Business Analytics education and piloting AI in HR teaching. These efforts signify our commitment to driving pedagogical transformation and curriculum innovation, preparing students for the evolving demands of the digital economy.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Oral Presentation Time: 1400-1500

Venue: Fanling Room, Lower Level I

Presenter(s)

– Mr Jungjin PARK, PhD student, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technology

– Professor Larry LI, Associate Head & Associate Professor, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technolog

Abstract

Immersive technologies come in various forms and names, such as virtual reality (VR), augmented reality (AR), and recently spatial computing. While higher education has always been at the forefront of experimenting with such technologies in the classroom, the ubiquity of smartphones and tablets – capable of creating robust AR experiences – has made it possible for wider adoption in recent years. In this presentation, we highlight lessons learned from a pilot project that leveraged AR to enhance aerospace laboratory training at the Hong Kong University of Science and Technology, and how this effort is being expanded across multiple disciplines such as pulmonary physiotherapy and forensic pathology. In particular, we share our vision to combine AR and large language models (LLMs) to design truly immersive learning experiences that can be effectively deployed into classrooms. When combined, the two technologies mutually benefit and supplement their respective advantages and limitations, thereby overcoming many of the current challenges faced by educators when deploying either on their own.

Theme: 1. Showcase Project Achievements

Sub-theme:  Innovative Technology-in-Education

Poster Presentation Time: 1225-1400; 1500-1600

Venue: G4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Hung-lin CHI, Associate Professor, Department of Building and Real Estate, The Hong Kong Polytechnic University

– Ms Junyu CHEN, Ph.D Student, Department of Building and Real Estate, The Hong Kong Polytechnic University

– Mr Haolei LIN, Ph.D Student, Department of Building and Real Estate, The Hong Kong Polytechnic University

Abstract

KnowLearn is an interactive learning assistant system designed for architecture, engineering, and construction (AEC) education, where personalized recommendations for students in virtual learning environments remain under-explored. An educational knowledge graph (KG) was constructed to contain multifaceted information by connecting pedagogical, learning performance, and learning feedback data as sub-graphs. A heterogeneous graph attention network (HAN) was implemented to infer latent information in the educational KG and identified essential factors shaping students’ acceptance of virtual learning environments. Based on sampling data of 107 students from the Hong Kong Polytechnic University, Department of Building and Real Estate, we found students’ self-efficacy, intention to use, and in-class quiz performance were significant predictors of final learning outcomes in subjects that adopt virtual learning environments. This project further deployed a local-based large language model (LLM) Qwen-7B and built an interactive graphical user interface (GUI) with Gradio. Utilizing the information preserved in the educational KG and learned from HAN as the basis, this LLM facilitated conversations between students and KnowLearn, enhancing personalized recommendations while securing student privacy. The developed system contributed to helping improve the learning experiences and performances of AEC students within virtual learning environments.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: I3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Winnie WONG, Educational Development Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Mr Vincent CHAN, Educational Development Assistant, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

Background and Objectives: This project aims to leverage the immersive capabilities of the metaverse to enhance data security and privacy awareness among students and staff at the Education University of Hong Kong. Develop a series of interactive and engaging educational materials to enhance the understanding of data security principles and data privacy policies. Design and implement a dynamic and user-friendly online platform (Metaverse Space) to host the educational materials, facilitating easy access and learning for target audiences. Methods and Findings: Within this metaverse-based platform, users are presented with practical scenarios that simulate real-world situations involving security-critical concepts. The educational virtual environment is strategically gamified to motivate users through rewarding challenges and progressive levels, bridging the gap between theory and practice. The dynamic simulation exercises allow participants to directly experience the impact of security failures and rehearse protective actions in a risk-free, controlled setting, nurturing applied skills alongside conceptual understanding. The survey results, based on responses from (n=20), indicate that the gamified metaverse prototype is both engaging and effective in teaching data security and privacy concepts. The interactive scenarios and simulations were particularly praised for their usefulness in understanding real-world data security issues. The navigation of the metaverse environment was generally considered easy. Overall, the positive responses suggest that the gamified metaverse is a valuable tool for learning data security, demonstrating its effectiveness in an educational context. Discussion and Perspectives: Leveraging Metaverses data security learning platform offers an innovative and immersive approach to addressing the limitations of traditional training methods, empowering users with comprehensive knowledge and applied skills to mitigate evolving cyber threats.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: B3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Xiang LI, Assistant Professor, Department of Applied Social Science, The Hong Kong Polytechnic

– Dr Xiaoqin ZHU, Assistant Professor, Department of Applied Social Science, The Hong Kong Polytechnic

– Dr Diya DOU, Assistant Professor, Department of Applied Social Science, The Hong Kong Polytechnic

Abstract

Higher education programs often focus on disciplinary knowledge and professional skills, with cognitive skills given top priority. As a timely response to limited education for wellbeing and non-cognitive skills development, PolyU’s Leadership and Intra-personal Development Team developed four subjects, including Tomorrow’s Leaders, Promotion of Children and Adolescent Development, Service Leadership, and Service Leadership through Serving Children and Families with Special Needs to nurture students’ leadership, improve their wellbeing, and promote their whole person development. These subjects aim to nurture students to become ethical leaders of tomorrow and responsible citizens by adopting a holistic youth development approach based on cutting-edge theories and research on late adolescence and emerging adulthood, leadership development, and service-learning. To date, over 27,000 students have taken the four subjects. Different evaluation methods involving multiple stakeholders over time have demonstrated positive and significant impact of the four subjects on students’ wellbeing and holistic development. Positive feedback from students and recognition from the higher education community have contributed to these subjects receiving numerous prestigious awards, both internationally and locally. These include the UGC Teaching Award 2018 and the Gold Award in the Nurturing Wellbeing & Purpose category at the Wharton-QS Stars Reimagine Education Awards 2021.

Theme: 2. Thematic Exploration

Sub-theme: 2.4  Whole-Person Development

Poster Presentation Time: 1225-1400; 1500-1600

Venue: A1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Ms Crystal LUO, Teaching and Learning Manager, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

– Miss Pui Ying WONG, Educational Development Officer, Centre for Learning, Teaching and Technology, The Education University of Hong Kong

Abstract

The global pandemic prompted academic institutions to shift from traditional test-based assessments to alternative assessments, including methods such as self-assessments, peer evaluations, and digital technology-enhanced tasks. The effectiveness of alternative assessment hinges on students’ perceptions, which may subsequently influence their degree of engagement. This study was thus designed to investigate the relationship between students’ perceptions and their involvement in alternative assessment in a Hong Kong university. An online survey was administered to 177 students between November 2022 and February 2023, with the collected data undergoing quantitative analysis. The results show that students generally maintain moderate levels of positive perceptions and active involvement towards alternative assessments. Moreover, a statistically significant correlation was observed between their perceptions and involvement. Our findings not only provide evidence to support the relationship between students’ perceptions and their involvement in alternative assessment practices, but also provide insights into the importance of understanding the real-life applicability of such assessments, the facilitating role of technological tools, and the practical implementation of these assessments into courses.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: H3, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Henry Tsz Yeung FUNG, Lecturer cum Programme Director of ORGC Concentration, Communication Studies, Hong Kong Baptist University

Abstract

The outbreak of the COVID-19 pandemic had a profound impact on university students’ learning, necessitating a sudden shift from face-to-face learning to virtual learning. This sudden shift disrupted student-teacher interactions and cut off access to vital resources like libraries and media labs, leaving students scrambling in an unfamiliar digital landscape. Recognizing the need for accessible learning tools in these uncertain times, this study centres on the curation of a digital video archive featuring exemplary student works to facilitate peer-to-peer learning in the context of the COVID-19 pandemic. Fifty high-achieving students majoring in communication were invited to discuss their learning experiences and the processes involved in creating distinct class projects. These interviews were then turned into thirty short peer-learning videos and stored in a digital archive. The archive was advertised to over 200 students via mass email, in-class promotions, and school web pages during the Fall 2022 and Spring 2023 semesters. To gain a better understanding of student engagement with the digital archive as a means of active learning and knowledge construction, three focus group interviews were conducted. Findings reveal that the archive positively impacts student learning by providing an accessible, flexible platform for understanding course materials outside of the traditional classroom setting. This is particularly useful during the add/drop period when students want to learn more about the course before enrolment. Additionally, the peer advice and work samples shared in the videos provide a grounded perspective on instructor expectations, hence enabling students to produce higher-quality work.

Theme: 1. Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: K1, Tai Po-Shek-O Room, Lower Level 1

Presenter(s)

– Dr Laura ZHOU, Education Development Officer, Education Development Centre, The Hong Kong Polytechnic University

– Mr Leo WONG, Project Associate, Education Development Centre, The Hong Kong Polytechnic University

Abstract

The flipped learning and teaching approach redefines the traditional classroom dynamic by swapping the order of direct instruction and homework activities. In a flipped classroom, students engage with instructional materials (such as videos, readings, or podcasts) outside of class, freeing up valuable in-class time for active learning, collaborative activities, and deeper understanding. In our quest to promote effective flipped learning and teaching practices, we conducted comprehensive interviews with experienced teaching staff at PolyU, who have successfully integrated this methodology into their course. Their valuable insights were collected and compiled into case studies, which were then disseminated to all teaching staff members through e-newsletters and experience sharing workshops. These teaching cases serve as compelling examples, showcasing the versatility and impact of flipped learning and teaching. They underscore the significance of adapting pedagogical methods to enhance student learning experiences. By shifting the locus of content consumption outside the classroom, educators empower students to actively engage with the material during face-to-face sessions, fostering a deeper understanding and more meaningful interactions.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.2  Fund for Innovative Technology-in-Education (FITE)