Poster Presentation Time: 1225-1400; 1500-1600

Venue: H2, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Pauli LAI, Lecturer, Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University

– Dr Julia CHEN, Director, Educational Development Centre, The Hong Kong Polytechnic University

Abstract

A common assessment in university is the oral presentation, and students are often required to deliver presentations in English. Two challenges arise. First, many students mainly focus on the discipline content in the assessment preparation process rather than the communication or use of English in their presentations. Second, lecturers of large classes (e.g. around 200 engineering students in one course) hardly have time to give feedback to each student on the English communication aspect of their oral presentations. A baseline survey reveals students’ need for assistance with presentation skills and a hope for having AI-generated feedback among both students and discipline teachers. To address these needs and hope, a team of educators from PolyU and BU with expertise in language and AI technology collaboratively developed an online English oral presentation platform called SmartPresenter. SmartPresenter provides students with presentation tips, learning materials, and extensive AI-generated feedback on the communication-related aspects of delivering oral presentations in English, including eye contact, facial expressions, vocal fillers, pronunciation, and fluency. This presentation describes the development and features of SmartPresenter, and the evaluation results of the effectiveness of the platform in facilitating independent learning practices for English oral presentations and assisting teachers in grading presentation assessment.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.3  Special UGC Grant for Strategic Development of Virtual Teaching and Learning (VTL)

Poster Presentation Time: 1500-1600; 1700-1800

Venue: G1, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Yuk Ming TANG, Senior Lecturer, Department of Indusial and System Engineering, The Hong Kong Polytechnic University

Abstract

STEM education is essential in today’s curriculum even for university students. However, traditional classroom-based instruction methods often lack interactivity and tailored experiences that foster student engagement and comprehension. The integration of Virtual Reality (VR) and Artificial Intelligence (AI) generative chatbots has emerged as a transformative influence on the teaching and learning process. Despite this, limited research has explored the impact of advanced technology on STEM learning outcomes. This study explores the potential of employing VR and AI as tools to facilitate teaching to enhance students’ learning outcomes. 120 university students are involved in this study to examine the difference in learning outcomes by utilizing three instructional approaches for learning projectile motion: (1) a traditional didactic classroom, (2) a game-based VR metaverse, and (3) a game-based VR metaverse enriched with a generative chatbot-based pedagogical agent. The study prudently evaluated alterations in student motivation, cognitive benefit, and learning outcomes. Preliminary findings suggest that incorporating VR and AI into teaching considerably enhances student engagement and cognitive participation. This study demonstrates how the integration of VR with AI can elevate student engagement, comprehension, and skill acquisition in STEM education, paving the way for a more captivating and effective learning environment in the Edu-metaverse.

Theme: 2. Thematic Exploration

Sub-theme: 2.1 Community of Practice (CoP)

Poster Presentation Time: 1225-1400; 1500-1600

Venue: G4, Tai Po-Shek-O Room, Lower Level I

Presenter(s)

– Dr Hung-lin CHI, Associate Professor, Department of Building and Real Estate, The Hong Kong Polytechnic University

– Ms Junyu CHEN, Ph.D Student, Department of Building and Real Estate, The Hong Kong Polytechnic University

– Mr Haolei LIN, Ph.D Student, Department of Building and Real Estate, The Hong Kong Polytechnic University

Abstract

KnowLearn is an interactive learning assistant system designed for architecture, engineering, and construction (AEC) education, where personalized recommendations for students in virtual learning environments remain under-explored. An educational knowledge graph (KG) was constructed to contain multifaceted information by connecting pedagogical, learning performance, and learning feedback data as sub-graphs. A heterogeneous graph attention network (HAN) was implemented to infer latent information in the educational KG and identified essential factors shaping students’ acceptance of virtual learning environments. Based on sampling data of 107 students from the Hong Kong Polytechnic University, Department of Building and Real Estate, we found students’ self-efficacy, intention to use, and in-class quiz performance were significant predictors of final learning outcomes in subjects that adopt virtual learning environments. This project further deployed a local-based large language model (LLM) Qwen-7B and built an interactive graphical user interface (GUI) with Gradio. Utilizing the information preserved in the educational KG and learned from HAN as the basis, this LLM facilitated conversations between students and KnowLearn, enhancing personalized recommendations while securing student privacy. The developed system contributed to helping improve the learning experiences and performances of AEC students within virtual learning environments.

Theme: 1: Showcase Project Achievements

Sub-theme: 1.1  Teaching Development and Language Enhancement Grant (TDLEG)