Evaluating AI-Driven Dialogues In Higher Education: An Experimental Study Using The Brian Platform

AI-powered chatbot tutors vs. traditional quizzes: examining whether guided learning dialogues enhance knowledge acquisition and critical thinking skills.

Abstract

This BeLEARN project will investigate the effectiveness of Brian’s AI-based dialogue tool in higher education. This innovative feature creates customizable AI tutors that guide students through exercises with defined completion criteria, potentially developing higher-order thinking skills more effectively than through traditional quizzes.
The research collaboration between Brian AG and BFH will compare student performance and experiences using AI dialogue exercises versus conventional learning methods. The study will involve students at BFH, with data collection planned for 2025.
This project contributes to digital education innovation by examining whether AI-powered dialogue systems can enhance knowledge acquisition and critical thinking. Results will inform future development of adaptive learning technologies and personalized educational experiences, while advancing understanding of AI’s role in modern pedagogy.

(Zwischen-) Ergebnisse und Infos zum Projektstand

We have successfully recruited lecturers at BFH for both the spring and autumn semesters 2025. The onboarding process has begun, and we are currently assisting these educators in creating appropriate course content for the study. This initial phase of implementation is proceeding according to schedule.

Translation

This project bridges educational research and practice through Brian’s AI-powered platform. The recently launched AI-based dialogue tool allows teachers to create exercises requiring open-text answers, featuring customizable AI tutors and teacher-defined completion criteria. Brian will enhance the platform by integrating AI dialogue with gamification and analytics features, while collaborating with BFH to develop specialized exercises for test courses. The partnership will provide software access to test classes and establish a feedback loop where research findings directly inform technology improvements in commercial AI-supported educational tools.

Gesamtleitung

Projektmitarbeit

Beteiligte Institutionen