Human-AI collaboration: Designing artificial agents to facilitate socially shared regulation among learners

Abstract

Abstract

Socially shared regulation of learning (SSRL) is a crucial process for groups of learners to successfully collaborate. Detecting and supporting SSRL is a challenge, especially in real time, but hybrid intelligence approaches such as Artificial Intelligence (AI) agents may make this possible. Leveraging the concept of trigger events which invite SSRL, we present a design of an AI agent, MAI, which can detect SSRL and prompt students to raise their group-level metacognitive awareness with the aim of facilitating SSRL. We present the methodology we used to design MAI, drawing on the Echeloned DSR (eDSR) Methodological Framework and making use of the Wizard of Oz prototyping paradigm. We likewise present empirical results evaluating our initial prototype of MAI, using lexical alignment between speakers as a quantitative measure of the effect of MAI's prompts on facilitating SSRL, the Partner Model Questionnaire as a quantitative measure of perceptions of MAI, and interviews as qualitative context for these perceptions. We found that the first prototype of MAI did not facilitate SSRL as hoped, possibly owing to mixed perceptions of MAI's reliability and lack of clarity about MAI's role in the collaborative learning task. From these findings, we offer revised prompts for the next iteration of prototyping this agent and a refined set of design requirements for future development of metacognitive AI agents for supporting SSRL.