On opportunities and challenges of large multimodal foundation models in education

Küchemann, Stefan; Avila, Karina E.; Dinc, Yavuz; Hortmann, Chiara; Revenga, Natalia; Ruf, Verena; Stausberg, Niklas; Steinert, Steffen; Fischer, Frank; Fischer, Martin; Kasneci, Enkelejda; Kasneci, Gjergji; Kuhr, Thomas; Kutyniok, Gitta; Malone, Sarah; Sailer, Michael; Schmidt, Albrecht; Stadler, Matthias; Weller, Jochen; Kuhn, Jochen (2025): On opportunities and challenges of large multimodal foundation models in education. npj Science of Learning, 10: 11. ISSN 2056-7936

Abstract

Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that arise from the integration of large multimodal foundation models in education.

• Dokumententyp: Artikel (LMU)
• Organisationseinheit (Fakultäten): 17 Physik
• DFG-Fachsystematik der Wissenschaftsbereiche: Naturwissenschaften
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 491502892