Multimodal Model with Emotion Architecture Development: Trends and Prospects

Konson, Grigoriy Rafael’evich
D.Sc. (in Art History), D.Sc. (in Cultural Studies), Professor, Director of Humanities & Social Sciences Center—Chairman of the Expert Council on the Humanities and Social Sciences, Education, & Culture, MIPT University, Chief Research Fellow, Department for Scientific and Technical Data, GITR Film & Television School—Editor-in-Chief at The Art and Science of Television Journal, Moscow, Russia
gkonson@yandex.ru

Kostin, Anton Aleksandrovich
PhD in Philosophy, Assistant Professor, Humanities & Social Sciences Center, MIPT University, Research Fellow, Gamification Lab,Sber, Moscow, Russia
kostin.aa@mipt.ru

Malykh, Valentin Andreyevich
PhD in Engineering, Senior Research Fellow, MTS AI, Moscow, Russia
valentin.malykh@phystech.edu

Abstract
The report focuses on the trends and prospects for the multimodal model of emotional artificial intelligence.

The key points of the report are as follows:

  • Researching non-verbal communication and developing a concept of full non-verbal behavior for avatars.
  • Creating a universal applied system of emotional intelligence for avatar-agents that can be adapted to different service sectors.
  • Developing an emotional architecture for an artificial agent based on research in the field of psychophysiology.
  • Developing a prototype of a multimodal model for recognizing user emotions and an artificial agent that expresses emotions, understands, and appropriately responds to user emotions.


Keywords: non-verbal communication, emotion architecture, artificial agent
Made on
Tilda