HIGH-LEVEL ARCHITECTURE OF MULSEMEDIA SOFTWARE SYSTEM

Abstract

This paper delves deep into the creation of a unified, high-level architecture for an emerging category of software known as mulsemedia software. Mulsemedia, a term that connects 'multimedia' and 'sensory', refers to an extended version of multimedia. Unlike traditional multimedia which primarily focuses on visual and auditory data, mulsemedia encompasses a broader spectrum of temporal multimodal data. A core component of this concept is the mulsemedia object, essentially a physical entity monitored by a computer system. This is done through the integration of various sensors, aimed at capturing a comprehensive digital representation of the object. The goal is to have this digital description be so intricate and detailed that it mirrors the human sensory experience when perceiving the object. Mulsemedia software, therefore, can be understood as an application that specializes in handling this rich, temporal multimodal data, providing a holistic view of the mulsemedia object. The software landscape already features categories that align with the mulsemedia software system, notably the digital twin platforms and metaverse applications. However, mulsemedia stands out as a relatively new concept, and thus there's a pressing need to establish novel methodologies to develop software that can efficiently and effectively interact with diverse modalities of mulsemedia data. The primary focus of this research is centred on conceptualizing and formulating a high-level architecture tailored for mulsemedia software. This architecture, while robust in its design principles, boasts versatility, making it seamlessly adaptable across a myriad of application scenarios and use cases. Such a foundational architecture will pave the way for future advancements in mulsemedia software development, fostering innovation in this burgeoning field.