Technological fields:
In January 2024, RE:LAB was selected among 54 participating organisations for the successful submission of the PenGUIn project, for the UTTER’s Financial Support to Third parties – First Open Call. UTTER (Unified Transcription and Translation for Extended Reality, https://he-utter.eu/) is an Horizon Europe project working on advancing online and hybrid interaction through extended reality. UTTER is developing conversation platforms in which human agents interact while being assisted by AI agents, demonstrated in two use cases (meeting assistant and multilingual customer support assistant).
The aim of PenGUIn, a 9-months project, is to support user experience through an innovative, inclusive, adaptive and usable Graphical User Interface for XR platforms, and study the most appropriate information design framework to support agent tasks and the relative cognitive load in the presented UTTER’s use cases – and beyond (e.g., virtual learning, virtual healthcare), to support the achievement of the task objectives.
The proposed solution will converge innovativeness, usability and content design in a dynamic of functionality, effectiveness, and ergonomics, according to RE:LAB’s methodology “Interaction Engineering”. PenGUIn aims to design and test a user-centred design approach to prototype a library of graphical elements that are intuitive, cross-cutting, and compatible with usability criteria.
PenGUIn will design and test a user-centred design approach to prototype a library of graphical elements that are intuitive, cross-cutting, and compatible with usability criteria. PenGUIn will support transparent, inclusive, and task-oriented dialogue and interaction between agents and users on virtual platform, considering various use cases for the development of adaptable XR interaction logics. The approach will consider simulation of use in different contexts; type of interaction and communication between operator and users; emotion-tracking and AI inputs; type of information and content to be managed (also adaptable to the emotions detected); flexibility of customization; validation of the developed UI. RE:LAB will evaluate the interaction through expert analysis, focus groups and users testing iteratively. Graphic design development will provide a product for different (custom) interaction needs, while maintaining a consistent and standardizable (semi-custom) structure.
The project will work on two use cases to develop a novel User Interface:
– Multilingual customer service platform
– Multilingual virtual meeting assistant
Next project
If you are interested in collaborating with us or if you would like information about our services, please contact us and we will be happy to help. Let’s get in touch and make something great happen.