Multimodal Interaction, Lectures

Upon completion of the course, the student will understand the concepts of multimodal interaction and interaction modality and know about voice, gesture and gaze-based interaction and haptics. They can apply these interaction modalities separately and together for appropriate uses to design multimodal interfaces and provide reasoning on why the selected modalities suit the interface. They can relate human-technology interaction and human-human interaction and understand how design of former can benefit from the latter. They can also plan evaluations of multimodal interface. Completion of the course helps students efficiently learn more about interaction techniques, haptic interaction and other covered modalities and can also apply their understanding to other interaction modalities.

• Human factors of different interaction modalities and multimodal interaction;
• Devices and interaction technologies for multimodal interaction;
• Tools and methods for design and implementation of multimodal applications;
• Fusion and fission of different modalities needed to create multimodal interfaces;
• Evaluation and user experience of multimodal interaction.

In the course, four modalities are covered in more detail: speech, gestures, gaze tracking and haptics. Multimodal fusion and fission are discussed as well. In addition, evaluation of multimodal interfaces is covered.

Common learning events for all

Blended Learning:

30.08.2021 14:00 - 16:00
02.09.2021 14:00 - 16:00
06.09.2021 14:00 - 16:00
09.09.2021 14:00 - 16:00
13.09.2021 14:00 - 16:00
16.09.2021 14:00 - 16:00
20.09.2021 14:00 - 16:00
23.09.2021 14:00 - 16:00
27.09.2021 14:00 - 16:00
30.09.2021 14:00 - 16:00
04.10.2021 14:00 - 16:00
07.10.2021 14:00 - 16:00
11.10.2021 14:00 - 16:00
14.10.2021 14:00 - 16:00
25.10.2021 14:00 - 16:00
28.10.2021 14:00 - 16:00
01.11.2021 14:00 - 16:00
04.11.2021 14:00 - 16:00
08.11.2021 14:00 - 16:00
11.11.2021 14:00 - 16:00
15.11.2021 14:00 - 16:00
18.11.2021 14:00 - 16:00
22.11.2021 14:00 - 16:00
25.11.2021 14:00 - 16:00
29.11.2021 14:00 - 16:00
02.12.2021 14:00 - 16:00
06.12.2021 14:00 - 16:00
09.12.2021 14:00 - 16:00

Prerequisites

Prior to joining the course, the students should understand the core concepts of user interfaces and user experience.

Recommended Prerequisites

• Introduction to User Interfaces, TIEA1, 5 cr
• Human-Technology Interaction 1: Basics, HTI.100, 5 cr
• Human-Technology Interaction 2: Design, HTI.110, 5 cr

Materials are distributed via course Moodle area. Slide sets and textbook type materials are available.

General scale, 0-5