NDLI: Multimodal HCI: exploratory studies on effects of first impression and single modality ratings in retrospective evaluation

Please wait, while we are loading the content...

Multimodal HCI: exploratory studies on effects of first impression and single modality ratings in retrospective evaluation

Content Provider	Springer Nature Link
Author	Weiss, Benjamin Wechsung, Ina Hillmann, Stefan Möller, Sebastian
Copyright Year	2016
Abstract	This paper deals with the relevance of the first impression of interactive systems, based on short passive visual/auditory stimuli of system output. Individual consistency between such impressions and retrospective user ratings, obtained directly after real interaction, is studied in four exploratory experiments. All systems allow for voice user input. Two systems are considered to be multimodal as they support additional input other than speech (e.g., gesture); whereas the other two systems, offering speech as the sole input modality, are multimedia systems. The first impression of the four systems is based on screen-shots of typical display views and selected prompts of the systems’ speech output. Measures used here were pragmatic quality (i.e., the functional aspects of a system such as efficiency and effectiveness that are closely related to the concept of usability) and hedonic qualities (i.e., the systems non-instrumental aspects such as its ability to provide stimulation and identification—to evoke the psychological well-being of the user. It was tested, whether consistency found for web-sites can also be found for speech-based systems. In our case, this consistency was assessed not between systems, but within systems. Results indicate that users’ first impression of system output does correlate with ratings collected after the interaction for each of the four systems. For the two truly multimodal systems, ratings after single input (e.g., only voice, only touch screen) also correlates with ratings of a multimodal interaction with the same system. This result confirms data from literature. However, our assumption of lower correlations for the first impression of pragmatic quality, expected due to its experience-based character, is not supported. Instead, pragmatic quality seems to represent a construct with low consistency in general. Reasons for this might be found in the benefit of pragmatic quality experienced during multimodal interaction that is neither covered by unimodal interaction, nor predictable from a first impression. Additional multiple regression analysis for the two systems with multiple input modalities show that the first impression of the visual system output can complement predictors from the single modality interactions to model post-usage multimodal ratings. However, which of the output channels has a relevant impact was found to be highly system dependent.
Starting Page	115
Ending Page	131
Page Count	17
File Format	PDF
ISSN	17837677
Journal	Journal on Multimodal User Interfaces
Volume Number	11
Issue Number	2
e-ISSN	17838738
Language	English
Publisher	Springer International Publishing
Publisher Date	2016-11-22
Publisher Place	Cham
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Multimodal dialog system User factors User experience Evaluation Quality aspects User Interfaces and Human Computer Interaction Signal,Image and Speech Processing Image Processing and Computer Vision
Content Type	Text
Resource Type	Article
Subject	Signal Processing Human-Computer Interaction

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Enriching the user experience with multimodal interfaces

The W3C multimodal architecture and interfaces standard

Analysis of significant dialog events in realistic human–computer interaction

Empathetic video clip experience through timely multimodal interaction

Prototyping and evaluating glove-based multimodal interfaces

Run-time model based framework for automatic evaluation of multimodal interfaces

Measuring the Quality of Service and Quality of Experience of multimodal human–machine interaction

Design and usability evaluation of multimodal interaction with finite state machines: a conceptual framework

Cross-disciplinary approaches to multimodal user interfaces

Multimodal HCI: exploratory studies on effects of first impression and single modality ratings in retrospective evaluation

Similar Documents

Enriching the user experience with multimodal interfaces

The W3C multimodal architecture and interfaces standard

Analysis of significant dialog events in realistic human–computer interaction

Empathetic video clip experience through timely multimodal interaction

Prototyping and evaluating glove-based multimodal interfaces

Run-time model based framework for automatic evaluation of multimodal interfaces

Measuring the Quality of Service and Quality of Experience of multimodal human–machine interaction

Design and usability evaluation of multimodal interaction with finite state machines: a conceptual framework

Cross-disciplinary approaches to multimodal user interfaces

Multimodal HCI: exploratory studies on effects of first impression and single modality ratings in retrospective evaluation