NDLI: Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: An Empirical Study

Please wait, while we are loading the content...

Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: An Empirical Study

Content Provider	ACM Digital Library
Author	Turrin, Roberto Cremonesi, Paolo Garzotto, Franca
Copyright Year	2012
Abstract	Recommender Systems (RSs) help users search large amounts of digital contents and services by allowing them to identify the items that are likely to be more attractive or useful. RSs play an important persuasion role, as they can potentially augment the users’ trust towards in an application and orient their decisions or actions towards specific directions. This article explores the persuasiveness of RSs, presenting two vast empirical studies that address a number of research questions. First, we investigate if a design property of RSs, defined by the statistically measured quality of algorithms, is a reliable predictor of their potential for persuasion. This factor is measured in terms of perceived quality, defined by the overall satisfaction, as well as by how users judge the accuracy and novelty of recommendations. For our purposes, we designed an empirical study involving 210 subjects and implemented seven full-sized versions of a commercial RS, each one using the same interface and dataset (a subset of Netflix), but each with a different recommender algorithm. In each experimental configuration we computed the statistical quality (recall and F-measures) and collected data regarding the quality perceived by 30 users. The results show us that algorithmic attributes are less crucial than we might expect in determining the user’s perception of an RS’s quality, and suggest that the user’s judgment and attitude towards a recommender are likely to be more affected by factors related to the user experience. Second, we explore the persuasiveness of RSs in the context of large interactive TV services. We report a study aimed at assessing whether measurable persuasion effects (e.g., changes of shopping behavior) can be achieved through the introduction of a recommender. Our data, collected for more than one year, allow us to conclude that, (1) the adoption of an RS can affect both the lift factor and the conversion rate, determining an increased volume of sales and influencing the user’s decision to actually buy one of the recommended products, (2) the introduction of an RS tends to diversify purchases and orient users towards less obvious choices (the long tail), and (3) the perceived novelty of recommendations is likely to be more influential than their perceived accuracy. Overall, the results of these studies improve our understanding of the persuasion phenomena induced by RSs, and have implications that can be of interest to academic scholars, designers, and adopters of this class of systems.
Starting Page	1
Ending Page	41
Page Count	41
File Format	PDF
ISSN	21606455
e-ISSN	21606463
DOI	10.1145/2209310.2209314
Volume Number	2
Issue Number	2
Journal	ACM Transactions on Interactive Intelligent Systems (TiiS)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-06-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	F-measure Recommender Systems Accuracy Conversion rate Design Empirical study Fallout ITV Lift factor Long tail Novelty Perceived quality Persuasion Quality evaluation Recall Recommender algorithm Satisfaction
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Human-Computer Interaction

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Diversity, Serendipity, Novelty, and Coverage: A Survey and Empirical Analysis of Beyond-Accuracy Objectives in Recommender Systems

Using novelty score of unseen items to handle popularity bias in recommender systems

Empirical study of Software Quality estimation

Investigating the Effectiveness of Persuasion Strategies on Recommender Systems

Evaluating the Diversity of Top-N Recommendations

Minimal Interaction Content Discovery in Recommender Systems

Analyzing Potential of Personal Values-Based User Modeling for Long Tail Item Recommendation

Leverage Item Popularity and Recommendation Quality via Cost-Sensitive Factorization Machines

Interaction quality effects on customer satisfaction from the perspective of customers' perception — The empirical test from online stock trading

Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: An Empirical Study

Similar Documents

Diversity, Serendipity, Novelty, and Coverage: A Survey and Empirical Analysis of Beyond-Accuracy Objectives in Recommender Systems

Using novelty score of unseen items to handle popularity bias in recommender systems

Empirical study of Software Quality estimation

Investigating the Effectiveness of Persuasion Strategies on Recommender Systems

Evaluating the Diversity of Top-N Recommendations

Minimal Interaction Content Discovery in Recommender Systems

Analyzing Potential of Personal Values-Based User Modeling for Long Tail Item Recommendation

Leverage Item Popularity and Recommendation Quality via Cost-Sensitive Factorization Machines

Interaction quality effects on customer satisfaction from the perspective of customers' perception — The empirical test from online stock trading

Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: An Empirical Study