NDLI: Modeling the influence of action on spatial attention in visual interactive environments

Content Provider	IEEE Xplore Digital Library
Author	Borji, A. Sihite, D.N. Itti, L.
Copyright Year	2012
Description	Author affiliation: Department of Computer Science, University of Southern California, Los Angeles, USA (Borji, A.; Sihite, D.N.; Itti, L.)
Abstract	A large number of studies have been reported on top-down influences of visual attention. However, less progress have been made in understanding and modeling its mechanisms in real-world tasks. In this paper, we propose an approach for learning spatial attention taking into account influences of physical actions on top-down attention. For this purpose, we focus on interactive visual environments (video games) which are modest real-world simulations, where a player has to attend to certain aspects of visual stimuli and perform actions to achieve a goal. The basic idea is to learn a mapping from current mental state of the game player, represented by past actions and observations, to its gaze fixation. A data-driven approach is followed where we train a model from the data of some players and test it over a new subject. In particular, two contributions this paper makes are: 1) employing multi-modal information including mean eye position, gist of a scene, physical actions, bottom-up saliency, and tagged events for state representation and 2) analysis of different methods of combining bottom-up and top-down influences. Comparing with other top-down task-driven and bottom-up spatio-temporal models, our approach shows higher NSS scores in predicting eye positions.
Starting Page	444
Ending Page	450
File Size	1293965
Page Count	7
File Format	PDF
ISBN	9781467314039
ISSN	10504729
e-ISBN	9781467314053
e-ISBN	9781467314046
DOI	10.1109/ICRA.2012.6224551
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-14
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Games Wheels Vectors Visualization Computational modeling Predictive models Humans
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Control and Systems Engineering Electrical and Electronic Engineering Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

What/Where to Look Next? Modeling Top-Down Visual Attention in Complex Interactive Environments

Trust-driven interactive visual navigation for autonomous robots

Probabilistic learning of task-specific visual attention

Adapting Models of Visual Aesthetics for Personalized Content Creation

Towards a Watson that sees: Language-guided action recognition for robots

Proactive Mediation in Plan-Based Narrative Environments

Integrated probabilistic generative model for detecting smoke on visual images

Locally Weighted Learning Model Predictive Control for nonlinear and time varying dynamics

Automated Planning and Player Modeling for Interactive Storytelling

Modeling the influence of action on spatial attention in visual interactive environments

Similar Documents

What/Where to Look Next? Modeling Top-Down Visual Attention in Complex Interactive Environments

Trust-driven interactive visual navigation for autonomous robots

Probabilistic learning of task-specific visual attention

Adapting Models of Visual Aesthetics for Personalized Content Creation

Towards a Watson that sees: Language-guided action recognition for robots

Proactive Mediation in Plan-Based Narrative Environments

Integrated probabilistic generative model for detecting smoke on visual images

Locally Weighted Learning Model Predictive Control for nonlinear and time varying dynamics

Automated Planning and Player Modeling for Interactive Storytelling

Modeling the influence of action on spatial attention in visual interactive environments