NDLI: Online Estimation of Evolving Human Visual Interest

Please wait, while we are loading the content...

Online Estimation of Evolving Human Visual Interest

Content Provider	ACM Digital Library
Author	Kalpathi, Ramakrishnan Kankanhalli, Mohan Rajagopal, Anoop Kolar Katti, Harish
Copyright Year	2014
Abstract	Regions in video streams attracting human interest contribute significantly to human understanding of the video. Being able to predict $\textit{salient}$ and informative Regions of Interest (ROIs) through a sequence of eye movements is a challenging problem. Applications such as content-aware retargeting of videos to different aspect ratios while preserving informative regions and smart insertion of dialog (closed-caption $text)^{1}$ into the video stream can significantly be improved using the predicted ROIs. We propose an interactive human-in-the-loop framework to model eye movements and predict visual saliency into yet-unseen frames. Eye tracking and video content are used to model visual attention in a manner that accounts for important eye-gaze characteristics such as temporal discontinuities due to sudden eye movements, noise, and behavioral artifacts. A novel statistical- and algorithm-based method gaze buffering is proposed for eye-gaze analysis and its fusion with content-based features. Our robust saliency prediction is instantiated for two challenging and exciting applications. The first application alters video aspect ratios on-the-fly using content-aware video retargeting, thus making them suitable for a variety of display sizes. The second application dynamically localizes active speakers and places dialog captions on-the-fly in the video stream. Our method ensures that dialogs are faithful to active speaker locations and do not interfere with salient content in the video stream. Our framework naturally accommodates personalisation of the application to suit biases and preferences of individual users.
Starting Page	1
Ending Page	21
Page Count	21
File Format	PDF
ISSN	15516857
e-ISSN	15516865
DOI	10.1145/2632284
Volume Number	11
Issue Number	1
Journal	ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2014-09-04
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Video retargeting Gaze Video captioning Visual attention
Content Type	Text
Resource Type	Article
Subject	Hardware and Architecture Computer Networks and Communications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Algorithms for video retargeting

Video game design using an eye-movement-dependent model of visual attention

Visual Attention Retargeting

Video accessibility enhancement for hearing-impaired users

Depth Personalization and Streaming of Stereoscopic Sports Videos

Supporting region-of-interest cropping through constrained compression

Analysis and Detection of Fake Views in Online Video Services

Semantic Photo Retargeting Under Noisy Image Labels

The conductor interaction method

Online Estimation of Evolving Human Visual Interest

Similar Documents

Algorithms for video retargeting

Video game design using an eye-movement-dependent model of visual attention

Visual Attention Retargeting

Video accessibility enhancement for hearing-impaired users

Depth Personalization and Streaming of Stereoscopic Sports Videos

Supporting region-of-interest cropping through constrained compression

Analysis and Detection of Fake Views in Online Video Services

Semantic Photo Retargeting Under Noisy Image Labels

The conductor interaction method

Online Estimation of Evolving Human Visual Interest