NDLI: ADVISOR: Personalized Video Soundtrack Recommendation by Late Fusion with Heuristic Rankings

Please wait, while we are loading the content...

Bing, the fastest growing image search engine

Affective media and wearables: surprising findings

Back and to the future: quality provisioning for multimedia content delivery

Cross-modal Retrieval with Correspondence Autoencoder

Analysis/synthesis approaches for creatively processing video signals

Multiple Features But Few Labels?: A Symbiotic Solution Exemplified for Video Analysis

Music Emotion Recognition by Multi-label Multi-layer Multi-instance Multi-view Learning

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

What are the Fashion Trends in New York?

Perception-Guided Multimodal Feature Fusion for Photo Aesthetics Assessment

Weakly-Supervised Image Parsing via Constructing Semantic Graphs and Hypergraphs

Quality-adaptive Prefetching for Interactive Branched Video using HTTP-based Adaptive Streaming

We are not All Equal: Personalizing Models for Facial Expression Analysis with Transductive Parameter Transfer

How 'How' Reflects What's What: Content-based Exploitation of How Users Frame Social Images

Media Experience of Complementary Information and Tweets on a Second Screen

Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits

Optimized Distances for Binary Code Ranking

Mining Cross-network Association for YouTube Video Promotion

What Videos Are Similar with You?: Learning a Common Attributed Representation for Video Recommendation

Medical case retrieval

Local Selection of Features for Image Search and Annotation

libLDB: a library for extracting ultrafast and distinctive binary feature description

VideoLat: An Extensible Tool for Multimedia Delay Measurements

Audiovisual Resynthesis in an Augmented Reality

Fine-grained Visual Faceted Search

Taste+: Digitally Enhancing Taste Sensations of Food and Beverages

WeMash: An Online System for Web Video Mashup

Salable Image Search with Reliable Binary Code

Modeling the Interest-Forgetting Curve for Music Recommendation

Representing And Recognizing Motion Trajectories: A Tube And Droplet Approach

Immersive 3D Communication

AVEC 2014: the 4th international audio/visual emotion challenge and workshop

VideoStory: A New Multimedia Embedding for Few-Example Recognition and Translation of Events

Exploring Principles-of-Art Features For Image Emotion Recognition

Latent Tensor Transfer Learning for RGB-D Action Recognition

Song Recommendation for Social Singing Community

Exploring Inter-feature and Inter-class Relationships with Deep Neural Networks for Video Classification

Discovering the City by Mining Diverse and Multimodal Data Streams

Impact of Ultra High Definition on Visual Attention

Fused one-vs-all mid-level features for fine-grained visual categorization

Self-Organized Inter-Destination Multimedia Synchronization For Adaptive Media Streaming

Object-Based Visual Sentiment Concept Analysis and Application

A Group Testing Framework for Similarity Search in High-dimensional Spaces

Interactive Line Drawing Recognition and Vectorization with Commodity Camera

Validating an iOS-based Rhythmic Auditory Cueing Evaluation (iRACE) for Parkinson's Disease

Iterative Multi-View Hashing for Cross Media Indexing

One of a Kind: User Profiling by Social Curation

ADVISOR: Personalized Video Soundtrack Recommendation by Late Fusion with Heuristic Rankings

Mobile Video Broadcasting Services: Combining Video Composition and Network Efficient Transmission

Segmentation and Indexing of Endoscopic Videos

Caffe: Convolutional Architecture for Fast Feature Embedding

The Yael Library

Sound-Light Giblet

Real-time query-by-image video search system

Reverbalize: A Crowdsourced Reverberation Controller

FreeViewer: An Intelligent Director for 3D Tele-Immersion System

Chic or Social: Visual Popularity Analysis in Online Fashion Networks

Learning to Assess Image Retargeting

Multi-modal Language Models for Lecture Video Retrieval

Over-the-Top Content Delivery: State of the Art and Challenges Ahead

The Workshop on Computational Personality Recognition 2014

Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition

From Writing to Painting: A Kinect-Based Cross-Modal Chinese Painting Generation System

3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks

"Sheldon speaking, Bonjour!": Leveraging Multilingual Tracks for (Weakly) Supervised Speaker Identification

Error-Driven Incremental Learning in Deep Convolutional Neural Network for Large-Scale Image Classification

New Yorker Melange: Interactive Brew of Personalized Venue Recommendations

An Objective Quality of Experience (QoE) Assessment Index for Retargeted Images

Scalable Visual Instance Mining with Threads of Features

Anahita: A System for 3D Video Streaming with Depth Customization

An Event Driven Fusion Approach for Enjoyment Recognition in Real-time

Object Segmentation in Images using EEG Signals

RAPID: Rating Pictorial Aesthetics using Deep Learning

Towards Efficient Privacy-preserving Image Feature Extraction in Cloud Computing

Rescue Tail Queries: Learning to Image Search Re-rank via Click-wise Multimodal Fusion

3D Interest Maps From Simultaneous Video Recordings

Social Embedding Image Distance Learning

Music-information retrieval in environments containing acoustic noise

Learning recognition of semantically relevant video segments from endoscopy videos contributed and edited in a private social network

Menpo: A Comprehensive Platform for Parametric Image Alignment and Visual Deformable Models

Loki+Lire: a framework to create web-based multimedia search engines

Gone: an interactive experience for two people

Automatic Real-Time Zooming and Panning on Salient Objects from a Panoramic Video

SynthAssist: an audio synthesizer programmed with vocal imitation

MiSCon: a hot plugging tool for real-time motion-based system control

n-gram Models for Video Semantic Indexing

Efficient Image Retargeting via Adaptive Pixel Fusion

Food Detection and Recognition Using Convolutional Neural Network

Emerging Topics on Personalized and Localized Multimedia Information Systems

CrowdMM14 - 2014 International ACM Workshop on Crowdsourcing for Multimedia

Gibber: Abstractions for Creative Multimedia Programming

Dynamic Background Learning through Deep Auto-encoder Networks

What's Making that Sound?

Start from Scratch: Towards Automatically Identifying, Modeling, and Naming Visual Attributes

ATLAS: Automatic Temporal Segmentation and Annotation of Lecture Videos Based on Modelling Transition Time

Acceptability-based QoE Management for User-centric Mobile Video Delivery: A Field Study Evaluation

Multi-modal Mutual Topic Reinforce Modeling for Cross-media Retrieval

LiveRender: A Cloud Gaming System Based on Compressed Graphics Streaming

Correlating Speaker Gestures in Political Debates with Audience Engagement Measured via EEG

Help Save The Planet: Please Do Adjust Your Picture

Fashion Parsing with Video Context

User-level psychological stress detection from social media using deep neural network

Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search

Crowdsourcing a Reverberation Descriptor Map

Improving Content-based and Hybrid Music Recommendation using Deep Learning

Automated Multi-Track Mixing and Analysis of Instrument Mixtures

Multimodal Alignment of Videos

Circles and Sounds

Event Detection in Broadcasting Video for Halfpipe Sports

Eat as much as you can: a kinect-based facial rehabilitation game based on mouth and tongue movements

CeleLabel: an interactive system for annotating celebrities in web videos

Line-Based Drawing Style Description for Manga Classification

Learning Compact Face Representation: Packing a Face into an int32

Locality Preserving Discriminative Hashing

Learning Knowledge Bases for Text and Multimedia

EMASC14: 1st International Workshop on Emerging Multimedia Applications and Services for Smart Cities

Predicting Viewer Perceived Emotions in Animated GIFs

Qi Visualizer: An Interactive Pulse Spectrogram Visualization using Mobile Participatory Biometrics

Wally: A Scalable Distributed Automated Video Surveillance System with Rich Search Functionalities

A Multimedia E-Health Framework Towards An Interactive And Non-Invasive Therapy Monitoring Environment

FoodCam-256: A Large-scale Real-time Mobile Food RecognitionSystem employing High-Dimensional Features and Compression of Classifier Weights

Supervised hashing with error correcting codes

Person Search in a Scene by Jointly Modeling People Commonness and Person Uniqueness

Augmented Image Retrieval using Multi-order Object Layout with Attributes

Social multimedia computing

GeoMM 2014: the third ACM multimedia workshop ongeotagging and its applications in multimedia

Context-Based Photography Learning using Crowdsourced Images and Social Media

Stoicheia: Architecture, Sound and Tesla's Apotheosis

Deep Search with Attribute-aware Deep Network

EventEye: Monitoring Evolving Events from Tweet Streams

HMD Viewing Spherical Video Streaming System

Pedestrian Attribute Recognition At Far Distance

Object Tracking using Reformative Transductive Learning with Sample Variational Correspondence

The Stack-of-Rings Interface for Large-Scale Image Browsing on Mobile Touch Devices

Video hyperlinking

HuEvent'14: 2014 workshop on human-centered event understanding from multimedia

Virtual Portraitist: Aesthetic Evaluation of Selfies Based on Angle

States of Diffusion for n+1 devices

Virtual Director Adapting Visual Presentation to Conversation Context in Group Videoconferencing: An Interactive Demo

3D Immersive Cardiopulmonary Resuscitation (CPR) Trainer

Jiku director 2.0: a mobile video mashup system with zoom and pan using motion maps

MSVA: Musical Street View Animator: An Effective and Efficient Way to Enjoy the Street Views of Your Journey

Multimodal Dynamic Networks for Gesture Recognition

Automatic Personality and Interaction Style Recognition from Facebook Profile Pictures

An Introduction to Arts and Digital Culture Inside Multimedia

ImmersiveMe'14: 2nd ACM international workshop on immersive media experiences

Cross Modal Deep Model and Gaussian Process Based Model for MSR-Bing Challenge

SmartVisio: Interactive Sketch Recognition with Natural Correction and Editing

Taking good selfies on your phone

ClockDrift: a mobile application for measuring drift in multimedia devices

QoE-driven Unsupervised Image Categorization for Optimized Web Delivery: Short Paper

Event Detection based on Twitter Enthusiasm Degree for Generating a Sports Highlight Video

Automatic Image Cropping using Visual Composition, Boundary Simplicity and Content Preservation Models

WISMM'14 -- First ACM International Workshop on Internet-Scale Multimedia Management

Bag-of-Words Based Deep Neural Network for Image Retrieval

Speech Emotion Recognition Using CNN

Boosting cross-media retrieval via visual-auditory feature analysis and relevance feedback

Mask Assisted Object Coding with Deep Learning for Object Retrieval in Surveillance Videos

3rd International Workshop on Socially-Aware Multimedia (SAM'14)

Click-through-based Subspace Learning for Image Search

Attractive or Not?: Beauty Prediction with Attractiveness-Aware Encoders and Robust Late Fusion

Transfer in Photography Composition

Estimate Gaze Density by Incorporating Emotion

Summary Abstract for the 3rd ACM International Workshop on Multimedia Analysis for Ecological Data

AWtoolbox: Characterizing Audio Information Using Audio Words

Eyes Whisper Depression: A CCA based Multimodal Approach

Trajectory Based Jump Pattern Recognition in Broadcast Volleyball Videos

PIVP 2014: First International Workshop on Perception Inspired Video Processing

Screencast in the Wild: Performance and Limitations

Just Browsing?: Understanding User Journeys in Online TV

Fast Instance Search Based on Approximate Bichromatic Reverse Nearest Neighbor Search

Serious Games 2014: International Workshop on Serious Games

One-Pass Video Stabilization on Mobile Devices

Inductive Transfer Deep Hashing for Image Retrieval

A Robust Panel Extraction Method for Manga

You Talkin' to Me?: Recognizing Complex Human Interactions in Unconstrained Videos

What Can We Learn about Motion Videos from Still Images?

RIFF: Retina-inspired Invariant Fast Feature Descriptor

Instructional Videos for Unsupervised Harvesting and Learning of Action Examples

Modeling Attributes from Category-Attribute Proportions

Stevens' Power Law in 3D Tele-immersion: Towards Subjective Modeling of Multimodal Cyber Interaction

Beautifying Fisheye Images using Orientation and Shape Cues

Exploiting Correlation Consensus: Towards Subspace Clustering for Multi-modal Data

Multi-view Multi-task Feature Extraction for Web Image Classification

Temporal Fusion Approach Using Segment Weight for Affect Recognition from Body Movements

Learning Multimodal Neural Network with Ranking Examples

Image Re-ranking with an Alternating Optimization

sTrack: Secure Tracking in Community Surveillance

Supervised Discriminative Hashing for Compact Binary Codes

Automatic Removal of Visual Stop-Words

Searching for Recent Celebrity Images in Microblog Platform

Personalized Visual Vocabulary Adaption for Social Image Retrieval

Automatic Image Synthesis from Keywords Using Scene Context

Organizing Video Search Results to Adapted Semantic Hierarchies for Topic-based Browsing

Co-Saliency Detection via Base Reconstruction

Face-Based Automatic Personality Perception

Real-time summarization of user-generated videos based on semantic recognition

Automatic Facial Image Annotation and Retrieval by Integrating Voice Label and Visual Appearance

Facial Attribute Space Compression by Latent Human Topic Discovery

Hacking Chinese Touclick CAPTCHA by Multi-Scale Corner Structure Model with Fast Pattern Matching

Query-Adaptive Hash Code Ranking for Fast Nearest Neighbor Search

Emotional Analysis of Music: A Comparison of Methods

Orthogonal Gaussian Process for Automatic Age Estimation

Systematic Assessment of the Video Recording Position for User-generated Event Videos

Clothing Retrieval Based on Local Similarity with Multiple Images

Points of Interest Detection from Multiple Sensor-Rich Videos in Geo-Space

BAP: Bimodal Attribute Prediction for Zero-Shot Image Categorization

Convolutional Network Features for Scene Recognition

Recognizing Human Activities from Smartphone Sensor Signals

Building a Self-Learning Eye Gaze Model from User Interaction Data

Perceived Audio Quality for Streaming Stereo Music

Twitter-driven YouTube Views: Beyond Individual Influencers

Toward an Estimation of User Tagging Credibility for Social Image Retrieval

Discriminating Native from Non-Native Speech Using Fusion of Visual Cues

Decoding Auditory Saliency from FMRI Brain Imaging

Affective Image Retrieval via Multi-Graph Learning

A Framework of Mobile Visual Search Based on the Weighted Matching of Dominant Descriptor

Crowd Counting via Head Detection and Motion Flow Estimation

Recognizing Thousands of Legal Entities through Instance-based Visual Classification

Efficient Cross-Domain Image Retrieval by Multi-Level Matching and Spatial Verification for Structural Similarity

Semantic feature projection for continuous emotion analysis

Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation

Learning Like a Toddler: Watching Television Series to Learn Vocabulary from Images and Audio

Real-time crowd detection based on gradient magnitude entropy model

Automatic Maya hieroglyph retrieval using shape and context information

Cuteness Recognition and Localization in the Photos of Animals

Face Recognition from Multiple Images per Subject

A Dataset and Taxonomy for Urban Sound Research

A 3D Fingertips Detecting and Tracking Algorithm based on the Sliding Window

Admission Control for Wireless Adaptive HTTP Streaming: An Evidence Theory Based Approach

Instructive Video Retrieval Based on Hybrid Ranking and Attribute Learning: A Case Study on Surgical Skill Training

Temporal Dropout of Changes Approach to Convolutional Learning of Spatio-Temporal Features

Matrix Completion for Cross-view Pairwise Constraint Propagation

A Real-Time Smart Display Detection System

Real-Time HDR Panorama Video

Cross-Media Hashing with Neural Networks

Pose Maker: A Pose Recommendation System for Person in the Landscape Photographing

Dynamic Resource Management in Cloud-based Distributed Virtual Environments

How Your Portrait Impresses People?: Inferring Personality Impressions from Portrait Contents

Representing Musical Patterns via the Rhythmic Style Histogram Feature

Interactive 3D Animation Creation and Viewing System based on Motion Graph and Pose Estimation Method

Who's Time Is It Anyway?: Investigating the Accuracy of Camera Timestamps

Mobile Photo Album Management with Multiscale Timeline

Color Transfer based on Spatial Structure for Telepresence

Jointly Discovering Fine-grained and Coarse-grained Sentiments via Topic Modeling

Interactive Audio Web Development Workflow

Human Computer Interface for Quadriplegic People Based on Face Position/gesture Detection

A Real-Time Smart Assistant for Video Surveillance Through Handheld Devices

What Strikes the Strings of Your Heart?: Multi-Label Dimensionality Reduction for Music Emotion Analysis

A Multi-Touch DJ Interface with Remote Audience Feedback

Fusing Music and Video Modalities Using Multi-timescale Shared Representations

ADVISOR: Personalized Video Soundtrack Recommendation by Late Fusion with Heuristic Rankings

Content Provider	ACM Digital Library
Author	Yu, Yi Zimmermann, Roger Shah, Rajiv Ratn
Abstract	Capturing videos anytime and anywhere, and then instantly sharing them online, has become a very popular activity. However, many outdoor user-generated videos (UGVs) lack a certain appeal because their soundtracks consist mostly of ambient background noise. Aimed at making UGVs more attractive, we introduce ADVISOR, a personalized video soundtrack recommendation system. We propose a fast and effective heuristic ranking approach based on heterogeneous late fusion by jointly considering three aspects: venue categories, visual scene, and user listening history. Specifically, we combine confidence scores, produced by SVMhmm models constructed from geographic, visual, and audio features, to obtain different types of video characteristics. Our contributions are threefold. First, we predict scene moods from a real-world video dataset that was collected from users' daily outdoor activities. Second, we perform heuristic rankings to fuse the predicted confidence scores of multiple models, and third we customize the video soundtrack recommendation functionality to make it compatible with mobile devices. A series of extensive experiments confirm that our approach performs well and recommends appealing soundtracks for UGVs to enhance the viewing experience.
Starting Page	607
Ending Page	616
Page Count	10
File Format	PDF
ISBN	9781450330633
DOI	10.1145/2647868.2654919
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2014-11-03
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Video soundtrack generation Scene mood prediction User preference Geographic category Music retrieval
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in