NDLI: Multimodal fusion using dynamic hybrid models

Content Provider	IEEE Xplore Digital Library
Author	Amer, M.R. Siddiquie, B. Khan, S. Divakaran, A. Sawhney, H.
Copyright Year	2014
Abstract	We propose a novel hybrid model that exploits the strength of discriminative classifiers along with the representational power of generative models. Our focus is on detecting multimodal events in time varying sequences. Discriminative classifiers have been shown to achieve higher performances than the corresponding generative likelihood-based classifiers. On the other hand, generative models learn a rich informative space which allows for data generation and joint feature representation that discriminative models lack. We employ a deep temporal generative model for unsupervised learning of a shared representation across multiple modalities with time varying data. The temporal generative model takes into account short term temporal phenomena and allows for filling in missing data by generating data within or across modalities. The hybrid model involves augmenting the temporal generative model with a temporal discriminative model for event detection, and classification, which enables modeling long range temporal dynamics. We evaluate our approach on audio-visual datasets (AVEC, AVLetters, and CUAVE) and demonstrate its superiority compared to the state-of-the-art.
Sponsorship	IEEE Comput. Soc.
Starting Page	556
Ending Page	563
File Size	7616351
Page Count	8
File Format	PDF
ISBN	9781479949854
DOI	10.1109/WACV.2014.6836053
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-03-24
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data models Hidden Markov models Hybrid power systems Hafnium Joints Vectors Computational modeling
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Multimodal biometric systems by fusion of palmprint and Finger-Knuckle-Print using Hidden Markov Model

A hybrid continuous speech recognition system using segmental neural nets with hidden Markov models

Musical genres classification using Markov models

Trajectory analysis of speech using continuous state hidden Markov Models

Recognizing Activities Using a Kinect Skeleton Tracking and Hidden Markov Models

A Probabilistic-Based Trust Evaluation Model Using Hidden Markov Models and Bonus Malus Systems

Data Fusion Using Restricted Boltzmann Machines

Algorithms for Hidden Markov Models with Imprecisely Specified Parameters

Multimodal signal fusion

Multimodal fusion using dynamic hybrid models

Similar Documents

Multimodal biometric systems by fusion of palmprint and Finger-Knuckle-Print using Hidden Markov Model

A hybrid continuous speech recognition system using segmental neural nets with hidden Markov models

Musical genres classification using Markov models

Trajectory analysis of speech using continuous state hidden Markov Models

Recognizing Activities Using a Kinect Skeleton Tracking and Hidden Markov Models

A Probabilistic-Based Trust Evaluation Model Using Hidden Markov Models and Bonus Malus Systems

Data Fusion Using Restricted Boltzmann Machines

Algorithms for Hidden Markov Models with Imprecisely Specified Parameters

Multimodal signal fusion

Multimodal fusion using dynamic hybrid models