NDLI: Keynote speech 4: Extraction of linguistic and paralinguistic information from audio-visual data

Content Provider	IEEE Xplore Digital Library
Author	Narayanan, S.
Copyright Year	2015
Description	Author affiliation: Univ. of Southern California, Los Angeles, CA, USA (Narayanan, S.)
Abstract	Audio-visual data have been a key enabler of human observational research and practice. The confluence of sensing, communication and computing technologies is allowing capture and access to data, in diverse forms and modalities, in ways that were unimaginable even a few years ago. Importantly, these data afford the analysis and interpretation of multimodal cues of verbal and non-verbal human behavior. These signals carry crucial information about not only a person's intent and identity but also underlying attitudes and emotions. Automatically capturing these cues, although vastly challenging, offers the promise of not just efficient data processing but in tools for discovery that enable hitherto unimagined insights. Recent computational approaches that have leveraged judicious use of both data and knowledge have yielded significant advances in this regards, for example in deriving rich information from multimodal sources including human speech, language, and videos of visual behavior. This talk will focus on some of the advances and challenges in gathering such data and creating algorithms for machine processing of such cues. It will also introduce some of the freely available data resources for research.
Starting Page	1
Ending Page	2
File Size	440321
Page Count	2
File Format	PDF
e-ISBN	9781467382793
DOI	10.1109/ICSDA.2015.7357854
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-10-28
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Content Type	Text
Resource Type	Synopsis

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automatic visual feature extraction for Mandarin audio-visual speech recognition

Keynote speech 3: Visual quality evaluation for images and videos

Keynote speech 4: Cognitive radio and Australia's National Broadband Network

Evaluation of Prosodic and Voice Quality Features on Automatic Extraction of Paralinguistic Information

Keynote 1 - From data to information to flow

Avsp 2001 international conference on auditory-visual speech processing speechreading essentials: signal, paralinguistic cues, and skill.

Audio-visual speech recognition in noisy audio environments

Continuous Audio-Visual Speech Recognition (1998)

Audio-visual speech recognition by speechreading

Keynote speech 4: Extraction of linguistic and paralinguistic information from audio-visual data

Similar Documents

Automatic visual feature extraction for Mandarin audio-visual speech recognition

Keynote speech 3: Visual quality evaluation for images and videos

Keynote speech 4: Cognitive radio and Australia's National Broadband Network

Evaluation of Prosodic and Voice Quality Features on Automatic Extraction of Paralinguistic Information

Keynote 1 - From data to information to flow

Avsp 2001 international conference on auditory-visual speech processing speechreading essentials: signal, paralinguistic cues, and skill.

Audio-visual speech recognition in noisy audio environments

Continuous Audio-Visual Speech Recognition (1998)

Audio-visual speech recognition by speechreading

Keynote speech 4: Extraction of linguistic and paralinguistic information from audio-visual data