NDLI: Toward better retrieval and presentation by exploring cross-media correlations

Please wait, while we are loading the content...

Toward better retrieval and presentation by exploring cross-media correlations

Content Provider	Springer Nature Link
Author	Chu, Wei Ta Chen, Herng Yow
Copyright Year	2005
Abstract	This paper addresses explicit correlation and implicit correlation between various media streams in a composite multimedia document, the so-called navigated hypermedia document in our language learning system, in order to facilitate document retrieval and synchronized presentation. For replaying a recorded lecture in a form as close as possible to the original classroom experience, we devised a capturing mechanism to explicitly record all the lecturing media streams and relations between them, including instructor’s voice, slide change of the HTML lectures, and various guiding actions (e.g., tele-pointers, pen strokes, document scrolling, keyword highlighting, and text annotations) on HTML-based slides. In addition, for more effective learning, we study three different aspects - temporal, spatial, and content relation - of the implicit correlations that are inherently hidden between the media involved. The implicit relations are discovered by three designed processes: the speech-text alignment process for temporally synchronized speech-text presentation, the automatic scrolling process for the viewing window’s spatial synchronization, and the content dependency checking process to ensure consistency of the content processed and the relations involved. The experimental results show that exploring cross-media correlations is helpful for system development in document presentation and retrieving. Users are allowed to replay a vivid and learning-effective multimedia lecture and to access the desired part of the document very easily via cross-media indexing. Hence the results have been applied to the development of online multimedia language learning systems aimed at improving students’ English and Chinese language capabilities.
Starting Page	183
Ending Page	198
Page Count	16
File Format	PDF
ISSN	09424962
Journal	Multimedia Systems
Volume Number	10
Issue Number	3
e-ISSN	14321882
Language	English
Publisher	Springer-Verlag
Publisher Date	2005-01-01
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Cross-media correlation Multimedia synchronization Content access and presentation Computer Communication Networks Operating Systems Data Storage Representation Data Encryption Computer Graphics Image Processing
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Information Systems Media Technology Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Cross-media retrieval by intra-media and inter-media correlation mining

Analyzing semantic correlation for cross-modal retrieval

A middleware to enhance current multimedia retrieval systems with content-based functionalities

Systems and architectures for multimedia information retrieval

Inter-destination multimedia synchronization: schemes, use cases and standardization

Semantic interactive image retrieval combining visual and conceptual content description

Modeling user context with applications to media retrieval

FAST: Toward more effective and efficient image retrieval

Relative image similarity learning with contextual information for Internet cross-media retrieval

Toward better retrieval and presentation by exploring cross-media correlations

Similar Documents

Cross-media retrieval by intra-media and inter-media correlation mining

Analyzing semantic correlation for cross-modal retrieval

A middleware to enhance current multimedia retrieval systems with content-based functionalities

Systems and architectures for multimedia information retrieval

Inter-destination multimedia synchronization: schemes, use cases and standardization

Semantic interactive image retrieval combining visual and conceptual content description

Modeling user context with applications to media retrieval

FAST: Toward more effective and efficient image retrieval

Relative image similarity learning with contextual information for Internet cross-media retrieval

Toward better retrieval and presentation by exploring cross-media correlations