NDLI: A software framework for multimodal humancomputer interaction systems

Content Provider	IEEE Xplore Digital Library
Author	Jie Shen Pantic, M.
Copyright Year	2009
Description	Author affiliation: Department of Computing, Imperial College London, U.K., EEMCS, Univ. Twente, N.L. (Pantic, M.) \|\| Department of Computing, Imperial College London, London, U.K. (Jie Shen)
Abstract	This paper describes a software framework we designed and implemented for the development and research in the area of multimodal human-computer interface. The proposed framework is based on publish / subscribe architecture, which allows developers and researchers to conveniently configure, test and expand their system in a modular and incremental manner. In order to achieve reliable and efficient data transport between modules while still providing a high degree of system flexibility, the framework uses a shared-memory based data transport protocol for message delivery together with a TCP based system management protocol to maintain the integrity of system structure at runtime. The framework is delivered as a communication middleware, providing a basic system manager and well-documented, easy-to-use and open source C++ SDKs supporting both module development and server extension. The experimental comparison between the proposed framework and other similar tools available to the community indicates that our framework greatly outperforms the others in terms of average message latency, maximum data throughput and CPU consumption level, especially in heavy workload scenarios. To demonstrate the performance of our framework in real world applications, we have built a demo system which is used to detect faces and facial feature points in real-time captured video. The result shows our framework is capable of delivering some tens of megabytes of data per second effectively and efficiently even under tight resource constraint.
Starting Page	2038
Ending Page	2045
File Size	346931
Page Count	8
File Format	PDF
ISBN	9781424427932
ISSN	1062922X
DOI	10.1109/ICSMC.2009.5346338
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-10-11
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Transport protocols Face detection Software design Computer architecture System testing Maintenance Middleware Delay Throughput Facial features Publish / Subscribe Architecture Software Framework Multimodal Human Computer Interface
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

${rm HCI}^{wedge}2$ Framework: A Software Framework for Multimodal Human-Computer Interaction Systems

HCI⁁2 Workbench: A development tool for multimodal human-computer interaction systems

A Software Framework for Multimodal Human- Computer Interaction Systems

UbiBroker: Event-based communication architecture for pervasive display networks

Abstract: A Survey of Versatility for Publish/Subscribe (2005)

A Survey on Versatility for Publish/Subscribe Infrastructures (2005)

An upgrade mechanism based on publish/subscribe interaction 1.

Publish-subscribe for high-performance computing

Architecting a Testing Framework for Publish/Subscribe Applications

A software framework for multimodal humancomputer interaction systems

Similar Documents

${rm HCI}^{wedge}2$ Framework: A Software Framework for Multimodal Human-Computer Interaction Systems

HCI⁁2 Workbench: A development tool for multimodal human-computer interaction systems

A Software Framework for Multimodal Human- Computer Interaction Systems

UbiBroker: Event-based communication architecture for pervasive display networks

Abstract: A Survey of Versatility for Publish/Subscribe (2005)

A Survey on Versatility for Publish/Subscribe Infrastructures (2005)

An upgrade mechanism based on publish/subscribe interaction 1.

Publish-subscribe for high-performance computing

Architecting a Testing Framework for Publish/Subscribe Applications

A software framework for multimodal humancomputer interaction systems