NDLI: Research and experiment of lip coordination with speech for the humanoid head robot-“H&Frobot-III”

Content Provider	IEEE Xplore Digital Library
Author	Meng Qingmei Wu Weiguo Zhong Yusheng Song Ce
Copyright Year	2008
Description	Author affiliation: Dept. of Mechanism Design, Harbin Inst. of Technol., Harbin (Meng Qingmei; Wu Weiguo; Zhong Yusheng; Song Ce)
Abstract	This paper proposes a method of lip shape coordination with speech in the facial expression robot system ldquoH&Frobot-IIIrdquo. The proposed method can model the talking robotpsilas lip shape using visual speech system, which includes three modules: speech recognition, lip shape recognition and lip pose actuator. In the lip shape recognition module, a viseme representation method is proposed for synthesising the human visual speech. To analyze the robotpsilas lip shape, lip shape model is developed based on the anatomy and facial action coding system (FACS). When robot speaking, the lip shape coordination with speech can be realized through basic lip shape or the combination of basic lip shape. In the ldquoH&Frobot-IIIrdquo system, the lip shape is realized through slide and guide slot mechanism, which implements the two-way movement of muscle in the lip. Finally, the result of the experiment, which is the lip coordination with speech, is shown. When speaking same word, the lip shape of robot is similarity to that of human.
Starting Page	603
Ending Page	608
File Size	12193090
Page Count	6
File Format	PDF
ISBN	9781424428212
DOI	10.1109/ICHR.2008.4756012
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2008-12-01
Publisher Place	South Korea
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Temperature sensors Actuators Shape Robot kinematics Humanoid robots Speech recognition Robot sensing systems Magnetic heads Human robot interaction Speech synthesis
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Fritz - A Humanoid Communication Robot

Integration of emotional reactions on human facial expressions into the robot head MEXI

Control of facial expressions of the humanoid robot head ROMAN

Design of a humanoid robot head for studying human-robot interaction

i-RoK: A human like robotic head

Interactive hand/eye coordination between a human and a humanoid-a proposal

Natural human-robot interaction using speech, head pose and gestures

Learning sensory motor coordination for grasping by a humanoid robot

Research and Development of the Humanoid Head Portrait Robot "H&Frobot-II" with Expression and Function of Recognizing Human Expression

Research and experiment of lip coordination with speech for the humanoid head robot-“H&Frobot-III”

Similar Documents

Fritz - A Humanoid Communication Robot

Integration of emotional reactions on human facial expressions into the robot head MEXI

Control of facial expressions of the humanoid robot head ROMAN

Design of a humanoid robot head for studying human-robot interaction

i-RoK: A human like robotic head

Interactive hand/eye coordination between a human and a humanoid-a proposal

Natural human-robot interaction using speech, head pose and gestures

Learning sensory motor coordination for grasping by a humanoid robot

Research and Development of the Humanoid Head Portrait Robot "H&Frobot-II" with Expression and Function of Recognizing Human Expression

Research and experiment of lip coordination with speech for the humanoid head robot-“H&Frobot-III”