NDLI: Self-supervised cross-modal online learning of basic object affordances for developmental robotic systems

Content Provider	IEEE Xplore Digital Library
Author	Ridge, B. Skocaj, D. Leonardis, A.
Copyright Year	2010
Description	Author affiliation: Faculty of Computer and Information Science, University of Ljubljana, Slovenia (Ridge, B.; Skocaj, D.; Leonardis, A.)
Abstract	For a developmental robotic system to function successfully in the real world, it is important that it be able to form its own internal representations of affordance classes based on observable regularities in sensory data. Usually successful classifiers are built using labeled training data, but it is not always realistic to assume that labels are available in a developmental robotics setting. There does, however, exist an advantage in this setting that can help circumvent the absence of labels: co-occurrence of correlated data across separate sensory modalities over time. The main contribution of this paper is an online classifier training algorithm based on Kohonen's learning vector quantization (LVQ) that, by taking advantage of this co-occurrence information, does not require labels during training, either dynamically generated or otherwise. We evaluate the algorithm in experiments involving a robotic arm that interacts with various household objects on a table surface where camera systems extract features for two separate visual modalities. It is shown to improve its ability to classify the affordances of novel objects over time, coming close to the performance of equivalent fully-supervised algorithms.
Starting Page	5047
Ending Page	5054
File Size	1184600
Page Count	8
File Format	PDF
ISBN	9781424450381
ISSN	10504729
DOI	10.1109/ROBOT.2010.5509544
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-05-03
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Robot sensing systems Robotics and automation Vector quantization Robot vision systems Cameras Data mining Feature extraction Shape USA Councils Information science
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Control and Systems Engineering Electrical and Electronic Engineering Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Hybrid laser and vision based object search and localization

Multi-camera object detection for robotics

Adaptation to robot failures and shape change in decentralized construction

Probabilistic localization with a blind robot

Using Object Affordances to Improve Object Recognition

Visual sensing of continuum robot shape using self-organizing maps

Object recognition and full pose registration from a single image for robotic manipulation

An approximation algorithm for the least overlapping p-Frame problem with non-partial coverage for networked robotic cameras

Determining Shot Accuracy of a Robotic Pool System

Self-supervised cross-modal online learning of basic object affordances for developmental robotic systems

Similar Documents

Hybrid laser and vision based object search and localization

Multi-camera object detection for robotics

Adaptation to robot failures and shape change in decentralized construction

Probabilistic localization with a blind robot

Using Object Affordances to Improve Object Recognition

Visual sensing of continuum robot shape using self-organizing maps

Object recognition and full pose registration from a single image for robotic manipulation

An approximation algorithm for the least overlapping p-Frame problem with non-partial coverage for networked robotic cameras

Determining Shot Accuracy of a Robotic Pool System

Self-supervised cross-modal online learning of basic object affordances for developmental robotic systems