NDLI: Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks

Content Provider	PubMed Central
Author	Bleser, Gabriele Damen, Dima Behera, Ardhendu Hendeby, Gustaf Mura, Katharina Markus, Miezal Gee, Andrew Petersen, Nils Gustavo, Maçães Domingues, Hugo Dominic, Gorecky Almeida, Luis Mayol-cuevas, Walterio Calway, Andrew Cohn, Anthony G. Hogg, David C. Stricker, Didier
Editor	Bontempi, Gianluca
Copyright Year	2015
Abstract	Today, the workflows that are involved in industrial assembly and production activities are becoming increasingly complex. To efficiently and safely perform these workflows is demanding on the workers, in particular when it comes to infrequent or repetitive tasks. This burden on the workers can be eased by introducing smart assistance systems. This article presents a scalable concept and an integrated system demonstrator designed for this purpose. The basic idea is to learn workflows from observing multiple expert operators and then transfer the learnt workflow models to novice users. Being entirely learning-based, the proposed system can be applied to various tasks and domains. The above idea has been realized in a prototype, which combines components pushing the state of the art of hardware and software designed with interoperability in mind. The emphasis of this article is on the algorithms developed for the prototype: 1) fusion of inertial and visual sensor information from an on-body sensor network (BSN) to robustly track the user’s pose in magnetically polluted environments; 2) learning-based computer vision algorithms to map the workspace, localize the sensor with respect to the workspace and capture objects, even as they are carried; 3) domain-independent and robust workflow recovery and monitoring algorithms based on spatiotemporal pairwise relations deduced from object and user movement with respect to the scene; and 4) context-sensitive augmented reality (AR) user feedback using a head-mounted display (HMD). A distinguishing key feature of the developed algorithms is that they all operate solely on data from the on-body sensor network and that no external instrumentation is needed. The feasibility of the chosen approach for the complete action-perception-feedback loop is demonstrated on three increasingly complex datasets representing manual industrial tasks. These limited size datasets indicate and highlight the potential of the chosen technology as a combined entity as well as point out limitations of the system.
Related Links	http://dx.doi.org/10.1371/journal.pone.0127769
Starting Page	127769
File Format	PDF
ISSN	19326203
e-ISSN	19326203
Journal	PLoS ONE
Issue Number	6
Volume Number	10
Language	English
Publisher	Public Library of Science
Publisher Date	2015-06-01
Access Restriction	Open
Rights Holder	Public Library of Science
Subject Keyword	Biochemistry, Genetics and Molecular Biology(all) Agricultural and Biological Sciences(all) Medicine(all) Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Multidisciplinary

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Correlated Dynamics in Egocentric Communication Networks

Egocentric Representation Acquired from Offline Map Learning

Multi-Parametric Clustering for Sensor Node Coordination in Cognitive Wireless Sensor Networks

Real-Time Monitoring of Protein Conformational Changes Using a Nano-Mechanical Sensor

Using Workflows to Explore and Optimise Named Entity Recognition for Chemistry

Improved Object Localization Using Accurate Distance Estimation in Wireless Multimedia Sensor Networks

Reconstructing Causal Biological Networks through Active Learning

Threshold Learning Dynamics in Social Networks

Identifying Cognitive States Using Regularity Partitions

Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks

Similar Documents

Correlated Dynamics in Egocentric Communication Networks

Egocentric Representation Acquired from Offline Map Learning

Multi-Parametric Clustering for Sensor Node Coordination in Cognitive Wireless Sensor Networks

Real-Time Monitoring of Protein Conformational Changes Using a Nano-Mechanical Sensor

Using Workflows to Explore and Optimise Named Entity Recognition for Chemistry

Improved Object Localization Using Accurate Distance Estimation in Wireless Multimedia Sensor Networks

Reconstructing Causal Biological Networks through Active Learning

Threshold Learning Dynamics in Social Networks

Identifying Cognitive States Using Regularity Partitions

Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks