NDLI: Assessment of observers' stability and reliability — A tool for evaluation of intra- and inter-concordance in animal behavioral recordings

Content Provider	IEEE Xplore Digital Library
Author	Garcia, V.A. Crispim Junior, C.F. Marino-Neto, J.
Copyright Year	2010
Description	Author affiliation: Institute of Biomedical Engineering, Dept. of Electrical Engineering,, Federal University of Santa Catarina, Brazil (Marino-Neto, J.) \|\| Institute of Biomedical Engineering of Federal University of Santa Catarina, Dept. of Electrical Engineering, Florianopolis, Brazil (Crispim Junior, C.F.) \|\| Electrical Engineering at the Federal University of Santa Catarina Florianopolis, Brazil (Garcia, V.A.)
Abstract	Behavior studies on the neurobiological effects of environmental, pharmacological and physiological manipulations in lab animals try to correlate these procedures with specific changes in animal behavior. Parameters such as duration, latency and frequency are assessed from the visually recorded sequences of behaviors, to distinguish changes due to manipulation. Since behavioral recording procedure is intrinsically interpretative, high variability in experimental results is expected and usual, due to observer-related influences such as experience, knowledge, stress, fatigue and personal biases. Here, we present a computer program that supports the assessment of inter- and intra-observer concordance, using statistical indices (e.g., Kappa and Kendal coefficients and concordance index). The software was tested in a case study with 4 different observers, naïve to behavioral recording procedures. On paired analysis, the higher agreement index achieved was 0.76 (concordance index) and 0.47 (Kappa Coefficient, where 0 is no agreement and 1 is total agreement). Observers showed poor concordance indices (lower than 0.7), emphasizing the concern on observer recording stability and on precise morphological definition of the recorded behaviors. These indices can also be used to train observers and to refine the behavioral catalogue definitions, as they are related to different behavioral recording aspects.
Starting Page	6603
Ending Page	6606
File Size	779873
Page Count	4
File Format	PDF
ISBN	9781424441235
ISSN	1557170X
DOI	10.1109/IEMBS.2010.5627131
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-08-31
Publisher Place	Argentina
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Observers Indexes Software Reliability Animals Mathematical model XML
Content Type	Text
Resource Type	Article
Subject	Signal Processing Biomedical Engineering Health Informatics Computer Vision and Pattern Recognition

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Multimodal multidimensional imaging for visual system status assessment

A reliability assessment software using Kinect to complement the clinical evaluation of Parkinson's disease

A CAD system for atherosclerotic plaque assessment

Drowsiness detection by thoracic effort signal analysis in real driving environments

Multiple-Model Set-Valued Observers: A new tool for HRF model selection in fMRI

Inter-observer variability assessment of a left ventricle segmentation tool applied to 4D MDCT images of the heart

Rényi entropy and Lempel-Ziv complexity of mechanomyographic recordings of diaphragm muscle as indexes of respiratory effort

RESTING STATE INTER AND INTRA HEMISPHERIC HUMAN BRAIN FUNCTIONAL CONNECTIVITY

Trust sensor interface for improving reliability of EMG-based user intent recognition

Assessment of observers' stability and reliability — A tool for evaluation of intra- and inter-concordance in animal behavioral recordings

Similar Documents

Multimodal multidimensional imaging for visual system status assessment

A reliability assessment software using Kinect to complement the clinical evaluation of Parkinson's disease

A CAD system for atherosclerotic plaque assessment

Drowsiness detection by thoracic effort signal analysis in real driving environments

Multiple-Model Set-Valued Observers: A new tool for HRF model selection in fMRI

Inter-observer variability assessment of a left ventricle segmentation tool applied to 4D MDCT images of the heart

Rényi entropy and Lempel-Ziv complexity of mechanomyographic recordings of diaphragm muscle as indexes of respiratory effort

RESTING STATE INTER AND INTRA HEMISPHERIC HUMAN BRAIN FUNCTIONAL CONNECTIVITY

Trust sensor interface for improving reliability of EMG-based user intent recognition

Assessment of observers' stability and reliability — A tool for evaluation of intra- and inter-concordance in animal behavioral recordings