NDLI: A combination of two methods for evaluating the usability of a hospital information system

Content Provider	Springer Nature : BioMed Central
Author	Khajouei, Reza Farahani, Fatemeh
Abstract	Background None of the evaluation methods can identify all the usability problems of information systems. So far, no study has sufficiently investigated the potential of a combination of these methods to identify usability problems. The present study aimed at examining the potential for combining two commonly utilized user-based and expert-based methods to evaluate the usability of a hospital information system. Methods Think aloud (TA) and Heuristic evaluation (HE) methods were used to identify the usability problems of two subsystems of the Social Security Electronic System in Iran. To this end, the problems were categorized into five groups based on ISO-Nielsen usability attributes. The Chi-square test was applied to compare the intended methods based on the total number of problems and the number of problems within each group, followed by utilizing the Mann-Whitney U test to compare the mean severity scores of these methods. Results The evaluation by combining these methods yielded 423 problems of which 75% varied between the methods. The two methods were significantly different in terms of the total number of problems, the number of problems in each usability group, and the mean severity of two satisfaction and efficiency attributes (P < 0.05). However, no significant difference was observed between the two methods based on the mean severity of problems and severity scores related to three usability attributes i.e., effectiveness, learnability, and error prevention (P > 0.05). In addition, the mean severity of problems identified by each method was at the “Major” level. Conclusion Based on the results, although the mean severity scores of the identified problems were not significantly different, these methods identify heterogeneous problems. HE mainly identifies problems related to satisfaction, learnability, and error prevention while TA detects problems related to effectiveness and efficiency attributes. Therefore, using a combination of these two methods can identify a wider range of usability problems.
Related Links	https://bmcmedinformdecismak.biomedcentral.com/counter/pdf/10.1186/s12911-020-1083-6.pdf
Ending Page	10
Page Count	10
Starting Page	1
File Format	HTM / HTML
ISSN	14726947
DOI	10.1186/s12911-020-1083-6
Journal	BMC Medical Informatics and Decision Making
Issue Number	1
Volume Number	20
Language	English
Publisher	BioMed Central
Publisher Date	2020-05-04
Access Restriction	Open
Subject Keyword	Health Informatics Information Systems and Communication Service Management of Computing and Information Systems Usability evaluation Human-computer interaction Heuristic evaluation Think aloud Hospital information system
Content Type	Text
Resource Type	Article
Subject	Health Informatics Computer Science Applications Health Policy
Journal Impact Factor	3.3/2023
5-Year Journal Impact Factor	3.9/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Comparison of usability evaluation methods for a health information system: heuristic evaluation versus cognitive walkthrough method

A heuristic evaluation of a pharmacy surveillance information system

Evaluating the usability of Iran’s national comprehensive health information system: a think-aloud study to uncover usability problems in the recording of childcare data

Investigating usability of mobile health applications in Bangladesh

Usability evaluation of emergency information systems in educational hospitals in Kerman, Iran

Evaluating users’ experiences of electronic prescribing systems in relation to patient safety: a mixed methods study

Usability evaluation of an eHealth intervention for family carers of individuals affected by psychosis: A mixed-method study

Usability Evaluation of Hospital Information System: A Cross-Sectional Study

Quality of human-computer interaction - results of a national usability survey of hospital-IT in Germany

A combination of two methods for evaluating the usability of a hospital information system

Similar Documents

Comparison of usability evaluation methods for a health information system: heuristic evaluation versus cognitive walkthrough method

A heuristic evaluation of a pharmacy surveillance information system

Evaluating the usability of Iran’s national comprehensive health information system: a think-aloud study to uncover usability problems in the recording of childcare data

Investigating usability of mobile health applications in Bangladesh

Usability evaluation of emergency information systems in educational hospitals in Kerman, Iran

Evaluating users’ experiences of electronic prescribing systems in relation to patient safety: a mixed methods study

Usability evaluation of an eHealth intervention for family carers of individuals affected by psychosis: A mixed-method study

Usability Evaluation of Hospital Information System: A Cross-Sectional Study

Quality of human-computer interaction - results of a national usability survey of hospital-IT in Germany

A combination of two methods for evaluating the usability of a hospital information system