Usability of Emergency Department Information System Based on Users' Viewpoint; a Cross-Sectional Study
Archives of Academic Emergency Medicine,
Vol. 10 No. 1 (2022),
1 January 2022
,
Page e71
https://doi.org/10.22037/aaem.v10i1.1635
Abstract
Introduction: The emergency department is of special importance due to its emergency and vital services, the high volume of referrals, and the patients' physical condition. Thus, it requires a well-designed information system with no usability problems. This study aimed to evaluate the usability of the emergency department information system from users' perspectives.
Methods: This was a cross-sectional study. The research setting was the emergency department of 3 hospitals. The research instrument was a 37-item questionnaire adapted from the USE and ISO Metrics questionnaires, consisting of five dimensions measuring the usefulness of the system, ease of use, ease of learning, user satisfaction, and suitability for the task. The content validity of the questionnaire was examined using the content validity ratio and content validity index, and its reliability was assessed using Cronbach's alpha (α = 0.88).
Results: Fifty questionnaires were administered in the three hospitals, and the response rate was 80%. According to the findings, 55% of the respondents were female. The highest mean scores belonged to usefulness in emergency department information system (EDIS) A, ease of use in EDIS B, ease of learning in EDIS A, user satisfaction in EDIS C, and suitability for the task in EDIS A. According to the usability evaluation criteria, ease of learning (3.66 ± 0.74), usefulness (3.53 ± 0.87), and suitability for the task (3.47 ± 0.96) received the highest scores, and the lowest scores belonged to user satisfaction (3.29 ± 1.01) and ease of use (3.12 ± 1.00).
Conclusion: In terms of usability criteria, the emergency department information system is at a relatively good level. The usability of these systems can be further enhanced by considering the users' working needs, improving software flexibility, customizing the software, using data visualization tools, observing consistency of features and standards, and increasing the quality of information and system services.
- Informtation Systems
- Hospital Information Systems
- Emergency Service, Hospital
How to Cite
References
Steptoe AP, Corel B, Sullivan AF, Camargo CA. Characterizing emergency departments to improve understanding of emergency care systems. International Journal of Emergency Medicine. 2011;4(1):42.
Khademian Z, Sharif F, Tabei SZ, Bolandparvaz S, Abbaszadeh A, Abbasi HR. Teamwork improvement in emergency trauma departments. Iranian journal of nursing and midwifery research. 2013;18(4):333-9.
Redley B, Botti M, Wood B, Bucknall T. Interprofessional communication supporting clinical handover in emergency departments: An observation study. Australasian emergency nursing journal : AENJ. 2017;20(3):122-30.
Soremekun OA, Takayesu JK, Bohan SJ. Framework for analyzing wait times and other factors that impact patient satisfaction in the emergency department. The Journal of emergency medicine. 2011;41(6):686-92.
Morley C, Unwin M, Peterson GM, Stankovich J, Kinsman L. Emergency department crowding: A systematic review of causes, consequences and solutions. PloS one. 2018;13(8):e0203316.
Sun BC, Hsia RY, Weiss RE, Zingmond D, Liang LJ, Han W, et al. Effect of emergency department crowding on outcomes of admitted patients. Annals of emergency medicine. 2013;61(6):605-11.e6.
Stang AS, Crotts J, Johnson DW, Hartling L, Guttmann A. Crowding measures associated with the quality of emergency department care: a systematic review. Academic emergency medicine : official journal of the Society for Academic Emergency Medicine. 2015;22(6):643-56.
Chisholm CD, Collison EK, Nelson DR, Cordell WH. Emergency department workplace interruptions: are emergency physicians "interrupt-driven" and "multitasking"? Academic emergency medicine : official journal of the Society for Academic Emergency Medicine. 2000;7(11):1239-43.
Bergs J, Vandijck D, Hoogmartens O, Heerinckx P, Van Sassenbroeck D, Depaire B, et al. Emergency department crowding: Time to shift the paradigm from predicting and controlling to analysing and managing. International emergency nursing. 2016;24:74-7.
Clark LN, Benda NC, Hegde S, McGeorge NM, Guarrera-Schick TK, Hettinger AZ, et al. Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques. Applied ergonomics. 2017;60:356-65.
Callen J, Li L, Georgiou A, Paoloni R, Gibson K, Li J, et al. Does an integrated Emergency Department Information System change the sequence of clinical work? A mixed-method cross-site study. International journal of medical informatics. 2014;83(12):958-66.
Farley HL, Baumlin KM, Hamedani AG, Cheung DS, Edwards MR, Fuller DC, et al. Quality and safety implications of emergency department information systems. Annals of emergency medicine. 2013;62(4):399-407.
Landman A, Teich JM, Pruitt P, Moore SE, Theriault J, Dorisca E, et al. The Boston Marathon Bombings Mass Casualty Incident: One Emergency Department's Information Systems Challenges and Opportunities. Annals of emergency medicine. 2015;66(1):51-9.
Handel DA, Wears RL, Nathanson LA, Pines JM. Using Information Technology to Improve the Quality and Safety of Emergency Care. Academic Emergency Medicine. 2011;18(6):e45-e51.
Stokes-Buzzelli S, Peltzer-Jones JM, Martin GB, Ford MM, Weise A. Use of health information technology to manage frequently presenting emergency department patients. The western journal of emergency medicine. 2010;11(4):348-53.
Schiro J, Pelayo S, Martinot A, Dubos F, Beuscart-Zéphir MC, Marcilly R. Applying a Human-Centered Design to Develop a Patient Prioritization Tool for a Pediatric Emergency Department: Detailed Case Study of First Iterations. JMIR human factors. 2020;7(3):e18427.
Shapiro JS, Baumlin KM, Chawla N, Genes N, Godbold J, Ye F, et al. Emergency department information system implementation and process redesign result in rapid and sustained financial enhancement at a large academic center. Academic emergency medicine : official journal of the Society for Academic Emergency Medicine. 2010;17(5):527-35.
Kim MS, Shapiro JS, Genes N, Aguilar MV, Mohrer D, Baumlin K, et al. A pilot study on usability analysis of emergency department information system by nurses. Applied clinical informatics. 2012;3(1):135-53.
Landman AB, Bernstein SL, Hsiao AL, Desai RA. Emergency department information system adoption in the United States. Academic emergency medicine : official journal of the Society for Academic Emergency Medicine. 2010;17(5):536-44.
Gagnon MP, Desmartis M, Labrecque M, Car J, Pagliari C, Pluye P, et al. Systematic review of factors influencing the adoption of information and communication technologies by healthcare professionals. Journal of medical systems. 2012;36(1):241-77.
Inokuchi R, Sato H, Nakamura K, Aoki Y, Shinohara K, Gunshin M, et al. Motivations and barriers to implementing electronic health records and ED information systems in Japan. The American journal of emergency medicine. 2014;32(7):725-30.
Kushniruk AW, Triola MM, Borycki EM, Stein B, Kannry JL. Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. International journal of medical informatics. 2005;74(7-8):519-26.
Gediga G, Hamborg K-C, Düntsch I. The IsoMetrics usability inventory: an operationalization of ISO 9241-10 supporting summative and formative evaluation of software systems. Behaviour information technology. 1999;18(3):64-151.
Ahmadi M, Shahmoradi L, Barabadi M, Hoseini F. Usability evaluation of hospital information systems based on isometric 9241. Hakim Med J. 2011;13(4):226-33. [In Persian]
Dehdari T, Rahimi T, Aryaeian N, Gohari MR, Esfeh JM. Developing and testing a measurement tool for assessing predictors of breakfast consumption based on a health promotion model. Journal of nutrition education and behavior. 2014;46(4):250-8.
Hosseini Teshnizi S, Hayavi Haghighi MH, Alipour J. Evaluation of health information systems with ISO 9241-10 standard: A systematic review and meta-analysis. Informatics in Medicine Unlocked. 2021;25:100639.
Rostami S, Sarmad A, Mohammadi M, Cheleie M, Amiri S, Zardoei Golanbary SH. Evaluating hospital information systems from the point of view of the medical records section users in Medical-Educational Hospitals of Kermanshah 2014. Journal of medicine and life. 2015;8(Spec Iss 4):232-40.
Safdari R, Dargahi H, Shahmoradi L. Survey of quality ergonomic of Iran's hospital information system and comparison with three other software from users' point of view. Journal of Hospital. 2010;9(1):33-42. [In Persian]
Hamborg K-C, Vehse B, Bludau H-B. Questionnaire based usability evaluation of hospital information systems. Electronic journal of information systems evaluation. 2004;7(1):21-30.
Machado Faria TV, Pavanelli M, Bernardes JL, editors. Evaluating the Usability Using USE Questionnaire: Mindboard System Use Case. Learning and Collaboration Technologies; 2016 2016//; Cham: Springer International Publishing.
Lund AM. Measuring usability with the use questionnaire12. Usability interface. 2001;8(2):3-6.
Hamidi Farahani R, Sharifi M, Ayat M, Markazi Moghaddam N. Hospital Information Systems in Iranian Military Hospitals: A Multiple Case Analysis. J Arch Mil Med. 2014;2(4):e22853.
Ayat M, Sharifi M. A Multiple Comparison Between Military Hospitals and Civilian Hospitals with a Look on the Maturity Situation of Hospital Information Systems in Iran. J Arch Mil Med. 2017;5(4):e13659.
International Organization for Standardization. Ergonomic requirements for office work with visual display terminals (VDTs) -- Part 11: Guidance on usability. Geneva, Switzerland: International Organization for Standardization; 1998. (ISO 9241-11:1998). Cited [20 February 2022]. Available at: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-1:v1:en
Dantas C, Jegundo A, Quintas J, Martins A, Queirós A, Rocha N. European Portuguese Validation of Usefulness, Satisfaction and Ease of Use Questionnaire (USE). Advances in Intelligent Systems and Computing2017. 570.
Gao M, Kortum P, Oswald F. Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity. 2018;- 62:- 1418.
Khajouei R, Azizi A, Atashi A. Usability Evaluation of an Emergency Information System: A Heuristic Evaluation. Journal of Health Administration. 2013;16(52):61-72.
Kalankesh LR, Nasiry Z, Fein RA, Damanabi S. Factors Influencing User Satisfaction with Information Systems: A Systematic Review. Galen Med J. 2020;9:e1686-e.
Karahoca A, Bayraktar E, Tatoglu E, Karahoca D. Information system design for a hospital emergency department: A usability analysis of software prototypes. Journal of Biomedical Informatics. 2010;43(2):224-32.
McGeorge N, Hegde S, Berg RL, Guarrera-Schick TK, LaVergne DT, Casucci SN, et al. Assessment of Innovative Emergency Department Information Displays in a Clinical Simulation Center. J Cogn Eng Decis Mak. 2015;9(4):329-46.
Sadoughi F, Khoshkam M, Farahi SR. Usability Evaluation Of Hospital Information Systems In Hospitals Affiliated With Mashhad University Of Medical Sciences, Iran. health information management. 2012;9(3):310-7. [In Persian]
Callen J, Paoloni R, Li J, Stewart M, Gibson K, Georgiou A, et al. Perceptions of the effect of information and communication technology on the quality of care delivered in emergency departments: a cross-site qualitative study. Annals of emergency medicine. 2013;61(2):131-44.
Agharezaei Z, Khajouei R, Ahmadian L, Agharezaei L. Usability Evaluation Of A Laboratory Information System. health information management. 2013;10(2 (30)):1-12. [In Persian]
Vartak S, Crandall DK, Brokel JM, Wakefield DS, Ward MM. Transformation of Emergency Department processes of care with EHR, CPOE, and ER event tracking systems. Health information management : journal of the Health Information Management Association of Australia. 2009;38(2):27-32.
Palm J-M, Colombet I, Sicotte C, Degoulet P. Determinants of user satisfaction with a Clinical Information System. AMIA Annu Symp Proc. 2006;2006:614-8.
Yu P, Li H, Gagnon MP. Health IT acceptance factors in long-term care facilities: a cross-sectional survey. International journal of medical informatics. 2009;78(4):219-29.
De Leeuw JA, Woltjer H, Kool RB. Identification of Factors Influencing the Adoption of Health Information Technology by Nurses Who Are Digitally Lagging: In-Depth Interview Study. J Med Internet Res. 2020;22(8):e15630.
Dowding D, Randell R, Gardner P, Fitzpatrick G, Dykes P, Favela J, et al. Dashboards for improving patient care: review of the literature. International journal of medical informatics. 2015;84(2):87-100.
Hoot NR, Aronsky D. Systematic review of emergency department crowding: causes, effects, and solutions. Annals of emergency medicine. 2008;52(2):126-36.
Habib MI, Khan KM. Overcrowding and possible solutions for a busy paediatric emergency department. JPMA The Journal of the Pakistan Medical Association. 2017;67(9):1398-403.
Moghaddasi H, Rabiei R, Asadi F, Ostvan N. Evaluation of Nursing Information Systems: Application of Usability Aspects in the Development of Systems. Healthc Inform Res. 2017;23(2):101-8.
Ehteshami A, Sadoughi F, Saeedbakhsh S, Isfahani MK. Assessment of Medical Records Module of Health Information System According to ISO 9241-10. Acta Inform Med. 2013;21(1):36-41.
- Abstract Viewed: 519 times
- pdf Downloaded: 272 times