Development and Psychometric Evaluation of Scales: A Survey of Published Articles

Foroozan Atashzadeh-Shoorideh, Farideh Yaghmaei



Background and purpose: Using valid and reliable instruments is an important way for collecting data in qualitative researches. This paper is a report of a study conducted to examine the extent of psychometric properties of the scales in research papers published in Journal of Advanced Nursing.
Methods: In this study, the Journal of Advanced Nursing was chosen for systematic review. All articles which were published during 2007-2009 in this journal were collected and articles related to instrument development were selected. Each article was completely reviewed to identify the methods of instrument validation and reliability.
Results: From 980 articles published in Journal of Advanced Nursing during 2007-2009, 41 (4.18%) articles were about research methodology. In these, 12 articles (29.27%) were related to developing an instrument. In this study, review of 12 articles that published in Journal of Advanced Nursing, 2007-2009, showed that some of the articles did not measure psychometric properties properly, thus some of the developed scales need to measure other types of necessary validity. In addition, reliability testing needs to be performed on each instrument used in a study before other statistical analysis are performed. From 12 articles, all of the articles measured and reported Cronbach’s alpha, but four of them did not measure test-retest.
Conclusions: Although researchers put a great emphasis on methodology and statistical analysis, they pay less attention to the psychometric properties of their new instruments. The authors of this article hope to draw the attention of researcher to the importance of measuring psychometric properties of new instruments.



Full Text:




Houser J. Nursing Research: Reading, Using,and Creating Evidence. 2nd Ed. Sudbury, Jones and Bartlett Publishers; 2011.

Watson R, Hugh McK, Seamus C, John K.Nursing Research: Designs and Methods. Elsevier Health Sciences; 2008.

Yaghmaie F. Subjective computer training:Development of a scale. Journal of Medical Education. 2004; 5(1):33-7.

Burns N, Grove SK. Practice of NursingResearch, Conduct, Critique and Utilization. 6th Ed. Philadelphia: Saunders Co; 2009.

Burns N, Grove SK. Understanding NursingResearch, Building an Evidence-Based Practice. 6th Ed. Philadelphia: Saunders Co; 2014.

Rattray J, Jones MC. Essential elements ofquestionnaire design and development. Journal of Clinical Nursing. 2007; 16(2):234–43.

Bush CT. Nursing research. Virginia: RestonPublishing Co; 1985.

Polit DF, Hungler BP. Nursing ResearchPrinciples and Methods. 7th Ed. Philadelphia: Lippincott Co; 2004.

Dempsy PA, Dempsy AD. Using NursingResearch, Process, Critical Evaluation and Utilization. 5th Ed. Philadelphia: Lippincott Co.; 2000.

Kerlinger FN. Foundations of behavioralresearch. 3rd Ed. New York: CBS Publishing; 1986.

Yaghmaie F. Content validity and itsestimation. Journal of Medical Education. 2003; 3(1):25-7.

LoBiondo-Wood G, Haber J. NursingResearch; Methods, Critical Appraisal, and Utilization. 8th Ed. St. Louis: Mosby-Elsevier; 2014.

Polit DF, Beck CT. Essentials of NursingResearch, Methods, Appraisal and Utilization. 6th Ed. Philadelphia: Lippincott Williams & Wilkins; 2006.

Nunnally JC, Bernstein IH. PsychometricTheory. 3rd Ed. New York: McGraw Hill Inc; 1994.

Yaghmaie F. Development of a scale formeasuring user computer experience. Journal of Research Nursing. 2007; 12(2):185-90.

Yaghmaei F. Measuring Behavior in Researchby Valid and Reliable Instruments. 2nd Ed. Tehran: Shahid Beheshti Medical University Publishing; 2009. (Persian)

Clark LA, Watson D. Constructing validity:Basic issues in objective scale development. Psychological Assessment. 1995; 7(9):309–19.

Yaghmaie F. Reliability and its measurement inquantitative studies. Journal of Faculty of Nursing & Midwifery, Shahid Beheshti University of Medical Sciences. 2003; 13(42):22-7. (Persian)

Zagheri-Tafreshi M, Yaghmaie F. Factoranalysis of construct validity: A review of nursing articles. Journal of Medical Education. 2007; 10(1):19-26.

Ushiro R. Nurse–Physician CollaborationScale: development and psychometric testing. Journal of Advanced Nursing. 2009; 65(7):1497–508.

Chang HJ, et al. Chinese version of the positiveand negative suicide ideation: Instrument development. Journal of Advanced Nursing. 2009; 65(7):1485–96.

Eizenberg MM, et al. Moral distressquestionnaire for clinical nurses: instrument development. Journal of Advanced Nursing. 2009; 65(4):885–92.

Munro BH. Statistical Methods for Health CareResearch. 5th edition. Philadelphia: Lippincott Williams and Wilkins; 2005.

Liu M, Yin L, Ma E, Lo S, Zeng L.Competency Inventory for Registered Nurses in Macao: instrument validation. Journal of Advanced Nursing. 2009; 65(4):893–900.

Zisberg A, Young HM, Schepp K.Development and psychometric testing of the Scale of Older Adults’ Routine. Journal of Advanced Nursing. 2009; 65(3):672–83.

Woods-Dauphinee S, Berg K, Daley K.Monitoring status and evaluating outcomes: An overview of rating scales for the use with patients who have sustained a stroke. Topics in Geriatric Rehabilitation. 1994; 10(2):22–41.

Cyr L, Francis K. Measures of clinical fornominal and categorical data: The kappa coefficient. Computers in Biology and Medicine. 1992; 22(4):239-46.

Pelander T, Leino-Kilpi H, Katajisto J. Thequality of pediatric nursing care: developing the Child Care Quality at Hospital instrument for children. Journal of Advanced Nursing. 2009; 65(2):443–53.

Stotts NA, Aldrich KM. How to try this definesyour terms, Evaluating instruments for use in nursing practice. Advanced Journal of Nursing. 2007; 107(10):71-2.

Ferketich S. Focus on psychometrics: Aspectsof item analysis. Research in Nursing & Health. 1991; 14(2); 165–8.

Carlson C. Development and testing of fourinstruments to assess prior conditions that influence nurses’ adoption of evidence-based pain management practices. Journal of Advanced Nursing. 2008; 64(6):632–43.

Pisanti R, Lombardo C, Lucidi F, Lazzari D,Bertini M. Development and validation of a brief Occupational Coping Self-Efficacy Questionnaire for Nurses. Journal of Advanced Nursing. 2008; 62(2):238–47.

Barnes CR, Adamson-Macedo EN. PerceivedMaternal Parenting Self-Efficacy (PMP S-E) instrument: development and validation with mothers of hospitalized preterm neonates. Journal of Advanced Nursing. 2007; 60(5):550–60.

Van Laar D, Edwards J A, Easton S. The Work-related quality of life scale for healthcare workers. Journal of Advanced Nursing. 2007; 60(3):325–33.

Bentler PM, Bonett DG. Significance tests andgoodness of fit in the analysis of covariance structures. Psychological Bulletin. 1980; 88(3):588–606.

Browne MW, Cudeck R. Alternative Ways ofAssessing Model Fit in Testing Structural Equation Models. Sage, Newbury Park, CA, USA; 1993.

Otieno OG, Toyama H, Asonuma M. Nurses’views on the use, quality and user satisfaction with electronic medical records: questionnaire development. Journal of Advanced Nursing. 2007; 60(2):209–19.

Fu M, McDaniel RW, Rhodes VA. Measuringsymptom occurrence and symptom distress: development of the symptom experience index. Journal of Advanced Nursing. 2007; 59(6):623–34.

Streiner DL, Norman GR. Health MeasurementScales: A Practical Guide to Their Development and Use. 5th edition. Oxford University Press Inc.: New York; 2015.

Fu MR, Rhodes VA, Xu B. The Chinesetranslation: The index of nausea, vomiting, and retching (INVR). Cancer Nursing. 2002; 25(2):134–40.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.