Abstract
Purpose
The umbrella term Patient Reported Outcomes (PRO) has been successfully proposed for instruments measuring perceived health outcomes, but its relationship to current conceptual models remains to be established. Our aim was to develop a classification system for PRO measures based on a valid conceptual model.
Methods
We reviewed models and classification schemes of health outcomes and integrated them in a common conceptual framework, based on the models by Wilson and Cleary and the International Classification of Functioning (ICF). We developed a cross-classification system based on the minimum common set of consistent concepts identified in previous classifications, and specified categories based on the WHO International Classifications (ICD-10, and ICF). We exemplified the use of the classification system with selected PRO instruments.
Results
We identified three guiding concepts: (1) construct (the measurement object); (2) population (based on age, gender, condition, and culture); and (3) measurement model (dimensionality, metric, and adaptability). The application of the system to selected PRO measures demonstrated the feasibility of its use, and showed that most of them actually assess more than one construct.
Conclusion
This classification system of PRO measures, based on a valid integrated conceptual model, should allow the classification of most currently used instruments and may facilitate a more adequate selection and application of these instruments.
Similar content being viewed by others
References
Patrick, D. L., & Erickson, P. (1993). Health status and health policy. New York: Oxford University Press.
Garratt, A., Schmidt, L., Mackintosh, A., & Fitzpatrick, R. (2002). Quality of life measurement: Bibliographic study of patient assessed health outcome measures. BMJ (Clinical Research Ed.), 324(7351), 1417. doi:10.1136/bmj.324.7351.1417.
Tully, M. P., & Cantrill, J. A. (1999). Subjective outcome measurement—A primer. Pharmacy World & Science, 21(3), 101–109. doi:10.1023/A:1008694522700.
Lenderking, W. (2003). Task force report of the patient-reported outcomes harmonization group: Too much harmony, not enough melody? Value in Health, 6(5), 503–504. doi:10.1046/j.1524-4733.2003.65002.x.
Acquadro, C., Berzon, R., Dubois, D., et al. & PRO Harmonization Group. (2003). Incorporating the patient’s perspective into drug development and communication: An ad hoc task force report of the patient-reported outcomes (PRO) harmonization group meeting at the Food and Drug Administration, February 16, 2001. Value in Health, 6(5), 522–531. doi:10.1046/j.1524-4733.2003.65309.x.
Taillefer, M. C., Dupuis, G., Roberge, M. A., & Le May, S. (2003). Health-related quality of life models: Systematic review of the literature. Social Indicators Research, 64, 293–323. doi:10.1023/A:1024740307643.
FDA. (2006). Draft guidance for industry on patient-reported outcome measures: Use in medicinal product development to support labeling claims. Federal Register, 71, 5862–5863.
Levine, D. M., Morlock, L. L., Mushlin, A. I., Shapiro, S., & Malitz, F. E. (1976). The role of new health practitioners in a prepaid group practice: Provider differences in process and outcomes of medical care. Medical Care, 14(4), 326–347. doi:10.1097/00005650-197604000-00004.
Schmidt, S., & Bullinger, M. (2003). Current issues in cross-cultural quality of life instrument development. Archives of Physical Medicine and Rehabilitation, 84(4, Suppl 2), S29–S34. doi:10.1053/apmr.2003.50244.
Emery, M. P., Perrier, L. L., & Acquadro, C. (2005). Patient-reported outcome and quality of life instruments database (PROQOLID): Frequently asked questions. Health and Quality of Life Outcomes, 3(1), 12. doi:10.1186/1477-7525-3-12.
McDowell, I., & Newell, C. (1996). Measuring health. A guide to rating scales and questionnaires. New York: Oxford University Press.
Osoba, D. (2002). A taxonomy of the uses of health-related quality-of-life instruments in cancer care and the clinical meaningfulness of the results. Medical Care, 40(6, Suppl), III31–III38. doi:10.1097/00005650-200206001-00006.
Kirshner, B., & Guyatt, G. (1985). A methodological framework for assessing health indices. Journal of Chronic Diseases, 38(1), 27–36. doi:10.1016/0021-9681(85)90005-0.
Patrick, D. L., & Deyo, R. A. (1989). Generic and disease-specific measures in assessing health status and quality of life. Medical Care, 27(3, Suppl), S217–S232. doi:10.1097/00005650-198903001-00018.
Guyatt, G. H., Veldhuyzen Van Zanten, S. J., Feeny, D. H., & Patrick, D. L. (1989). Measuring quality of life in clinical trials: A taxonomy and review. Canadian Medical Association Journal, 140(12), 1441–1448.
Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118(8), 622–629.
MacKeigan, L. D., & Pathak, D. S. (1992). Overview of health-related quality-of-life measures. American Journal of Hospital Pharmacy, 49(9), 2236–2245.
Patrick, D. L., & Chiang, Y. P. (2002). Measurement of health outcomes in treatment effectiveness evaluations. Medical Care, 38(9, Suppl II), II-14–II-25.
Bowling, A. (1997). Measuring health: A review of quality of life measurement scales (2nd ed.). Buckingham: Open University Press.
The Patient-Reported Outcomes Measurement Information System (PROMIS). (2007). Progress of an NIH roadmap cooperative group during its first two years. Medical Care, 45(5, Suppl 1), S3–S11.
Revicki, D. (2007). FDA draft guidance and health-outcomes research. Lancet, 369, 540–542. doi:10.1016/S0140-6736(07)60250-5.
Valderas, J. M., & Alonso, J. (2007). Linking measurement to rooted theory models in the PROMIS project. Medical Care, 45(10), 1008.
Espallargues, M., Valderas, J. M., & Alonso, J. (2000). Provision of feedback on perceived health status to health care professionals: A systematic review of its impact. Medical Care, 38(2), 175–186. doi:10.1097/00005650-200002000-00007.
Greenhalgh, T., & Peacock, R. (2005). Effectiveness and efficiency of search methods in systematic reviews of complex evidence: Audit of primary sources. BMJ (Clinical Research Ed.), 331(7524), 1064–1065. doi:10.1136/bmj.38636.593461.68.
[25] Patrick DL, Chiang YP. Measurement of Health Outcomes in Treatment Effectiveness Evaluations. Medical Care 2002:38 (9, Suppl. II):II14–II25
Cross-classification.WordNet. Princeton University. (2006). Available at http://wordnet.princeton.edu/perl/webwn?s=cross-classification. Accessed 07 May 2008.
Scientific Advisory Committee of the Medical Outcomes Trust. (2002). Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research, 11, 193–205. doi:10.1023/A:1015291021312.
Streiner, D. L., & Norman, G. R. (1995). Health measurement scales: A practical guide to their development and use (2nd ed.). New York: Oxford University Press.
Wilson, I. B., & Cleary, P. D. (1995). Linking clinical variables with health-related quality of life. Journal of the American Medical Association, 273, 59–65. doi:10.1001/jama.273.1.59.
Engel, G. E. (1977). The need for a new medical model: A challenge for biomedicine. Science, 196(4286), 129–136. doi:10.1126/science.847460.
Sullivan, M. D., Kempen, G. I., Van Sonderen, E., & Ormel, J. (2000). Models of health-related quality of life in a population of community-dwelling Dutch elderly. Quality of Life Research, 9(7), 801–810. doi:10.1023/A:1008987709788.
Orfila, F., Ferrer, M., Lamarca, R., Tebe, C., Domingo-Salvany, A., & Alonso, J. (2006). Gender differences in health-related quality of life among the elderly: The role of objective functional capacity and chronic conditions. Social Science & Medicine, 63(9), 2367–2380. doi:10.1016/j.socscimed.2006.06.017.
Sousa, K. H., & Kwok, O. I. (2006). Putting Wilson and Cleary to the test: Analysis of a HRQOL conceptual model using structural equation modeling. Quality of Life Research, 15, 725–737. doi:10.1007/s11136-005-3975-4.
Hays, R. D., Revicki, D., & Coyne, K. S. (2005). Application of structural equation modeling to health outcomes research. Evaluation & the Health Professions, 28(3), 295–309. doi:10.1177/0163278705278277.
Hofer, S., Benzer, W., Alber, H., et al. (2005). Determinants of health-related quality of life in coronary artery disease patients: A prospective study generating a structural equation model. Psychosomatics, 46(3), 212–223. doi:10.1176/appi.psy.46.3.212.
Üstün, T. B., Chatterji, S., Bickenbach, J., Kostanjsek, N., & Schneider, M. (2003). The international classification of functioning, disability and health: A new tool for understanding disability and health. Disability and Rehabilitation, 25(11–12), 565–571. doi:10.1080/0963828031000137063.
Post, M. W. M., de Witte, L. P., & Schrijvers, A. J. P. (1999). Quality of life and the ICIDH: Towards an integrated conceptual model for rehabilitation outcomes research. Clinical Rehabilitation, 13, 5. doi:10.1191/026921599701532072.
McKenna, S. P., & Doward, L. C. (2004). Integrating patient-reported outcomes. Value in Health, 7(Suppl 1), S9–S12. doi:10.1111/j.1524-4733.2004.7s103.x.
Geyh, S., Cieza, A., Kollerits, B., Grimby, G., & Stucki, G. (2007). Content comparison of health-related quality of life measures used in stroke based on the international classification of functioning, disability and health (ICF): A systematic review. Quality of Life Research, 16(5), 833–851. doi:10.1007/s11136-007-9174-8.
Cieza, A., Geyh, S., Chatterji, S., Kostanjsek, N., Ustun, B., & Stucki, G. (2005). ICF linking rules: An update based on lessons learned. Journal of Rehabilitation Medicine, 37(4), 212–218. doi:10.1080/16501970510040263.
Tennant, A. (1995). Quality of life—A measure too far? Annals of the Rheumatic Diseases, 54(6), 439–440. doi:10.1136/ard.54.6.439.
Oxford English Dictionary. (2008). Oxford: Oxford University Press. Available online at http://www.oed.com/. Accessed 7 May 2008.
Starfield, B. (1973). Health services research: A working model. The New England Journal of Medicine, 289(3), 132–136.
Shikiar, R., & Rentz, A. M. (2004). Satisfaction with medication. An overview of conceptual, methodologic and regulatory issues. Value in Health, 7, 204–215. doi:10.1111/j.1524-4733.2004.72252.x.
International Statistical Classification of Diseases and Related Health Problems. 10th Revision Version for 2006. Accesible at http://www.who.int/classifications/apps/icd/icd10online/. Accessed 15 May 2008.
International Classification of Functioning.Disability and Health. Accesible at http://www.who.int/classifications/icf/site/onlinebrowser/icf.cfm. Accessed 15 May 2008.
Streiner, D., & Normand, C. (1995). Health measurement scales: A practical guide to their development and use (2nd ed.). Oxford: Oxford University Press.
Nunnally, J. C. (1967). Psychometric theory. New York: McGraw Hill.
Wright, J. G., & Feinstein, A. R. (1992). A comparative contrast of clinimetric and psychometric methods for constructing indexes and rating scales. Journal of Clinical Epidemiology, 45, 1201–1218. doi:10.1016/0895-4356(92)90161-F.
Ribera, A., Permanyer-Miralda, G., Alonso, J., Cascant, P., Soriano, N., & Brotons, C. (2006). Is psychometric scoring of the McNew quality of life after myocardial infarction questionnaire superior to the clinimetric scoring? A comparison of the two approaches. Quality of Life Research, 15(3), 357–365. doi:10.1007/s11136-005-2291-3.
Kaplan, R. M. (1998). Profile versus utility based measures of outcome for clinical trials. In M. J. Staquet, R. D. Hays & P. M. Fayers (Eds.), Quality of life assessment in clinical trials. Methods and practice. Oxford: Oxford University Press.
Bowling, A. (2005). Just one question: If one question works, why ask several? Journal of Epidemiology and Community Health, 59, 342–345. doi:10.1136/jech.2004.021204.
Carr, J. A., & Higginson, I. J. (2001). Are quality of life measures patient centered? BMJ (Clinical Research Ed.), 322, 1357–1360. doi:10.1136/bmj.322.7298.1357.
Patel, K. K., Veenstra, D. L., & Patrick, D. L. (2003). A review of selected patient-generated outcome measures and their application in clinical trials. Value in Health, 6(5), 595–603. doi:10.1046/j.1524-4733.2003.65236.x.
Gill, T. M., & Feinstein, A. R. (1994). A critical appraisal of the quality of quality of life measurements. Journal of the American Medical Association, 272, 619–626. doi:10.1001/jama.272.8.619.
Kosinski, M., Bjorner, J. B., Ware, J. E., Jr., Sullivan, E., & Straus, W. L. (2006). An evaluation of a patient-reported outcomes found computerized adaptive testing was efficient in assessing osteoarthritis impact. Journal of Clinical Epidemiology, 59(7), 715–723. doi:10.1016/j.jclinepi.2005.07.019.
Jette, A.M., & Badley, E. (2000). Conceptual issues in the measurement of work disability. In: N. Mathiowetz & G. S. Wunderlich (Eds), Survey measurement of work disability: Summary of a workshop (pp. 4–27). Washington DC: National Academy Press. Available online at http://books.nap.edu/html/work_disability/ch2.html. Accessed 19 July 2008.
Valderas, J. M., Ferrer, M., Mendívil, J., Garin, O., Rajmil, L., Herdman, M., et al. (2008). The scientific committee on “patient-reported outcomes” of the IRYSS network. Development of EMPRO: A tool for the standardized assessment of patient-reported outcome measures. Value in Health, 11(4), 700–708. doi:10.1111/j.1524-4733.2007.00309.x.
Valderas, J. M., Kotzeva, A., Espallargues, M., Guyatt, G., Ferrans, C. E., Halyard, M. Y., et al. (2008). The impact of measuring patient-reported outcomes in clinical practice: A systematic review of the literature. Quality of Life Research, 17(2), 179–193. doi:10.1007/s11136-007-9295-0.
Valderas, J. M., Alonso, J., & Guyatt, G. H. (2008). Measuring patient-reported outcomes: Moving from clinical trials into clinical practice. The Medical Journal of Australia, 189(2), 93–94.
Krumholz, H. M., Normand, S. T., Spertus, J. A., Shahian, D. M., & Bradley, E. H. (2007). Measuring performance for treating heart attacks and heart failure: The case for outcomes measurement. Health Affairs, 26(1), 75–85. doi:10.1377/hlthaff.26.1.75.
Patel, K. K., Veenstra, D. L., & Patrick, D. L. (2003). A review of selected patient-generated outcome measures and their application in clinical trials. Value Health, 6(5), 595–603.
Acknowledgement
The authors would like to thank Dr Montse Ferrer, MD PhD MPH (Health Services Research Unit, IMIM-Hospital del Mar, Spain) and Dr Martin Roland, DM (Director of the National Primary Care Research and Development Centre, Manchester University, UK) for their thoughtful comments on a previous draft of the manuscript. We would also wish to acknowledge the contribution of two anonymous reviewers to the completeness and clarity we may have achieved in this article.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Valderas, J.M., Alonso, J. Patient reported outcome measures: a model-based classification system for research and clinical practice. Qual Life Res 17, 1125–1135 (2008). https://doi.org/10.1007/s11136-008-9396-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-008-9396-4