Patient-Related Outcome Measures for Shoulder Surgery and Rehabilitation
Lori A. Michener, PhD, PT, ATC
Phillip W. McClure, PT, PhD
Dr. McClure or an immediate family member serves as a board member, owner, officer, or committee member of the Journal of Orthopaedic and Sports Physical Therapy. Dr. Michener or an immediate family member has received nonincome support (such as equipment or services), commercially derived honoraria, or other non-research–related funding (such as paid travel) from the Journal of Orthopaedic and Sports Physical Therapy; and serves as a board member, owner, officer, or committee member of the ACOEM–American College of Occupational and Environmental Medicine, the American Physical Therapy Association–Orthopaedic Section, the ASSET–American Society of Shoulder and Elbow Therapists, the Journal of Orthopaedic and Sports Physical Therapy, and the Shoulder and Elbow–British Elbow and Shoulder Society.
Introduction
Outcome measures can be used to systematically assess the effects of surgical interventions and rehabilitation for musculoskeletal shoulder disorders. Ernest Codman, MD, was the first to describe this “end result idea” in 1905. He subsequently was also the first physician to describe the outcomes of the patients he treated in order to improve quality of care. To systematically assess the outcomes of care, outcome measures should be selected that can be simply and routinely performed, with adequate psychometric properties, and that are relevant to the patient. Patient-rated outcome (PRO) measures can fit these requirements to assess the effects of care for both individuals and groups of patients, as well as to guide treatment decision-making in daily clinical practice for individual patients. By providing the patient perspective, PROs can assess the direct impact of a shoulder disorder and its treatment on the patient’s daily activities and participation in work and recreational pursuits, which facilitates the assessment of the effectiveness and efficacy of treatment interventions. Moreover, PROs aid in the assessment of cost-effectiveness and value.
Clinician-rated impairment measures, such as shoulder range of motion (ROM) and strength, assess muscle and joint capacity in isolation, thus do not specifically determine the ability of the patient to use the upper extremity during required daily activities. These assessments of tissue or joint impairments are inadequate to comprehensively assess outcomes of care. PROs assess the patient perspective, which is frequently more reflective of the desired functional status, and is ultimately the most important aspect of outcome of care. Moreover, most PROs meet the requirements of simple routine use. Why are they not being used by clinicians consistently? Reported reasons for the lack of PRO use are unfamiliarity with the measures, time considerations for the patient and clinician, and lack of knowledge to interpret and use the final scores. This chapter will provide an overview of PROs for shoulder disorders—how to interpret and use the scores for treatment decision-making and quality improvement.
Psychometric Measurement Properties of Patient-Rated Outcomes
PRO measures should have established measurement properties of reliability, validity, error estimates, and responsiveness. In Table 2.1, these psychometric properties and common terms are defined. The properties of a PRO should be evaluated in a sample group of patients in whom the PRO is intended to be used. A PRO score should be reliable and reproducible over time in patients whose shoulder symptoms and function/disability are not changing. Items used to generate the total score or subscales scores should demonstrate internal consistency, which is the similarity of the items used to form the score. Types of validity of a scale include: (1) concurrent validity—correlated with other similar scales or measures of shoulder disability, (2) convergent validity—not related to scales that are not measures of shoulder disability, and (3) discriminate validity—ability to discriminate between patients with different levels of disability.
For daily clinical use and interpretation of a scale, the most helpful metrics are the error and responsiveness values. Error estimates are used to interpret the scale’s single score or a changed score. The standard error of the measure (SEM) is an estimate of error of a score when a patient completes a score just one time; SEM = standard deviation × [(1 − internal consistency coefficient or reliability coefficient)1/2]. The minimal detectable change (MDC), also known as the smallest detectable difference (SDD), is the error associated with change scores (e.g., before and after treatment); MDC = SEM × [(2)1/2]. The SEM and MDC both have a 68% confidence interval (CI).
To determine the 90% CI, the SEM and MDC are multiplied by the corresponding z-score of 1.64 for the SEM90 and MDC90, respectively. A critical feature of these error estimates is that they are in the same units or points as the scale itself; therefore, they allow a direct interpretation of error rather than a standardized reliability coefficient.
To determine the 90% CI, the SEM and MDC are multiplied by the corresponding z-score of 1.64 for the SEM90 and MDC90, respectively. A critical feature of these error estimates is that they are in the same units or points as the scale itself; therefore, they allow a direct interpretation of error rather than a standardized reliability coefficient.
Table 2.1 PSYCHOMETRIC MEASUREMENT PROPERTIES OF PATIENT-RATED OUTCOMES | ||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Responsiveness, as an aspect of validity, is the ability of a scale to measure clinical change when it has occurred. Two established metrics, effect size (ES) and standardized response mean (SRM), are used to assess the size of treatment effect over time by calculating the magnitude of the change that has occurred and taking into account the variability (standard deviation) of the scores. To determine if the change is clinically meaningful, an external criterion of improvement is used as an anchor to establish meaningful clinical change. The minimally clinically important difference (MCID), also known as the minimal important change (MIC) value, is the PRO change value that indicates the minimally clinically important change in the PRO score. A more recent term—the substantial clinical benefit (SCB), also known as major clinically important improvement (MCII)—is the PRO change value of substantial or large change that may be expected over a longer period of treatment or as a long-term outcome. The MCID and SCB are both anchor-based metrics that can be used to determine if change in a PRO score is clinically meaningful.
Patient-Rated Outcomes for Musculoskeletal Shoulder Disorders
Shoulder pain and symptoms, difficulty with activities and participation, and patient satisfaction with shoulder use are the major elements assessed in PRO measures for shoulder disorders. PROs that are commonly used to assess outcomes of surgery and rehabilitation and have established measurement properties are presented in Table 2.2. These measures include two PROs, the Disabilities of the Arm, Shoulder, and Hand (DASH) and the Quick-DASH, which consider both upper extremities as a single unit when assessing symptoms and disability. This is accomplished by asking the patient to answer based on ability to perform the tasks “regardless of how you perform the task,” stating that “it doesn’t matter which hand or arm you use to perform the activity.” Thus, the DASH and Quick-DASH do not allow for the specific assessment of only the involved shoulder. Three other PROs assess function/disability, two including symptoms of pain of the involved shoulder specifically. The American Shoulder and Elbow Surgeon’s (ASES) Patient Self-Report, developed by the American Shoulder and Elbow Surgeons, assesses pain and function/disability considering the right or left shoulder individually with respect to the level of difficulty with daily tasks. The ASES function subscale has 10 questions, with ratings of difficulty using a 4-point Likert scale. The Simple
Shoulder Test (SST) epitomizes its name. It contains 12 simple items of daily function with dichotomous (yes/no) response options. The University of Pennsylvania Shoulder Score (Penn) assesses function and pain as well as patient satisfaction with shoulder use for the involved shoulder. The Penn uses an 11-point numeric rating for pain and satisfaction, and a 5-point Likert scale for the functional items.
Shoulder Test (SST) epitomizes its name. It contains 12 simple items of daily function with dichotomous (yes/no) response options. The University of Pennsylvania Shoulder Score (Penn) assesses function and pain as well as patient satisfaction with shoulder use for the involved shoulder. The Penn uses an 11-point numeric rating for pain and satisfaction, and a 5-point Likert scale for the functional items.
Table 2.2 SCALE MEASUREMENT PROPERTIES PATIENT-RELATED OUTCOMES | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|