Intra- and inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM)
Main Article Content
Abstract
Objectives: To examine intra-rater and inter-rater reliability of the STREAM Thai version in evaluating motor recovery of patients with stroke.
Materials and methods: Thirty patients with stroke (mean age 62.5±13.5 yrs.) participated in the study. Time post stroke was between 15 days to 5 years. Seventeen participants had left hemiparesis and 13 participants had right hemiparesis. Raters were physical therapists experienced in stroke rehabilitation and received STREAM training. For intra-rater reliability test, the same physical therapist re-assessed each patient through videotape 7 days after the first assessment. For inter-rater reliability test, STREAM Thai version was administered to each patient by two physical therapists in a random order and the same setting within 24 hours interval. Intra-rater and inter-rater reliability was calculated using intraclass correlation coefficients (ICC) model 3, 1 and 2, 1, respectively. The significance level was set at p<0.05.
Results: Intra-rater reliability of the STREAM Thai version and all subcomponents was demonstrated by ICC of 0.99. ICC for inter-rater reliability was 0.96. Sub-analysis for each component revealed the ICCs of 0.98, 0.94 and 0.83 for estimating the inter-rater reliability of upper limb movement, lower limb movement, and basic mobility, respectively. Bland Altman plots revealed that mean difference between assessments was -1.4 points (95% confidence interval between -7.2 and 4.3 points), between raters was -5.5 points (95% confidence interval between -23.8 and 12.8 points).
Conclusion: Assessment of motor recovery in patients with stroke using STREAM Thai version by trained PT who had stroke rehabilitation experience was highly reliable for both intra-rater and inter-rater.
Journal of Associated Medical Sciences 2017; 50(1): 71-86. Doi: 10.14456/jams.2017.7
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Personal views expressed by the contributors in their articles are not necessarily those of the Journal of Associated Medical Sciences, Faculty of Associated Medical Sciences, Chiang Mai University.
References
2. Bureau of policy and strategy: Public health statistics 2007-2011. Ministry of Public Health, Thailand.
3. Task Force on Standards for Measurement in Physical Therapy. Standards for tests and measurements in physical therapy practice. Phys Ther 1991; 71: 589-622.
4. Sungkarat S. Neurorehabilitation of individuals with brain disorders: from theory to practice. Chiang Mai: Siamnana Printing; 2013.
5. Gor-Garcia-Fogeda MD, Molina-Rueda F, Cuesta-Gomez A, Carratala-Tejada M, Alguacil-Diego IM, Miangolarra-Page JC. Scales to assess gross motor function in stroke patients: A systematic review. Arch Phys Med Rehabil 2014; 95: 1174-83. doi: 10.1016/j.apmr.2014.02.013.
6. Daley K, Mayo N, Danys I, Cabot R, Wood-Dauphinee S. The Stroke Rehabilitation Assessment of Movement (STREAM): Refining and validating the content. Physiother Can 1997; 49: 269-78.
7. Daley K, Mayo N, Wood-Dauphinee S. Reliability of scores on the Stroke Rehabilitation Assessment of Movement (STREAM) measure. Phys Ther 1999; 79: 8-23.
8. Wang CH, Hsieh CH, Dai MH, Chen CH, Lai YF. Inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM) instrument. J Rehabil Med 2002; 34: 20-4.
9. Wolak ME, Fairbairn DJ, Paulsen YR. Guidelines for estimating repeatability. Methods Ecol Evol 2012; 3: 129-37.
10. World Health Organization. Process of translation and adaptation of instruments. Available from: http://www.who.int/substance_abuse/research_tools/translation/en/
11. Waltz CF, Strickland O, Lenz ER. Measurement in nursing and health research. 4th ed. New York: Springer Publishing Company; 2010.
12. Sanford J, Moreland J, Swanson LR, Stratford PW, Gowland C. Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. Phys Ther 1993; 73: 447-54.
13. Marinus J, Visser M, Stiggelbout AM, Martin J, Martinez-Martin P, Bonuccelli U, et al. A short scale for the assessment of motor impairments and disabilities in Parkinson’s disease: the SPES/SCOPA. J Neurol Neurosurg Psychiatry 2004; 75: 388–95.
14. Domholdt E. Physical therapy research: principles and applications. 2nd ed. Philadelphia: WB Saunders; 2000.
15. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1: 307-10.
16. Hsueh IP, Wang WC, Wang CH, Sheu CF, Lo SK, Lin JH, et al. A simplified stroke rehabilitation assessment of movement instrument. Phys Ther 2006; 86: 936-43.
17. Carr JH, Shepherd RB, Nordholm L, Lynne D. Investigation of a new motor assessment scale for stroke patients. Phys Ther 1985; 65: 175-80.
18. Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med 1975; 7: 13-31.
19. Poole JL, Whitney SL. Motor assessment scale for stroke patients: concurrent validity and inter-rater reliability. Arch Phys Med Rehabil 1988; 69: 195-97.
20. Malouin F, Pichard L, Bonneau C, Durand A, Corriveau D. Evaluating motor recovery early after stroke: comparison of the Fugl-Meyer Assessment and the Motor Assessment Scale. Arch Phys Med Rehabil 1994; 75: 1206-12.