Intra- and inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM)

Main Article Content

Somporn Sungkarat
Sureeporn Uthaikhup
Mathita Keawsutthi
Jitima Charoenlimprasert
Supapon Kaewsanmuang

Abstract

Objectives: To examine intra-rater and inter-rater reliability of the STREAM Thai version in evaluating motor recovery of patients with stroke.


Materials and methods: Thirty patients with stroke (mean age 62.5±13.5 yrs.) participated in the study. Time post stroke was between 15 days to 5 years. Seventeen participants had left hemiparesis and 13 participants had right hemiparesis. Raters were physical therapists experienced in stroke rehabilitation and received STREAM training. For intra-rater reliability test, the same physical therapist re-assessed each patient through videotape 7 days after the first assessment. For inter-rater reliability test, STREAM Thai version was administered to each patient by two physical therapists in a random order and the same setting within 24 hours interval. Intra-rater and inter-rater reliability was calculated using intraclass correlation coefficients (ICC) model 3, 1 and 2, 1, respectively. The significance level was set at p<0.05.


Results: Intra-rater reliability of the STREAM Thai version and all subcomponents was demonstrated by ICC of 0.99. ICC for inter-rater reliability was 0.96. Sub-analysis for each component revealed the ICCs of 0.98, 0.94 and 0.83 for estimating the inter-rater reliability of upper limb movement, lower limb movement, and basic mobility, respectively. Bland Altman plots revealed that mean difference between assessments was -1.4 points (95% confidence interval between -7.2 and 4.3 points), between raters was -5.5 points (95% confidence interval between -23.8 and 12.8 points).


Conclusion: Assessment of motor recovery in patients with stroke using STREAM Thai version by trained PT who had stroke rehabilitation experience was highly reliable for both intra-rater and inter-rater.


Journal of Associated Medical Sciences 2017; 50(1): 71-86. Doi: 10.14456/jams.2017.7

Article Details

How to Cite
Sungkarat, S., Uthaikhup, S., Keawsutthi, M., Charoenlimprasert, J., & Kaewsanmuang, S. (2017). Intra- and inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM). Journal of Associated Medical Sciences, 50(1), 71. Retrieved from https://he01.tci-thaijo.org/index.php/bulletinAMS/article/view/74227
Section
Research Articles

References

1. World Health Organization. The atlas of heart disease and stroke. Available from: http://www.who.int/cardiovascular_diseases/resources/ atlas/en.

2. Bureau of policy and strategy: Public health statistics 2007-2011. Ministry of Public Health, Thailand.

3. Task Force on Standards for Measurement in Physical Therapy. Standards for tests and measurements in physical therapy practice. Phys Ther 1991; 71: 589-622.

4. Sungkarat S. Neurorehabilitation of individuals with brain disorders: from theory to practice. Chiang Mai: Siamnana Printing; 2013.

5. Gor-Garcia-Fogeda MD, Molina-Rueda F, Cuesta-Gomez A, Carratala-Tejada M, Alguacil-Diego IM, Miangolarra-Page JC. Scales to assess gross motor function in stroke patients: A systematic review. Arch Phys Med Rehabil 2014; 95: 1174-83. doi: 10.1016/j.apmr.2014.02.013.

6. Daley K, Mayo N, Danys I, Cabot R, Wood-Dauphinee S. The Stroke Rehabilitation Assessment of Movement (STREAM): Refining and validating the content. Physiother Can 1997; 49: 269-78.

7. Daley K, Mayo N, Wood-Dauphinee S. Reliability of scores on the Stroke Rehabilitation Assessment of Movement (STREAM) measure. Phys Ther 1999; 79: 8-23.

8. Wang CH, Hsieh CH, Dai MH, Chen CH, Lai YF. Inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM) instrument. J Rehabil Med 2002; 34: 20-4.

9. Wolak ME, Fairbairn DJ, Paulsen YR. Guidelines for estimating repeatability. Methods Ecol Evol 2012; 3: 129-37.

10. World Health Organization. Process of translation and adaptation of instruments. Available from: http://www.who.int/substance_abuse/research_tools/translation/en/

11. Waltz CF, Strickland O, Lenz ER. Measurement in nursing and health research. 4th ed. New York: Springer Publishing Company; 2010.

12. Sanford J, Moreland J, Swanson LR, Stratford PW, Gowland C. Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. Phys Ther 1993; 73: 447-54.

13. Marinus J, Visser M, Stiggelbout AM, Martin J, Martinez-Martin P, Bonuccelli U, et al. A short scale for the assessment of motor impairments and disabilities in Parkinson’s disease: the SPES/SCOPA. J Neurol Neurosurg Psychiatry 2004; 75: 388–95.

14. Domholdt E. Physical therapy research: principles and applications. 2nd ed. Philadelphia: WB Saunders; 2000.

15. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1: 307-10.

16. Hsueh IP, Wang WC, Wang CH, Sheu CF, Lo SK, Lin JH, et al. A simplified stroke rehabilitation assessment of movement instrument. Phys Ther 2006; 86: 936-43.

17. Carr JH, Shepherd RB, Nordholm L, Lynne D. Investigation of a new motor assessment scale for stroke patients. Phys Ther 1985; 65: 175-80.

18. Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med 1975; 7: 13-31.

19. Poole JL, Whitney SL. Motor assessment scale for stroke patients: concurrent validity and inter-rater reliability. Arch Phys Med Rehabil 1988; 69: 195-97.

20. Malouin F, Pichard L, Bonneau C, Durand A, Corriveau D. Evaluating motor recovery early after stroke: comparison of the Fugl-Meyer Assessment and the Motor Assessment Scale. Arch Phys Med Rehabil 1994; 75: 1206-12.