Development of occupational therapy screening tool for clients with stroke
Article Sidebar
Main Article Content
Abstract
Background: The number of new stroke cases in the Thai population increases every year. Occupational therapy has a crucial role in stroke rehabilitation. In Thailand, there is currently no standardized occupational therapy screening tool for gathering clients’ impairments to facilitate further evaluation and intervention.
Objectives: To develop an occupational therapy screening tool for clients with stroke and investigate its psychometric properties.
Materials and methods: The development of the screening tool was based on a literature review and opinions of registered occupational therapists (OTs) who have had at least five years of experience working with stroke clients. Five experts examined content validity. The Index of Congruence (IOC) was calculated, and the items that showed IOC scores of over 0.5 were incorporated into the target screening tool. Afterward, two types of reliability were measured, including test-retest and inter-rater reliability. Using purposive sampling, 44 participants with chronic stroke were selected to test each type of reliability. Intraclass correlation coefficient (ICC) models 3, 1, and 2, k were used to determine test-retest and inter-rater reliability, respectively.
Results: Based on the literature review and 128 OTs’ opinions, the screening tool covers four domains: sensation, voluntary movement control of upper extremity and hand function, perception, and cognition. Content validity IOC scores were between 0.8 and 1.0 for all items. The screening tool had excellent test-retest reliability on all items, except memory. And the ICC between the two raters ranged from 0.91 to 1.00, which showed excellent inter-rater reliability.
Conclusion: The occupational therapy screening tool for clients with stroke has proven valid and reliable as a screening tool in clinical settings. Further research is recommended for concurrent, sensitivity, and specificity studies.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Personal views expressed by the contributors in their articles are not necessarily those of the Journal of Associated Medical Sciences, Faculty of Associated Medical Sciences, Chiang Mai University.
References
Gillen G. Cerebrovascular accident (stroke). In: Schultz-Krohn W, Pendleton E, editors. Pedretti’s Occupational therapy practice skill for physical dysfunction. 8th Ed. St. Louis, MO : Elsevier; 2018: 809-940.
Suwanwela NC. Stroke epidemiology in Thailand. J. Stroke. 2014; 16(1): 1-7. doi: 10.5853/jos.2014.16.1.1. Epub 2014 Jan 31. PMID: 24741559; PMCID: PMC3961816.
Bernhardt J, Hayward KS, Kwakkel G, Ward NS, Wolf SL, Borschmann K, Krakauer JW, Boyd LA, Carmichael ST, Corbett D, Cramer SC. Agreed definitions and a shared vision for new standards in stroke recovery research: The stroke recovery and rehabilitation roundtable taskforce. Neurorehabil Neural Repair. 2017; 31(9): 793-9. doi: 10.1177/1545968317732668. PMID: 28934920.
Edmans J, Coupar F, Gordon A. Introduction. In: Edmans J, editor. Occupational therapy and stroke. 2nd Ed. West Sussex : Wiley-Blackwell; 2010: 1-4.
O’Brien JC, Hussey SM. Occupational therapy process: Evaluation, intervention, and outcomes. In: O’Brien JC, Hussey SM, editors. Introduction to occupational therapy. 4th Ed. St.Louis, Miss.: Elsevier/Mosby; 2012: 113-23.
American Occupational Therapy Association. Occupational therapy practice framework: Domain and process (4th ed.). Am J Occup Ther. 2020;74(Suppl. 2), 7412410010. doi.org/10.5014/ajot.2020.74S2001.
Munkhetvit P. Theory and background knowledge of evaluation. In: Munkhetvit P, editor. Occupational therapy evaluation for adults with physical dysfunction. Chiang Mai: Siampimnana; 2017: 1-24.
Hinojosa J, Kramer P. Evaluation - where do we begin?. In: Hinojosa J, Kramer P, editors. Evaluation obtaining and Interpreting data. : American Occupational Therapy Association; 1998: 1-3.
Duncan PW, Zorowitz R, Bates B, Choi JY, Glasberg JJ, Graham GD, Katz RC, Lamberty K, Reker D. Management of adult stroke rehabilitation care: A clinical practice guideline. Stroke. 2005; 36(9): e100-43. doi: 10.1161/ 01.STR.0000180861.54180.FF. PMID: 16120836.
Edwards DF, Hahn MG, Baum CM, Perlmutter MS, Sheedy C, Dromerick AW. Screening patients with stroke for rehabilitation needs: Validation of the post-stroke rehabilitation guidelines. Neurorehabil Neural Repair. 2006; 20(1): 42-8. doi: 10.1177/1545968305283038. PMID: 16467277.
Philp I, Brainin M, Walker MF, Ward AB, Gillard P, Shields AL, Norrving B; Global Stroke Community Advisory Panel. Development of a poststroke checklist to standardize follow-up care for stroke survivors. J Stroke Cerebrovasc Dis. 2013; 22(7): e173-80. doi: 10.1016/j.jstrokecerebrovasdis.2012.10.016. Epub 2012 Dec 21. PMID: 23265778.
Cooke DM, McKenna K, Fleming J. Development of a standardized occupational therapy screening tool for visual perception in adults. Scand J Occup Ther. 2005; 12(2): 59-71. doi: 10.1080/11038120410020683-1. PMID: 16392761.
Flamand-Roze C, Falissard B, Roze E, Maintigneux L, Beziz J, Chacon A, Join-Lambert C, Adams D, Denier C. Validation of a new language screening tool for patients with acute stroke: The Language Screening Test (LAST). Stroke. 2011; 42(5): 1224-9. doi: 10.1161/STROKEAHA.110.609503. Epub 2011 Apr 12. PMID: 21487118.
Apichai S, Chinchai P, Dhippayom JP, Munkhetvit P. A new assessment of activities of daily living for Thai stroke patients. CMU J. Nat. Sci. 2020; 19(2): 176-90. doi.org/10.12982/CMUJNS.2020.0012.
Cicchetti DV, Sparrow SA. Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. Am J Ment Defic. 1981; 86(2):127-37. PMID: 7315877.
Burton L, Tyson SF. Screening for cognitive impairment after stroke: A systematic review of psychometric properties and clinical utility. J Rehabil Med. 2015; 47(3): 193-203. doi: 10.2340/16501977-1930. PMID: 25590458.
Wade DT, Vergis E. The Short Orientation-Memory-Concentration Test: A study of its reliability and validity. Clin Rehabil. 1999; 13(2): 164-70. doi: 10.1191/026921599673848768. PMID: 10348397.
American Occupational Therapy Association (AOTA). Standards of practice for occupational therapy. Am J Occup Ther. 2014; 69(3): 6913410057p1-p6. doi.org/10.5014/ajot.2015.696S06.
Salter K, Campbell N, Richardson M, Mehta S, Jutai J, Zettler L, Moses M, McClure A, Mays R., Foley N, Teasell R. Outcome measurements in stroke rehabilitation. [database on the Internet]. Canadian Partnership for Stroke Recovery. [cited 2022 March 15]. Available from:http://www.ebrsr.com/sites/default/files/Chapter%2020_Outcome%20Measures. (2013).
DeVellis RF. Validity. In: DeVellis, RF, editor. Scale Development: Theory and Applications. Thousand Oaks: Sage Publications Inc; 2012. p. 59-60. doi.org/10.1037/1040-3590.7.3.238.
Teasell R, Salbach NM. Rehabilitation and recovery following stroke. [database on the Internet]. Canadian stroke best practice recommendations. [cited 2022 March 28]. Available from: https://heartstrokeprod.azureedge.net/-/media/1-stroke-best-practices/rehabilitation-nov2019/csbpr-rehabiliation-table1-suggested-stroke-rehabilitation-screening-and-assessment-toolsnov19.ashx?la=en&rev=96be9dace11948ccaa56529fcc674f60. (2019).
Haynes SN, Richard DCS, Kubany ES. Content validity in psychological assessment: A functional approach to concepts and methods. Psychol Assess. 1995; 7(3): 238-47. doi.org/ 10.1037 /10403590.7.3.238.
Beck K. Ensuring content validity of psychological and educational tests – the role of experts. FLR. 2020; 8(6): 1-37. doi.org/10.14786/flr.v8i6.517.
Selvaraj AM, Singaravelan RM. Intra rater reliability and validity of simplified stroke rehabilitation assessment of movement (s-stream) scale on voluntary movement of the limbs and basic mobility in patients with stroke – An observational study. IP Indian J Neurosci. 2019; 5(3): 167-71. doi.org/10.18231 /j.ijn. 2019.026.
Charoenlimprasert J, Srioum S , Maneerat T, Songvanich S, Kaewsanmung S, Suputtitada A. Translation, cross-cultural adaptation, reliability and validity of the Thai version of the trunk impairment scale 2.0. ASEAN J Rehabil Med. 2021; 31(2): 59-66.
Wesnes K, Pincock C. Practice effects on cognitive tasks: A major problem? Lancet Neurol. 2002; 1(8): 473. doi: 10.1016/s1474-4422(02)00236-3. PMID: 12849328.
Goldberg TE, Harvey PD, Wesnes KA, Snyder PJ, Schneider LS. Practice effects due to serial cognitive assessment: Implications for preclinical Alzheimer’s disease randomized controlled trials. Alzheimers Dement (Amst). 2015; 1(1): 103-11. doi: 10.1016/j. dadm.2014.11.003. PMID: 27239497; PMCID: PMC4876902.
O’Sullivan MJ, Li X, Galligan D, Pendlebury ST. Cognitive recovery after stroke: memory. Stroke. 2023; 54: 44- 54. doi: 10.1161/STROKEAHA.122.041497.
Desmond DW, Moroney JT, Sano M, Stern Y. Recovery of cognitive function after stroke. Stroke. 1996; 27(10): 1798-803. doi: 10.1161/01.str.27.10.1798. PMID: 8841333.
Hochstenbach JB, den Otter R, Mulder TW. Cognitive recovery after stroke: A 2-year follow-up. Arch Phys Med Rehabil. 2003; 84(10): 1499-504. doi: 10.1016/s0003-9993(03)00370-8. PMID: 14586918.
Behling O, Law, KS. Translating questionnaires and other research instruments: Problems and solution. London: Sage Publications; 2000.
Ratchagit T. Why training is important to an organization? [Internet].Thailand: Tada Ratchagit; 2018 [updated 11 June 2019; cited 2022 March 15]. Available from: https://th.hrnote.asia/orgdevelopment/th-trainingofhr181226/
Rohde A, McCracken M, Worrall L, Farrell A, O’Halloran R, Godecke E, David M, Doi SA. Inter-rater reliability, intra-rater reliability and internal consistency of the Brisbane Evidence-Based Language Test. Disabil Rehabil. 2022; 44(4):637-645. doi: 10.1080/09638288. 2020.1776774. Epub 2020 Jun 22. PMID: 32571103.
Amano S, Umeji A, Uchita A, Hashimoto Y, Takebayashi T, Kanata Y, Uchiyama Y, Domen K. Reliability of remote evaluation for the Fugl-Meyer assessment and the action research arm test in hemiparetic patients after stroke. Top Stroke Rehabil. 2018; 25(6):432-437. doi: 10.1080/10749357.2018. 1481569. Epub 2018 Jul 20. PMID: 30028659.