Psychometric properties of a new occupational therapy cognitive outcome measure for Thai older adults with cognitive impairments
Article Sidebar
Main Article Content
Abstract
Background: Occupational therapy (OT) cognitive interventions requires a standardised cognitive outcome measure to help explain the effectiveness of the interventions. Now, there is a lack of measures to use for Thai older adults with cognitive impairments. Therefore, a new Occupational Therapy Cognitive Outcome Measure (OTCOM) for Thai older adults with cognitive impairments was developed to support evidence-based OT cognitive interventions.
Objectives: To examine the psychometric properties including internal consistency, inter-rater and intra-rater reliability, known-group construct validity, concurrent validity, and responsiveness of the OTCOM.
Materials and methods: A prospective cohort design was used in this study. One hundred and ten older adults; sixty-one older adults with cognitive impairments and forty-nine older adults without cognitive impairments, were recruited. The Cronbach’s alpha coefficient was calculated for internal consistency. Intraclass correlation coefficient (ICC) was used to analyse rater reliability. Analyses of concurrent and known-group construct validity were done using Pearson correlation and independent t-test, respectively. Both effect size (ES) and standardised response mean (SRM) were calculated for responsiveness of the OTCOM.
Results: The results showed good internal consistency (α=0.88), and excellent inter-rater and intra-rater reliability (ICC=0.99). A high correlation between the OTCOM and the Dynamic Lowenstein Occupational Therapy Cognitive Assessment-Geriatric (DLOTCA-G) and the Thai Cognitive-Perceptual Test (Thai-CPT) was found, indicating good concurrent validity. There was a significant difference between older adults with cognitive impairments and without cognitive impairments, suggesting good construct validity by the known-group method. Responsiveness was shown as large ES and SRM in the total score.
Conclusion: The OTCOM showed good psychometric properties, making it useful in OT practice after revisions.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Personal views expressed by the contributors in their articles are not necessarily those of the Journal of Associated Medical Sciences, Faculty of Associated Medical Sciences, Chiang Mai University.
References
United Nations Department of Economic and Social Affairs. World population ageing 2020 highlights: Living arrangements of older persons. New York: United Nations Publication; 2020 [cited 2021 Dec 12]. Available from: https://www.un.org/development/desa/pd/sites/www.un.org.development.desa.pd/files/undesa_pd-2020_world_population_ageing_highlights.pdf
Department of Older Persons. Statistics of the elderly in Thailand, 77 provinces at December 31th, 2020 [Internet]. Department of Older Persons; 2021 [updated 2021 Mar 7; cited 2021 Dec 12]. Available from: https://www.dop.go.th/th/know/side/1/1/335. (in Thai)
Davis CP. Dementia, symptoms, warning signs, types, causes, and treatment [Internet]. 2019 [updated 2021 Aug 26; cited 2021 Dec 10]. Available from: https://www.emedicinehealth.com/dementia_overview/article_em.htm.
Murman DL. The impact of age on cognition. Semin Hear. 2015; 36(3): 111-21. doi: 10.1055/s-0035-1555115.
Teng E, Tassniyom K, Lu PH. Reduced quality of life ratings in mild cognitive impairment: analyses of subject and informant responses. Am J Geriatr Psychiatry. 2012; 20(12): 1016-25. doi: 10.1097/JGP.0b013e31826ce640.
O’Sullivan G, Hocking C. Translating action research into practice: Seeking occupational justice for people with dementia. OTJR (Thorofare N J). 2013; 33(3): 168-76. doi: 10.3928/15394492-20130614-05.
Lincoln N, das Nair R. Outcome measurement in cognitive neurorehabilitation. In: Gordon Winocur, Donald T. Stuss, Robertson. IH, editors. Cognitive neurorehabilitation: Evidence and application. 2nd ed. New York: Cambridge University Press; 2010. p. 91-105.
Smith PG, Morrow RH, Ross DA. Field trials of health interventions: A toolbox. 3rd ed. Smith PG, Morrow RH, Ross DA, editors. London: Oxford University Press; 2015. p.198-215.
Harrison J, Noel-Storr A, Demeyere N, Reynish E, Quinn T. Outcomes measures in a decade of dementia and mild cognitive impairment trials. Alzheimers Res Ther. 2016; 8(48): 1-10. doi: 10.1186/s13195-016-0216-8.
Manee FS, Nadar MS, Alotaibi NM, Rassafiani M. Cognitive assessments used in occupational therapy practice: A global perspective. Occup Ther Int. 2020; 2020: 8914372. doi: 10.1155/2020/8914372.
Chaiwong P, Sungkarat S, Rattakorn P, Munkhetvit P. Cognitive assessment and intervention in occupational therapy for elderly Thai adults with neurocognitive disorders. JAMS. 2022; 55(2): 16-22. doi: 10.12982/JAMS.2022.0012.
Macků K, Caha J, Pászto V, Tuček P. Subjective or objective? How objective measures relate to subjective life satisfaction in europe. ISPRS Int J Geo-Inf. 2020;9(5):320. doi: 10.3390/ijgi9050320.
Lidz CS. Dynamic assessment: Some thoughts on the model, the medium, and the message. Learn Individ Differ. 1992; 4(2): 125-36. doi: 10.1016/1041-6080(92)90009-4.
Lidz CS, Elliott J. Dynamic assessment: Prevailing models and applications. Amsterdam: Elsevier Science; 2000.
Katz N, Averbuch S, Bar-Haim Erez A. Dynamic Lowenstein Occupational Therapy Cognitive Assessment–Geriatric Version (DLOTCA-G): Assessing change in cognitive performance. Am J Occup Ther. 2012; 66(3): 311-9. doi: 10.5014/ajot.2012.002485.
Nasreddine Z. MoCA clinic data [Internet]. 2021 [cited 2021 Dec 12]. Available from: https://www.mocatest.org/moca-clinic-data/.
Wongpakaran N, Wongpakaran T, Reekum RV. The use of GDS-15 in detecting MDD: A comparison between residents in a thai long-term care home and geriatric outpatients. J Clin Med Res. 2013; 5(2): 101-11. doi: 10.4021/jocmr1239w.
Katz N, Averbuch S, Bar-Haim Erez A. Dynamic Loewenstein occupational therapy cognitive assessment for geriatrics manual. Wayne, NJ: Maddak; 2011.
Munkhetvit P. Manual of Thai Cognitive-Perception Test (Thai-CPT). Chiangmai: Suthin Publishing; 2010. (in Thai).
Munkhetvit P, Rattakorn P, Apikomonkorn H, Punyanon T. Cognitive skills training for the elderly with suspected dementia (research report): Faculty of Associated Medical Sciences, Chiang Mai University; 2015. (in Thai).
Chapparo C, Ranka J. Occupation analysis: Cognition and acquire brain impairment. In: Mackencie L, O’Toole G, editors. Occupation Analysis in Practice. New Delhi: Wiley-Blackwell; 2011. p. 147-62.
Toglia JP. The dynamic interactional model of cognition in cognitive rehabilitation. In: Katz N, editor. Cognition, occupation, and particcipation across the life span: Neuroscuence, neurorehabilitation, and model for intervention in occupational therapy. 3rd ed. Bethesda, MD: AOTA Press; 2011. p. 161-202.
Levy LL, Burns T. Cogitive disabilities reconsidered model: Rehabilitation of older adults with dementia. In: Katz N, editor. Cognition, occupation, and particcipation across the life span: Neuroscuence, neurorehabilitation, and model for intervention in occupational therapy. 3rd ed. Bethesda, MD: AOTA Press; 2011. p. 407-41.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. Washington, DC: American Psychiatric Publishing; 2013.
George D, Mallery P. SPSS for windows step by step - a simple guide and reference, 14.0 update. 7th ed. Boston, Pearson: Allyn and Bacon; 2007.
Fleiss JL. Design and analysis of clinical experiments. John Wiley & Sons; 2011.
Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016; 15(2): 155-63. doi: 10.1016/j.jcm.2016.02.012.
Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: A critical review and recommendations. J Clin Epidemiol. 2000; 53(5): 459-68. doi: 10.1016/S0895-4356(99)00206-1.
Cohen J. Statistical power analysis for the behavioral sciences. New York: Academic Press; 1978.
Cohen J. A power primer. Psychol Bull. 1992; 112(1): 155-9. doi: 10.1037//0033-2909.112.1.155.
DeVellis RF. Scale development: Theory and applications. 4th ed: SAGE Publications; 2016.
Furr RM. Scale construction and psychometrics for social and personality psychology. United Kingdom: SAGE Publications; 2011.
Asher IE. Asher's occupational therapy assessment tools : An annotated index. 4th ed. Bethesda, MD: AOTA Press; 2014.
Griffiths K, Cook M, Newcombe R. Cube copying after cerebral damage. J Clin Exp Neuropsychol. 1988; 10(6): 800-12. doi: 10.1080/01688638808402815.
Dridan BA. The simple copy task: Clinical utility, psychometric properties and normative data. Australia: La Trobe University; 2012.
Lesourd M, Osiurak F, Baumard J, Bartolo A, Vanbellingen T, Reynaud E. Cerebral correlates of imitation of intransitive gestures: An integrative review of neuroimaging data and brain lesion studies. Neurosci Biobehav Rev. 2018; 95: 44-60. doi: 10.1016/j.neubiorev.2018.07.019.
Washington CC, Moss M. Pragmatic aspects of establishing interrater reliability in research. Nurs Res. 1988; 37(3): 190-1.
Carrion C, Folkvord F, Anastasiadou D, Aymerich M. Cognitive therapy for dementia patients: A systematic review. Dement Geriatr Cogn Disord. 2018; 46(1-2): 1-26. doi: 10.1159/000490851.
Heerema E. Alert and oriented x1, x2, x3, and x4 in dementia [Internet]. 2019 [updated Nov 5; cited 2021 Dec 12]. Available from: https://www.verywellhealth.com/what-is-orientation-and-how-is-it-affected-by-dementia-98571.