Development of the Thai Health Literacy Assessment Based on the Testing of Essential Skills

Main Article Content

พิชญกร วโรตมะกุล
สงวน ลือเกียรติบัณฑิต
วรนุช แสงเจริญ

Abstract

Objective: To develop the Thai Health Literacy Assessment based on Skills: THLA-S), and to determine the cut-off value to interpret the level of health literacy (HL). Methods: There were 5 steps in development of this measure:1)analysis of skills assessed by the HLSI (Health Literacy Skills Instrument), the measurement model of THLA-S, 2) preparation of the first draft of the THLA-S for measuring the skills equivalent to those assessed by the HLSI, 3) review of the measure by 6 experts and revision of the measure accordingly, 4) validity and reliability testing in large samples in a regional hospital with 522 outpatients and their relatives chosen by accidental sampling. The subjects completed the THLA-S and questionnaire on various indicators of HL (self-perception on skills for activities necessary for HL, reading ability from cloze test, HL screening test, and ability to use nutritional label), and THLA-N (Thai Health Literacy Assessment Using Nutrition Label), 5) determination of cut-off of the THLA-S using THLA-N as gold standard. Results: The THLA-S showed a Cronbach’s alpha of 0.81. The measure was valid because 1) In assessing self-perception on skills for activities necessary for HL, those reporting 6 activities (from all 8 activities) as easy had a higher level of the THLA-S than those reporting the tasks difficult 2) those with a higher education level showed a higher level of the THLA-S 3) relationships between the THLA-S scores with the following HL indicators were positive and statistically significant (P<0.05)--self-perception on skills for activities necessary for HL, reading ability as measured by the cloze test, scores from screening tests for inadequate HL, ability to use nutrition labels and the THLA-N with correlation coefficients of 0.34, 0.40, 0.16, 0.63 and 0.61, respectively. Analysis of the ROC curve using the THLA-N as a gold standard showed an AUC of 0.84. The THLA-S scores less than or equal to 13 indicated inadequate HL. At this cut-off, the scale had a sensitivity of 75.0 percent, specificity of 78.4 percent, PPV of 79.12 percent and NPV of 74.19 percent, with LR+ and LR- of 3.47 and 0.32 respectively. Conclusion: The THLA-S is valid, reliable, sensitive, and specific with satisfying discriminating power of HL. However, the THLA-S still needs further improvement because of its large number of items. 

Article Details

Section
Research Articles

References

1. Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, Brand H. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health 2012; 12:80. doi: 10.1186/1471-2458-12-80.

2. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Viera A, Crotty K, et al. Health literacy interventions and outcomes: an updated systematic review. Evidence reports/technology assessments No.199 [online]. 2011 [cited Feb 12, 2016]. Available from: www.ncbi.nlm.nih.gov/pubmed/23126607.

3. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med 2011; 155: 97-107.

4. Cho YI, Lee SY, Arozullah AM, Crittenden KS. Effects of health literacy on health status and health service utilization amongst the elderly.Soc Sci Med 2008; 66: 1809-16.

5. Institute of Medicine. Health literacy: a prescription to end confusion. Washington DC: National Academies ; 2004.

6. Neilsen-Bohlman L, Panzer AM, Hamlin B, Kindig DA. Health literacy: a prescription to end confusion. Washington DC: The National Academies Press; 2004.

7. Baker DW. The meaning and the measure of health literacy. J Gen Intern Med. 2006; 21: 878-83.

8. Parker RM, Kindig DA. Beyond the Institute of medicine health literacy report: are the recommenda- tions being taken seriously. J Gen Intern Med 2006; 21: 891-2.

9. McCormack L, Bann C, Squiers L, Berkman ND, Squire C, Schillinger D, et al. Measuring health literacy: a pilot study of a new skills-based instru- ment. J Health Commun 2010; 5 Suppl 2: S51-71.

10. Ungsinun I. Creating and developing of Thai health literacy scales [online]. 2017 [cited Jun 16, 2018]. Available from: bsris.swu.ac.th/upload/268335.pdf.

11. Bangonsri J. Validity and reliability of the Thai vertion of health literacy screening tools for patients at Srinagarind Hospital, Khon Kaen, Thailand [master thesis]. Khon Kaen University; 2013.

12. Phantong W. Development of the Thai Health Literacy Assessment using Word List (THLA-W) [minor thesis]. Songkhla: Prince of Songkla Univer- sity; 2016.

13. Haun JN, Valerio MA, Mccormack LA, Sørensen K, Paasche-Orlow MK. Health literacy measurement: an inventory and descriptive summary of 51 instru- ments. J Health Commun 2014; 19: 302-33.

14. Janchooto P. Development of the Thai Health Literacy Assessment Using Word List with Extended Questions to Test Comprehension (THLA -W+): Testing in Sadao Hospital [minor Thesis]. Songkhla: Prince of Songkla University; 2017.

15. Lee SY, Bender DE, Ruiz RE, Cho YI. Development of an easy-to-use Spanish health literacy test. Health Serv Res. 2006; 41: 1392-412.

16. Na Pattalung P. Development of a Health Literacy Screener for Thais Based on the Approach of the Newest Vital Sign [master thesis]. Songkhla: Prince of Songkla University; 2018.

17. Weiss BD, Mays MZ, Martz W, Casto KM, DeWalt DA, Pignone MP, et al. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med 2005; 3: 514-22.

18. Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med 2004; 36: 588-94.

19. Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and testing of survey questionnaires. Appl Cogn Psychol 1991; 5: 251-67

20. Faul GF, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods 2009; 41: 1149-60.

21. Youden WJ. Index for rating diagnostic tests. Cancer 1950;3:32-5.

22. Zhou XH, Obuchowski NA, Obuschowski DM. Statistical methods in diagnostic medicine. New York: Wiley & Sons; 2002.

23. Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240: 1285-93.

24. Jaeschke R, Guyatt GH, Sackett DL. Users' guides to the medical literature. III. How to use an article about a diagnostic test. A. Are the results of the study valid? Evidence-based medicine working group. JAMA 1994; 271: 389-91.

25. Feise RJ, Michael MJ. Functional rating index: a new valid and reliable instrument to measure the magnitude of clinical change in spinal conditions. Spine 2001; 26: 78-86.