Quantifying Experiences with Telepractice for Aphasia Therapy: A Text Mining Analysis of Client Response Data

Abstract

Measures of satisfaction following treatment for aphasia have been limited. The challenge associated with reduced verbal output among many persons with aphasia (PWA) has reportedly been a key reason measures of treatment satisfaction have been limited. A novel approach to measure treatment satisfaction is the use of content analysis (CA), which uses the presence of certain words, themes, or concepts to explore outcomes such as treatment satisfaction particularly among individuals who generate limited output. CA utilizes responses and response patterns to assign meaning to client responses. The aim of this study was to use CA to measure posttreatment satisfaction with a telepractice approach for aphasia treatment. Seventeen PWA received 12 treatment sessions over a 6-week period. At the conclusion of the treatment, CA was utilized to explore patient satisfaction with this treatment approach. The participants reported an overall positive sentiment for the telepractice approach. Two primary topics emerged which were healthcare provider and healthcare delivery, where text analysis revealed discussion of these topics to be centered around being “helpful” and “being effective.” This study demonstrated that CA can be an effective approach for determining satisfaction with aphasia treatment particularly among PWA with limited verbal abilities.

Keywords

aphasia - satisfaction - content analysis

Publication History

Article published online:
30 September 2020

• References

• 1 Ferrand Y, Siemens J, Weathers D. et al. Patient satisfaction with healthcare services a critical review. Qual Manag J 2016; 23 (04) 6-22
• 2 Huang JA, Lai CS, Tsai WC, Weng RH, Hu WH, Yang DY. Determining factors of patient satisfaction for frequent users of emergency services in a medical center. J Chin Med Assoc 2004; 67 (08) 403-410
• 3 Chen Q, Beal EW, Okunrintemi V. et al. The association between patient satisfaction and patient-reported health outcomes. J Patient Exp 2019; 6 (03) 201-209
• 4 Porter ME, Teisberg EO. Redefining Health Care: Creating Value-Based Competition on Results. Harvard Business Press; 2006
• 5 Wegner SE. Measuring value in health care: the times, they are a changin'. N C Med J 2016; 77 (04) 276-278
• 6 Porter ME. What is value in health care?. N Engl J Med 2010; 363 (26) 2477-2481
• 7 Bleich SN, Özaltin E, Murray CK. How does satisfaction with the health-care system relate to patient experience?. Bull World Health Organ 2009; 87 (04) 271-278
• 8 Greaves F, Ramirez-Cano D, Millett C, Darzi A, Donaldson L. Use of sentiment analysis for capturing patient experience from free-text comments posted online. J Med Internet Res 2013; 15 (11) e239
• 9 Patwardhan A, Spencer CH. Are patient surveys valuable as a service-improvement tool in health services? An overview. J Healthc Leadersh 2012; 4: 33-46
• 10 McCoy TH, Castro VM, Cagan A, Roberson AM, Kohane IS, Perlis RH. Sentiment measured in hospital discharge notes is associated with readmission and mortality risk: an electronic health record study. PLoS One 2015; 10 (08) e0136341
• 11 Maramba ID, Davey A, Elliott MN. et al. Web-based textual analysis of free-text patient experience comments from a survey in primary care. JMIR Med Inform 2015; 3 (02) e20
• 12 Tomkins B, Siyambalapitiya S, Worrall L. What do people with aphasia think about their health care? Factors influencing satisfaction and dissatisfaction. Aphasiology 2013; 27 (08) 972-991
• 13 Hersh D. “Hopeless, sorry, hopeless”: co-constructing narratives of care with people who have aphasia post-stroke. Top Lang Disord 2015; 35 (03) 219-236
• 14 Hemsley B, Werninck M, Worrall L. “That really shouldn't have happened”: people with aphasia and their spouses narrate adverse events in hospital. Aphasiology 2013; 27 (06) 706-722
• 15 American Speech-Language-Hearing Association. Mission Statement. 2020 : Available at: asha.org . Accessed August 1, 2020
• 16 Morris MA, Clayman ML, Peters KJ, Leppin AL, LeBlanc A. Patient-centered communication strategies for patients with aphasia: discrepancies between what patients want and what physicians do. Disabil Health J 2015; 8 (02) 208-215
• 17 Centers for Medicare and Medicaid Services. Hospital Consumer Assessment of Healthcare Providers and Systems Survey (HCAHPS). 2020 . Available at: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/HospitalQualityInits/HospitalHCAHPS . Accessed August 1, 2020
• 18 New England Journal of Medicine Catalyst. Patient satisfaction surveys. January 1, 2018. Available at: https://catalyst.nejm.org/doi/full/10.1056/CAT.18.0288 . Accessed August 1, 2020
• 19 Brady MC, Fredrick A, Williams B. People with aphasia: capacity to consent, research participation and intervention inequalities. Int J Stroke 2013; 8 (03) 193-196
• 20 Jauch LR, Osborn RN, Martin TN. Structured content analysis of cases: a complementary method for organizational research. Acad Manage Rev 1980; 5 (04) 517-525
• 21 Varanasi P, Tanniru M. Seeking intelligence from patient experience using text mining: analysis of emergency department data. Inf Syst Manage 2015; 32 (03) 220-228
• 22 He K, Hong N, Lapalme-Remis S. et al. Understanding the patient perspective of epilepsy treatment through text mining of online patient support groups. Epilepsy Behav 2019; 94: 65-71
• 23 El-Gayar O, Nasralah T, El Noshokaty A. IT for diabetes self-management-What are the patients' expectations?. [Twenty-fourth Americas Conference on Information Systems Proceedings]; New Orleans, 2018: Available at: https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1074&context=amcis2018 . Accessed August 1, 2020
• 24 Merkouris A, Papathanassoglou ED, Lemonidou C. Evaluation of patient satisfaction with nursing care: quantitative or qualitative approach?. Int J Nurs Stud 2004; 41 (04) 355-367
• 25 Montini T, Noble AA, Stelfox HT. Content analysis of patient complaints. Int J Qual Health Care 2008; 20 (06) 412-420
• 26 O'Cathain A, Thomas KJ. “Any other comments?” Open questions on questionnaires - a bane or a bonus to research?. BMC Med Res Methodol 2004; 4 (01) 25
• 27 Howell E, Martin J. Inpatient Survey 2007: analysis of the patients' free-text comments. Picker Institute Europe; 2007. . Available at: http://www.nhssurveys.org/survey/736. Accessed August 1, 2020
• 28 Hearst M. What Is Text Mining?. SIMS, University of California; Berkeley: 2003
• 29 Palmer R, Hughes H, Chater T. What do people with aphasia want to be able to say? A content analysis of words identified as personally relevant by people with aphasia. PLoS One 2017; 12 (03) e0174065
• 30 Press I. Patient Satisfaction: Defining, Measuring, and Improving the Experience of Care. Health Administration Press; 2002
• 31 Ford RC, Bach SA, Fottler MD. Methods of measuring patient satisfaction in health care organizations. Health Care Manage Rev 1997; 22 (02) 74-89
• 32 Wynn ST. Achieving patient satisfaction: utilizing telehealth via an academic–practice partnership. J Am Psychiatr Nurses Assoc 2020;
• 33 Orlando JF, Beard M, Kumar S. Systematic review of patient and caregivers' satisfaction with telehealth videoconferencing as a mode of service delivery in managing patients' health. PLoS One 2019; 14 (08) e0221848
• 34 Tousignant M, Macoir J, Martel-Sauvageau V. et al. Satisfaction with in-home speech telerehabilitation in post-stroke aphasia: an exploratory analysis. JISfTeH 2018; 6: e11
• 35 Kertesz A. Western Aphasia Battery-Revised (WAB-R): Examiner's Manual. PsychCorp. and Harcort Assessment Incorporation; 2006
• 36 Ellis C, Peach RK, Rothermich K. Relative weight analysis of the Western Aphasia Battery. Aphasiology 2020;
• 37 Fromm D, Forbes M, Holland A, Dalton SG, Richardson J, MacWhinney B. Discourse characteristics in aphasia beyond the Western Aphasia Battery cutoff. Am J Speech Lang Pathol 2017; 26 (03) 762-768
• 38 Bandur DL, Shewan CM. Language oriented treatment: a psycholinguistic approach to aphasia. In: Chapey R. , ed. Language Intervention Strategies in Aphasia and Related Neurogenic Communication Disorders. Philadelphia: Wolters Kluwer Health; 2008. ;4: 756-799
• 39 Bandur DL, Shewan CM. Treatment of Aphasia: A Language-Oriented Approach. London: Taylor & Francis; 1986
• 40 Efstratiadou EA, Papathanasiou I, Holland R, Archonti A, Hilari K. A systematic review of semantic feature analysis therapy studies for aphasia. J Speech Lang Hear Res 2018; 61 (05) 1261-1278
• 41 Edmonds LA, Babb M. Effect of verb network strengthening treatment in moderate-to-severe aphasia. Am J Speech Lang Pathol 2011; 20 (02) 131-145
• 42 Wambaugh JL, Wright S, Nessler C, Mauszycki SC. Combined aphasia and apraxia of speech treatment (CAAST): effects of a novel therapy. J Speech Lang Hear Res 2014; 57 (06) 2191-2207
• 43 Duffy JR. Motor Speech Disorders: Substrates, Differential Diagnosis, and Management, 3rd ed. St. Louis, MO: Elsevier; 2013
• 44 Attkisson CC, Zwick R. The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome, evaluation and program planning. The Client Satisfaction Questionnaire 1982; 5 (03) 233-237
• 45 Jussila J, Vuori V, Okkonen J, Helander N. , eds. Reliability and Perceived Value of Sentiment Analysis for Twitter data. In: Strategic Innovative Marketing. Cham, Switzerland: Springer; 2017: 43-48
• 46 Katz RC, Wertz RT. The efficacy of computer-provided reading treatment for chronic aphasic adults. J Speech Lang Hear Res 1997; 40 (03) 493-507
• 47 Saif H, Fernández M, He Y, Alani H. On stopwords, filtering and data sparsity for sentiment analysis of twitter. Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). 2014: 810-817 . Available at: http://www.lrec-conf.org/proceedings/lrec2014/pdf/292_Paper.pdf. Accessed august 1, 2020
• 48 Imandoust SB, Bolandraftar M. Application of k-nearest neighbor (kNN) approach for predicting economic events: theoretical background. Int J Eng Res Appl 2013; 3 (05) 605-610
• 49 Hilari K. The impact of stroke: are people with aphasia different to those without?. Disabil Rehabil 2011; 33 (03) 211-218
• 50 Threats TT, Worrall L. Classifying communication disability using the ICF. Adv Speech Lang Pathol 2004; 6 (01) 53-62
• 51 Silverman D. Doing Qualitative Research: A Practical Handbook. SAGE Publications Limited; 2010
• 52 Sallee MW, Flood JT. Using qualitative research to bridge research, policy, and practice. Theory Pract 2012; 51 (02) 137-144
• 53 Harry B, Lipsky M. Qualitative research on special education teacher preparation. In: McCray M, Browness T, Lignugaris B. , eds. Edited By Paul T. Sindelar, Erica D. McCray, Mary T. Brownell, Benjamin Lignugaris/Kraft Handbook of Research on Special Education Teacher Preparation. Taylor and Francis; 2014: 445-460
• 54 Thomson S. Qualitative research: validity. JOAAG 2011; 6 (01) 77-82
• 55 Lam R. Teacher assessment literacy: surveying knowledge, conceptions and practices of classroom-based writing assessment in Hong Kong. System 2019; 81: 78-89
• 56 Flick U. Introducing Research Methodology: Thinking Your Way Through Your Research Project. SAGE Publications Limited; 2011