Web-based textual analysis of free-text patient experience comments from a survey in primary care.

作者: Inocencio Daniel Maramba , Antoinette Davey , Marc N Elliott , Martin Roberts , Martin Roland

DOI: 10.2196/MEDINFORM.3783

关键词: Context (language use)ReceptionistsSentiment analysisWeb applicationDocumentationReading (process)Text processingPatient experienceComputer scienceNatural language processingArtificial intelligence

摘要: Background: Open-ended questions eliciting free-text comments have been widely adopted in surveys of patient experience. Analysis free text can provide deeper or new insight, identify areas for action, and initiate further investigation. Also, they may be a promising way to progress from documentation experience achieving quality improvement. The usual methods analyzing are known time resource intensive. To efficiently deal with large amount free-text, rapidly summarizing characterizing the being explored. Objective: aim this study was investigate feasibility using freely available Web-based processing tools (text clouds, distinctive word extraction, key words context) extracting useful information amounts commentary about experience, as an alternative more intensive analytic methods. Methods: We collected responses broad, open-ended question on patients’ primary care cross-sectional postal survey patients recently consulting doctors 25 English general practices. encoded files which were then uploaded three textual tools. we used two cloud creators: TagCrowd unigrams, Many Eyes bigrams; Voyant Tools, reading tool that extract perform Keyword Context (KWIC) analysis. association scores occurrence certain tested logistic regression KWIC analysis also performed gain insight into use significant word. Results: In total, 3426 received 7721 (comment rate: 44.4%). five most frequent “doctor”, “appointment”, “surgery”, “practice”, “time”. two-word combinations “reception staff”, “excellent service”, “two weeks”. showed “excellent” significantly associated better (OR=1.96, 95%CI=1.63-2.34), while “rude” worse (OR=0.53, 95%CI=0.46-0.60). results revealed 49 78 (63%) occurrences related receptionists 17(22%) doctors. Conclusions: output serve springboard Text extraction show promise quick evaluation unstructured feedback. easily understandable, but require probing such establish context. Future research should explore whether sophisticated (eg, sentiment analysis, natural language processing) could add additional levels understanding. [JMIR Med Inform 2015;3(2):e20]

参考文章(55)
Gilbert C. Liu, Mitchell A. Harris, Stacey A. Keyton, Richard M. Frankel, Use of unstructured parent narratives to evaluate medical student competencies in communication and professionalism. Ambulatory Pediatrics. ,vol. 7, pp. 207- 213 ,(2007) , 10.1016/J.AMBP.2007.03.001
Wilfred McSherry, Steve Jamieson, The qualitative findings from an online survey investigating nurses' perceptions of spirituality and spiritual care. Journal of Clinical Nursing. ,vol. 22, pp. 3170- 3182 ,(2013) , 10.1111/JOCN.12411
M. Roland, M. Elliott, G. Lyratzopoulos, J. Barbiere, R. A Parker, P. Smith, P. Bower, J. Campbell, Reliability of patient responses in pay for performance schemes: analysis of national General Practitioner Patient Survey data in England BMJ. ,vol. 339, ,(2009) , 10.1136/BMJ.B3851
Marliese Thomas, Dana M. Caudle, Cecilia M. Schmitz, To tag or not to tag Library Hi Tech. ,vol. 27, pp. 411- 434 ,(2009) , 10.1108/07378830910988540
Laura Ashley, Helen Jones, James Thomas, Alex Newsham, Amy Downing, Eva Morris, Julia Brown, Galina Velikova, David Forman, Penny Wright, Integrating patient reported outcomes with clinical cancer registry data: a feasibility study of the electronic Patient-Reported Outcomes From Cancer Survivors (ePOCS) system. Journal of Medical Internet Research. ,vol. 15, ,(2013) , 10.2196/JMIR.2764
Alice Frohna, David Stern, The nature of qualitative comments in evaluating professionalism Medical Education. ,vol. 39, pp. 763- 768 ,(2005) , 10.1111/J.1365-2929.2005.02234.X
Nancy L. Leech, Anthony J. Onwuegbuzie, An Array of Qualitative Data Analysis Tools: A Call for Data Analysis Triangulation. School Psychology Quarterly. ,vol. 22, pp. 557- 584 ,(2007) , 10.1037/1045-3830.22.4.557
Crispin Jenkinson, Angela Coulter, Stephen Bruster, The Picker Patient Experience Questionnaire: development and validation using data from in-patient surveys in five countries International Journal for Quality in Health Care. ,vol. 14, pp. 353- 358 ,(2002) , 10.1093/INTQHC/14.5.353
Christine Wright, Suzanne H. Richards, Jacqueline J. Hill, Martin J. Roberts, Geoff R. Norman, Michael Greco, Matthew R.S. Taylor, John L. Campbell, Multisource feedback in evaluating the performance of doctors: the example of the UK General Medical Council patient and colleague questionnaires. Academic Medicine. ,vol. 87, pp. 1668- 1678 ,(2012) , 10.1097/ACM.0B013E3182724CC0