Readability of Ebola Information on Websites of Public Health Agencies, United States, United Kingdom, Canada, Australia, and Europe

Table

RIS[TXT - 2 KB]

Enrique Castro-Sánchez

, Elpiniki Spanoudakis, and Alison H. Holmes

Author affiliations: Imperial College London, London, UK; and National Institute for Health Research, London

Abstract

Public involvement in efforts to control the current Ebola virus disease epidemic requires understandable information. We reviewed the readability of Ebola information from public health agencies in non–Ebola-affected areas. A substantial proportion of citizens would have difficulty understanding existing information, which would potentially hinder effective health-seeking behaviors.

The outbreak of Ebola virus disease (EVD) that originated in Guinea in April 2014 has become the largest known epidemic of this pathogen and was declared an international public health emergency (1). In addition, repatriation of health care workers and volunteers to Europe and the United States has resulted in human-to-human transmission in western health care organizations (2), thus bringing Ebola to the fore of public attention in settings far removed from local outbreak areas.

Currently, because there is no antiviral treatment or vaccine, surveillance and strict observation of recommended infection prevention and control measures, aided by public awareness regarding symptoms and prompt health care–seeking behavior, are essential efforts to control Ebola. In Africa, low awareness has led to community misunderstandings and unwillingness to cooperate with medical teams (3). In non–EVD-affected countries, nonrigorous information has resulted in unfounded fear among health care workers and citizens, disrupting the activity of hospitals caring for persons with EVD (4).

For health messages to be followed effectively, they must be tailored to the health literacy of the audience. Health literacy, which refers to “the cognitive and social skills which determine the motivation and ability of individuals to gain access to, understand and use information in ways which promote and maintain good health” (5), has been associated with better self-care (6). However, a substantial proportion of citizens worldwide have insufficient or inadequate health literacy (7).

Several factors, including readability of information provided (8), can help reduce health literacy deficits. Readability refers to “the determination of the reading comprehension level a person must have to understand written materials” (9). It is recommended that health information materials should be written at a level typically understandable by an 11-year-old person (10). Such recommendations for clarity and understandability might be more effective if one considers that anxiety or panic attributed to a highly virulent infection, such as Ebola, might hinder comprehension of related information (11).

We examined readability of EVD public information available from selected public health agencies in non–EVD-affected countries. Countries that have EVD should explore how well this information would serve to reduce panic and anxiety and perform as an effective source of advice for the public.

The Study

Current information on Ebola aimed at the public was downloaded from various websites; a list is provided in Technical Appendix[PDF - 137 KB - 2 pages]. Information was retrieved from the European Centre for Disease Control (Ebola factsheet for the general public); the US Centers for Disease Prevention and Control (CDC; Questions and answers on Ebola); Public Health England (PHE) in the United Kingdom (Ebola: public health questions and answers); and the government of Canada (Ebola virus disease) on September 1, 2014 and from the government of Australia (Ebolavirus disease outbreaks in West Africa: important information for travellers, patients and consumers) and the World Health Organization (WHO; Advice for individuals and families. Ebola guidance package) on November 11, 2014.

Any figures, such as maps or pictograms, were removed, and content was then formatted as plain text and uploaded to a free online tool (http://www.readabilityformulas.com/free-readability-formula-tests.php/) from which different readability indicators were obtained (Technical Appendix[PDF - 137 KB - 2 pages]). The causes, symptoms, risks, treatment, prevention, and surveillance pages in the Canadian website were individually opened and analyzed. We calculated measures of central tendency and dispersion for scores obtained in indicators reported by using Stata version 10.1 (StataCorp LP, College Station, TX, USA).

Results are shown in the Table. In terms of reading difficulty, mean Flesch Reading Ease score for all information was 48.85 (SD 7.76; 95% CI 40.69–57.00) and indicated difficult to read. WHO information was easiest to read (score 62.3); information from Australia was most difficult to read (score 42). Mean Gunning FOG Index was 12.6 (SD 1.68; 95% CI 10.83–14.36) and indicated difficult to read. Again, written content from WHO and Australia were at the easiest and most difficult reading levels, respectively.

Factsheets from PHE and Canada required a 12th US school grade reading level to be understood, and the CDC and WHO factsheets required a 9th US school grade reading level. Comparable results were obtained with Coleman-Liau Index and the SMOG (simple measure of gobbledygook) formula. The Automated Readability Index for all materials was 10.7 (SD 1.97; 95% CI 8.62–12.77) and required an age of 15–16 years to understand the text. Finally, information from PHE and Australia was written at the most demanding level according to the Linsear Write Formula (score 14.1, or college level), and the CDC content required an 8th US grade reading level for comprehension (score 8.4). The mean result for all content was 11.95 (SD 2.42, 95% CI 9.40–14.49).

Conclusions

Our analyses indicate that the information on EVD provided on websites of different public health agencies is written at a higher than recommended reading level. For such a reason, a substantial proportion of citizens with low literacy in the United States, United Kingdom, Canada, Australia, and Europe would have difficulty understanding key EVD messages. These results are of concern because poor readability might prevent or delay adoption of appropriate health-seeking behaviors, prolong ineffective self-care strategies, and perpetuate stigmatizing attitudes toward Ebola.

Providing adequate EVD information for the public might be arduous. Uncertainties remain regarding optimal clinical management for Ebola patients and disagreements in infection prevention and control protocols. The continued modification of procedures also demands constant public engagement efforts to avoid dissemination of conflicting messages and to ensure that information released is up to date and presented at a level that can be adequately understood. Because there have been limited national communication campaigns in non–EVD-affected countries, it is likely that other outlets, including traditional mass media and social media, might have been used by the public to meet their information needs (13), with probable trade-offs between immediacy and accuracy or reliability of information provided. The variation of readability identified in our study suggests that with contributions from health literacy specialists, public health agencies could further adapt the EVD information provided.

We recognize that persons accessing health information online are not representative of the average population because they are more educated and benefit from better information-seeking skills and health literacy (14). Thus, the online audience might be able to make more effective use of information on websites analyzed. However, such might not be the case for persons whose first language is not English, who might find information provided even more difficult to understand because of linguistic and cultural barriers.

It is accepted that readability measures alone may not reflect the level at which information is written (15). Because the Ebola epidemic has continued since our analysis, it might be possible for currently available information to have been modified and display greater readability. Our analysis was not exhaustive because we assessed selected public health agencies in non–EVD-affected countries and concentrated in English language materials. Therefore, our findings might not be representative of all health pages with EVD information. However, we evaluated key official websites.

Public health agencies in non–EVD-affected countries must improve the readability of EVD information currently provided so that the public could adopt effective self-care strategies, avoid fear, and reduce unnecessary panic and stigma toward persons affected by Ebola. In addition, agencies should consider multimodal Ebola awareness campaigns, including social marketing interventions, to encourage and strengthen public participation in Ebola control efforts.

Dr. Castro-Sánchez is the lead research nurse at the National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infection and Antimicrobial Resistance at Imperial College London, London, UK. His research interests include health literacy in infectious diseases and healthcare-associated infections, and effect of social networks on clinicians and patients’ attitudes to infection.

Acknowledgments

E.C.-S. was responsible for the design of the study and collected data. A.H.H. provided technical input during all stages of the project and analysis. All authors were responsible for data analysis, contributed substantially to writing the manuscript, approved its final version, had full access to all data in the study, and take responsibility for the integrity, accuracy, and presentation of data. E.C.-S. is the guarantor.

This study was supported by the National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infection and Antimicrobial Resistance at Imperial College London in partnership with PHE.

References

World Health Organization. Statement on the 1st meeting of the IHR emergency committee on the 2014 Ebola outbreak in West Africa. World Health Organization, IHR Emergency Committee regarding Ebola; 2014 [cited 2014 Nov 11].http://www.who.int/mediacentre/news/statements/2014/ebola-20140808/en/
World Health Organization. WHO Disease Outbreak News 1st October 2014: Ebola virus disease—United States of America. World Health Organization, Global alert and response; 2014 [cited 2014 Nov 11]. http://www.who.int/csr/don/01-october-2014-ebola/en/
Ebola in West Africa: gaining community trust and confidence. Lancet. 2014;383:1946. DOI PubMed
Mosquera M, Melendez V, Latasa P. Handling Europe’s first Ebola case: internal hospital communication experience. Am J Infect Control. 2015;Feb 24:pii: S0196-6553(15)00033-4.
Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000;15:259–67. DOI
White S, Chen J, Atchison R. Relationship of preventive health practices and health literacy: a national study. Am J Health Behav. 2008;32:227–42.DOI PubMed
Rudd RE. Health literacy skills of U.S. adults. Am J Health Behav. 2007;31(Suppl 1):S8–18. DOI PubMed
National Work Group on Literacy and Health. Communicating with patients who have limited literacy skills. J Fam Pract. 1998;46:168–76.PubMed
Albright J, de Guzman C, Acebo P, Paiva D, Faulkner M, Swanson J. Readability of patient education materials: implications for clinical practice. Appl Nurs Res. 1996;9:139–43. DOI PubMed
Cotugna N, Vickery CE, Carpenter-Haefele KM. Evaluation of literacy level of patient education pages in health-related journals. J Community Health. 2005;30:213–9. DOI PubMed
Calvo MG, Carreiras M. Selective influence of test anxiety on reading processes. Br J Psychol. 1993;84:375–88 and. DOI PubMed
Organisation for Economic Co-operation and Development. OECD skills outlook 2013: first results from the survey of adult skills. Paris. Organ.2013;•••: .DOI
van Bekkum JE, Hilton S. Primary care nurses’ experiences of how the mass media influence frontline healthcare in the UK. BMC Fam Pract.2013;14:178. DOI PubMed
Fox S. Digital divisions. Washington, DC: Pew Internet and American Life Project; 2005 [cited 2014 Nov 11].http://www.pewinternet.org/~/media//Files/Reports/2005/PIP_Digital_Divisions_Oct_5_2005.pdf
Meade C, Smith C. Readability formulae: cautions and criteria. Patient Education and Counseling. 1991;17:153e8.

Table

Table. Readability of Ebola public information published by selected public health agencies

Technical Appendix

. Website addresses for information on Ebola and readability indicators. 137 KB

Suggested citation for this article: Castro-Sánchez E, Spanoudakis E, Holmes AH. Readability of Ebola information on websites of public health agencies, United States, United Kingdom, Canada, Australia, and Europe. Emerg Infect Dis. 2015 Jul [date cited]. http://dx.doi.org/10.3201/eid2107.141829

DOI: 10.3201/eid2107.141829