Advertisement
Original Article| Volume 5, ISSUE 1, e1-e9, February 2023

Download started.

Ok

Reducing the Use of Complex Words and Reducing Sentence Length to <15 Words Improves Readability of Patient Education Materials Regarding Sports Medicine Knee Injuries

Open AccessPublished:December 29, 2022DOI:https://doi.org/10.1016/j.asmr.2022.10.004

      Purpose

      To develop a standardized method to improve readability of orthopaedic patient education materials (PEMs) without diluting their critical content by reducing the use of complex words (≥3 syllables) and shortening sentence length to ≤15 words.

      Methods

      OrthoInfo, a patient education website developed by the Academy of American Orthopedic Surgeons, was queried for PEMs relevant to the care of athletic injuries of the knee. Inclusion criteria were PEMs that were unique, pertained to topics of knee pathology in sports medicine, and written in a prose format. Exclusion criteria were information presented in video or slideshow format, or topics not pertaining to knee pathology in sports medicine. Readability of PEMs was evaluated using 7 unique readability formulas before and after applying a standardized method to improve readability while preserving critical content (reducing the use of ≥3 syllable words and ensuring sentence length is ≤15 words). Paired samples t-tests were conducted to assess the relationship between reading levels of the original PEMs and reading level of edited PEMs.

      Results

      Reading levels differed significantly between the 22 original PEMs and edited PEMs across all 7 readability formulas (P < .01). Mean Flesch Kincaid Grade Level of original PEMs (9.8 ± 1.4) was significantly increased compared to that of edited PEMs (6.4 ± 1.1) (P = 1.9 × 10–13). 4.0% of original PEMs met National Institutes of Health recommendations of a sixth-grade reading level compared with 48.0% of modified PEMs.

      Conclusions

      A standardized method that reduces the use of ≥3 syllable words and ensures sentence length is ≤15 words significantly reduces the reading-grade level of PEMs for sports-related knee injuries. Orthopaedic organizations and institutions should apply this simple standardized method when creating PEMs to enhance health literacy.

      Clinical Relevance

      The readability of PEMs is important when communicating technical material to patients. While many studies have suggested strategies to improve the readability of PEMs, literature describing the benefit of these proposed changes is scarce. The information from this study details a simple standardized method to use when creating PEMs that may enhance health literacy and improve patient outcomes.
      The internet has become a vast resource for medical information. Approximately one-half of adult internet users have reported using the internet to learn more information about a specific medical treatment or procedure.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      In response to this current trend, the American Academy of Orthopaedic Surgeons (AAOS) has developed online patient education materials (PEMs) to enhance patient–doctor communication and improve patient health literacy in the treatment of orthopaedic conditions.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      However, although the internet can be a vast source of information, its usefulness in patient care is dependent not only on the content available to patients but also the health literacy of the patient consuming the information.
      Health literacy is the capacity to obtain, process, and understand basic health concepts needed to make appropriate health decisions.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      • Roberts H.
      • Zhang D.
      • Dyer G.S.M.
      The readability of AAOS patient education materials: Evaluating the progress since 2008.
      • Friedman D.B.
      • Hoffman-Goetz L.
      A systematic review of readability and comprehension instruments used for print and web-based cancer information.
      Health literacy is considered to be the single best predictor of a patient’s health status, with poor health literacy leading to worse patient outcomes.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Baker D.W.
      • Parker R.M.
      • Williams M.v.
      • Clark W.S.
      • Nurss J.
      The relationship of patient reading ability to self-reported health and use of health services.
      ,
      • Johnson K.
      • Weiss B.D.
      How long does it take to assess literacy skills in clinical practice?.
      Poor health literacy has been associated with more frequent hospital admissions, longer hospital stays, increased risk for seeking emergency care, increased complications, reduced compliance, and more frequent missed appointments.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Baker D.W.
      • Parker R.M.
      • Williams M.v.
      • Clark W.S.
      • Nurss J.
      The relationship of patient reading ability to self-reported health and use of health services.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      • Berkman N.D.
      • Sheridan S.L.
      • Donahue K.E.
      • Halpern D.J.
      • Crotty K.
      Low health literacy and health outcomes: An updated systematic review.
      • DeWalt D.A.
      • Berkman N.D.
      • Sheridan S.
      • Lohr K.N.
      • Pignone M.P.
      Literacy and health outcomes.
      • Serper M.
      • Patzer R.E.
      • Curtis L.M.
      • et al.
      Health literacy, cognitive ability, and functional health status among older adults.
      • Friedland R.
      Understanding health literacy: new estimates of the high costs of inadequate health literacy.
      • Murero M.
      • D’Ancona G.
      • Karamanoukian H.
      Use of the internet by patients before and after cardiac surgery: An interdisciplinary telephone survey.
      Not only does poor health literacy bring worse outcomes for the patient, but it also contributes an estimated $73 billion of additional cost burden to the U.S. health care system.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      To be effective, PEMs must be written at a level that the target population can comprehend.
      There is clearly a disparity with regards to health literacy in the United States. It is estimated that approximately 21% of U.S. adults read at, or below a fifth-grade reading level, described as “functionally illiterate.”
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Ley P.
      • Florio T.
      The use of readability formulas in health care.
      An additional 30% of U.S. adults read between a sixth-grade and eighth-grade reading level, termed “marginally literate.”
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Ley P.
      • Florio T.
      The use of readability formulas in health care.
      Furthermore, nearly one-half of the Hispanic and African American US population is functionally illiterate.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      National Center for Education Statistics. A First Look at the Literacy of America’s Adults in the 21st Century.
      ,
      National Center for Education Statistics
      Adult literacy in America: A first look at the results of the National Adult Literacy Survey.
      Therefore, the American Medical Association and National Institutes of Health recommend that all PEMs be written at or below a sixth-grade reading level.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      • Roberts H.
      • Zhang D.
      • Dyer G.S.M.
      The readability of AAOS patient education materials: Evaluating the progress since 2008.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      Sports-related knee injuries such as anterior cruciate ligament or meniscus tears are very common, and there are ample resources for knee injury-related PEMs. However, anatomy, pathology, and treatment plans of knee injuries often are described in terms that are obscure to patients. Complex, multisyllable terminology, including “anterior cruciate ligament,” “articular cartilage,” “meniscectomy,” or “arthroscopy,” can be foreign and confusing terms for patients. Therefore, the field of sports medicine, specifically involving knee pathology, is rife with the possibility for misunderstanding, leading to low patient health literacy. Improving the readability of orthopaedic PEMs is a realistic and important goal to improve the health literacy and overall health of patients. While many studies have suggested simple strategies to improve readability scores of PEMs such as reducing complex words, literature describing the benefit of these proposed changes is scarce.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      The purpose of this study is to develop a standardized method that can be applied to orthopaedic knee injury–related PEMs for the purpose of improving their readability without diluting their critical content. We hypothesized that reducing the use of complex words (≥3 syllables) and shortening sentence length to ≤15 words would improve the readability of orthopaedic PEMs.

      Methods

      Data Collection

      OrthoInfo, a patient education website developed and reviewed by the AAOS, was queried for PEMs relevant to the care of athletic injuries of the knee.
      American Academy of Orthopaedic Surgeons
      OrthoInfo.
      All PEMs were collected by a single author from OrthoInfo (S.H.). Inclusion criteria were PEMs that were unique articles, pertained to topics of knee pathology in sports medicine, and written in a prose format. Exclusion criteria were information presented in video or slideshow format or topics not pertaining to knee pathology in sports medicine. A total of 205 PEMs were available for review for the study. After application of inclusion and exclusion criteria, 22 PEMs were included in the study (Table 1).
      Table 1Readability Formula Scores of Seven Independent Readability Formulas for Original Versus Edited PEMs Included in the Present Study
      PEM: Article TitleFlesch Reading Ease ScoreGunning FogFlesch–Kincaid Grade LevelThe Coleman-Liau IndexThe SMOG IndexAutomated Readability IndexLinsear Write Formula
      OriginalEditedOriginalEditedOriginalEditedOriginalEditedOriginalEditedOriginalEditedOriginalEdited
      Adolescent Anterior Knee Pain48.863.513.59.211.27.512.011.010.37.411.87.512.76.8
      Anterior Cruciate Ligament (ACL) Injuries49.465.612.98.510.06.612.011.010.17.19.96.39.45.5
      Collateral Ligament Injuries61.375.611.47.58.14.910.09.08.86.07.84.58.24.4
      Combined Knee Ligament Injuries52.569.713.38.39.55.611.010.010.06.59.05.09.04.4
      Common Knee Injuries52.969.711.68.39.65.612.010.09.86.59.45.09.24.4
      Meniscus Tears55.369.911.77.78.75.711.010.08.96.38.45.37.74.5
      Osgood–Schlatter Disease (Knee Pain)55.573.212.68.29.76.012.010.09.26.210.86.711.06.1
      Patellar Dislocation and Instability in Children (Unstable Kneecap)52.568.613.09.210.16.612.010.09.97.310.36.311.26.3
      Patellar Tendon Tear56.570.711.68.79.16.311.09.08.86.79.16.28.76.2
      Patellofemoral Pain Syndrome51.970.712.98.610.46.312.09.09.86.710.86.311.66.1
      Pes Anserine (Knee Tendon) Bursitis42.963.014.410.011.67.613.010.011.17.911.67.512.47.2
      Posterior Cruciate Ligament (PCL) Injuries46.266.415.110.210.96.712.09.011.17.610.45.612.06.1
      Shin Splints57.563.111.59.88.47.012.011.08.47.38.67.07.45.7
      Unstable Kneecap64.473.911.48.38.65.99.09.08.36.39.25.910.86.1
      ACL Injury: Does It Require Surgery?37.753.016.912.513.39.613.012.012.49.413.89.515.49.0
      Knee Arthroscopy Exercise Guide71.177.78.06.36.04.710.09.06.35.25.94.45.54.4
      Knee Arthroscopy49.860.413.410.710.48.112.011.010.28.310.88.111.47.6
      Meniscal Transplant Surgery49.869.813.28.110.26.712.010.010.06.410.16.910.76.5
      Discoid Meniscus53.967.912.48.59.46.512.010.09.46.69.56.49.05.7
      Arthritis of the Knee48.673.313.77.510.65.713.010.010.36.011.15.811.45.3
      Osteonecrosis of the Knee49.972.812.56.710.46.012.09.09.75.410.46.011.05.6
      Patellofemoral Arthritis55.675.611.46.58.85.312.010.08.85.49.25.88.05.0
      Mean values52.968.812.78.69.86.411.710.09.66.89.96.310.25.9
      Standard deviation6.95.61.71.41.41.11.00.81.21.01.61.22.11.1
      PEMs, patient education materials; SMOG, Simple Measure of Gobbledygook.

      Determination of Readability

      The reading level of each PEM was calculated using an online tool.
      My Byline Media
      Readability Formulas.
      Reading level was evaluated by 7 readability formulas, including Flesch Reading Ease score, Gunning-Fog, Flesch–Kincaid Grade Level, The Coleman–Liau Index, The Simple Measure of Gobbledygook Index, Automated Readability Index, and Linsear Write Formula (Table 2). Additional data recorded for each PEM included total number of words, mean number of words per sentence, mean number of syllables per word, and percentage of complex words.
      Table 2Descriptions of the Seven Independent Readability Formulas Used to Evaluate Handouts in the Current Study
      Readability AssessmentFormulaDescription
      Flesch–Kincaid grade level(0.39 × B) + (11.8 × W) – 15.59B = mean number of syllables per word

      W = mean number of words per sentence
      Flesch Reading Ease206.835 – (1.015 × W) – (84.6 × B)B = mean number of syllables per word

      W = mean number of words per sentence
      Simple Measure of Gobbledygook (SMOG) Index1.043 × √(P × 30) + 3.1291P = number of words with ≥3 syllables

      S = number of sentences
      Coleman–Liau(0.0588 × L) – (0.296 × T) – 15.8L = mean number of letters/word

      T = mean number of sentences/100 words
      Gunning Fog0.4 × (W/S + 100 – P/W)S = mean number of sentences

      W = mean number of words/sentence

      P = mean number of words with ≥3 syllables
      Automated Readability Index4.71 (characters/words) + 0.5 (words/sentences) – 21.43
      Linsear WriteNo formula—calculates the U.S. grade level of a text sample based on sentence length and the number of words with 3 or more syllables.

      Assessing Readability

      Each PEM was accessed on and downloaded from OrthoInfo.com. The content of each PEM was copy and pasted into a new Microsoft Word document. This content was then copy and pasted into the text box of the Automatic Readability Checker on www.readabilityformulas.com/. The option to “Check Text Readability” was selected and the readability data for each PEM was recorded.

      Applying the Standardized Method to Improve Readability

      After evaluating the readability of the original PEMs provided by OrthoInfo, the original documents were edited using a standardized method for improvement of readability while preserving critical content of the PEM (S.H., N.C., S.G., J.B.). The standardized method involved reducing the use of complex words (≥3 syllables) and ensuring sentence length was ≤15 words. The application of these editing techniques reflects the most often cited techniques for improving readability, which include replacing complex medical jargon with simpler terms and shortening sentence length to 10-15 words per sentnces.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      ,
      • Jackson R.H.
      • Davis T.C.
      • Bairnsfather L.E.
      • George R.B.
      • Crouch M.A.
      • Gault H.
      Patient reading ability: An overlooked problem in health care.
      ,
      • Flesch R.
      A new readability yardstick.
      Critical content was described as medical information necessary for patient understanding of the described knee pathology and determined by the author who originally collected the PEMs (S.H.). Individuals determining critical content are preferably practicing orthopaedic surgeons; however, critical content also can be determined by individuals training within the field of orthopaedic surgery. Investigators were limited to a single round of editing in further attempts to preserve critical content. After editing, the reading level of each PEM was evaluated for a second time using the aforementioned criteria. The same readability formulas and same additional datapoints were recorded for the edited documents as for the original documents.

      Statistical Analysis

      Mean reading level, percentage of PEMs above a sixth-grade reading level, and percentage of PEMs at-or-below sixth-grade reading level were calculated for both original and edited PEMs. In addition, the mean change in reading level after editing was calculated for original and edited PEMs. Extracted data were analyzed through SPSS software version 19.0. Categorical variables are reported in frequencies and percentages. In addition, statistical analysis was conducted using paired-sample t-test to determine differences in reading level between original PEMs and edited PEMs. Paired samples t-tests were conducted to assess the relationship between reading levels of the original PEMs and reading level of edited PEMs. A P-value of .05 was deemed statistically significant.

      Results

      A total of 205 PEMs were available for review. Of these, 22 met the inclusion criteria and were included in the study (Fig 1). Reading levels differed significantly between the 22 original PEMs and edited PEMs across all 7 readability formulas (P < .01) (Table 1). Using the Flesch–Kincaid Grade Level readability formula, we found that the mean reading level for original PEMs was 9.77 ± 1.42 compared before modification with 6.40 ± 1.08 for edited PEMS (P = 1.9 × 10–13). Per the Flesch–Kincaid Grade level readability formula, one original PEM (4.0%) versus 12 edited PEMs (48.0%) met National Institutes of Health recommendations of a sixth-grade reading level before and after changes respectively. Readability formula scores and numerical data for each PEM evaluated is displayed in Tables 1 and 3. Readability scores across these 7 readability formulas are summarized in Table 4.
      Figure thumbnail gr1
      Fig 1Application of inclusion and exclusion criteria to patient education materials (PEMs) collected from a query of OrthoInfo.com for PEMs relevant to the care of athletic injuries of the knee.
      Table 3Numerical Descriptive Statistics for Original Versus Edited PEMs Included in the Present Study
      Patient Education Material: Article TitleNumber of Words (Total)Words per SentenceMean Characters per WordMean Syllables per Word% of 3+ Syllable WordsNo. of 3+ Syllable Words
      OriginalEditedOriginalEditedOriginalEditedOriginalEditedOriginalEditedOriginalEdited
      Adolescent Anterior Knee Pain1,4691,408191254.82217%13%244176
      Anterior Cruciate Ligament (ACL) Injuries1,3331,24715105.14.82221%14%277178
      Collateral Ligament Injuries1,0489261494.74.62116%11%172106
      Combined Knee Ligament Injuries7526411484.94.72221%14%15691
      Common Knee Injuries1,31664115854.72219%14%25291
      Meniscus Tears1,2391,09913954.72218%12%226137
      Osgood-Schlatter Disease (Knee Pain)626590171254.72115%9%9352
      Patellar Dislocation and Instability in Children (Unstable Kneecap)9961,032171254.72118%13%175135
      Patellar Tendon Tear1,8901,81915124.94.62115%11%287199
      Patellofemoral Pain Syndrome1,8441,769181254.62116%11%298191
      Pes Anserine (Knee Tendon) Bursitis43944618135.24.82221%14%9163
      Posterior Cruciate Ligament (PCL) Injuries1,1951,131171154.62222%15%263172
      Shin Splints1,1651,040131054.92216%15%191153
      Unstable Kneecap47345718124.64.51111%9%5442
      ACL Injury: Does It Require Surgery?3,1433,14522155.252222%17%678548
      Knee Arthroscopy Exercise Guide1,1061,0741194.74.51110%8%11483
      Knee Arthroscopy1,7081,40217135.14.92219%15%317214
      Meniscal Transplant Surgery1,1751,03715135.14.72119%9%22692
      Discoid Meniscus1,2661,165151154.72217%11%221132
      Arthritis of the Knee2,3401,92016115.24.82119%9%451176
      Osteonecrosis of the Knee1,7741,543161254.62117%7%300104
      Patellofemoral Arthritis1,4401,20813115.14.72117%7%24290
      Mean values1,351.71,215.515.811.15.04.71.91.517.5%11.7%242.2146.6
      Standard deviation600.3584.42.41.70.20.10.30.53%3%129.1100.2
      PEMs, patient education materials.
      Table 4Readability Scores of Seven Independent Readability Formulas for Original Versus Edited PEMs Included in the Present Study
      Readability FormulaOriginal PEMsEdited PEMsChange in MeanP Value
      MeanSDMeanSD
      Flesch Reading Ease Score52.96.968.85.615.9P = 5.5E-13
      Gunning Fog12.71.78.61.4–4.1P = 1.5E-13
      Flesch–Kincaid Grade Level9.81.46.41.1–3.4P = 1.9E-13
      The Coleman-Liau Index11.71.010.00.8–1.7P = 5.2E-09
      The SMOG Index9.61.26.81.0–2.9P = 1.0E-12
      Automated Readability Index9.91.66.31.2–3.6P = 1.5E-13
      Linsear Write Formula10.22.15.91.1–4.3P = 2.0E-12
      PEMs, patient education materials; SMOG, Simple Measure of Gobbledygook; SD, standard deviation.
      The relationship between additional numerical data describing the original PEMs and edited PEMs, including mean number of words, mean words per sentence, mean characters per word, mean syllables per word, mean percentage of complex words, and mean number of complex words differed significantly. The mean number of words per sentence was measured to be 15.8 ± 2.4 for original PEMs versus 11.1 ± 1.7 for edited PEMs (P = 5.8 × 10–13). Percentage of complex words was measured to be 17.6% ± 3.1% for original PEMs compared to 11.7% ± 2.8% for edited PEMs (P = 7.2 × 10–10). Numerical data regarding these variables are summarized in Table 5. All numerical data compared between original PEMs and edited PEMs differed significantly (P < .01).
      Table 5Composite Descriptive Statistics Comparing Original Versus Edited PEMs Included in the Present Study
      MeasurementOriginal PEMsEdited PEMsChange in MeanP Value
      MeanSDMeanSD
      Number of words (total)1351.7600.31215.5584.4–136.2P = .00042
      Number of words per sentence15.82.411.11.7–4.7P = 5.8E-12
      Mean characters per word5.00.24.70.1–0.3P = 3.3E-11
      Mean syllables per word1.90.31.50.5–0.4P = .23
      % of 3+ syllable words17.60%3.10%11.70%2.80%5.9%P = 7.2E-10
      No. of 3+ syllable words242.2129.1146.6100.2–95.6P = 1.3E-7
      PEMs, patient education materials; SD, standard deviation.

      Discussion

      The primary findings of this study support our hypothesis and illustrate that a standardized method focused on reducing the usage of complex words and reducing sentence length to ≤15 words per sentence improves readability of PEMs across all 7 readability formulas. This current study not only shows that PEMs for knee pathology in orthopaedic sports medicine are written at a level well above the recommended reading level, but also, more importantly, proposes a simple standardized method that effectively improves readability of PEMs while preserving critical content. The standardized method for improving readability used in this study significantly improved the readability of all PEMs across all 7 independent readability formulas and significantly reduced numbers of words, number of words per sentence, characters per word, syllables per word, percentage of complex words, and number of complex words. This is a clinically impactful finding as improving the readability of PEMs directly translates to enhanced patient health literacy which can lead to better patient outcomes.
      • Rooney M.K.
      • Santiago G.
      • Perni S.
      • et al.
      Readability of patient education materials from high-impact medical journals: A 20-year analysis.
      • Friedman A.J.
      • Cosby R.
      • Boyko S.
      • Hatton-Bauer J.
      • Turnbull G.
      Effective teaching strategies and methods of delivery for patient education: A systematic review and practice guideline recommendations.
      • Wilson E.A.H.
      • Park D.C.
      • Curtis L.M.
      • et al.
      Media and memory: The efficacy of video and print materials for promoting patient education about asthma.
      Furthermore, the simplicity of the standardized method allows for it to easily be applied to other fields within orthopaedics, as well as other specialties within medicine, to improve health literacy on a wider scale.
      Recommendations for improving readability of PEMs have existed for several decades. The prevailing sentiment of these suggestions is that it is essential to consider the reading skills of the target audience when creating PEMs. The most often cited technique for improving readability includes replacing complex medical jargon with simpler terms (Fig 2).
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      ,
      • Jackson R.H.
      • Davis T.C.
      • Bairnsfather L.E.
      • George R.B.
      • Crouch M.A.
      • Gault H.
      Patient reading ability: An overlooked problem in health care.
      ,
      • Flesch R.
      A new readability yardstick.
      An example of simplifying word choice would be the replacement of the 4-syllable term “arthroscopy” with the 1-syllable word “scope.”
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      Although both terms convey the same message, the latter is easier to understand and thus more accessible to the reader. In improving word choice, it has been recommended to use shorter words with fewer syllables.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      Another often-suggested technique includes simplifying sentences to be more succinct and easier to understand.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      ,
      • Jackson R.H.
      • Davis T.C.
      • Bairnsfather L.E.
      • George R.B.
      • Crouch M.A.
      • Gault H.
      Patient reading ability: An overlooked problem in health care.
      ,
      • Flesch R.
      A new readability yardstick.
      Reducing length of sentences to 10 to 15 words was shown by one study to improve the reading level of 8 PEMs by an average of 1.41 grade levels.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      This parallels the finding in the current study that limiting use of complex words and reducing sentence length to fewer than 15 words can effectively improve the reading level of PEMs by 3.13 grade levels according to the Flesch–Kincaid Grade Level readability formula. Other recommended strategies for improving readability of PEMs include writing in active versus passive voice, using bulleted lists when appropriate, supplementing with visual illustrations, using traditional 12- to 14-point font size, and maintaining consistency in word choice (e.g., using only “surgery,” “operation,” or “procedure” instead of interchanging them).
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Flesch R.
      A new readability yardstick.
      Pitfalls that decrease readability, and should be avoided, include using all capital letters, italics, and nontraditional fonts and sans-serif fonts.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Albright J.
      • de Guzman C.
      • Acebo P.
      • Paiva D.
      • Faulkner M.
      • Swanson J.
      Readability of patient education materials: Implications for clinical practice.
      While many studies analyzing readability of orthopaedic PEMs suggest these improvements, few, if any, have investigate the ability for these strategies to effectively improve readability of PEMs.
      Figure thumbnail gr2
      Fig 2List of complex words, often containing medical jargon, and their suggested alternatives that can function to improve readability of patient education materials (PEMs).
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      Although the availability of PEMs has increased in past decades, there exists a remarkable discrepancy between the readability of the documents and the reading skills of target audience. Current literature has consistently demonstrated the readability of orthopaedic PEMs to be inappropriately high and well above the recommended sixth-grade reading level.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      • Roberts H.
      • Zhang D.
      • Dyer G.S.M.
      The readability of AAOS patient education materials: Evaluating the progress since 2008.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      For many patients, this creates a barrier to understanding medical information and their own diagnoses. There exists ample literature describing the inappropriately high reading level of PEMs across many fields within orthopaedic surgery.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      • Roberts H.
      • Zhang D.
      • Dyer G.S.M.
      The readability of AAOS patient education materials: Evaluating the progress since 2008.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      A 2008 study showed that PEMs published on the AAOS website had an average reading grade level of 10.4, and only 2% of the articles were written below the recommended sixth-grade reading level.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Roberts H.
      • Zhang D.
      • Dyer G.S.M.
      The readability of AAOS patient education materials: Evaluating the progress since 2008.
      A re-evaluation of AAOS PEMs in 2015 still showed that only 3% of these articles were written at or below the sixth-grade reading level.
      • Roberts H.
      • Zhang D.
      • Dyer G.S.M.
      The readability of AAOS patient education materials: Evaluating the progress since 2008.
      ,
      • Eltorai A.E.M.
      • Thomas N.P.
      • Yang H.
      • Daniels A.H.
      • Born C.T.
      Readability of trauma-related patient education materials from the American Academy of Orthopaedic Surgeons.
      Recommendations for improving readability of PEMs have existed for several decades. The most often cited techniques include replacing complex medical jargon with simpler terms and shortening sentence length to 10-15 words per sentence.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      ,
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      ,
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Stelzer J.W.
      • Wellington I.J.
      • Trudeau M.T.
      • et al.
      Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
      ,
      • Jackson R.H.
      • Davis T.C.
      • Bairnsfather L.E.
      • George R.B.
      • Crouch M.A.
      • Gault H.
      Patient reading ability: An overlooked problem in health care.
      ,
      • Flesch R.
      A new readability yardstick.
      These measures are supposed to create PEMs that are more accessible to the reader without sacrificing the critical content of the article.
      More recent literature consistently displays that readability of PEMs continues to be a barrier for patients. An analysis of the readability of PEMs provided by the American Orthopaedic Society for Sports Medicine in 2018 found that all PEMs were written above the recommended sixth-grade reading level with 36% written above a twelfth-grade reading level.
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      In addition, a 2018 investigation of PEMs for hip arthroscopy found an average reading level of grade 12.79, with no individual websites containing information below an eighth-grade reading level.
      • Mehta M.P.
      • Swindell H.W.
      • Westermann R.W.
      • Rosneck J.T.
      • Lynch T.S.
      Assessing the readability of online information about hip arthroscopy.
      Furthermore, a 2015 analysis of online foot and ankle PEMs produced by the AAOS, the American Orthopaedic Foot and Ankle Society, Medline Plus, and 11 academic centers found an average reading level of grade 10.1, with no organization or institution producing a reading level within the recommended range.
      • Sheppard E.D.
      • Hyde Z.
      • Florence M.N.
      • McGwin G.
      • Kirchner J.S.
      • Ponce B.A.
      Improving the readability of online foot and ankle patient education materials.
      Thus, as these studies show, online PEMs currently require some degree of secondary education to properly understand the presented information. This limits the potential for improvement in health literacy and is a disservice to patients at large.
      Inappropriately high reading levels of PEMs reduce both the accessibility and potential utility of these important opportunities for improving health literacy. Health literacy is vital for orthopaedic patients. Multiple studies have demonstrated an association between health literacy and patient expectation and outcomes and also have highlighted the importance of setting realistic expectations.
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Rossi M.J.
      • Brand J.C.
      • Provencher M.T.
      • Lubowitz J.H.
      The expectation game: Patient comprehension is a determinant of outcome.
      ,
      • Wu J.R.
      • Moser D.K.
      • DeWalt D.A.
      • Rayens M.K.
      • Dracup K.
      Health literacy mediates the relationship between age and health outcomes in patients with heart failure.
      When patients do not have a complete understanding of their health information, they have been shown to ask fewer questions when meeting with physicians and express understanding when they are actually unsure.
      • Kakazu R.
      • Schumaier A.
      • Minoughan C.
      • Grawe B.
      Poor readability of AOSSM patient education resources and opportunities for improvement.
      ,
      • Katz M.G.
      • Jacobson T.A.
      • Veledar E.
      • Kripalani S.
      Patient literacy and question-asking behavior during the medical encounter: A mixed-methods analysis.
      ,
      • Menendez M.E.
      • van Hoorn B.T.
      • Mackert M.
      • Donovan E.E.
      • Chen N.C.
      • Ring D.
      Patients with limited health literacy ask fewer questions during office visits with hand surgeons.
      Investigators have shown that, when health literacy is low, and patients lack a thorough understanding of their diagnosis and treatment plan, patients experience worse outcomes.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      • Berkman N.D.
      • Sheridan S.L.
      • Donahue K.E.
      • Halpern D.J.
      • Crotty K.
      Low health literacy and health outcomes: An updated systematic review.
      • DeWalt D.A.
      • Berkman N.D.
      • Sheridan S.
      • Lohr K.N.
      • Pignone M.P.
      Literacy and health outcomes.
      • Serper M.
      • Patzer R.E.
      • Curtis L.M.
      • et al.
      Health literacy, cognitive ability, and functional health status among older adults.
      Poor health literacy has been associated with more frequent hospital admissions, with longer stays in the hospital, greater risks for seeking emergency care, increased complications, reduced compliance, and more frequent missed appointments.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Baker D.W.
      • Parker R.M.
      • Williams M.v.
      • Clark W.S.
      • Nurss J.
      The relationship of patient reading ability to self-reported health and use of health services.
      ,
      • Yi M.M.
      • Yi P.H.
      • Hussein K.I.
      • Cross M.B.
      • della Valle C.J.
      Readability of patient education materials from the web sites of orthopedic implant manufacturers.
      • Berkman N.D.
      • Sheridan S.L.
      • Donahue K.E.
      • Halpern D.J.
      • Crotty K.
      Low health literacy and health outcomes: An updated systematic review.
      • DeWalt D.A.
      • Berkman N.D.
      • Sheridan S.
      • Lohr K.N.
      • Pignone M.P.
      Literacy and health outcomes.
      • Serper M.
      • Patzer R.E.
      • Curtis L.M.
      • et al.
      Health literacy, cognitive ability, and functional health status among older adults.
      • Friedland R.
      Understanding health literacy: new estimates of the high costs of inadequate health literacy.
      • Murero M.
      • D’Ancona G.
      • Karamanoukian H.
      Use of the internet by patients before and after cardiac surgery: An interdisciplinary telephone survey.
      Not only does poor health literacy bring worse outcomes for the patient, but also it creates financial burden. Poor health literacy contributes an estimated $73 billion of additional burden to the U.S. health care system.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      Estimates show that the health care cost of Medicaid for those with limited health literacy is approximately 4 times greater than those with adequate health literacy.
      • Badarudeen S.
      • Sabharwal S.
      Assessing readability of patient education materials: Current role in orthopaedics.
      ,
      • Johnson K.
      • Weiss B.D.
      How long does it take to assess literacy skills in clinical practice?.
      Poor health literacy is a pervasive issue in orthopaedics that results in worse patient outcomes but has the potential to be fixed with better patient education.

      Limitations

      There are several limitations of this study. The first is the lack of patient perception of improvement of readability. As objective, evidence-based equations were used to determine readability, individual patients were not recruited to evaluate subjective readability of PEMs. In addition, the PEMs were only taken from a single informational website. While this was done to improve consistency with regards to the writing style and content, there is the possibility that other sources of literature may present information in a more readable form. Since this website is endorsed by the AAOS and is used by a large number or patients and providers alike, it was determined that this would be a valuable resource to assess. A third limitation was that the readability of the original and edited PEMs used in this study was not tested by actual patients. This represents an area of focus of future studies in which actual patient comprehension can be measured before and after reading the PEMs.

      Conclusions

      A standardized method that reduces the use of ≥3 syllable words and ensures that sentence length is ≤15 words significantly reduces the reading-grade level of PEMs for sports-related knee injuries. Orthopaedic organizations and institutions should apply this simple standardized method when creating PEMs to enhance health literacy.

      Supplementary Data

      References

        • Mehta M.P.
        • Swindell H.W.
        • Westermann R.W.
        • Rosneck J.T.
        • Lynch T.S.
        Assessing the readability of online information about hip arthroscopy.
        Arthroscopy. 2018; 34: 2142-2149
        • Sheppard E.D.
        • Hyde Z.
        • Florence M.N.
        • McGwin G.
        • Kirchner J.S.
        • Ponce B.A.
        Improving the readability of online foot and ankle patient education materials.
        Foot Ankle Int. 2014; 35: 1282-1286
        • Badarudeen S.
        • Sabharwal S.
        Assessing readability of patient education materials: Current role in orthopaedics.
        Clin Orthop Rel Res. 2010; 468: 2572-2580
        • Roberts H.
        • Zhang D.
        • Dyer G.S.M.
        The readability of AAOS patient education materials: Evaluating the progress since 2008.
        J Bone Joint Surg Am. 2016; 98: e70
        • Friedman D.B.
        • Hoffman-Goetz L.
        A systematic review of readability and comprehension instruments used for print and web-based cancer information.
        Health Educ Behav. 2006; 33: 352-373
        • Baker D.W.
        • Parker R.M.
        • Williams M.v.
        • Clark W.S.
        • Nurss J.
        The relationship of patient reading ability to self-reported health and use of health services.
        Am J Public Health. 1997; 87: 1027-1030
        • Johnson K.
        • Weiss B.D.
        How long does it take to assess literacy skills in clinical practice?.
        J Am Board Fam Med. 2008; 21: 211-214
        • Yi M.M.
        • Yi P.H.
        • Hussein K.I.
        • Cross M.B.
        • della Valle C.J.
        Readability of patient education materials from the web sites of orthopedic implant manufacturers.
        J Arthroplasty. 2017; 32: 3568-3572
        • Berkman N.D.
        • Sheridan S.L.
        • Donahue K.E.
        • Halpern D.J.
        • Crotty K.
        Low health literacy and health outcomes: An updated systematic review.
        Ann Intern Med. 2011; 155: 97
        • DeWalt D.A.
        • Berkman N.D.
        • Sheridan S.
        • Lohr K.N.
        • Pignone M.P.
        Literacy and health outcomes.
        J Gen Intern Med. 2004; 19: 1228-1239
        • Serper M.
        • Patzer R.E.
        • Curtis L.M.
        • et al.
        Health literacy, cognitive ability, and functional health status among older adults.
        Health Serv Res. 2014; 49: 1249-1267
        • Friedland R.
        Understanding health literacy: new estimates of the high costs of inadequate health literacy.
        in: Congress of the United States. U.S. Congress, Washington, DC1998: 57-91 (The price we pay for illiteracy)
        • Murero M.
        • D’Ancona G.
        • Karamanoukian H.
        Use of the internet by patients before and after cardiac surgery: An interdisciplinary telephone survey.
        J Med Internet Res. 2001; 3: e27
        • Ley P.
        • Florio T.
        The use of readability formulas in health care.
        Psychol Health Med. 1996; 1: 7-28
      1. National Center for Education Statistics. A First Look at the Literacy of America’s Adults in the 21st Century.
        (Accessed March 14, 2022)
        • National Center for Education Statistics
        Adult literacy in America: A first look at the results of the National Adult Literacy Survey.
        National Center for Education Statistics, Washington, DC1993
        • Kakazu R.
        • Schumaier A.
        • Minoughan C.
        • Grawe B.
        Poor readability of AOSSM patient education resources and opportunities for improvement.
        Orthop J Sports Med. 2018; 62325967118805386
        • Stelzer J.W.
        • Wellington I.J.
        • Trudeau M.T.
        • et al.
        Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions.
        JSES Int. 2022; 6: 44-48
        • American Academy of Orthopaedic Surgeons
        OrthoInfo.
        https://orthoinfo.org
        Date accessed: October 3, 2022
        • My Byline Media
        Readability Formulas.
        www.readabilityformulas.com
        Date accessed: October 3, 2022
        • Jackson R.H.
        • Davis T.C.
        • Bairnsfather L.E.
        • George R.B.
        • Crouch M.A.
        • Gault H.
        Patient reading ability: An overlooked problem in health care.
        South Med J. 1991; 84: 1172-1175
        • Flesch R.
        A new readability yardstick.
        J Appl Psychol. 1948; 32: 221-233
        • Rooney M.K.
        • Santiago G.
        • Perni S.
        • et al.
        Readability of patient education materials from high-impact medical journals: A 20-year analysis.
        J Patient Exp. 2021; 8237437352199884
        • Friedman A.J.
        • Cosby R.
        • Boyko S.
        • Hatton-Bauer J.
        • Turnbull G.
        Effective teaching strategies and methods of delivery for patient education: A systematic review and practice guideline recommendations.
        J Cancer Educ. 2011; 26: 12-21
        • Wilson E.A.H.
        • Park D.C.
        • Curtis L.M.
        • et al.
        Media and memory: The efficacy of video and print materials for promoting patient education about asthma.
        Patient Educ Couns. 2010; 80: 393-398
        • Albright J.
        • de Guzman C.
        • Acebo P.
        • Paiva D.
        • Faulkner M.
        • Swanson J.
        Readability of patient education materials: Implications for clinical practice.
        Appl Nursing Res. 1996; 9: 139-143
        • Eltorai A.E.M.
        • Thomas N.P.
        • Yang H.
        • Daniels A.H.
        • Born C.T.
        Readability of trauma-related patient education materials from the American Academy of Orthopaedic Surgeons.
        Trauma Mon. 2016; 21e20141
        • Rossi M.J.
        • Brand J.C.
        • Provencher M.T.
        • Lubowitz J.H.
        The expectation game: Patient comprehension is a determinant of outcome.
        Arthroscopy. 2015; 31: 2283-2284
        • Wu J.R.
        • Moser D.K.
        • DeWalt D.A.
        • Rayens M.K.
        • Dracup K.
        Health literacy mediates the relationship between age and health outcomes in patients with heart failure.
        Circ Heart Fail. 2016; 9e002250
        • Katz M.G.
        • Jacobson T.A.
        • Veledar E.
        • Kripalani S.
        Patient literacy and question-asking behavior during the medical encounter: A mixed-methods analysis.
        J Gen Intern Med. 2007; 22: 782-786
        • Menendez M.E.
        • van Hoorn B.T.
        • Mackert M.
        • Donovan E.E.
        • Chen N.C.
        • Ring D.
        Patients with limited health literacy ask fewer questions during office visits with hand surgeons.
        Clin Orthop Relat Res. 2017; 475: 1291-1297