If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
To investigate the efficacy of YouTube videos as a patient education resource related to rehabilitation and return to play following medial patellofemoral ligament (MPFL) reconstruction.
Methods
YouTube was queried using 6 predetermined search terms. Videos were included if they met the following criteria: (1) written in the English language; and (2) within the first 100 videos for each search term. Videos were excluded if they met any of the following criteria: (1) not written in the English language; (2) did not include medial patellofemoral ligament/MPFL in the title; (3) duplicate videos; (4) part of a multivideo series such a vlogs; (5) advertisements; and (6) videos <1 minute. The remaining videos were evaluated by 2 independent viewers and scored using 4 distinct scoring systems: Global Quality Scale, The Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT), MPFL Rehabilitation and Return to Play Score, and the Journal of the American Medical Association benchmark criteria. The data was analyzed with IBM SPSS Statistics, version 27). The Kruskal–Wallis test was used to compare quality scores and video analytics to their assigned categories. Results where P < .05 were considered statistically significant and pairwise comparison analysis was completed to determine the video categories with statistically significant differences. Correlation of categorical variables with video analytics (views, video power index, duration, and days since publication) and quality scores was determined using the Pearson Correlation coefficient.
Results
Of the initial 600 videos, 58 met inclusion criteria, which were subsequently reviewed and scored. Most videos scored on the low-end of the possible scoring ranges with a mean Global Quality Scale score of 1.61 (standard deviation [SD] 0.81), PEMAT Understandability score of 59.40 (SD 17.54), PEMAT Actionability score of 18.20 (SD 29.92), MPFL Rehabilitation and Return to Play Score of 1.64 (SD 2.13), and Journal of the American Medical Association benchmark score of 2.08 (SD 0.75).
Conclusions
The videos in YouTube’s library received low scores in quality, reliability, understandability and actionability. Therefore, YouTube is currently a poor source of information for patients regarding postoperative rehabilitation and return to play following MPFL reconstruction.
Clinical Relevance
Patients increasingly view medical information online. YouTube is second only to Google as the most used search engine. It is important to understand the quality of information patients receive on YouTube following MPFL reconstruction so orthopaedic surgeons know to guide patients to higher-quality alternatives.
Medial patellofemoral ligament (MPFL) reconstruction is a common surgical treatment option for patients with patellar instability. In addition, numerous studies suggest that surgical management leads to reduced rates of recurrent patellar instability for first-time patella dislocators when compared with nonoperative management.
Prevalence and site of medial patellofemoral ligament injuries in patients with acute lateral patellar dislocations: A systematic review and meta-analysis.
found the greatest incidence of acute patellar dislocations is in patients between the ages of 10 and 17 years, with 29 in 100,000 affected and 61% of all first-time acute patellar dislocations having occurred during sporting activities. Patients, such as those with MPFL injuries, commonly turn to the Internet to obtain information about surgical intervention.
YouTube is second only to Google as the most commonly used search engine for general Internet searches and is increasingly being used by patients to access health care–related information.
a considerable overlap with the age group at greatest risk for patellar instability and MPFL injury. Recently, the quality of information found on YouTube pertaining to a variety of specific orthopaedic conditions was assessed.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
These studies demonstrated that most information regarding various orthopaedic injuries and procedures on YouTube is of poor quality. The purpose of this study was to investigate the efficacy of YouTube videos as a patient education resource related to rehabilitation and return to play following MPFL reconstruction. Our hypothesis was that the information found on YouTube regarding rehabilitation and return to play following MPFL reconstruction would be of low quality.
Methods
YouTube (www.youtube.com) was searched on March 28, 2021, for videos pertaining to rehabilitation and return to play following MPFL reconstruction. YouTube’s search algorithm uses age, gender, geolocation, and watch history to personalize search results.
To prevent these potential confounders from affecting our search, we used Incognito mode on the Google Chrome web browser to anonymize our online identity. Incognito mode prevents YouTube from using personal browsing data and influencing search results.
To conduct a comprehensive search, the first 100 videos recorded in the English language for each of the following 6 search terms were analyzed: (1) rehab and return to play medial patellofemoral ligament reconstruction; (2) rehab and return to play MPFL reconstruction; (3) rehabilitation MPFL reconstruction; (4) rehab MPFL reconstruction; (5) return to play MPFL reconstruction; and (6) recovery MPFL reconstruction. Videos were excluded if they met any of the following criteria: (1) not in the English language; (2) did not include medial patellofemoral ligament/MPFL in the title; (3) duplicate videos; (4) part of a multivideo series such as vlogs; (5) advertisements; and (6) videos <1 minute. The remaining videos were categorized into the following 5 groups based on the background of the publishing individual: nonphysician (videos not created by a physician), academic (videos created by physicians with current university, research, or medical education affiliations), independent physician (videos created by independent physicians without academic affiliations), other medical (videos created by medical sources other than physicians), and nonmedical (videos created by nonmedical sources). Two independent viewers evaluated the efficacy of the videos for patient education by using 4 different scoring systems: Global Quality Scale (GQS),
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information.
In addition, video analytics such as views, duration, days since publication, like, and dislikes were recorded. Video power index (VPI) was then calculated using the following formula to gauge user approval of the video
The quality of nonspecific video content was assessed using the GQS. The GQS is a 5-point rating system that evaluates educational content based on its quality, flow, topics covered, and usefulness (Table 1). Although unvalidated, other studies have used the GQS rating system to evaluate the nonspecific educational quality of YouTube videos for patients.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Assessment of Specific MPFL Rehabilitation and Return to Play Video Content Quality
To assess the quality of video content specific to the rehabilitation and return to play for athletes following MPFL reconstruction, we developed the MPFL RRPS. Currently, there are no published rehabilitation or return to play guidelines following MPFL reconstruction that have been widely adopted, and so the MPFL RRPS was based on the current literature.
Quality and variability of online available physical therapy protocols from academic orthopaedic surgery programs for medial patellofemoral ligament reconstruction.
The MPFL RRPS is composed of a checklist of 8 topics and is scored in a binary fashion; 1 point is given for any mention of each checklist item and 0 points are given for no mention of each checklist item, with a maximum score of 8 (Tables 2 and 3). Novel scoring checklists have been used in similar studies to assess the educational content of YouTube videos for specific orthopaedic topics.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Assessment of the Understandability and Actionability of Video Content
To determine the usefulness of the video content for a broad range of patients, we used the PEMAT scoring system. This tool consists of 13 items measuring understandability and 4 items measuring actionability scored in a binary fashion, resulting in a percentage score. Understandability is defined as the ability of patients from a diverse background with varying levels of health literacy to process and explain the main video topics. Actionability is defined as the ability of patients from diverse backgrounds and varying levels of health literacy to act based on the information presented in the videos.
Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information.
Although other studies did not use the PEMAT scoring system, this study deemed the ability of patients to comprehend and act on video content to be an important characteristic to assess.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Assessment of the Reliability and Quality of Video Source Information
The reliability and quality of the information source for each video was assessed using the JAMA benchmark criteria. This scoring system rates the reliability and quality of source information by determining whether the information meets 4 criteria: clear authorship, attribution, disclosure, and currency (Table 4).
Each of the 4 criteria is scored in a binary fashion, with a maximum score of 4 denoting excellent reliability and a quality source of information. As with the GQS, other similar studies have used this method of scoring the JAMA benchmark criteria to assess the reliability and quality of YouTube videos.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Table 4The Journal of the American Medical Association (JAMA) Benchmark Criteria
Authorship
Authors and contributors, their affiliations, and relevant credentials should be provided.
Attribution
References and sources for all content should be listed clearly, and all relevant copyright information noted.
Disclosure
Web site “ownership” should be prominently and fully disclosed, as should any sponsorship, advertising, underwriting, commercial funding arrangements or support, or potential conflicts of interest. This includes arrangements in which links to other sites are posted as a result of financial considerations. Similar standards should hold in discussion forums.
Currency
Dates that content was posted and updated should be indicated.
The collected data were analyzed with IBM SPSS Statistics, version 27 (IBM Corp., Armonk, NY). To analyze the 2 reviewers’ agreement for each scoring system, the interclass correlation coefficient (ICC) (model: 2-way fixed, type: consistency), along with their 95% confidence intervals (CIs), were found. The closer the ICC value is to 1.0, the greater the agreement between the video reviewer’s scores. The scores of the 2 reviewers were then averaged for further analysis.
Using the Shapiro–Wilk test, we determined whether the assessed variables resembled a normal distribution. Since not all variables showed significant normality, the Kruskal–Wallis test was used to compare quality scores and video analytics with their assigned categories. Results where P < .05 were considered statistically significant and pairwise comparison analysis was performed to determine the video categories with statistically significant differences.
Correlation of categorical variables with video analytics (views, VPI, duration, and days since publication) and quality scores was determined using the Pearson Correlation coefficient. The significance of each correlation was also found and correlations with P < .05 were considered statistically significant.
Results
Of the initial 600 videos, 542 met 1 or more of the exclusion criteria. Seven videos were advertisements, 247 were duplicates, 92 were vlogs or multipart series, 24 were less than 1 minute in length, and 213 did not contain information about MPFL in their title. This left 58 videos to be scored. The mean duration of the videos was 9:19 (standard deviation [SD] 11:20), mean number of views was 13,864 (SD 30,273), and mean VPI was 95.73 (SD 8.60). The number of videos assigned to each category is outlined in Figure 1 and Table 5. The frequency of scores by both reviewers are outlined in Fig 2, Fig 3, Fig 4, Fig 5, Fig 6 and Table 6, Table 7, Table 8, Table 9, Table 10. The averaged results of the scoring systems for each video category are summarized in Table 11.
Fig 1Number of videos per video category. Non-physician: Videos not created by a physician. Academic: Videos created by physicians with current university, research, or medical education affiliations. Other Medical: Videos created by medical sources other than physicians. Non-medical: Videos created by non-medical sources. Ind. Physician: Videos created by independent physicians without academic affiliations.
NOTE. Nonphysician: Videos not created by a physician. Academic: Videos created by physicians with current university, research, or medical education affiliations. Other medical: Videos created by medical sources other than physicians. Nonmedical: Videos created by non-medical sources. Independent physician: Videos created by independent physicians without academic affiliations.
NOTE. Nonphysician: Videos not created by a physician. Academic: Videos created by physicians with current university, research, or medical education affiliations. Other medical: Videos created by medical sources other than physicians. Nonmedical: Videos created by non-medical sources. Independent physician: Videos created by independent physicians without academic affiliations.
GQS, Global Quality Score; JAMA, Journal of the American Medical Association; MPFL RRPS, Medial Patellofemoral Ligament Rehabilitation and Return to Play Score; PEMAT, Patient Education Materials Assessment Tool for Audiovisual Materials.
The ICC demonstrated a good agreement of 0.82 (CI 0.69-0.89) between the 2 reviewers for the JAMA benchmark, while showing excellent agreement for the GQS, PEMAT Understandability, PEMAT Actionability, and MPFL RRPS scoring systems with values of 0.94 (CI 0.89-0.96), 0.98 (CI 0.96-0.99), 0.98 (CI 0.97-0.99), and 0.96 (CI 0.94-0.98), respectively. The mean GQS was 1.61 (SD 0.81) (CI 1.40-1.82), with 56% being characterized as poor and 31% as generally poor quality by the GQS (Fig 2 and Table 6). The novel MPFL RRPS also showed that, on average, the videos were of poor quality, with a mean of 1.64 (SD 2.13) (CI 1.08-2.20) (Fig 4 and Table 8). In fact, the scores from both reviewers indicated that the majority of videos (54%) did not mention a single included criterion (Fig 4 and Table 8). The ability for YouTube users to both understand and take away actionable information from these videos was also less than satisfactory, with an average PEMAT Understandability score of 59.4 (SD 17.54) (CI 54.79-64.01) and Actionability score of 18.2% (SD 29.92) (CI 10.33-26.06) (Table 1) (Figs 3, 5, and Tables 7, 9).
Through the Kruskal–Wallis comparison of average score results to the videos’ assigned category, only JAMA benchmark scores were found to significantly differ across categories (P < .001). Further pairwise comparisons indicated that a difference existed between academic and non-medical sources (P = .02) as well as academic and independent physician sources (P = .02). This indicates that video category does not signify a more useful video in any scoring system other than the JAMA benchmark.
The Pearson coefficients indicated that average GQS (r = 0.30, P = .02) and MPFL RRPS (r = 0.31, P = .02) were significantly correlated with video duration. In addition, the JAMA benchmark was found to be significantly and inversely correlated to the days since publication (r = –0.32, P = .01), as newer videos were found to have greater scores. Both views and VPI were not significantly correlated with any scoring criteria.
Discussion
The study demonstrates that YouTube provides poor educational resources to patients looking for information about rehabilitation following MPFL reconstruction. With a mean GQS score of 1.61, PEMAT Understandability score of 59.40, PEMAT Actionability score of 29.92, MPFL RRPS of 1.64, and JAMA benchmark score of 2.08, the videos in YouTube’s library fall on the low end of the possible scoring ranges, demonstrating significant room for improvement. Therefore, the videos found do not provide patients with the high-quality information necessary to understand the recovery process following MPFL reconstruction. However, the data also show that videos published more recently have greater JAMA scores. This may be due, in part, to similar studies
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
having found YouTube to be a poor source of information regarding various orthopaedic topics, thereby prompting the development of more reliable and higher-quality videos on YouTube.
In addition to most videos receiving poor marks for each scoring system, the lack of correlation between video views and reviewers’ scores highlights that many YouTube users are not accessing the highest-quality videos offered on YouTube. This may be due, in part, to YouTube’s search algorithm. By using user age, gender, geolocation, and watch history to personalize search results, YouTube users may be accessing more popular videos that the algorithm shows them, not necessarily they highest-quality videos.
Significant correlations were found between video duration and average GQS scores and MPFL rehabilitation scores. Although longer videos received greater marks in these scoring categories, it is important to note that videos experience a significant fall-off in user engagement if they are longer than 2 minutes and another decrease if they are longer than 12 minutes.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
reviewed YouTube videos concerning rehabilitation following anterior cruciate ligament reconstruction and concluded that YouTube provided poor information quality, reliability, and accuracy. In 2 separate studies, Kunze et al.
however, found YouTube to be a high-quality source of information regarding ankylosing spondylitis exercises, which may be because this topic is nonoperative and therefore requires less technical information for a comprehensive video. This discrepancy shows that while YouTube does not currently provide high-quality information on many orthopaedic topics, it has the potential to provide the information necessary to make patients feel more comfortable about what to expect as they begin postoperative rehabilitation.
All of the aforementioned studies used similar scoring systems and statistical analysis to reach their conclusions. While the GQS, PEMAT, and JAMA systems were used in this study to measure the overall efficacy of the videos as a patient education resource, the novel MPFL RRPS was developed to specifically review each video's usefulness in regards to MPFL rehabilitation. The MPFL RRPS revealed that the most infrequently discussed topics in the videos were pain management (8 videos, 13.79%), functional testing guidelines prior to return to play (5 videos, 8.62%), and proprioception exercises (3 videos, 5.17%). These topics are important aspects of MPFL rehabilitation and the infrequency with which they were discussed further highlights the overall poor efficacy of educational resources available to YouTube users seeking information on MPFL rehabilitation. As previously discussed, the greatest incidence of acute patellar dislocation occurs between the ages of 10 and 17 years.
As younger generations become more reliant on the internet as a source of information, it will be increasingly important for the websites they use to provide them with high-quality information.
There are several limitations to this study. First, this is a cross-sectional study. With the popularity of YouTube, it is possible that more videos related to rehabilitation following MPFL reconstruction have since been added. YouTube may become a more reliable source of MPFL rehabilitation information as the video library expands. Second, there is no peer-review process in place for videos published on YouTube; therefore, there is no system to oversee the quality or efficacy of information shared. In addition, since YouTube was the only search engine queried, there is a potential for selection bias. Another limitation is the use of Google Chrome’s Incognito mode to prevent YouTube from using our browsing data to personalize our search results and adding potential confounders. However, each patient who uses YouTube to learn about rehabilitation and return to play following MPFL reconstruction has their own unique personalized search results. Furthermore, our search terms may not be reflective of those that the patient population would use. Both of which, may affect the generalizability of our results. Another limitation of this study is that the GQS and MPFL RRPS scoring systems used are unvalidated. In addition, all of the scoring systems used are subjective in nature. The use of the ICC to highlight excellent agreement for the majority of scoring systems somewhat diminishes this limitation. However, further analysis with more reviewers could lead to more concrete agreement over the quality and reliability of the videos studied.
Conclusions
The videos in YouTube’s library received low scores in quality, reliability, understandability and actionability. Therefore, YouTube is currently a poor source of information for patients regarding postoperative rehabilitation and return to play following MPFL reconstruction.
Prevalence and site of medial patellofemoral ligament injuries in patients with acute lateral patellar dislocations: A systematic review and meta-analysis.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information.
Quality and variability of online available physical therapy protocols from academic orthopaedic surgery programs for medial patellofemoral ligament reconstruction.
The authors report the following potential conflicts of interest or sources of funding: M.K.M. reports personal fees from Arthrex, outside the submitted work, and AAOS: board or committee member; American Journal of Sports Medicine Electronic Media: editorial or governing board; American Orthopaedic Association: board or committee member; American Orthopaedic Society for Sports Medicine: board or committee member; Arthroscopy: editorial or governing board; Arthroscopy Association of North America: board or committee member; Ortho Info: editorial or governing board; Ruth Jackson Orthopaedic Society: board or committee member; and The Forum: board or committee member. Full ICMJE author disclosure forms are available for this article online, as supplementary material.
00040-2&id=gr1.jpg){kind=link}
00040-2&id=gr2.jpg){kind=link}
00040-2&id=gr3.jpg){kind=link}
00040-2&id=gr4.jpg){kind=link}
00040-2&id=gr5.jpg){kind=link}
00040-2&id=gr6.jpg){kind=link}