If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
To investigate the information quality on YouTube regarding rehabilitation and return to sport (RTS) after hip arthroscopy.
Methods
By use of private browsing and predefined search terms, 217 unique videos regarding RTS and rehabilitation after hip arthroscopy were included and systematically reviewed. A total of 164 videos were included in the final analysis. Videos were scored using 4 scoring systems: (1) Journal of the American Medical Association benchmark criteria, (2) the Global Quality Score, (3) a score for RTS after hip arthroscopy, and (4) a score for rehabilitation after hip arthroscopy.
Results
A large majority of the included videos provided substandard information quality, dependability, and precision. RTS videos that were uploaded by physicians had a significantly higher Journal of the American Medical Association score, Global Quality Score, and RTS score compared with commercial and personal testimony videos (P = .0003, P = .0021, and P = .0005, respectively). Physician videos pertaining to RTS were also significantly longer than videos in other categories (P = .0397).
Conclusions
The quality and reliability of video content on YouTube pertaining to rehabilitation and RTS after hip arthroscopy are generally poor. The educational content of YouTube videos produced by physicians is of significantly higher quality as compared with non-physicians, patient testimonials, and commercials.
Clinical Relevance
The quality of the information patients receive on rehabilitation and RTS after hip arthroscopy is important for successful outcomes.
Rehabilitation after hip arthroscopy is critical, and clinical outcomes are dependent on the implementation of high-quality rehabilitation protocols.
Despite a technically well-performed surgical procedure, patients who are inadequately rehabilitated are not immune to recurrent and/or further injury. A recent study evaluating 350 patients undergoing rehabilitation after hip arthroscopy found that those who did not achieve appropriate rehabilitation thresholds by 3 months postoperatively were nearly 3 times more likely to require reoperation.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
More than 50% of patients in North America have reported using the Internet to search for health information, and sports medicine patients are more likely to use social media as a resource for health information than patients treated by other orthopaedic subspecialties.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
One of the most accessed and widely available resources of information on the Internet is YouTube (Alphabet, Mountain View, CA), which is available in over 100 countries and in 80 different languages and boasts greater than 1 billion guests per month.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Despite the ubiquity of health information on YouTube, there is considerable skepticism about the quality of the information, and recent studies have shown considerably low information quality.
The purpose of this study was to investigate the information quality on YouTube regarding rehabilitation and RTS after hip arthroscopy. The hypothesis was that the informational quality, reliability, and accuracy of educational, commercial, or personal testimony videos on YouTube would be poor and that resources distributed by physicians would be of higher quality than information produced by non-physicians.
Methods
On August 3, 2020, a search of YouTube videos pertaining to rehabilitation and RTS after hip arthroscopy was conducted. For RTS, the following search terms were used: Hip arthroscopy return to sport, Hip arthroscopy return to running, Hip arthroscopy return to work. For rehabilitation, the following search terms were used: Hip scope rehab protocol, Hip scope physical therapy protocol, Hip scope physical therapy, Hip arthroscopy rehab, Hip arthroscopy physical therapy, Hip arthroscopy PT, Hip arthroscopy recovery tips. To account for the variability in video content presentation, a second search was performed on August 18, 2020, using the same search terms. The inclusion criterion was any video that discussed rehabilitation or RTS after hip arthroscopy. Videos that were not in English, did not have sound support, or did not explicitly discuss rehabilitation or RTS even though it was included in the title; videos that did not involve human patients; and duplicate videos were excluded from the study.
Similarly to previous studies in the literature, the search terms were initially derived using the autofill tool in the YouTube video search bar.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Evaluation of the reliability, utility, and quality of the information in sleeve gastrectomy videos shared on open access video sharing platform YouTube.
To account for previous browsing behavior and avoid biased search results, the anonymous browsing function of Google Chrome (Alphabet) was used for this study. Google Chrome is free software that enables anonymous Web browsing through the incognito function; by concealing the user’s identity and browsing history, standard YouTube algorithms cannot introduce bias, and thus, the results were not influenced.
The review of videos was performed by 1 orthopaedic surgery resident (T.R.J.) and 2 medical students (L.A. and K.J.W.), and any discrepancies between the observers were clarified by mutual agreement. As the default settings, YouTube organizes search results based on descending order of relevance to search term used. Users seldom access videos beyond the third page, and in accordance with this, the first 60 videos under each search term were included in the study.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Jansen BJ, Spink A. An analysis of web documents retrieved and viewed. Presented at the Fourth International Conference on Internet Computing, Las Vegas, NV, June 23-26, 2003.
The following information was recorded for each video: Universal Resource Locator (URL), video title, number of total views, video category, duration of video in minutes, date of publication, days since upload, number of likes, number of dislikes, like ratio, video power index (VPI), and view ratio (views per day). The like ratio was determined by the number of likes divided by the number of dislikes. The VPI is an index used to quantify the popularity of a video based on the views and likes and has been validated in previous literature.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
The VPI is calculated as (Like ratio × View ratio)/100. Because YouTube lacks a modality for indexing videos based on popularity, the VPI has been used as a surrogate measure. An increased VPI signifies increased video popularity when compared with videos with a lower VPI. All included videos were categorized into 1 of 4 groups: educational–physician, educational–non-physician (health professionals other than licensed medical doctors), personal testimony, and commercial.
Video Scoring
Four scoring methods were implemented to assess the quality of included videos: Journal of the American Medical Association (JAMA) benchmark criteria, the Global Quality Score (GQS), a rehabilitation score, and an RTS score. The JAMA benchmark criteria are an objective assessment aid that consists of 4 independent guidelines. One point is given for the presence of each guideline. A maximum of 4 points can be achieved, and a higher score designates better accuracy and reliability for the source. The caliber of educational content was evaluated by the use of the GQS. The GQS contains 5 criteria that gauge the educational value of online resources. One point was assigned for the presence of each criterion. The higher the score, the higher the educational quality. The highest attainable score is 5 points, which indicates excellent quality and flow of information. To assess the educational content regarding rehabilitation and RTS, 2 nonvalidated grading systems were used: an RTS–after–hip arthroscopy score and a rehabilitation–after–hip arthroscopy score. The use of nonvalidated assessment tools to assess the educational quality of orthopaedic videos online has been accepted in the literature.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Because of the lack of a gold standard in rehabilitation and RTS, these scoring systems were developed based on recent literature evaluating the current state of rehabilitation and RTS after hip arthroscopy, as well as expert opinion.
The RTS score had a scale from 0 to 15 points. Likewise, the rehabilitation score had a scale from 0 to 15 points. For both scoring systems, a score of 0 to 4 points is indicative of videos of poor quality; 5 to 10, moderate quality; and 11 to 15, excellent quality (Appendix Tables 1-4, available at www.arthroscopyjournal.org).
Statistical Analysis
Continuous data were reported as means and standard deviations. Categorical data were reported as absolute and relative frequencies. Descriptive analysis was used to describe video characteristics. Variables with a non-normal distribution were evaluated using the Mann-Whitney U test. JAMA benchmark, GQS, RTS, and rehabilitation criteria were all evaluated using 2-tailed independent t tests. Results with P < .05 were considered statistically significant. Multivariate analysis was performed to assess the relation between video characteristics and categories. All calculations were performed with SPSS software (version 21; IBM, Armonk, NY).
Results
Initially, 217 YouTube videos (135 rehabilitation and 82 RTS videos) were identified. Of these videos, 53 were excluded because they did not meet the criteria necessary to be included. A total of 164 videos (82 rehabilitation and 82 RTS videos) remained in the final analysis (Fig 1). Of the 164 videos present in the analysis, 95 (57.9%) reported on rehabilitation after femoroacetabular impingement, 22 (13.4%) reported on rehabilitation for other pathologies, and 47 (28.7%) did not disclose an underlying pathology. Videos that reported on rehabilitation for other pathologies included but were not limited to gluteus medius repair, instability, and labral tears. The sum of all video views among the 164 videos was 6,038,762. Figure 2 and Figure 3 show the distribution of JAMA scores and GQS values, respectively, for all videos. Figure 4 shows the distribution of rehabilitation and RTS scores for all videos.
Fig 1Flowchart of search criteria used for inclusion of YouTube videos regarding rehabilitation and return to sport (RTS) after hip arthroscopy.
Fig 2Distribution of video scoring using Journal of the American Medical Association (JAMA) benchmark criteria. (Rehab, rehabilitation; RTS, return to sport.)
The mean duration was 5.9 ± 5.0 minutes, the mean number of views was 34,115.00 ± 81,321.90, the mean time since upload of the video (i.e., video age) was 1,525.60 ± 918.20 days, and the mean VPI was 4.7 ± 9.7. Of the videos, 26 were classified as educational–physician; 34, educational–non-physician; 4, commercial; and 18, personal testimony. The mean JAMA benchmark criteria score was 2.2 ± 0.9 points, the mean GQS was 2.0 ± 1.1 points, and the mean rehabilitation score was 2.3 ± 2.0 points (Table 1). Only 11.0% of videos regarding rehabilitation (9 of 82) had a GQS of 4 points or greater.
Commercial videos had a significantly higher like-dislike ratio compared with all other categories (P = .004). Videos classified as educational–physician had a significantly older video age (P = .001). There were no statistically significant differences in the number of views, video duration, likes, dislikes, VPI, JAMA score, GQS, and rehabilitation score (Table 2). A multivariate analysis to control for confounders confirmed that educational–physician videos had a significantly longer video age (P = .0289).
Table 2Characteristics of Rehabilitation Videos by Category
The mean duration was 6.4 ± 5.8 minutes, the mean number of views was 39,527.90 ± 151,365.50, the mean time since upload of the video was 1,524.90 ± 1,029.9 days, and the mean VPI was 5.5 ± 24.7. The mean JAMA benchmark criteria score was 2.5 ± 1.3 points, the mean GQS was 2.4 ± 1.2 points, and the mean RTS score was 2.7 ± 2.6 points. Only 17.1% of videos regarding RTS (14 of 82) had a GQS of 4 points or greater. Of the videos, 50 were classified as educational–physician; 14, educational–non-physician; 10, commercial; and 8, personal testimony. Educational–physician videos had a significantly higher JAMA score, GQS, and RTS score compared with all other groups (P = .0003, P = .0021, and P = .0005, respectively) (Table 3). Educational–physician videos were also significantly longer than videos in other categories (P = .0397). On multivariate analysis, video categories were not found to have a significant impact on video characteristics (P > .05).
This investigation showed that, in general, YouTube videos provided poor-quality educational information regarding rehabilitation and RTS after hip arthroscopy. Recent studies have shown that nearly two-thirds of patients use the Internet prior to their medical appointment to acquire knowledge about their condition, and YouTube is a frequently used platform for patient information.
The content on YouTube, however, is not subject to a rigorous peer-review process. Patients should exercise caution when using this resource as a source of information for postoperative treatment after hip arthroscopy, and physicians and physical therapists alike should be mindful of the poor quality of information regarding rehabilitation and RTS.
When assessing the quality of educational health content on YouTube, previous studies have shown the poor quality and reliability of information available. Springer et al.
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
examined the quality of the educational content on YouTube regarding RTS and rehabilitation after anterior cruciate ligament reconstruction. Their evaluation of 140 videos found consistently poor quality with reported scores for rehabilitation and RTS, with GQS values of 1.95 ± 0.64 points and 1.62 ± 0.82 points, respectively; JAMA scores of 1.32 ± 0.64 points and 1.26 ± 0.7 points, respectively; a rehabilitation score of 5.0 ± 3.42 points; and an RTS score 3.05 ± 3.35 points. In an assessment of the educational content on YouTube regarding facial plastic surgery procedures, Ward et al.
evaluated 240 videos using the DISCERN score. The DISCERN score is a validated information quality assessment instrument. The average DISCERN score was reported as 2.21, indicating that videos had important and potentially serious shortcomings in quality. Delli et al.
assessed the quality of 70 educational YouTube videos discussing Sjögren syndrome and found a mean GQS of 2.5 ± 1.2 points. This indicates poor educational quality and further confirms the consistent finding of poor educational information quality among YouTube videos.
In accordance with previous investigations, our study found YouTube videos reporting rehabilitation and RTS after hip arthroscopy to be of poor quality. This is likely due to the fact that only 46.9% of all videos included in the final analysis were produced and maintained by physicians and these are not likely to be subject to vigorous review. Patients looking for rehabilitation and RTS information after hip arthroscopy on YouTube should be aware of the poor quality of information and the fact that the information provided on YouTube is not peer reviewed for accuracy. It is advisable that clinicians provide patients with educational resources that have been reviewed for accuracy regarding hip arthroscopy.
On the evaluation of educational health content on YouTube, several prior investigations have shown that content produced by physicians showed higher quality scores across multiple different specialties. Ferhatoglu et al.
Evaluation of the reliability, utility, and quality of the information in sleeve gastrectomy videos shared on open access video sharing platform YouTube.
examined the quality of information in 100 videos on YouTube regarding sleeve gastrectomy. They found that videos produced by university-affiliated physicians had significantly higher JAMA scores and GQS values compared with all other cohorts examined. In an assessment of the quality of information pertaining to rotator cuff repairs on YouTube, Celik et al.
reviewed 67 videos and showed that content uploaded by physicians had significantly higher DISCERN and JAMA scores (P < .001) when compared with all other author types. Our investigation corroborates these findings. Educational videos made by physicians comprised 61% of all the RTS videos and had a significantly higher JAMA score, GQS, and RTS score compared with all other video types. This phenomenon was not found among rehabilitation videos. This phenomenon is likely reflected by the degree of variability in rehabilitation composition and duration ranges found in the literature at which a patient can progress through his or her rehabilitation goals for each hip arthroscopic procedure.
Variability and comprehensiveness of North American online available physical therapy protocols following hip arthroscopy for femoroacetabular impingement and labral repair.
These findings suggest that patients should be aware that content posted by physicians is more likely to be accurate and of value when compared with posts by other entities.
Previous studies have sought out to evaluate YouTube videos based on their VPI. In a study evaluating the quality of 52 YouTube videos on developmental dysplasia of the hip (DDH), it was found that the VPI did not vary significantly based on the source of the videos, even though videos produced in an academic setting had a significantly higher GQS and DDH score when compared with commercially produced videos (P = .01 and P = .037, respectively).
to assess the educational quality of videos regarding DDH. In a study on the reliability of 100 YouTube videos on sleeve gastrectomy, Ferhatoglu et al.
Evaluation of the reliability, utility, and quality of the information in sleeve gastrectomy videos shared on open access video sharing platform YouTube.
found that videos produced by surgeons had a significantly lower VPI, even though this category had a higher JAMA score, GQS, DISCERN score, and sleeve gastrectomy scoring system score when compared with patient testimonials and advertisement-based videos. These findings are supported by the results of our study, which found that RTS videos produced by physicians had a significantly higher JAMA score, GQS, and RTS score compared with commercial and personal testimony videos. There was no statistically significant difference in the VPI between groups, and physician videos had an equivalent VPI to videos of lower quality (e.g., commercial videos). These findings suggest that patients and physicians alike must be rigorous in evaluating educational material on YouTube and that the VPI may not be an appropriate surrogate measurement for high-quality information.
Limitations
This study is not without limitations. Although the JAMA score and GQS are validated assessment tools, the scoring systems used in this study for the assessment of rehabilitation and RTS are not currently validated; however, these metrics show a similar low degree of precision to validated metrics. Whereas the interobserver reliability of the JAMA score and GQS has been shown to be good to excellent in the literature, the correlation coefficient between observers using the rehabilitation and RTS scoring systems is yet to be formally evaluated. Furthermore, assessment of video content on YouTube was performed at 2 different, albeit close, time points, which is subject to bias owing to the dynamic nature of the platform because new content is constantly being produced and uploaded on the platform. It must also be noted that the information quality of video content was assessed against a scoring criteria checklist. This process involved allocation of points if specific information was presented; it did not take into consideration the presence of false or inaccurate information. Finally, it must be acknowledged that currently, there is no gold standard in rehabilitation after hip arthroscopy. The lack of a standardized protocol can result in significant variation in the recommendations and practices of orthopaedic sport surgeons and, as such, can influence the scoring of videos on these topics.
Conclusions
The quality and reliability of video content on YouTube pertaining to rehabilitation and RTS after hip arthroscopy are generally poor. The educational content of YouTube videos produced by physicians is of significantly higher quality as compared with non-physicians, patient testimonials, and commercials.
Authors and contributors, their affiliations, and relevant credentials should be provided.
Attribution
References and sources for all content should be listed clearly, and all relevant copyright information should be noted.
Disclosure
Website "ownership" should be prominently and fully disclosed, as should any sponsorship, advertising, underwriting, commercial funding arrangements or support, or potential conflicts of interest. This includes arrangements in which links to other sites are posted as a result of financial considerations. Similar standards should hold in discussion forums.
Currency
Dates on which content was posted and updated should be indicated.
NOTE. One point is assigned for each criterion, with a maximum score of 4 points.
JAMA, Journal of the American Medical Association.
Poor quality and poor flow of site; most information missing; not at all useful for patients
1
Generally poor quality and poor flow; some information listed but many important topics missing; of very limited use to patients
2
Moderate quality and suboptimal flow; some important information adequately discussed but other important information poorly discussed; somewhat useful for patients
3
Good quality and generally good flow; most of relevant information listed but some topics not covered; useful for patients
4
Excellent quality and flow; very useful for patients
Online videos provide poor information quality, reliability, and accuracy regarding rehabilitation and return to sport after anterior cruciate ligament reconstruction.
Evaluation of the reliability, utility, and quality of the information in sleeve gastrectomy videos shared on open access video sharing platform YouTube.
Jansen BJ, Spink A. An analysis of web documents retrieved and viewed. Presented at the Fourth International Conference on Internet Computing, Las Vegas, NV, June 23-26, 2003.
Variability and comprehensiveness of North American online available physical therapy protocols following hip arthroscopy for femoroacetabular impingement and labral repair.
The authors report the following potential conflicts of interest or sources of funding: K.R.O. receives hospitality payments from Stryker and Zimmer and receives education support from Arthrex and Smith & Nephew, outside the submitted work. Full ICMJE author disclosure forms are available for this article online, as supplementary material.
00063-8&id=gr1.jpg){kind=link}
00063-8&id=gr2.jpg){kind=link}
00063-8&id=gr3.jpg){kind=link}
00063-8&id=gr4.jpg){kind=link}