Quality analysis of prior systematic reviews of carpal tunnel syndrome
an overview of the literature
Keywords:
Evidence-based medicine, Quality control, Carpal tunnel syndromeAbstract
BACKGROUND: Carpal tunnel syndrome (CTS) is a common condition greatly affects patients’ quality of life and ability to work. Systematic reviews provide useful information for treatment and health decisions. OBJECTIVE: This study aimed to assess the methodological quality of previously published systematic reviews on the treatment of CTS. DESIGN AND SETTING: Overview of systematic reviews conducted at the Brazilian public higher education institution, São Paulo, Brazil METHODS: We searched the MEDLINE and Cochrane Library database for systematic reviews investigating the treatment of CTS in adults. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and measurement tool to assess systematic reviews (AMSTAR) were applied by two independent examiners. RESULTS: Fifty-five studies were included. Considering the stratification within the AMSTAR measurement tool, we found that more than 76% of the analyzed studies were “low” or “very low”. PRISMA scores were higher when meta-analysis was present (15.61 versus 10.40; P = 0.008), while AMSTAR scores were higher when studies performed meta-analysis (8.43 versus 5.59; P = 0.009) or when they included randomized controlled trials (7.95 versus 6.06; P = 0.043). The intra-observer correlation demonstrated perfect agreement (> 0.8), a Spearman’s correlation coefficient of 0.829, and an ICC of0.857. The inter-observer correlation indicated that AMSTAR was more reliable than PRISMA. CONCLUSION: Overall, systematic reviews of the treatment of CTS are of poor quality. Reviews with better- quality conducted meta-analysis and included randomized controlled trials. AMSTAR is a better tool than PRISMA because it has a better performance and should be recommended in future studies. REGISTRATION NUMBER IN PROSPERO: CRD42020172328 (https://www.crd.york.ac.uk/PROSPERO/display_ record.php?ID=CRD42020172328).
Downloads
References
Hubbard ZS, Law TY, Rosas S, Jernigan SC, Chim H. Economic benefit of carpal tunnel release in the Medicare patient population. Neurosurg Focus. 2018;44(5):E16. PMID: 29712517; https://doi.org/10.3171/2018.1.FOCUS17802.
Verdugo RJ, Salinas RS, Castillo J, Cea JG. Surgical versus non-surgical treatment for carpal tunnel syndrome. Cochrane Database Syst Rev. 2002;(2):CD001552. Update in: Cochrane Database Syst Rev. 2003;(3):CD001552. PMID: 12076416; https://doi.org/10.1002/14651858. CD001552.
Roberts I, Ker K. How systematic reviews cause research waste. Lancet. 2015;386(10003):1536. PMID: 26530621; https://doi.org/10.1016/S0140-6736(15)00489-4.
Long C, desJardins-Park H, Popat R, Fox P. Quality of surgical randomized controlled trials in hand surgery: a systematic review. J Hand Surg Eur Vol. 2018;43(8):801-7. PMID: 29896997; https://doi.org;10.1177/1753193418780184.
Long C, Azad AD, desJardins-Park HE, Fox PM. Quality of Randomized Controlled Trials for Surgical Treatment of Carpal Tunnel Syndrome: A Systematic Review. Plast Reconstr Surg. 2019;143(3):791-9. PMID: 30822284; https://doi.org/10.1097/PRS.0000000000005366.
Brand J, Hardy R, Monroe E. Research Pearls: Checklists and Flowcharts to Improve Research Quality. Arthroscopy. 20;36(7):2030-8. PMID: 32169662; https://doi.org/10.1016/j.arthro/2020.02.046.
Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700. PMID: 19622552; https://doi.org/10.1136/bmj.b2700.
Shea BJ, Bouter LM, Peterson J, et al. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007;2(12):e1350. PMID: 18159233; https://doi.org/10.1371/journal.pone.0001350
Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10. PMID: 17302989; https://doi.org/10.1186/1471-2288-7-10.
Cohen J. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement. 1960;20(1):37-46. https://doi.org/10.1177/001316446002000104.
Tian J, Zhang J, Ge L, Yang K, Song F. The methodological and reporting quality of systematic reviews from China and the USA are similar. J Clin Epidemiol. 2017;85:50-8. PMID: 28063911; https://doi.10.1016/j.jclinepi.2016.12.004.
Zhang J, Han L, Shields L, Tian J, Wang J. A PRISMA assessment of the reporting quality of systematic reviews of nursing published in the Cochrane Library and paper-based journals. Medicine (Baltimore). 2019;98(49):e18099. PMID: 31804319; https://doi.org/10.1097/MD.0000000000018099.
Alvayay CS, Arce-Alvarez A. Revisión sistemática de tratamientos fisioterapéuticos conmejor evidencia para el síndrome del túnel carpiano [Systematic review of physiotherapy treatments with better evidence for the carpal tunnel síndrome]. Rev Soc Esp del Dolor. 2008;15(7):475-80.
Babaei-Ghazani A, Roomizadeh P, Forogh B, et al. Ultrasound-guided versus landmark-guided local corticosteroid injection for carpal tunnel syndrome: A systematic review and meta-analysis of randomized controlled clinical trials. Arch Phys Med Rehabil. 2018;99(4):766-75. PMID: 28943161. https://doi.org/10.1016/j.apmr.2017.08.484.
Ballastero-Pérez R, Plaza-Manzano G, Urraca-Gesto A, et al. Effectiveness of Nerve Gliding Exercises on Carpal Tunnel Syndrome: A Systematic Review. J Manipulative Physiol Ther 2017;40(1):50-9. PMID: 27842937; https://doi.org/10.1016/j.jmpt.2016.10.004.
Bekhet AH, Ragab B, Abushouk AI, Elgebaly A, Ali OI. Efficacy of low-level laser therapy in carpal tunnel syndrome management: a systematic review and meta-analysis. Lasers Med Sci. 2017;32(6):1439-48. PMID: 28580494; https://doi.org/10.1007/s10103-017-2234-6.
Burger M, Kriel R, Damon A, et al. The effectiveness of low-level laser therapy on pain, self-reported hand function, and grip strength compared to placebo or “sham” treatment for adults with carpal tunnel syndrome: A systematic review. Physiother Theory Pract. 2017;33(3):184-97.PMID: 28272964; https://doi.org/10.1080/09593985.2017.1282999.
Burton CL, Chesterton LS, Chen Y, van der Windt DA. Clinical Course and Prognostic Factors in Conservatively Managed Carpal Tunnel Syndrome: A Systematic Review. Arch Phys Med Rehabil. 2016;97(5):836-852.e1. PMID: 26440776; https://doi.org/10.1016/j.apmr.2015.09.013.
Chapell R, Coates V, Turkelson C. Poor outcome for neural surgery (epineurotomy or neurolysis) for carpal tunnel syndrome compared with carpal tunnel release alone: a meta-analysis of global outcomes. Plast Reconstr Surg. 2003;112(4):983-90; discussion 991-2. PMID: 12973213; https://doi.org/10.1097/01.PRS.0000076222.77125.1F.
Chen L, Duan X, Huang X, et al. Effectiveness and safety of endoscopic versus open carpal tunnel decompression. Arch Orthop Trauma Surg. 2014;134(4):585-93. PMID: 24414237; https://doi.org/10.1007/s00402-013-1898-z.
Chen PC, Chuang CH, Tu YK, et al. A Bayesian network meta-analysis: Comparing the clinical effectiveness of local corticosteroid injections using different treatment strategies for carpal tunnel syndrome. BMC Musculoskelet Disord. 2015;16:363. Erratum in: BMC Musculoskelet Disord. 2015;16(1):394. PMID: 26585378; https://doi.org/10.1186/s12891-015-0815-8.
Choi GH, Wieland LS, Lee H, Sim H, Lee MS, Shin BC. Acupuncture and related interventions for the treatment of symptoms associated with carpal tunnel syndrome. Cochrane Database Syst Rev. 2018;12(12):CD011215. PMID: 30521680; https://doi.org/10.1002/14651858.CD011215.pub2.
Dunn JC, Kusnezov NA, Koehler LR, et al. Outcomes Following Carpal Tunnel Release in Patients Receiving Workers’ Compensation: A Systematic Review. Hand (N Y). 2018;13(2):137-142. PMID: 28387162; https://doi.org/10.1177/1558944717701240.
Franke TP, Koes BW, Geelen SJG, Huisstede BM. Do Patients with Carpal Tunnel Syndrome Benefit from Low-Level Laser Therapy? A Systematic Review of Randomized Controlled Trials. Arch Phys Med Rehabil. 2018;99(8):1650-1659.e15. PMID: 28629992; https://doi.org/10.1016/j.apmr.2017.06.002.
Gerritsen AA, Uitdehaag BM, van Geldere D, et al. Systematic review of randomized clinical trials of surgical treatment for carpal tunnel syndrome. Br J Surg. 2001;88(10):1285-95. PMID: 11578281; https://doi.org/10.1046/j.0007-1323.2001.01858.x.
Gerritsen AA, de Krom MC, Struijs MA, et al. Conservative treatment options for carpal tunnel syndrome: a systematic review of randomised controlled trials. J Neurol. 2002;249(3):272-80. PMID: 11993525; https://doi.org/10.1007/s004150200004.
Goodyear-Smith F, Arroll B. What can family physicians offer patients with carpal tunnel syndrome other than surgery? A systematic review of nonsurgical management. Ann Fam Med. 2004;2(3):267-73. PMID: 15209206; https://doi.org/10.1370/afm.21.
Hamamoto Filho PT, Leite FV, Ruiz T, Resende LA. A systematic review of anti-inflammatories for mild to moderate carpal tunnel syndrome. J Clin Neuromuscul Dis. 2009;11(1):22-30. PMID: 19730018; https://doi.org/10.1097/CND.0b013e3181ac8364.
Hu K, Zhang T, Xu W. Intraindividual comparison between open and endoscopic release in bilateral carpal tunnel syndrome: a meta-analysis of randomized controlled trials. Brain Behav. 2016;6(3):e00439. PMID: 27099801; https://doi.org/10.1002/brb3.439.
Huisstede BM, Hoogvliet P, Randsdorp MS, et al. Carpal tunnel syndrome. Part I: effectiveness of nonsurgical treatments--a systematic review. Arch Phys Med Rehabil. 2010;91(7):981-1004. PMID: 20599038; https://doi.org/10.1016/j.apmr.2010.03.022.
Huisstede BM, Randsdorp MS, Coert JH, et al. Carpal tunnel syndrome. Part II: effectiveness of surgical treatments--a systematic review. Arch Phys Med Rehabil. 2010;91(7):1005-24. PMID: 20599039; https://doi.org/10.1016/j.apmr.2010.03.023.
Huisstede BM, Hoogvliet P, Franke TP, Randsdorp MS, Koes BW. Carpal Tunnel Syndrome: Effectiveness of Physical Therapy and Electrophysical Modalities. An Updated Systematic Review of Randomized Controlled Trials. Arch Phys Med Rehabil. 2018;99(8):1623-1634.e23. PMID: 28942118; https://doi.org/10.1016/j.apmr.2017.08.482.
Huisstede BM, van den Brink J, Randsdorp MS, Geelen SJ, Koes BW. Effectiveness of Surgical and Postsurgical Interventions for Carpal Tunnel Syndrome-A Systematic Review. Arch Phys Med Rehabil. 2018;99(8):1660-1680.e21. Erratum in: Arch Phys Med Rehabil. 2020;101(9):1665. PMID: 28577858; https://doi.org/10.1016/j. apmr.2017.04.024.
Huisstede BM, Randsdorp MS, van den Brink J, et al. Effectiveness of Oral Pain Medication and Corticosteroid Injections for Carpal Tunnel Syndrome: A Systematic Review. Arch Phys Med Rehabil. 2018;99(8):1609-1622.e10. PMID: 29626428; https://doi.org/10.1016/j.apmr.2018.03.003
Hunt KJ, Hung SK, Boddy K, Ernst E. Chiropractic manipulation for carpal tunnel syndrome: a systematic review. Hand Therapy. 2009;14(4):89-94. https://doi.org/10.1258/ht.2009.009023.
Jiménez Del Barrio S, Bueno Gracia E, Hidalgo García C, et al. Conservative treatment in patients with mild to moderate carpal tunnel syndrome: A systematic review. Neurologia (Engl Ed). 2018;33(9):590-601. PMID: 27461181; https://doi.org/10.1016/j.nrl.2016.05.018.
Kim JC, Jung SH, Lee SU, Lee SY. Effect of extracorporeal shockwave therapy on carpal tunnel syndrome: A systematic review and meta-analysis of randomized controlled trials. Medicine (Baltimore). 2019;98(33):e16870. PMID: 31415424; https://doi.org/10.1097/MD.0000000000016870.
Kim SD. Efficacy of tendon and nerve gliding exercises for carpal tunnel syndrome: a systematic review of randomized controlled trials. J Phys Ther Sci. 2015;27(8):2645-8. PMID: 26357452; https://doi.org/10.1589/jpts.27.2645.
Klokkari D, Mamais I. Effectiveness of surgical versus conservative treatment for carpal tunnel syndrome: A systematic review, meta-analysis and qualitative analysis. Hong Kong Physiother J.2018;38(2):91-114. PMID: 30930582; https://doi.org/10.1142/S1013702518500087.
Kohanzadeh S, Herrera FA, Dobke M. Outcomes of open and endoscopic carpal tunnel release: a meta-analysis. Hand (N Y). 2012;7(3):247-51. PMID: 23997726; https://doi.org/10.1007/s11552-012-9413-5.
Lai, Sike; Zhang, Kaibo; Li, Jian; Fu, Weili; Harhaus, Leila . Carpal tunnel release with versus without flexor retinaculum reconstruction for carpal tunnel syndrome at short- and long-term follow up—A meta-analysis of randomized controlled trials. Plos One (2019), 14(1), e0211369–. https://doi.org/10.1371/journal.pone.0211369
Li G, Kong L, Kou N, et al. The comparison of limited-incision versus standard-incision in treatment of carpal tunnel syndrome: A meta-analysis of randomized controlled trials. Medicine (Baltimore). 2019;98(18):e15372. PMID: 31045782; https://doi.org/10.1097/MD.0000000000015372.
Li ZJ, Wang Y, Zhang HF, et al. Effectiveness of low-level laser on carpal tunnel syndrome: A meta-analysis of previously reported randomized trials. Medicine (Baltimore). 2016;95(31):e4424. PMID: 27495063; https://doi.org/10.1097/MD.0000000000004424.
Lim YH, Chee DY, Girdler S, Lee HC. Median nerve mobilization techniques in the treatment of carpal tunnel syndrome: A systematic review. J Hand Ther. 2017;30(4):397-406. PMID: 28764878; https://doi.org/10.1016/j.jht.2017.06.019.
Malahias MA, Chytas D, Mavrogenis AF, et al. Platelet-rich plasma injections for carpal tunnel syndrome: a systematic and comprehensive review. Eur J Orthop Surg Traumatol. 2019;29(1):1-8. PMID: 30022241; https://doi.org/10.1007/s00590-018-2278-8.
Marshall S, Tardif G, Ashworth N. Local corticosteroid injection for carpal tunnel syndrome. Cochrane Database Syst Rev. 2007;(2):CD001554. PMID: 17443508; https://doi.org/10.1002/14651858. CD001554.pub2.
Medina McKeon JM, Yancosek KE. Neural gliding techniques for the treatment of carpal tunnel syndrome: a systematic review. J Sport Rehabil. 2008;17(3):324-41 PMID: 18708684; https://doi.org/10.1123/jsr.17.3.324.
Muller M, Tsui D, Schnurr R, et al. Effectiveness of hand therapy interventions in primary management of carpal tunnel syndrome: a systematic review. J Hand Ther. 2004;17(2):210-28. PMID: 15162107; https://doi.org/10.1197/j.jht.2004.02.009.
O’Connor D, Marshall S, Massy-Westropp N. Non-surgical treatment (other than steroid injection) for carpal tunnel syndrome. Cochrane Database Syst Rev. 2003;2003(1):CD003219. PMID: 12535461; https://doi.org/10.1002/14651858.CD003219.
O’Connor D, Page MJ, Marshall SC, Massy-Westropp N. Ergonomic positioning or equipment for treating carpal tunnel syndrome. Cochrane Database Syst Rev. 2012;1(1):CD009600. PMID: 22259003; https://doi.org/10.1002/14651858.CD009600.
Page MJ, Massy-Westropp N, O’Connor D, Pitt V. Splinting for carpal tunnel syndrome. Cochrane Database Syst Rev. 2012;2012(7):CD010003. PMID: 22786532; https://doi.org/10.1002/14651858.CD010003.
Page MJ, O’Connor D, Pitt V, Massy-Westropp N. Exercise and mobilisation interventions for carpal tunnel syndrome. Cochrane Database Syst Rev. 2012;(6):CD009899. PMID: 22696387; https://doi.org/10.1002/14651858.CD009899.
Page MJ, O’Connor D, Pitt V, Massy-Westropp N. Therapeutic ultrasound for carpal tunnel syndrome. Cochrane Database Syst Rev. 2013;2013(3):CD009601. PMID: 23543580; https://doi.org/10.1002/14651858.CD009601.pub2.
Piazzini DB, Aprile I, Ferrara PE, et al. A systematic review of conservative treatment of carpal tunnel syndrome. Clin Rehabil. 2007;21(4):299-314. PMID: 17613571; https://doi.org/10.1177/0269215507077294.
Sanati KA, Mansouri M, Macdonald D, et al. Surgical techniques and return to work following carpal tunnel release: a systematic review and meta-analysis. J Occup Rehabil. 2011;21(4):474-81. PMID: 21528400; https://doi.org/10.1007/s10926-011-9310-8.
Sayegh ET, Strauch RJ. Open versus endoscopic carpal tunnel release: a meta-analysis of randomized controlled trials. Clin Orthop Relat Res. 2015;473(3):1120-32. PMID: 25135849; https://doi.org/10.1007/s11999-014-3835-z.
Scholten RJ, Mink van der Molen A, Uitdehaag BM, Bouter LM, de Vet HC. Surgical treatment options for carpal tunnel syndrome. Cochrane Database Syst Rev. 2007 Oct 17;2007(4):CD003905. PMID: 17943805; https://doi.org/10.1002/14651858.CD003905.pub3.
Shi Q, MacDermid JC. Is surgical intervention more effective than non-surgical treatment for carpal tunnel syndrome? A systematic review. J Orthop Surg Res. 2011;6:17. PMID: 21477381; https://doi.org/10.1186/1749-799x-617.
Shi Q, Bobos P, Lalone EA, Warren L, MacDermid JC. Comparison of the Short-Term and Long-Term Effects of Surgery and Nonsurgical Intervention in Treating Carpal Tunnel Syndrome: A Systematic Review and Meta-Analysis. Hand (N Y). 2020;15(1):13-22. PMID: 30015499; https://doi.org/10.1177/1558944718787892.
Sim H, Shin BC, Lee MS, et al. Acupuncture for carpal tunnel syndrome: a systematic review of randomized controlled trials. J Pain. 2011;12(3):307-14. PMID: 21093382; https://doi.org/10.1016/j. jpain.2010.08.006.
Soltani AM, Allan BJ, Best MJ, Mir HS, Panthaki ZJ. A systematic review of the literature on the outcomes of treatment for recurrent and persistent carpal tunnel syndrome. Plast Reconstr Surg. 2013;132(1):114-21. PMID: 23806914; https://doi.org/10.1097/prs.0b013e318290faba.
Thoma A, Veltri K, Haines T, Duku E. A systematic review of reviews comparing the effectiveness of endoscopic and open carpal tunnel decompression. Plast Reconstr Surg. 20041;113(4):1184-91. PMID: 15083019; https://doi.org/10.1097/01.prs.0000110202.08818.c1.
Vasiliadis HS, Georgoulas P, Shrier I, Salanti G, Scholten RJ. Endoscopic release for carpal tunnel syndrome. Cochrane Database Syst Rev. 2014;(1):CD008265. PMID: 24482073; https://doi.org/10.1002/14651858.CD008265.pub2.
Vasiliadis HS, Nikolakopoulou A, Shrier I, et al. Endoscopic and Open Release Similarly Safe for the Treatment of Carpal Tunnel Syndrome. A Systematic Review and Meta-Analysis. PLoS One. 2015;10(12):e0143683. https://doi.org/10.1371/journal.pone.0143683.
Wade RG, Wormald JC, Figus A. Absorbable versus non-absorbable sutures for skin closure after carpal tunnel decompression surgery. Cochrane Database Syst Rev. 2018;2(2):CD011757. PMID: 29390170; https://doi.org/10.1002/14651858.CD011757.pub2.
Zuo D, Zhou Z, Wang H, et al. Endoscopic versus open carpal tunnel release for idiopathic carpal tunnel syndrome: a meta-analysis of randomized controlled trials. J Orthop Surg Res. 2015;10:12. PMID: 25627324; https://doi.org/10.1186/s13018-014-0148-6.
Belloti JC, Okamura A, Scheeren J, Faloppa F, Ynoe de Moraes V. A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment. PLoS One. 2019;14(1):e0206895. PMID: 30673700; https://doi.org/10.1371/journal.pone.0206895.
Zhi X, Zhang Z, Cui J, et al. Quality of Meta-analyses in Major Leading Orthopedics Journals: A Systematic Review. Orthop Traumatol Surg Res. 2017;103(8):1141-6. PMID: 28928047; https://doi.org/10.1016/j.otsr.2017.08.009.
Adie S, Ma D, Harris IA, Naylor JM, Craig JC. Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions. Ann Surg. 2015;261(4):685-94. PMID: 25575252; https://doi.org/10.1097/SLA.0000000000000836.
Felson DT. Bias in meta-analytic research. J Clin Epidemiol. 1992;45(8):885-92. PMID: 1624971; https://doi.org/10.1016/0895-4356(92)90072-u.
Kunkel ST, Sabatino MJ, Moschetti WE, Jevsevar DS. Systematic Reviews and Meta-Analyses in the Orthopaedic Literature: Assessment of the Current State of Quality and Proposal of a New Rating Strategy. Clinical Research in Orthopaedics. 2018;1(1):1-7. Available from: https://asclepiusopen.com/clinical-research-in-orthopaedics/volume-1-issue-1/1.pdf. Accessed in 2022 (Oct 18).
