Response to: Letter to the Editor, Minimally Invasive versus Open Surgery for Spinal Metastasis: A Systematic Review and Meta-Analysis

Article information

Asian Spine J. 2021;15(5):710-712
Publication date (electronic) : 2021 October 20
doi : https://doi.org/10.31616/asj.2021.0395.r2
1Tecnológico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Mexico
2Departamento de Neurología y Neurocirugía, Hospital Zambrano Hellion, San Pedro Garza Garcia, Mexico
Corresponding author: Jose Antonio Figueroa-Sanchez Hospital Zambrano Hellion, Av. Batallon de San Patricio 112, Real San Agustín, 66278 San Pedro Garza García, N.L., Mexico Tel: +52-81-8888-0000, E-mail: dr.figueroa@tec.mx
Received 2021 September 28; Accepted 2021 October 4.

Dear Editor & Drs. Ali and Tariq,

We appreciate your interest in our publication and the time taken to read and thoughtfully critique our work [1]. We believe in constructive criticism and cherish the opportunity to both address concerns raised by Drs. Ali and Tariq and further improve our work.

On the first point raised by Drs. Ali and Tariq concerning Prospective Register of Systematic Reviews (PROSPERO) registration: we routinely register planned reviews on PROSPERO and are fully aware of its intended purpose of transparency and reducing study duplication [2-5]. However, for countries other than the United Kingdom, the waiting time prior to the pandemic was at least 3 months, and in our experience, even longer. Due to current world affairs, PROSPERO is not actively reviewing submissions and is uploading them “as-is” prior to initial screening if unrelated to coronavirus disease 2019, thus its capacity as a quality-control filter is currently limited. Additionally, in our experience, we have found that full compliance with registration does not prevent other authors, from performing the same or similar studies [6-8].

Due to the aforementioned factors, we have decided not to pursue registration when we anticipate a study will take us less than a month from inception to submission, as we estimate publication would take an approximately similar time to the registration certification and upload. This defeats its use in preventing study duplication and our methods are transparent enough to allow and encourage this kind of discussion. Such is the case of this manuscript, which as detailed in methods, was initiated in November and submitted in December. Additionally, in this study’s specific case, we had already performed a small version of the analysis for in-house outcomes grand rounds session, which, per PROSPERO rules, would have made it ineligible for registration [9].

A recent study in vaccine research found that registration was one of the least complied factors within guidelines, finding only 26% of compliance [10]. Similar studies on ophthalmology reported again that registration was the least complied guideline at 9%, 19.4% in maxillo-craniofacial surgery, and 14% in neuroendovascular reviews [11-13]. Prior iterations of similar studies have also been successfully performed without registration [14,15]. Thus, given the time implication, that it does not actively prevent other studies from being performed, and the current relaxed standards, we believe registration shouldn’t be a barrier to performing and publishing reviews and currently reported compliance seems to reflect similar sentiments.

Regarding the second point mentioned on heterogeneity, we discuss the matter in the closing statements of the discussion section; we believe heterogeneity comes from unaccounted variations in concurrent treatment and staging from patients across different studies as well as from differences in indications for surgical intervention, which is difficult to control for and we even encouraged future dedicated studies. However, and again as we state various times in the manuscript, this is a difficult population to study and this should not preclude current attempts of analyzing available evidence.

We typically perform stepwise addition analysis of studies on I2 % to assess which studies induce heterogeneity and might impact results and determine if further stricter reanalysis or subgrouping is needed as recommended by Cochrane and have done so successfully in the past [3]. In this paper’s case, we found that heterogeneity changed effect size but not significance or direction in any analyzed variable’s result except for operative time, in which we opted for a more conservative conclusion. We typically perform sensitivity analysis to a degree in all of our work; however, the most accurate way to explore this heterogeneity is a meta-regression. In either case, Review Manager ver. 5.3 (RevMan; Cochrane, London, UK) does not feature dedicated functions for these processes [16,17].

Thirdly, on publication bias, other than a funnel plot, Review Manager ver. 5.3 (Cochrane) does not offer additional tools for publication bias such as Egger’s test. While we routinely assess funnel plots for symmetry, we find it to be too arbitrary to give any credible weight and attempt to correlate our findings with prior published literature. Funnel plots alone have been found to have limited use and studies have found researchers’ limited ability to adequately interpret funnel plots [18,19].

Lastly, we find McGrath’s method to be interesting and will undoubtedly consider it for future studies. However, it is important to notice that while the publication of McGrath et al. [20]~ is around 2 years, it has only been cited approximately 40 times compared to the publication of Wan et al. [21] (2,765), suggesting it’s yet to be more widely adopted and therefore we believe it to be an unfair assumption to expect it to be the default method for data estimation. Additionally, we specifically stated in our limitations section that data estimation was a limitation of our study but will look to incorporate this possible more accurate data estimation tool in future studies.

Once again, we appreciate the feedback and hope to have provided adequate responses to Drs. Ali and Tariq’s concerns.

Notes

No potential conflict of interest relevant to this article was reported.

References

1. Hinojosa-Gonzalez DE, Roblesgil-Medrano A, Villarreal-Espinosa JB, et al. Minimally invasive versus open surgery for spinal metastasis: a systematic review and meta-analysis. Asian Spine J 2021;Sep. 1. [Epub]. https://doi.org/10.31616/asj.2020.0637.
2. Hinojosa-Gonzalez DE, Salgado-Garza G, Torres-Martinez M, et al. Endovascular treatment of transplant renal artery stenosis: a systematic review and meta-analysis. J Endovasc Ther 2021;Aug. 16. [Epub]. https://doi.org/10.1177/15266028211038593.
3. Hinojosa-Gonzalez DE, Bueno LC, Roblesgil-Medrano A, et al. Laparoscopic vs open portoenterostomy in biliary atresia: a systematic review and meta-analysis. Pediatr Surg Int 2021;Jul. 16. [Epub]. https://doi.org/10.1007/s00383-021-04964-5.
4. Hinojosa-González DE, Salgado-Garza G. Portoenterostomy for biliary atresia: laparsocopic versus open approach: PROSPERO 2020 CRD42020204438 [Internet]. London: National Institute for Health Research; 2020. [cited 2021 Sep 20]. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020204438.
5. Hinojosa-Gonzalez DE. Percutaneous angioplasty alone vs percutaneous angioplasty and stenting in the treatment of transplant renal artery stenosis: a systematic review and meta-analysis: PROSPERO 2020 CRD42020171352 [Internet]. London: National Institute for Health Research; 2020. [cited 2021 Sep 20]. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020171352.
6. Bertolo R, Garisto J, Bove P, Mottrie A, Rocco B, ; EAU Robotic Urology Section (ERUS) Working Group on Science. Perioperative outcomes between single-port and “multi-port” robotic assisted radical prostatectomy: where do we stand? Urology 2021;155:138–43.
7. Li K, Yu X, Yang X, et al. Perioperative and oncologic outcomes of single-port vs multiport robot-assisted radical prostatectomy: a meta-analysis. J Endourol 2021;Jul. 21. [Epub]. https://doi.org/10.1089/end.2021.0210.
8. Hinojosa-Gonzalez DE, Torres-Martinez M. Singleport vs multi-port robotic prostatectomy: a systematic review and meta-analysis: PROSPERO 2021 CRD42021228744 [Internet]. London: National Institute for Health Research; 2020. [cited 2021 Sep 20]. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021228744.
9. Ndze VN, Jaca A, Wiysonge CS. Reporting quality of systematic reviews of interventions aimed at improving vaccination coverage: compliance with PRISMA guidelines. Hum Vaccin Immunother 2019;15:2836–43.
10. Lu VM, Alvi MA, Goyal A, Kerezoudis P, Bydon M. The potential of minimally invasive surgery to treat metastatic spinal disease versus open surgery: a systematic review and meta-analysis. World Neurosurg 2018;112:e859–68.
11. Lee SY, Sagoo H, Farwana R, Whitehurst K, Fowler A, Agha R. Compliance of systematic reviews in ophthalmology with the PRISMA statement. BMC Med Res Methodol 2017;17:178.
12. Akhigbe T, Zolnourian A, Bulters D. Compliance of systematic reviews articles in brain arteriovenous malformation with PRISMA statement guidelines: review of literature. J Clin Neurosci 2017;39:45–8.
13. Pidgeon TE, Wellstead G, Sagoo H, Jafree DJ, Fowler AJ, Agha RA. An assessment of the compliance of systematic review articles published in craniofacial surgery with the PRISMA statement guidelines: a systematic review. J Craniomaxillofac Surg 2016;44:1522–30.
14. Hughes H, Carthy AM, Sheridan GA, Donnell JM, Doyle F, Butler J. Thoracolumbar burst fractures: a systematic review and meta-analysis comparing posterior-only instrumentation versus combined anterior-posterior instrumentation. Spine (Phila Pa 1976) 2021;46:E840–9.
15. National Institute for Health Research. Prospero: the international prospective register of systematic reviews York: University of York; 2019.
16. Baker WL, White CM, Cappelleri JC, Kluger J, Coleman CI, ; Health Outcomes, Policy, and Economics (HOPE) Collaborative Group. Understanding heterogeneity in meta-analysis: the role of meta-regression. Int J Clin Pract 2009;63:1426–34.
17. Higgins JP, Thomas J, Chandler J, et al. Cochrane Handbook for Systematic Reviews of Interventions version 6.2 (updated February 2021) [Internet]. London: Cochrane; 2021. [cited 2021 Sep 20]. Available from: www.training.cochrane.org/handbook.
18. Sterne JA, Sutton AJ, Ioannidis JP, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomized controlled trials. BMJ 2011;343:d4002.
19. Terrin N, Schmid CH, Lau J. In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. J Clin Epidemiol 2005;58:894–901.
20. McGrath S, Zhao X, Steele R, Thombs BD, Benedetti A, ; DEPRESsion Screening Data (DEPRESSD) Collaboration. Estimating the sample mean and standard deviation from commonly reported quantiles in meta-analysis. Stat Methods Med Res 2020;Jan. 30. [Epub]. https://doi.org/10.1177/0962280219889080.
21. Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol 2014;14:135.

Article information Continued