Palabras clave: scoping reviews as topic, literature review as topic, evidence-based medicine, systematic mapping

Introduction

The rapid increase in the generation of evidence in different areas, such as health or technology, triggered the need to group and synthesize this evidence in reviews. Systematic reviews are the most popular model because they reach potentially extrapolated conclusions by grouping all the available (and good quality) evidence for a specific clinical question with a rigorous and reproducible method [1]. They answer questions with the Population-Intervention-Comparison-Outcome (PICO) format. The development of health care towards a multidisciplinary science has led to more complex questions that do not meet the PICO format. These new questions may include:

1. Complex multidimensional phenomena that require multivariate analysis, conceptual and methodological development, and complementarity of sources
2. The need to know the type and amount of evidence available in some specific area and whether it is feasible or required to conduct a systematic review in this area

New models of literature review emerged to answer these kinds of questions. They vary according to the type of question they aim to answer while maintaining the rigorousness and reproducibility of systematic reviews [1],[2].

Among these models, scoping reviews answer broad questions, and their production has increased considerably over the years, but more during the last decade [3],[4]. Most scoping reviews are related to health, followed by other social sciences and software engineering [3]. Public funds finance over 60% of scoping reviews, and most of them are developed by teams from North America and Europe [4].

This is the fifth article of a methodological series of narrative reviews about general topics on biostatistics and clinical epidemiology, which explore and summarize, in a friendly language, several published articles available in main databases and specialized reference texts. The series aims to reach undergraduate and graduate students. The Evidence-Based Medicine Team from the School of Medicine of Universidad de Valparaíso, Chile, collaborated with the Research department of Instituto Universitario Hospital Italiano de Buenos Aires, Argentina, and the UC Evidence Center, of the Universidad Católica, Chile, to elaborate the series. This article's main objective is to specify what scoping reviews are and when it is pertinent to conduct a scoping review and provide comments on their considerations and challenges.

What are scoping reviews?

Scoping reviews are extensive literature reviews that answer broad research questions. They focus on exploring the literature, establishing its size and potential scope in a specific area [2]. They show the general panorama rather than answer a specific question [1]. In addition, they follow a rigorous and systematic method that must be transparent and reproducible [5].

Since the inception of scoping reviews—in the late 90s—we lack a specific terminology for them [3],[4]. Scoping review is the most widely used; other terms such as "scoping study," "systematic mapping," or "scoping exercise" are also used [3].

Just as there is no specific terminology, there is no universal definition for scoping reviews. The most referenced definition is the one proposed by Mays et al. [6], and later used by Arksey and O'Malley [7], stating that scoping reviews "aim to map the key concepts rapidly underpinning a research area and the main sources and types of evidence available, and can be undertaken as stand-alone projects in their own right, especially where an area is complex or has not been reviewed comprehensively before" [6]. In this sense, scoping reviews are intended to be a comprehensive review of the literature: they must cover the greatest breadth of the available evidence, but the depth in the search may vary (depending on the objective of each review), which is why different sources can feed into scoping reviews, and both scientific articles and expert interviews are valid to the extent that they answer the research question [8].

Daudt et al. [9] suggested discarding the word "rapid" from the proposed definition since scoping reviews are not fast to perform, and they must be carried out conscientiously and in detail. They also state that the objectives of scoping reviews should be included in their definition (for example, to identify key concepts, gaps in the literature, and types and sources of evidence) to inform clinicians, policymakers, and researchers [9].

What are they for, and when should they be done?

Scoping reviews can have different objectives, but they all share the goal of identifying and mapping the available evidence in a specific area. Some possible objectives are:

1. To examine the amount and nature of the available evidence in a specific area: A scoping review with this objective is helpful to achieve a general view of a specific field when it is hard to know the amount of available evidence. It scans the availability of the evidence rather than the conclusions presented in that evidence [7],[10].

Example: A scoping review assessing and defining the location and the quality of the available evidence on emergency planning in the academic and grey literature of the United Kingdom [11].

2. To establish the need and feasibility of conducting a systematic review after a scoping review: Scoping reviews recognize the type of available evidence for a question, which can help set a basis for a systematic review [7]. It is possible to establish the feasibility of a systematic review if a previous scoping review answers questions such as "Are there any studies available?" or "What type of studies exist?" [10]. Besides, a scoping review may conclude whether a new systematic review would be relevant if it answers "Are there any previous systematic reviews?" or "How many previous systematic reviews are available?". Conducting a scoping review can be an important step before conducting a systematic review if we consider its human and financial cost. Scoping reviews may also help set up the specific question for a systematic review because the available evidence is helpful to detect populations or outcomes of interest for future systematic reviews [12]. Despite this objective may improve the efficiency when performing a systematic review, it is not the most frequent aim in conducting a scoping review [3],[4].

Example: A scoping review exploring how physical training interventions affect the fat percentage of people with an intellectual deficit and assesses the need for further investigation [13].

3. To summarize and spread the results of available evidence: The general picture of the available evidence for a question allows to sum up the results of this evidence and to present them to public policies makers, decision-makers, and even consumers (they may not have the experience nor the time needed to conduct a literature review on their own) [7].

Example: A scoping review summarizing the available recommendations on ophthalmologic care during the COVID-19 pandemic [14].

4. To identify gaps in the available evidence: This is the most frequent aim of scoping reviews [3],[4]. The mapping of evidence is used to identify where research is lacking and point to the potential direction of further research [7],[12]. It identifies the areas where there are no studies, but as it is not mandatory for scoping reviews to assess the quality of the evidence, those that skip this step may overlook gaps of evidence where only poor quality evidence exists, and further investigation is needed.

Example: A scoping review exploring and describing the available evidence on "occupational balance" (or the balance of work, rest, sleep, and play) and identifies the knowledge gaps [15].

5. To clarify concepts and definitions on a specific topic: Scoping reviews with this aim evaluate differences in definitions in a specific topic or the discrepancy among authors' interpretation of a definition. This encourages authors to reach consensus and to design a "definition based on the evidence."

Example: A scoping review that evaluates the definition of "bronchopulmonary dysplasia" in the available evidence and analyzes incidence variations according to the definition [16].

6. To evaluate how research is done in a specific area: When evaluating how research is conducted, scoping reviews can suggest standardizations, either methodological or about reporting (especially in those topics where there is greater variability).

Example: A scoping review evaluating and narratively describing how researchers conduct scoping reviews [3].

7. To identify key features or factors related to a specific concept: Scoping reviews may assess key aspects on a specific topic, guiding further investigation or better clinical practice thanks to its findings.

Example: A scoping review identifying the features of primary health care models for indigenous people and later informs the best healthcare model of attention [17],[18].

The main objective of scoping reviews can combine two or more of the above mentioned. In our experience, the flexibility to incorporate several sources (clinical practice guidelines in our case) allowed us to reach a general picture of existing recommendations and identify gaps of evidence by assessing the reporting quality of each guideline [14].

What are the differences and similarities with other types of literature reviews?

Systematic reviews are the literature reviews with the most extended trajectory and are widely used (and preferred) by decision-makers. In Table 1, we compare in detail scoping reviews with systematic reviews [12].

Table 1. Main differences between a systematic review and a scoping review.

Comparing scoping reviews with other literature reviews

Narrative reviews: It summarizes the evidence on a specific topic, but it can be subjective since the authors' experience, and previous knowledge or theories may guide the search and the synthesis of evidence. On the other hand, scoping reviews include a comprehensive and systematic search of the evidence (transparent and reproducible), and they extract and present the information in a structured form [2].

Evidence gap maps: They identify and analyze the gaps of evidence in the literature [21]. They are the most similar literature review to scoping reviews. They even share the extension of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) for scoping reviews [22]. Their primary difference is that gap maps present a schematic and interactive figure (map) that shows where the available evidence on a specific topic is and where the gaps are [21].

Rapid reviews: It is a 'systematic review' that takes shortcuts in its methodology. They are efficient when resources or time are restrained, and decision-makers often request their production in specific situations [12],[23]. A rapid review tests a hypothesis rather than formulating it.

What are the myths of scoping reviews?

"Scoping reviews are easy to perform" or "Scoping reviews are a less rigorous method than a systematic review": Most scoping reviews do not assess quality nor perform quantitative synthesis of the evidence, which is why some people think that scoping reviews are easier to perform, or less rigorous than systematic reviews [7]. However, scoping reviews require researchers to critically assess information in order to present it. Also, they may include different types of studies, so literature search and literature screening yield many results that must be included, and this inherently challenges its conduction. Scoping reviews are not less rigorous than systematic reviews: they are a different model with their methodology and challenges [19].

"Scoping reviews are quick to perform": Perhaps the main reason for this myth is that the definition used by Arksey and O'Malley states that scoping reviews "aim to map rapidly" the literature [6],[7]. However, multiple factors may affect the speed when performing a scoping review: the question breadth, the amount of evidence reached, the time researchers can spend on each scoping review, and the number of researchers working on it. Pham et al. found that performing a scoping review takes from two weeks to 20 months when analyzing 344 scoping reviews [3]. Therefore, we cannot claim that they are fast to perform [9]. The estimated time to carry out a scoping review (and the time of researchers required) is an important variable to consider in a scoping review's cost [7].

How are scoping reviews done?

There are different methods for conducting a scoping review. Arksey and O'Malley were the first to propose one, ensuring a rigorous and reproducible method to respond to the different scoping reviews' objectives [7]. Several authors suggested modifications to this original method to facilitate its application [8],[24],[25],[26], and, in 2015, the Joanna Briggs Institute published their methodology based on the original model and the ulterior suggestions [27], which has been well accepted [28]. This methodology was updated in 2020 and can be found in the chapter of scoping reviews in the JBI Manual for Evidence Synthesis [29].

The PRISMA Extension for Scoping Reviews (PRISMA-ScR) is the most recently published instrument to guide the scoping reviews' report [22]. It was based on the existing theoretical frameworks (previously mentioned), adding the comments and recommendations made to them. Multiple articles—preceding the publication of PRISMA-ScR—mentioned the need to standardize the methods of scoping reviews, enabling to evaluate their rigor, and to ensure a minimum level of analysis and report [3],[4],[8],[24],[26]: the PRISMA-ScR addresses these concerns. As mentioned above, PRISMA-ScR is also used to report evidence gap maps. Table 2 shows the PRISMA-ScR checklist; this extension excludes items from the original checklist (used for systematic reviews) and makes some items optional. For more information regarding this tool, we advise consulting it directly [22]. Given its recent release, there are still no publications that assess it (2018), but some published scoping reviews have already used this method, so soon we should expect to see users' opinions and recommendations [30].

Table 2. PRISMA extension for Scoping Reviews checklist.

Although different theoretical frameworks to perform scoping reviews have been proposed during the last 20 years, PRISMA-ScR extension may be the guide to follow from now on. The different proposals kept common ideas that are important to highlight:

Scoping reviews must be carried out by a multidisciplinary team: By doing so, different disciplines complement each other [9]. Some authors state that scoping reviews should include a librarian (or information specialist) to develop high-quality search strategies [31]. The team should include at least two researchers [27], but according to some authors' experience, this number would not be enough, considering how laborious the work can be, and because a greater number of members from different disciplines enriches the work [9]. If possible, at least two independent researchers should perform the analysis (the same as other types of reviews).

The process must be iterative [7],[27]: The process should be carried out with rigor and reflectively, repeating steps if necessary to accomplish the objectives of the scoping review. The review should be comprehensive, so researchers must repeat the search at different moments when performing a scoping review (and this should be detailed in the methods section).

Search strategies and data extraction tables should be piloted before its use [4],[7]: The search strategies used in a scoping review should be able to provide all results to the (broad) question to be addressed. The search strategy must be piloted—even repeatedly—to ensure this. Researchers should also test the data extraction tables, as the results they produce should answer the question and satisfy the specific objectives of each scoping review.

What to consider when conducting a scoping review?

A balance between breadth and depth: Bibliographic searches of databases, specific platforms, gray literature, manual reviews, the information provided by experts, and even interviews (the latter in areas other than health) may nourish the evidence in a scoping review. It is essential to cover as much available information as possible (breadth); the depth, instead, will be determined by the question of each scoping review. The breadth could be a challenge: sometimes, the volume of evidence to review is so large that the predicted time, the languages covered, and the number of reviewers required to develop the scoping review is underestimated [4],[7]. In these cases, sometimes the reviewers may be able to assess less evidence than the total retrieved; this is a limitation because, despite being reported (maintaining transparency), it is contradictory with the main aim of scoping reviews: to have a general panorama of all the available information. This balance between breadth and depth is easier to achieve—and thus a briefer scoping review—in areas where the existing evidence is scarce [12].

Evidence quality assessment: It is not mandatory to assess the quality of the evidence, but reviewers may carry it out if it is the aim of their scoping review. Some authors state that not assessing the quality of the evidence may be a limitation of scoping reviews [2],[3],[12],[19]. When reviewers do not assess the quality of evidence, they may fail to identify evidence gaps where there is evidence of low quality. This could be a problem in scoping reviews that aim to support or inform decision-making in healthcare since they would not identify gaps where evidence exists, or because it is of low or very low quality, and further studies are needed.

Consultation with experts or key informants: This step of scoping reviews has not yet been fully defined [24] and is considered optional [7]. This stage has many possible interpretations, such as: the experts can provide additional references [7]; the experts may revise the preliminary data of a scoping review, evaluating its validity or utility [4]. Both are valid interpretations and imply the participation of external agents in the review in different moments of its performance, thus reflecting the lack of development on this matter.

Standardization of the process and report: The use of PRISMA-ScR ensures the rigor of the report when conducting scoping reviews. PRISMA-ScR will increase readers' confidence in the presented information and allows them to read these articles critically [32].

Conclusions

Scoping reviews are a recent method of literature review. They answer broad research questions aiming to identify and map the available evidence for a specific area, accomplishing the specific objectives of each review. They differ from other types of literature reviews mainly in their objectives and the type of question they address, but they share the rigorous and reproducible method of systematic reviews. There are different standards for reporting scoping reviews, but the PRISMA extension for scoping reviews (PRISMA-ScR) is the newest and considers suggestions and critics made to previous guidelines.

Notes

Contributions of the authors
CV, LVM: conceptualization, methodology, investigation, writing, writing – review, visualization, supervision, project administration. LTB, BSM, MVP, ASD: conceptualization, methodology, investigation, writing, writing – review. ASD: conceptualization, methodology, investigation, writing, writing – review. 

Conflict of interest
The authors declare that there is no conflict of interest. 

Funding
The authors have no funding to report. 

From the editors
The original version of this article was submitted in Spanish, which was the peer-reviewed version. This is a translation of the article submitted by the authors and has been lightly copyedited by the journal.

Table 1. Main differences between a systematic review and a scoping review.

Table 2. PRISMA extension for Scoping Reviews checklist.

Esta obra de Medwave está bajo una licencia Creative Commons Atribución-NoComercial 3.0 Unported. Esta licencia permite el uso, distribución y reproducción del artículo en cualquier medio, siempre y cuando se otorgue el crédito correspondiente al autor del artículo y al medio en que se publica, en este caso, Medwave.