Comment
Medwave 2020;20(3):e7874 doi: 10.5867/medwave.2020.03.7874
Strengths and limitations of mathematical models in pandemics—the case of COVID-19 in Chile
Jorge Rojas-Vallejos
References | Related | Download PDF |
To Download PDF must login.
Print | A(+) A(-) | Easy read

Key Words: coronavirus, COVID-19, epidemiology, mathematical models

Abstract

This short paper focuses on the role of mathematical models to analyze the impact of pandemics on health resources and the different trade-offs that may be included in them. There is a large body of literature suggesting that mathematical modeling may be helpful to estimate how much additional equipment and infrastructure are necessary to mitigate an increase in demand for health services during a large-scale outbreak of an infectious disease. I comment on the crucial role of these models with a special focus on their strengths and limitations.


 
Introduction

This paper is motivated by the current pandemic of coronavirus (COVID-19) around the world and particularly in Chile. A recent article by Gutiérrez-Aguilar et al. (2020)[1] addresses the critical problem of health resources available to face the novel coronavirus outbreak. This new coronavirus is related to the SARS-CoV with similar incubation and generation times, but with a lower rate of progression to severe disease and death given the appropriate medical support.[2] However, the human-to-human transmission of COVID-19 has shown to be highly efficient and now is present in over 200 countries and territories.[3],[4] The disease caused by this virus tends to be more severe in older adults and the chronically ill. A fraction of the people infected may need to be admitted to an intensive care unit (ICU) and require mechanical ventilation. This is the major problem affecting advanced countries as well as developing ones.[5] The reason is straightforward to understand. ICU beds and mechanical ventilators are limited, and their numbers in a given country are sufficient for the usual healthcare demand. We can say that most of the time, the limitation on ICU resources is not binding. However, for the COVID-19 outbreak, this is no longer true, and countries such as Italy have failed to provide this intensive care with the consequence of increasing their death rate.[6] All this makes it essential to have mathematical models to forecast the demand for ICU resources correctly. In this article, I discuss the elements to consider performing this task successfully.

Small versus large models

Mathematical models can be used to estimate different types of variables and differ in their methodology. What variable or what model is used will depend upon the question to be answered. For example, we could use a model to estimate the number of infected people based on an assumption about the basic reproduction number (R0) or we could use data on infected people to estimate R0. If the disease has known behavior, then some parameters can be assumed as known. However, if the disease is new—as the COVID-19 case—then we must deal with all the problems associated with estimating such parameters. A critical parameter value to know is R0 and this can be a function of variables with different parameter values. Thus, depending on the environmental setting R0 is going to be different. In mathematical terms,

Equation (1) shows that the basic reproduction number depends upon a set of variables and there is a parameter λi related to each variable xi. Therefore, if we want to estimate R0, then we need to know what variables should be included. Assuming we know the right model specification, then we need to estimate the parameters λi. In this stage, we could encounter two main issues: (i) measurement errors in the data, and (ii) self-selection of individuals in the database. Both problems can be addressed in statistical terms, but gathering new information is necessary to make the corrections. All this is analyzed in a static setup. That is, time is not playing a role so far. However, as the variables, xi, evolved over time, t, then R0 will change as well. This can be represented as,

Equation (2) implies that the basic reproduction number can evolve over time as the variables do so, even if we assume time homogeneity for the coefficient parameters λi. Hence, the exercise of estimating R0 is not trivial.

The estimation of any parameter to input in a mathematical model is beset with the same level of complexity. How simple or complicated these estimations are, will depend upon the availability of data and/or the knowledge about the phenomenon itself.

The previous discussion is directed to highlight the importance of understanding the nature of the parameters entering into a model that is used to predict or forecast a given variable or a set of them. What parameters need to be known depends upon the underlying assumptions of the model. Usually, as the level of complexity increases, so does the number of parameters to be known. Greater complexity in the model is often associated with some gains in representing reality at the cost of needing more information (knowing more parameters)[7]. Whether the model should be large or small depends upon the situation. We need to consider that using a large model with unprecise parameter values could cause more harm than good, which leads me to the next section.

All models are wrong, but some are useful

The title of this section is attributed to the statistician George Box, who expressed the idea that a model, even complex, is a simplification of reality. Nonetheless, some models can be very helpful in understanding a phenomenon, or to forecast a variable. Economists have had to tackle the problem of building useful and applicable models for over a century. In Turnovsky (2011)[8] we find a piece of advice provided by Nobel Laureate Robert Solow on how to do successful and useful models, summarized by the following three ideas:

  1. Make it simple.
  2. Do it right.
  3. Make it plausible.

Underlying this suggestion is the idea that models should have the just right level of complexity, meaning that models should not be simpler than necessary, but also not more complex than needed. Achieving this balance is, of course, very complicated. However, a rigorous analysis of the problem being addressed should shed light on the assumption to be made and the parameter values that are available. The paper by Córdova-Lepe et al. (2020) is a good example of this. They build a model making several assumptions that are plausible and use a model that is simple enough to be tractable and complex enough to provide helpful insight. That is the just right level of complexity.

COVID-19 and the collapse of the healthcare system

Continuing with the discussion of the Córdova-Lepe et al. (2020) paper, they study the minimum daily effort such that the healthcare system may not collapse during the COVID-19 outbreak. In their model, assumptions are clearly stated, and sensitivity analysis is performed to analyze the overall impact of the different parameters. They acknowledge that a parameter that needs to be estimated is the daily effort to reduce contagion. Nonetheless, small changes of this parameter are quite relevant. With aid of numerical simulations, they achieve this qualitative finding. Stating dates for the collapse of the healthcare system without observing precise parameter values for the COVID-19 phenomenon is nearly impossible at this stage, even with a simple model that requires little information. Small models like this one can be extremely helpful to highlight that some actions are crucial, and at the same time, small differences can make a huge difference. Specifically, they find that to curb the epidemic of this respiratory disease, small actions such as isolation and social distancing could make the difference between the healthcare system collapsing or not.[9] They also point out that these measures may have undesirable economic impacts, which is not modeled in their paper because it is not their focus. It goes without saying that the economy is a relevant aspect for policymakers.[10]

Concluding remarks

Understanding the limitations of models is critical to provide helpful information to decision-makers and the general public. When studying mathematical models, more effort should be put into understanding the impact of the underlying assumptions on the results or predictions. Similarly, a more considerable effort should be exerted in analyzing the sensitivity of the model to different parameter values. Furthermore, the numeric ranges chosen should be transparently justified providing all available sources. The criteria above are recommended standards to improve the credibility of our analyses by other modelers, planners, and policymakers. Once a large-scale outbreak of an infectious disease happens, there is not much time to build models or estimate parameters. Therefore, having contingency plans based on different scenarios and models is vital to overcome a health crisis successfully.

Notes

Acknowledgements
I thank Marcela Espinoza (hematologist) from Clínica Dávila in Santiago, Amy Lastuka (Ph.D.) from the Center for Sustainable Energy in San Diego, CA, United States and Vivienne Bachelet (MD) professor at the School of Medicine, Universidad de Santiago de Chile, for their constructive suggestions.

Competing interests
None declared.

Licencia Creative Commons Esta obra de Medwave está bajo una licencia Creative Commons Atribución-NoComercial 3.0 Unported. Esta licencia permite el uso, distribución y reproducción del artículo en cualquier medio, siempre y cuando se otorgue el crédito correspondiente al autor del artículo y al medio en que se publica, en este caso, Medwave.

 

Este breve documento se centra en el papel de los modelos matemáticos para analizar el impacto de las pandemias en los recursos de salud y las diferentes trade-off que pueden estar presente. Existe una gran cantidad de literatura que sugiere que los modelos matemáticos pueden ser útiles para estimar cuánto equipo e infraestructura adicionales pueden ser necesarios para mitigar un aumento en la demanda de servicios de salud durante un brote a gran escala de una enfermedad infecciosa. Comento sobre el papel crucial de estos modelos con un enfoque especial en sus fortalezas y limitaciones.

Author: Jorge Rojas-Vallejos[1]

Affiliation:
[1] Facultad de Economia y Negocios, Universidad Andres Bello, Santiago, Chile

E-mail: jorge.rojas.v@unab.cl

Author address:
[1] School of Economics and Business
Universidad Andrés Bello
Fernández Concha 700, Las Condes
Santiago, Chile

Citation: Rojas-Vallejos J. Strengths and limitations of mathematical models in pandemics—the case of COVID-19 in Chile. Medwave 2020;20(3):e7874 doi: 10.5867/medwave.2020.03.7874

Submission date: 2/4/2020

Acceptance date: 3/4/2020

Publication date: 8/4/2020

Origin: Invited commentary

Type of review: Not externally peer-reviewed


 

Errata

1. Citation is corrected in the introduction | Link |

Comments (0)

We are pleased to have your comment on one of our articles. Your comment will be published as soon as it is posted. However, Medwave reserves the right to remove it later if the editors consider your comment to be: offensive in some sense, irrelevant, trivial, contains grammatical mistakes, contains political harangues, appears to be advertising, contains data from a particular person or suggests the need for changes in practice in terms of diagnostic, preventive or therapeutic interventions, if that evidence has not previously been published in a peer-reviewed journal.

No comments on this article.


To comment please log in

Medwave provides HTML and PDF download counts as well as other harvested interaction metrics.

There may be a 48-hour delay for most recent metrics to be posted.

  1. Gutiérrez-Aguilar R, Córdova-Lepe F, Muñoz-Quezada MT, Gutiérrez-Jara JP. Model for a threshold of daily rate reduction of COVID-19 cases to avoid hospital collapse in Chile. Medwave 2020;20(2):e7871 | CrossRef |
  2. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020 Feb 20;382(8):727-733. | CrossRef | PubMed |
  3. Johns Hopkins University. Coronavirus Resource Center. COVID-19 Data Center. 2020. [On line]. | Link |
  4. Lipsitch M, Swerdlow DL, Finelli L. Defining the Epidemiology of Covid-19 - Studies Needed. N Engl J Med. 2020 Mar 26;382(13):1194-1196. | CrossRef | PubMed |
  5. Anderson RM, Heesterbeek H, Klinkenberg D, Hollingsworth TD. How will country-based mitigation measures influence the course of the COVID-19 epidemic? Lancet. 2020 Mar 21;395(10228):931-934. | CrossRef | PubMed |
  6. Remuzzi A, Remuzzi G. COVID-19 and Italy: what next? Lancet. 2020 Mar 13. | CrossRef | PubMed |
  7. Domowitz I, White H. Misspecified models with dependent observations. Journal of Econometrics. 1982;20(1):35-58. | CrossRef |
  8. Turnovsky SJ. On the role of small models in macrodynamics. Journal of Economic Dynamics and Control. 2011;35(9):1605-1613.
  9. Wilder-Smith A, Freedman DO. Isolation, quarantine, social distancing and community containment: pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak. J Travel Med. 2020 Mar 13;27(2). | CrossRef | PubMed |
  10. Moghadas SM, Pizzi NJ, Wu J, Yan P. Managing public health crises: the role of models in pandemic preparedness. Influenza Other Respir Viruses. 2009 Mar;3(2):75-9. | CrossRef | PubMed |
Gutiérrez-Aguilar R, Córdova-Lepe F, Muñoz-Quezada MT, Gutiérrez-Jara JP. Model for a threshold of daily rate reduction of COVID-19 cases to avoid hospital collapse in Chile. Medwave 2020;20(2):e7871 | CrossRef |

Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020 Feb 20;382(8):727-733. | CrossRef | PubMed |

Johns Hopkins University. Coronavirus Resource Center. COVID-19 Data Center. 2020. [On line]. | Link |

Lipsitch M, Swerdlow DL, Finelli L. Defining the Epidemiology of Covid-19 - Studies Needed. N Engl J Med. 2020 Mar 26;382(13):1194-1196. | CrossRef | PubMed |

Anderson RM, Heesterbeek H, Klinkenberg D, Hollingsworth TD. How will country-based mitigation measures influence the course of the COVID-19 epidemic? Lancet. 2020 Mar 21;395(10228):931-934. | CrossRef | PubMed |

Remuzzi A, Remuzzi G. COVID-19 and Italy: what next? Lancet. 2020 Mar 13. | CrossRef | PubMed |

Domowitz I, White H. Misspecified models with dependent observations. Journal of Econometrics. 1982;20(1):35-58. | CrossRef |

Turnovsky SJ. On the role of small models in macrodynamics. Journal of Economic Dynamics and Control. 2011;35(9):1605-1613.

Wilder-Smith A, Freedman DO. Isolation, quarantine, social distancing and community containment: pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak. J Travel Med. 2020 Mar 13;27(2). | CrossRef | PubMed |

Moghadas SM, Pizzi NJ, Wu J, Yan P. Managing public health crises: the role of models in pandemic preparedness. Influenza Other Respir Viruses. 2009 Mar;3(2):75-9. | CrossRef | PubMed |

Model for a threshold of daily rate reduction of COVID-19 cases to avoid hospital collapse in Chile
Rodrigo Gutiérrez-Aguilar, Fernando Córdova-Lepe, María Teresa Muñoz-Quezada, Juan Pablo Gutiérrez-Jara (Chile)
Medwave 2020;20(3):e7871