Last data update: Apr 18, 2025. (Total: 49119 publications since 2009)
Records 1-30 (of 132 Records) |
Query Trace: Johansson M[original query] |
---|
Why the growth of arboviral diseases necessitates a new generation of global risk maps and future projections
Brady OJ , Bastos LS , Caldwell JM , Cauchemez S , Clapham HE , Dorigatti I , Gaythorpe KAM , Hu W , Hussain-Alkhateeb L , Johansson MA , Lim A , Lopez VK , Maude RJ , Messina JP , Mordecai EA , Peterson AT , Rodriquez-Barraquer I , Rabe IB , Rojas DP , Ryan SJ , Salje H , Semenza JC , Tran QM . PLoS Comput Biol 2025 21 (4) e1012771 ![]() Global risk maps are an important tool for assessing the global threat of mosquito and tick-transmitted arboviral diseases. Public health officials increasingly rely on risk maps to understand the drivers of transmission, forecast spread, identify gaps in surveillance, estimate disease burden, and target and evaluate the impact of interventions. Here, we describe how current approaches to mapping arboviral diseases have become unnecessarily siloed, ignoring the strengths and weaknesses of different data types and methods. This places limits on data and model output comparability, uncertainty estimation and generalisation that limit the answers they can provide to some of the most pressing questions in arbovirus control. We argue for a new generation of risk mapping models that jointly infer risk from multiple data types. We outline how this can be achieved conceptually and show how this new framework creates opportunities to better integrate epidemiological understanding and uncertainty quantification. We advocate for more co-development of risk maps among modellers and end-users to better enable risk maps to inform public health decisions. Prospective validation of risk maps for specific applications can inform further targeted data collection and subsequent model refinement in an iterative manner. If the expanding use of arbovirus risk maps for control is to continue, methods must develop and adapt to changing questions, interventions and data availability. |
Revisiting the relationship between weather and interannual variation in human plague cases in the Southwestern United States
Holcomb KM , Biggerstaff BJ , Johansson MA , Mead PS , Kugeler KJ , Eisen RJ . Am J Trop Med Hyg 2025 Plague is a rare, potentially fatal flea-borne zoonosis endemic in the western United States. A previous model described interannual variation in human cases based on temperature and lagged precipitation. We recreated this model in northeastern Arizona (1960-1997) to evaluate its capacity to predict recent cases (1998-2022). In recreating the original model, we found that future instead of concurrent temperature had inadvertently been used for the presented fit. Prediction from our revised models with lagged precipitation and temporally plausible temperature relationships aligned with low observed cases in 1998-2022. Elevated precipitation associated with high cases in historical data (>6 inches combined precipitation over two previous springs) was only observed once in the last quarter century, so we could not assess if these conditions were reliably associated with elevated (four or more) human plague cases. Observed weather conditions were similar to those previously associated with low (fewer than or equal to two) case counts, suggesting "baseline" conditions in the last quarter century. |
Pediatric rash illness outbreak with initial positive measles immunoglobulin M antibody test results - American Samoa, March-July 2023
Stefanos R , Schatzman S , Wakeman B , Raines K , Radhakrishnan L , Filardo TD , Crooke SN , Bankamp B , Beard RS , Ng TFF , Marine RL , Tong S , Konrote A , Johansson AM , Ilimaleota AF , Nua MT , Kemble SK , Desmond E , Rota PA , Routh JA , Hancock WT , Sugerman DE , Anesi MS . MMWR Morb Mortal Wkly Rep 2024 73 (45) 1030-1035 On April 24, 2023, the American Samoa Department of Health (ASDoH) declared a public health emergency amid concern about a possible measles outbreak given low 2-dose vaccination coverage at the time. ASDoH had received two positive measles immunoglobulin (Ig) M test results after Flag Day festivities 1 week earlier from vaccinated children. ASDoH performed active case finding, took actions to mitigate transmission, and requested technical assistance from CDC. ASDoH implemented a vaccination campaign to improve suboptimal coverage. Confirmatory molecular testing of specimens from these initial persons under investigation (PUIs) was not possible, but subsequent testing of specimens from additional PUIs by Hawaii State Laboratories Division and CDC ruled out measles. In settings with low measles prevalence, measles antibody testing results have low positive predictive value and can lead to difficulties with interpreting results. Testing for additional pathogens revealed a variety of viruses known to cause common childhood viral exanthems. Both molecular and serologic testing should be performed for all suspected measles cases. To decrease the probability of false-positive IgM results, testing should be reserved for cases that meet the Council of State and Territorial Epidemiologists measles case definition, especially those in persons with no evidence of immunity and with a history of recent international travel. In addition, maintaining high measles vaccination coverage can prevent future outbreaks. |
Leptospirosis outbreak in aftermath of Hurricane Fiona - Puerto Rico, 2022
Jones FK , Medina AG , Ryff KR , Irizarry-Ramos J , Wong JM , O'Neill E , Rodríguez IA , Cardona I , Hernández L , Hernandez-Romieu AC , Phillips MT , Johansson MA , Bayleyegn T , Atherstone C , DeBord KR , Negrón ME , Galloway R , Adams LE , Marzán-Rodríguez M . MMWR Morb Mortal Wkly Rep 2024 73 (35) 763-768 Leptospirosis, an acute bacterial zoonotic disease, is endemic in Puerto Rico. Infection in approximately 10%-15% of patients with clinical disease progresses to severe, potentially fatal illness. Increased incidence has been associated with flooding in endemic areas around the world. In 2022, Hurricane Fiona, a Category 1 hurricane, made landfall and inundated Puerto Rico with heavy rainfall and severe flooding, increasing the risk for a leptospirosis outbreak. In response, the Puerto Rico Department of Health (PRDH) changed guidelines to make leptospirosis cases reportable within 24 hours, centralized the case investigation management system, and provided training and messaging to health care providers. To evaluate changes in risk for leptospirosis after Hurricane Fiona to that before the storm, the increase in cases was quantified, and patient characteristics and geographic distribution were compared. During the 15 weeks after Hurricane Fiona, 156 patients experienced signs and symptoms of leptospirosis and had a specimen with a positive laboratory result reported to PRDH. The mean weekly number of cases during this period was 10.4, which is 3.6 as high as the weekly number of cases during the previous 37 weeks (2.9). After Hurricane Fiona, the proportion of cases indicating exposure to potentially contaminated water increased from 11% to 35%, and the number of persons receiving testing increased; these factors likely led to the resulting overall surge in reported cases. Robust surveillance combined with outreach to health care providers after flooding events can improve leptospirosis case identification, inform clinicians considering early initiation of treatment, and guide public messaging to avoid wading, swimming, or any contact with potentially contaminated floodwaters. |
Notes from the field: Prevalence of previous dengue virus infection among children and adolescents aged 7-16 years - American Samoa, September-October 2023
Kiplagat S , Tavale N , Konrote A , Johansson AM , Papu A , Perez-Padilla J , Jones FK , Desale H , Ilimaleota AF , Tulafono JM , Delorey M , Jones E , Chutaro E , Camacho J , Medina F , Tosado-Acevedo R , Munoz-Jordan JL , Paz-Bailey G , Adams LE , Nua MT , Wong JM , Anesi S . MMWR Morb Mortal Wkly Rep 2024 73 (31) 686-688 |
Infectious disease surveillance needs for the United States: lessons from Covid-19
Lipsitch M , Bassett MT , Brownstein JS , Elliott P , Eyre D , Grabowski MK , Hay JA , Johansson MA , Kissler SM , Larremore DB , Layden JE , Lessler J , Lynfield R , MacCannell D , Madoff LC , Metcalf CJE , Meyers LA , Ofori SK , Quinn C , Bento AI , Reich NG , Riley S , Rosenfeld R , Samore MH , Sampath R , Slayton RB , Swerdlow DL , Truelove S , Varma JK , Grad YH . Front Public Health 2024 12 1408193 ![]() ![]() The COVID-19 pandemic has highlighted the need to upgrade systems for infectious disease surveillance and forecasting and modeling of the spread of infection, both of which inform evidence-based public health guidance and policies. Here, we discuss requirements for an effective surveillance system to support decision making during a pandemic, drawing on the lessons of COVID-19 in the U.S., while looking to jurisdictions in the U.S. and beyond to learn lessons about the value of specific data types. In this report, we define the range of decisions for which surveillance data are required, the data elements needed to inform these decisions and to calibrate inputs and outputs of transmission-dynamic models, and the types of data needed to inform decisions by state, territorial, local, and tribal health authorities. We define actions needed to ensure that such data will be available and consider the contribution of such efforts to improving health equity. |
Challenges of COVID-19 case forecasting in the US, 2020-2021
Lopez VK , Cramer EY , Pagano R , Drake JM , O'Dea EB , Adee M , Ayer T , Chhatwal J , Dalgic OO , Ladd MA , Linas BP , Mueller PP , Xiao J , Bracher J , Castro Rivadeneira AJ , Gerding A , Gneiting T , Huang Y , Jayawardena D , Kanji AH , Le K , Mühlemann A , Niemi J , Ray EL , Stark A , Wang Y , Wattanachit N , Zorn MW , Pei S , Shaman J , Yamana TK , Tarasewicz SR , Wilson DJ , Baccam S , Gurung H , Stage S , Suchoski B , Gao L , Gu Z , Kim M , Li X , Wang G , Wang L , Wang Y , Yu S , Gardner L , Jindal S , Marshall M , Nixon K , Dent J , Hill AL , Kaminsky J , Lee EC , Lemaitre JC , Lessler J , Smith CP , Truelove S , Kinsey M , Mullany LC , Rainwater-Lovett K , Shin L , Tallaksen K , Wilson S , Karlen D , Castro L , Fairchild G , Michaud I , Osthus D , Bian J , Cao W , Gao Z , Lavista Ferres J , Li C , Liu TY , Xie X , Zhang S , Zheng S , Chinazzi M , Davis JT , Mu K , Pastore YPiontti A , Vespignani A , Xiong X , Walraven R , Chen J , Gu Q , Wang L , Xu P , Zhang W , Zou D , Gibson GC , Sheldon D , Srivastava A , Adiga A , Hurt B , Kaur G , Lewis B , Marathe M , Peddireddy AS , Porebski P , Venkatramanan S , Wang L , Prasad PV , Walker JW , Webber AE , Slayton RB , Biggerstaff M , Reich NG , Johansson MA . PLoS Comput Biol 2024 20 (5) e1011200 During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020 to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to inform pandemic-related decision making. |
Age-specific case data reveal varying dengue transmission intensity in US states and territories
Kada S , Paz-Bailey G , Adams LE , Johansson MA . PLoS Negl Trop Dis 2024 18 (3) e0011143 Dengue viruses (DENV) are endemic in the US territories of Puerto Rico, American Samoa, and the US Virgin Islands, with focal outbreaks also reported in the states of Florida and Hawaii. However, little is known about the intensity of dengue virus transmission over time and how dengue viruses have shaped the level of immunity in these populations, despite the importance of understanding how and why levels of immunity against dengue may change over time. These changes need to be considered when responding to future outbreaks and enacting dengue management strategies, such as guiding vaccine deployment. We used catalytic models fitted to case surveillance data stratified by age from the ArboNET national arboviral surveillance system to reconstruct the history of recent dengue virus transmission in Puerto Rico, American Samoa, US Virgin Islands, Florida, Hawaii, and Guam. We estimated average annual transmission intensity (i.e., force of infection) of DENV between 2010 and 2019 and the level of seroprevalence by age group in each population. We compared models and found that assuming all reported cases are secondary infections generally fit the surveillance data better than assuming all cases are primary infections. Using the secondary case model, we found that force of infection was highly heterogeneous between jurisdictions and over time within jurisdictions, ranging from 0.00003 (95% CrI: 0.00002-0.0004) in Florida to 0.08 (95% CrI: 0.044-0.14) in American Samoa during the 2010-2019 period. For early 2020, we estimated that seropositivity in 10 year-olds ranged from 0.09% (0.02%-0.54%) in Florida to 56.3% (43.7%-69.3%) in American Samoa. In the absence of serological data, age-specific case notification data collected through routine surveillance combined with mathematical modeling are powerful tools to monitor arbovirus circulation, estimate the level of population immunity, and design dengue management strategies. |
Introduction and spread of Dengue virus 3, Florida, USA, May 2022-April 2023
Jones FK , Morrison AM , Santiago GA , Rysava K , Zimler RA , Heberlein LA , Kopp E , Saunders KE , Baudin S , Rico E , Mejía-Echeverri Á , Taylor-Salmon E , Hill V , Breban MI , Vogels CBF , Grubaugh ND , Paul LM , Michael SF , Johansson MA , Adams LE , Munoz-Jordan J , Paz-Bailey G , Stanek DR . Emerg Infect Dis 2024 30 (2) 376-379 ![]() ![]() During May 2022-April 2023, dengue virus serotype 3 was identified among 601 travel-associated and 61 locally acquired dengue cases in Florida, USA. All 203 sequenced genomes belonged to the same genotype III lineage and revealed potential transmission chains in which most locally acquired cases occurred shortly after introduction, with little sustained transmission. |
Quantifying the relationship between arboviral infection prevalence and human mobility patterns among participants of the Communities Organized to Prevent Arboviruses cohort (COPA) in southern Puerto Rico
Phillips MT , Sánchez-González L , Shragai T , Rodriguez DM , Major CG , Johansson MA , Rivera-Amill V , Paz-Bailey G , Adams LE . PLoS Negl Trop Dis 2023 17 (12) e0011840 Human movement is increasingly being recognized as a major driver of arbovirus risk and dissemination. The Communities Organized to Prevent Arboviruses (COPA) study is a cohort in southern Puerto Rico to measure arboviral prevalence, evaluate interventions, and collect mobility data. To quantify the relationship between arboviral prevalence and human mobility patterns, we fit multilevel logistic regression models to estimate odds ratios for mobility-related predictors of positive chikungunya IgG or Zika IgM test results collected from COPA, assuming mobility data does not change substantially from year to year. From May 8, 2018-June 8, 2019, 39% of the 1,845 active participants during the study period had a positive arboviral seroprevalence result. Most (74%) participants reported spending five or more weekly hours outside of their home. A 1% increase in weekly hours spent outside the home was associated with a 4% (95% confidence interval (CI): 2-7%) decrease in the odds of testing positive for arbovirus. After adjusting for age and whether a person had air conditioning (AC) at home, any time spent in a work location was protective against arbovirus infection (32% decrease, CI: 9-49%). In fact, there was a general decreased prevalence for individuals who visited locations that were inside and had AC or screens, regardless of the type of location (32% decrease, CI: 12-47%). In this population, the protective characteristics of locations visited appear to be the most important driver of the relationship between mobility and arboviral prevalence. This relationship indicates that not all mobility is the same, with elements like screens and AC providing protection in some locations. These findings highlight the general importance of AC and screens, which are known to be protective against mosquitoes and mosquito-transmitted diseases. |
Evaluation of the US COVID-19 Scenario Modeling Hub for informing pandemic response under uncertainty
Howerton E , Contamin L , Mullany LC , Qin M , Reich NG , Bents S , Borchering RK , Jung SM , Loo SL , Smith CP , Levander J , Kerr J , Espino J , van Panhuis WG , Hochheiser H , Galanti M , Yamana T , Pei S , Shaman J , Rainwater-Lovett K , Kinsey M , Tallaksen K , Wilson S , Shin L , Lemaitre JC , Kaminsky J , Hulse JD , Lee EC , McKee CD , Hill A , Karlen D , Chinazzi M , Davis JT , Mu K , Xiong X , Pastore YPiontti A , Vespignani A , Rosenstrom ET , Ivy JS , Mayorga ME , Swann JL , España G , Cavany S , Moore S , Perkins A , Hladish T , Pillai A , Ben Toh K , Longini I Jr , Chen S , Paul R , Janies D , Thill JC , Bouchnita A , Bi K , Lachmann M , Fox SJ , Meyers LA , Srivastava A , Porebski P , Venkatramanan S , Adiga A , Lewis B , Klahn B , Outten J , Hurt B , Chen J , Mortveit H , Wilson A , Marathe M , Hoops S , Bhattacharya P , Machi D , Cadwell BL , Healy JM , Slayton RB , Johansson MA , Biggerstaff M , Truelove S , Runge MC , Shea K , Viboud C , Lessler J . Nat Commun 2023 14 (1) 7260 ![]() Our ability to forecast epidemics far into the future is constrained by the many complexities of disease systems. Realistic longer-term projections may, however, be possible under well-defined scenarios that specify the future state of critical epidemic drivers. Since December 2020, the U.S. COVID-19 Scenario Modeling Hub (SMH) has convened multiple modeling teams to make months ahead projections of SARS-CoV-2 burden, totaling nearly 1.8 million national and state-level projections. Here, we find SMH performance varied widely as a function of both scenario validity and model calibration. We show scenarios remained close to reality for 22 weeks on average before the arrival of unanticipated SARS-CoV-2 variants invalidated key assumptions. An ensemble of participating models that preserved variation between models (using the linear opinion pool method) was consistently more reliable than any single model in periods of valid scenario assumptions, while projection interval coverage was near target levels. SMH projections were used to guide pandemic response, illustrating the value of collaborative hubs for longer-term scenario projections. |
Multi-model prediction of West Nile virus neuroinvasive disease with machine learning for identification of important regional climatic drivers
Holcomb KM , Staples JE , Nett RJ , Beard CB , Petersen LR , Benjamin SG , Green BW , Jones H , Johansson MA . Geohealth 2023 7 (11) e2023GH000906 ![]() West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental United States (CONUS). Spatial heterogeneity in historical incidence, environmental factors, and complex ecology make prediction of spatiotemporal variation in WNV transmission challenging. Machine learning provides promising tools for identification of important variables in such situations. To predict annual WNV neuroinvasive disease (WNND) cases in CONUS (2015-2021), we fitted 10 probabilistic models with variation in complexity from naïve to machine learning algorithm and an ensemble. We made predictions in each of nine climate regions on a hexagonal grid and evaluated each model's predictive accuracy. Using the machine learning models (random forest and neural network), we identified the relative importance and variation in ranking of predictors (historical WNND cases, climate anomalies, human demographics, and land use) across regions. We found that historical WNND cases and population density were among the most important factors while anomalies in temperature and precipitation often had relatively low importance. While the relative performance of each model varied across climatic regions, the magnitude of difference between models was small. All models except the naïve model had non-significant differences in performance relative to the baseline model (negative binomial model fit per hexagon). No model, including the ensemble or more complex machine learning models, outperformed models based on historical case counts on the hexagon or region level; these models are good forecasting benchmarks. Further work is needed to assess if predictive capacity can be improved beyond that of these historical baselines. |
A systematic review of the data, methods and environmental covariates used to map Aedes-borne arbovirus transmission risk
Lim AY , Jafari Y , Caldwell JM , Clapham HE , Gaythorpe KAM , Hussain-Alkhateeb L , Johansson MA , Kraemer MUG , Maude RJ , McCormack CP , Messina JP , Mordecai EA , Rabe IB , Reiner RC Jr , Ryan SJ , Salje H , Semenza JC , Rojas DP , Brady OJ . BMC Infect Dis 2023 23 (1) 708 ![]() BACKGROUND: Aedes (Stegomyia)-borne diseases are an expanding global threat, but gaps in surveillance make comprehensive and comparable risk assessments challenging. Geostatistical models combine data from multiple locations and use links with environmental and socioeconomic factors to make predictive risk maps. Here we systematically review past approaches to map risk for different Aedes-borne arboviruses from local to global scales, identifying differences and similarities in the data types, covariates, and modelling approaches used. METHODS: We searched on-line databases for predictive risk mapping studies for dengue, Zika, chikungunya, and yellow fever with no geographical or date restrictions. We included studies that needed to parameterise or fit their model to real-world epidemiological data and make predictions to new spatial locations of some measure of population-level risk of viral transmission (e.g. incidence, occurrence, suitability, etc.). RESULTS: We found a growing number of arbovirus risk mapping studies across all endemic regions and arboviral diseases, with a total of 176 papers published 2002-2022 with the largest increases shortly following major epidemics. Three dominant use cases emerged: (i) global maps to identify limits of transmission, estimate burden and assess impacts of future global change, (ii) regional models used to predict the spread of major epidemics between countries and (iii) national and sub-national models that use local datasets to better understand transmission dynamics to improve outbreak detection and response. Temperature and rainfall were the most popular choice of covariates (included in 50% and 40% of studies respectively) but variables such as human mobility are increasingly being included. Surprisingly, few studies (22%, 31/144) robustly tested combinations of covariates from different domains (e.g. climatic, sociodemographic, ecological, etc.) and only 49% of studies assessed predictive performance via out-of-sample validation procedures. CONCLUSIONS: Here we show that approaches to map risk for different arboviruses have diversified in response to changing use cases, epidemiology and data availability. We identify key differences in mapping approaches between different arboviral diseases, discuss future research needs and outline specific recommendations for future arbovirus mapping. |
Public health impact of the U.S. Scenario Modeling Hub
Borchering RK , Healy JM , Cadwell BL , Johansson MA , Slayton RB , Wallace M , Biggerstaff M . Epidemics 2023 44 100705 ![]() ![]() Beginning in December 2020, the COVID-19 Scenario Modeling Hub has provided quantitative scenario-based projections for cases, hospitalizations, and deaths, aggregated across up to nine modeling groups. Projections spanned multiple months into the future and provided timely information on potential impacts of epidemiological uncertainties and interventions. Projections results were shared with the public, public health partners, and the Centers for Disease Control COVID-19 Response Team. The projections provided insights on situational awareness and informed decision-making to mitigate COVID-19 disease burden (e.g., vaccination strategies). By aggregating projections from multiple modeling teams, the Scenario Modeling Hub provided rapidly synthesized information in times of great uncertainty and conveyed possible trajectories in the presence of emerging variants. Here we detail several use cases of these projections in public health practice and communication, including assessments of whether modeling results directly or indirectly informed public health communication or guidance. These include multiple examples where comparisons of projected COVID-19 disease outcomes under different vaccination scenarios were used to inform Advisory Committee for Immunization Practices recommendations. We also describe challenges and lessons learned during this highly beneficial collaboration. |
Trade-offs between individual and ensemble forecasts of an emerging infectious disease (preprint)
Oidtman RJ , Omodei E , Kraemer MUG , Castañeda-Orjuela CA , Cruz-Rivera E , Misnaza-Castrillón S , Cifuentes MP , Rincon LE , Cañon V , Alarcon P , España G , Huber JH , Hill SC , Barker CM , Johansson MA , Manore CA , Reiner RC Jr , Rodriguez-Barraquer I , Siraj AS , Frias-Martinez E , García-Herranz M , Perkins TA . medRxiv 2021 2021.02.25.21252363 When new pathogens emerge, numerous questions arise about their future spread, some of which can be addressed with probabilistic forecasts. The many uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among model structures and assumptions, however. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance of a suite of 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about the role of human mobility in driving transmission, spatiotemporal variation in transmission potential, and the number of times the virus was introduced. All models used the same core transmission model and the same iterative data assimilation algorithm to generate forecasts. By assessing forecast performance through time using logarithmic scoring with ensemble weighting, we found that which model assumptions had the most ensemble weight changed through time. In particular, spatially coupled models had higher ensemble weights in the early and late phases of the epidemic, whereas non-spatial models had higher ensemble weights at the peak of the epidemic. We compared forecast performance of the equally-weighted ensemble model to each individual model and identified a trade-off whereby certain individual models outperformed the ensemble model early in the epidemic but the ensemble model outperformed all individual models on average. On balance, our results suggest that suites of models that span uncertainty across alternative assumptions are necessary to obtain robust forecasts in the context of emerging infectious diseases.Competing Interest StatementThe authors have declared no competing interest.Funding StatementRJO acknowledges support from an Eck Institute for Global Health Fellowship, GLOBES grant, Arthur J. Schmitt Fellowship, and the UNICEF Office of Innovation. MUGK is supported by The Branco Weiss Fellowship - Society in Science, administered by the ETH Zurich and acknowledges funding from the Oxford Martin School and the European Union Horizon 2020 project MOOD (\#874850). SCH is supported by the Wellcome Trust (220414/Z/20/Z).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:No IRB approvals were necessary.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe mobile phone data set used in this study is proprietary and subject to strict privacy regulations. The access to this data set was granted after reaching a non-disclosure agreement with the proprietor, who anonymized and aggregated the original data before giving access to the authors. The mobile phone is available on request after negotiation of a non-disclosure agreement with the company. The contact person is Enrique Frias-Martinez (efm{at}tid.es). Epidemiological, meteorological, and demographic data are available from Siraj et al.2018 and additionally available on https://github.com/roidtman/eid_ensemble_forecasting. https://www.github.com/roidtman/eid_ensemble_forecasting |
The United States COVID-19 Forecast Hub dataset (preprint)
Cramer EY , Huang Y , Wang Y , Ray EL , Cornell M , Bracher J , Brennen A , Rivadeneira AJC , Gerding A , House K , Jayawardena D , Kanji AH , Khandelwal A , Le K , Mody V , Mody V , Niemi J , Stark A , Shah A , Wattanchit N , Zorn MW , Reich NG , US COVID-19 Forecast Hub Consortium , Lopez VK , Walker JW , Slayton RB , Johansson MA , Biggerstaff M . medRxiv 2021 2021.11.04.21265886 ![]() Academic researchers, government agencies, industry groups, and individuals have produced forecasts at an unprecedented scale during the COVID-19 pandemic. To leverage these forecasts, the United States Centers for Disease Control and Prevention (CDC) partnered with an academic research lab at the University of Massachusetts Amherst to create the US COVID-19 Forecast Hub. Launched in April 2020, the Forecast Hub is a dataset with point and probabilistic forecasts of incident hospitalizations, incident cases, incident deaths, and cumulative deaths due to COVID-19 at national, state, and county levels in the United States. Included forecasts represent a variety of modeling approaches, data sources, and assumptions regarding the spread of COVID-19. The goal of this dataset is to establish a standardized and comparable set of short-term forecasts from modeling teams. These data can be used to develop ensemble models, communicate forecasts to the public, create visualizations, compare models, and inform policies regarding COVID-19 mitigation. These open-source data are available via download from GitHub, through an online API, and through R packages.Competing Interest StatementAV, MC, and APP report grants from Metabiota Inc outside the submitted work. Funding StatementFor teams that reported receiving funding for their work, we report the sources and disclosures below: AIpert-pwllnod: Natural Sciences and Engineering Research Council of Canada; Caltech-CS156: Gary Clinard Innovation Fund; CEID-Walk: University of Georgia; CMU-TimeSeries: CDC Center of Excellence, gifts from Google and Facebook; COVIDhub: This work has been supported by the US Centers for Disease Control and Prevention (1U01IP001122) and the National Institutes of General Medical Sciences (R35GM119582). The content is solely the responsibility of the authors and does not necessarily represent the official views of CDC, NIGMS or the National Institutes of Health; Johannes Bracher was supported by the Helmholtz Foundation via the SIMCARD Information & Data Science Pilot Project; Tilmann Gneiting gratefully acknowledges support by the Klaus Tschira Foundation; CU-select: NSF DMS-2027369 and a gift from the Morris-Singer Foundation; DDS-NBDS: NSF III-1812699; epiforecasts-ensemble1: Wellcome Trust (210758/Z/18/Z) FDANIHASU: supported by the Intramural Research Program of the NIH/NIDDK; GT_CHHS-COVID19: William W. George Endowment, Virginia C. and Joseph C. Mello Endowment, NSF DGE-1650044, NSF MRI 1828187, research cyberinfrastructure resources and services provided by the Partnership for an Advanced Computing Environment (PACE) at Georgia Tech, and the following benefactors at Georgia Tech: Andrea Laliberte, Joseph C. Mello, Richard Rick E. & Charlene Zalesky, and Claudia & Paul Raines, CDC MInD-Healthcare U01CK000531-Supplement; IHME: This work was supported by the Bill & Melinda Gates Foundation, as well as funding from the state of Washington and the National Science Foundation (award no. FAIN: 2031096); Imperial-ensemble1: SB acknowledges funding from the Wellcome Trust (219415); Institute of Business Forecasting: IBF; IowaStateLW-STEM: NSF DMS-1916204, Iowa State University Plant Sciences Institute Scholars Program, NSF DMS-1934884, Laurence H. Baker Center for Bioinformatics and Biological Statistics; IUPUI CIS: NSF; JHU_CSSE-DECOM: JHU CSSE: National Science Foundation (NSF) RAPID Real-time Forecasting of COVID-19 risk in the USA. 2021-2022. Award ID: 2108526. National Science Foundation (NSF) RAPID Development of an interactive web-based dashboard to track COVID-19 in real-time. 2020. Award ID: 2028604; JHU_IDD-CovidSP: State of California, US Dept of Health and Human Services, US Dept of Homeland Security, Johns Hopkins Health System, Office of the Dean at Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University Modeling and Policy Hub, Centers for Disease Control and Prevention (5U01CK000538-03), University of Utah Immunology, Inflammation, & Infectious Disease Initiative (26798 Seed Grant); JHU_UNC_GAS-StatMechP ol: NIH NIGMS: R01GM140564; JHUAPL-Bucky: US Dept of Health and Human Services; KITmetricslab-select_ensemble: Daniel Wolffram gratefully acknowledges support by the Klaus Tschira Foundation; LANL-GrowthRate: LANL LDRD 20200700ER; MIT-Cassandra: MIT Quest for Intelligence; MOBS-GLEAM_COVID: COVID Supplement CDC-HHS-6U01IP001137-01; CA NU38OT000297 from the Council of State and Territorial Epidemiologists (CSTE); NotreDame-FRED: NSF RAPID DEB 2027718; NotreDame-mobility: NSF RAPID DEB 2027718; PSI-DRAFT: NSF RAPID Grant # 2031536; QJHong-Encounter: NSF DMR-2001411 and DMR-1835939; SDSC_ISG-TrendModel: The development of the dashboard was partly funded by the Fondation Privee des Hopitaux Universitaires de Geneve; UA-EpiCovDA: NSF RAPID Grant # 2028401; UChicagoCHATTOPADHYAY-UnIT: Defense Advanced Research Projects Agency (DARPA) #HR00111890043/P00004 (I. Chattopadhyay, University of Chicago); UCSB-ACTS: NSF RAPID IIS 2029626; UCSD_NEU-DeepGLEAM: Google Faculty Award, W31P4Q-21-C-0014; UMass-MechBayes: NIGMS #R35GM119582, NSF #1749854, NIGMS #R35GM119582; UMich-RidgeTfReg: This project is funded by the University of Michigan Physics Department and the University of Michigan Office of Research; UVA-Ensemble: National Institutes of Health (NIH) Grant 1R01GM109718, NSF BIG DATA Grant IIS-1633028, NSF Grant No.: OAC-1916805, NSF Expeditions in Computing Grant CCF-1918656, CCF-1917819, NSF RAPID CNS-2028004, NSF RAPID OAC-2027541, US Centers for Disease Control and Prevention 75D30119C05935, a grant from Google, University of Virginia Strategic Investment Fund award number SIF160, Defense Threat Reduction Agency (DTRA) under Contract No. HDTRA1-19-D-0007, and Virginia Dept of Health Grant VDH-21-501-0141; Wadnwani_AI-BayesOpt: This study is made possible by the generous support of the American People through the United States Agency for International Development (USAID). The work described in this article was implemented under the TRACETB Project, managed by WIAI under the terms of Cooperative Agreement Number 72038620CA00006. The contents of this manuscript are the sole responsibility of the authors and do not necessarily reflect the views of USAID or the United States Government; WalmartLabsML-LogForecasting: Team acknowledges Walmart to support this study Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data produced are available online at https://github.com/reichlab/covid19-forecast-hub https://github.com/reichlab/covid19-forecast-hub |
Evaluation of individual and ensemble probabilistic forecasts of COVID-19 mortality in the US (preprint)
Cramer EY , Ray EL , Lopez VK , Bracher J , Brennen A , Castro Rivadeneira AJ , Gerding A , Gneiting T , House KH , Huang Y , Jayawardena D , Kanji AH , Khandelwal A , Le K , Mühlemann A , Niemi J , Shah A , Stark A , Wang Y , Wattanachit N , Zorn MW , Gu Y , Jain S , Bannur N , Deva A , Kulkarni M , Merugu S , Raval A , Shingi S , Tiwari A , White J , Abernethy NF , Woody S , Dahan M , Fox S , Gaither K , Lachmann M , Meyers LA , Scott JG , Tec M , Srivastava A , George GE , Cegan JC , Dettwiller ID , England WP , Farthing MW , Hunter RH , Lafferty B , Linkov I , Mayo ML , Parno MD , Rowland MA , Trump BD , Zhang-James Y , Chen S , Faraone SV , Hess J , Morley CP , Salekin A , Wang D , Corsetti SM , Baer TM , Eisenberg MC , Falb K , Huang Y , Martin ET , McCauley E , Myers RL , Schwarz T , Sheldon D , Gibson GC , Yu R , Gao L , Ma Y , Wu D , Yan X , Jin X , Wang YX , Chen Y , Guo L , Zhao Y , Gu Q , Chen J , Wang L , Xu P , Zhang W , Zou D , Biegel H , Lega J , McConnell S , Nagraj VP , Guertin SL , Hulme-Lowe C , Turner SD , Shi Y , Ban X , Walraven R , Hong QJ , Kong S , van de Walle A , Turtle JA , Ben-Nun M , Riley S , Riley P , Koyluoglu U , DesRoches D , Forli P , Hamory B , Kyriakides C , Leis H , Milliken J , Moloney M , Morgan J , Nirgudkar N , Ozcan G , Piwonka N , Ravi M , Schrader C , Shakhnovich E , Siegel D , Spatz R , Stiefeling C , Wilkinson B , Wong A , Cavany S , España G , Moore S , Oidtman R , Perkins A , Kraus D , Kraus A , Gao Z , Bian J , Cao W , Lavista Ferres J , Li C , Liu TY , Xie X , Zhang S , Zheng S , Vespignani A , Chinazzi M , Davis JT , Mu K , Pastore YPiontti A , Xiong X , Zheng A , Baek J , Farias V , Georgescu A , Levi R , Sinha D , Wilde J , Perakis G , Bennouna MA , Nze-Ndong D , Singhvi D , Spantidakis I , Thayaparan L , Tsiourvas A , Sarker A , Jadbabaie A , Shah D , Della Penna N , Celi LA , Sundar S , Wolfinger R , Osthus D , Castro L , Fairchild G , Michaud I , Karlen D , Kinsey M , Mullany LC , Rainwater-Lovett K , Shin L , Tallaksen K , Wilson S , Lee EC , Dent J , Grantz KH , Hill AL , Kaminsky J , Kaminsky K , Keegan LT , Lauer SA , Lemaitre JC , Lessler J , Meredith HR , Perez-Saez J , Shah S , Smith CP , Truelove SA , Wills J , Marshall M , Gardner L , Nixon K , Burant JC , Wang L , Gao L , Gu Z , Kim M , Li X , Wang G , Wang Y , Yu S , Reiner RC , Barber R , Gakidou E , Hay SI , Lim S , Murray C , Pigott D , Gurung HL , Baccam P , Stage SA , Suchoski BT , Prakash BA , Adhikari B , Cui J , Rodríguez A , Tabassum A , Xie J , Keskinocak P , Asplund J , Baxter A , Oruc BE , Serban N , Arik SO , Dusenberry M , Epshteyn A , Kanal E , Le LT , Li CL , Pfister T , Sava D , Sinha R , Tsai T , Yoder N , Yoon J , Zhang L , Abbott S , Bosse NI , Funk S , Hellewell J , Meakin SR , Sherratt K , Zhou M , Kalantari R , Yamana TK , Pei S , Shaman J , Li ML , Bertsimas D , Skali Lami O , Soni S , Tazi Bouardi H , Ayer T , Adee M , Chhatwal J , Dalgic OO , Ladd MA , Linas BP , Mueller P , Xiao J , Wang Y , Wang Q , Xie S , Zeng D , Green A , Bien J , Brooks L , Hu AJ , Jahja M , McDonald D , Narasimhan B , Politsch C , Rajanala S , Rumack A , Simon N , Tibshirani RJ , Tibshirani R , Ventura V , Wasserman L , O'Dea EB , Drake JM , Pagano R , Tran QT , Ho LST , Huynh H , Walker JW , Slayton RB , Johansson MA , Biggerstaff M , Reich NG . medRxiv 2021 2021.02.03.21250974 ![]() Short-term probabilistic forecasts of the trajectory of the COVID-19 pandemic in the United States have served as a visible and important communication channel between the scientific modeling community and both the general public and decision-makers. Forecasting models provide specific, quantitative, and evaluable predictions that inform short-term decisions such as healthcare staffing needs, school closures, and allocation of medical supplies. In 2020, the COVID-19 Forecast Hub (https://covid19forecasthub.org/) collected, disseminated, and synthesized hundreds of thousands of specific predictions from more than 50 different academic, industry, and independent research groups. This manuscript systematically evaluates 23 models that regularly submitted forecasts of reported weekly incident COVID-19 mortality counts in the US at the state and national level. One of these models was a multi-model ensemble that combined all available forecasts each week. The performance of individual models showed high variability across time, geospatial units, and forecast horizons. Half of the models evaluated showed better accuracy than a naïve baseline model. In combining the forecasts from all teams, the ensemble showed the best overall probabilistic accuracy of any model. Forecast accuracy degraded as models made predictions farther into the future, with probabilistic accuracy at a 20-week horizon more than 5 times worse than when predicting at a 1-week horizon. This project underscores the role that collaboration and active coordination between governmental public health agencies, academic modeling teams, and industry partners can play in developing modern modeling capabilities to support local, state, and federal response to outbreaks.Competing Interest StatementAV, MC, and APP report grants from Metabiota Inc outside the submitted work.Funding StatementFor teams that reported receiving funding for their work, we report the sources and disclosures below. CMU-TimeSeries: CDC Center of Excellence, gifts from Google and Facebook. CU-select: NSF DMS-2027369 and a gift from the Morris-Singer Foundation. COVIDhub: This work has been supported by the US Centers for Disease Control and Prevention (1U01IP001122) and the National Institutes of General Medical Sciences (R35GM119582). The content is solely the responsibility of the authors and does not necessarily represent the official views of CDC, NIGMS or the National Institutes of Health. Johannes Bracher was supported by the Helmholtz Foundation via the SIMCARD Information& Data Science Pilot Project. Tilmann Gneiting gratefully acknowledges support by the Klaus Tschira Foundation. DDS-NBDS: NSF III-1812699. EPIFORECASTS-ENSEMBLE1: Wellcome Trust (210758/Z/18/Z) GT_CHHS-COVID19: William W. George Endowment, Virginia C. and Joseph C. Mello Endowments, NSF DGE-1650044, NSF MRI 1828187, research cyberinfrastructure resources and services provided by the Partnership for an Advanced Computing Environment (PACE) at Georgia Tech, and the following benefactors at Georgia Tech: Andrea Laliberte, Joseph C. Mello, Richard Rick E. & Charlene Zalesky, and Claudia & Paul Raines GT-DeepCOVID: CDC MInD-Healthcare U01CK000531-Supplement. NSF (Expeditions CCF-1918770, CAREER IIS-2028586, RAPID IIS-2027862, Medium IIS-1955883, NRT DGE-1545362), CDC MInD program, ORNL and funds/computing resources from Georgia Tech and GTRI. IHME: This work was supported by the Bill & Melinda Gates Foundation, as well as funding from the state of Washington and the National Science Foundation (award no. FAIN: 2031096). IowaStateLW-STEM: Iowa State University Plant Sciences Institute Scholars Program, NSF DMS-1916204, NSF CCF-1934884, Laurence H. Baker Center for Bioinformatics and Biological Statistics. JHU_IDD-CovidSP: State of California, US Dept of Health and Human Services, US Dept of Homeland Security, US Office of Foreign Disaster Assistance, Johns Hopkins Health System, Office of the Dean at Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University Modeling and Policy Hub, Centers fo Disease Control and Prevention (5U01CK000538-03), University of Utah Immunology, Inflammation, & Infectious Disease Initiative (26798 Seed Grant). LANL-GrowthRate: LANL LDRD 20200700ER. MOBS-GLEAM_COVID: COVID Supplement CDC-HHS-6U01IP001137-01. NotreDame-mobility and NotreDame-FRED: NSF RAPID DEB 2027718 UA-EpiCovDA: NSF RAPID Grant # 2028401. UCSB-ACTS: NSF RAPID IIS 2029626. UCSD-NEU: Google Faculty Award, DARPA W31P4Q-21-C-0014, COVID Supplement CDC-HHS-6U01IP001137-01. UMass-MechBayes: NIGMS R35GM119582, NSF 1749854. UMich-RidgeTfReg: The University of Michigan Physics Department and the University of Michigan Office of Research.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:UMass-Amherst IRBAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data and code referred to in the manuscript are publicly available. https://github.com/reichlab/covid19-forecast-hub/ https://github.com/reichlab/covidEnsembles https://zoltardata.com/project/44 |
Reducing travel-related SARS-CoV-2 transmission with layered mitigation measures: Symptom monitoring, quarantine, and testing (preprint)
Johansson MA , Wolford H , Paul P , Diaz PS , Chen TH , Brown CM , Cetron MS , Alvarado-Ramy F . medRxiv 2020 2020.11.23.20237412 Balancing the control of SARS-CoV-2 transmission with the resumption of travel is a global priority. Current recommendations include mitigation measures before, during, and after travel. Pre- and post-travel strategies including symptom monitoring, testing, and quarantine can be combined in multiple ways considering different trade-offs in feasibility, adherence, effectiveness, cost and adverse consequences. Here we use a mathematical model to analyze the expected effectiveness of symptom monitoring, testing, and quarantine under different estimates of the infectious period, test-positivity relative to time of infection, and test sensitivity to reduce the risk of transmission from infected travelers during and after travel. If infection occurs 0-7 days prior to travel, immediate isolation following symptom onset prior to or during travel reduces risk of transmission while traveling by 26-30%. Pre-departure testing can further reduce risk if testing is close to the time of departure. For example, testing on the day of departure can reduce risk while traveling by 37-61%. For transmission risk after travel with infection time up to 7 days prior to arrival at the destination, isolation based on symptom monitoring reduced introduction risk at the destination by 42-56%. A 14-day quarantine after arrival, without symptom monitoring or testing, can reduce risk by 97-100% on its own. However, a shorter quarantine of 7 days combined with symptom monitoring and a test on day 3-4 after arrival is also effective (95-99%) at reducing introduction risk and is less burdensome, which may improve adherence. To reduce the risk of introduction without quarantine, optimal test timing after arrival is close to the time of arrival; with effective quarantine after arrival, testing a few days later optimizes sensitivity to detect those infected immediately before or while traveling. These measures can complement recommendations such as social distancing, using masks, and hand hygiene, to further reduce risk during and after travel.Competing Interest StatementThe authors have declared no competing interest.Funding StatementNo external funding supported this research.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Centers for Disease Control and PreventionAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesOnly publicly available data informed this research. |
Estimating incidence of infection from diverse data sources: Zika virus in Puerto Rico, 2016 (preprint)
Quandelacy TM , Healy JM , Greening B , Rodriguez DM , Chung KW , Kuehnert MJ , Biggerstaff BJ , Dirlikov E , Mier YTeran-Romero L , Sharp TM , Waterman S , Johansson MA . medRxiv 2020 2020.10.14.20212134 ![]() Emerging epidemics are challenging to track. Only a subset of cases is recognized and reported, as seen with the Zika virus (ZIKV) epidemic where large proportions of infection were asymptomatic. However, multiple imperfect indicators of infection provide an opportunity to estimate the underlying incidence of infection. We developed a modeling approach that integrates a generic Time-series Susceptible-Infected-Recovered epidemic model with assumptions about reporting biases in a Bayesian framework and applied it to the 2016 Zika epidemic in Puerto Rico using three indicators: suspected arboviral cases, suspected Zika-associated Guillain-Barré Syndrome cases, and blood bank data. Using this combination of surveillance data, we estimated the peak of the epidemic occurred during the week of August 15, 2016 (the 33rd week of year), and 120 to 140 (50% credible interval [CrI], 95% CrI: 97 to 170) weekly infections per 10,000 population occurred at the peak. By the end of 2016, we estimated that approximately 890,000 (95% CrI: 660,000 to 1,100,000) individuals were infected in 2016 (26%, 95% CrI: 19% to 33%, of the population infected). Utilizing multiple indicators offers the opportunity for real-time and retrospective situational awareness to support epidemic preparedness and response.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe author(s) received no specific funding for this work.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Exemption was obtained from the CDC Human Subjects Research Office as the data were collected as part of regular surveillance activities.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll relevant data are within the manuscript and its Supporting Information files. |
A systematic review and evaluation of Zika virus forecasting and prediction research during a public health emergency of international concern (preprint)
Kobres PY , Chretien JP , Johansson MA , Morgan JJ , Whung PY , Mukundan H , Del Valle SY , Forshey BM , Quandelacy TM , Biggerstaff M , Viboud C , Pollett S . bioRxiv 2019 634832 INTRODUCTION Epidemic forecasting and prediction tools have the potential to provide actionable information in the midst of emerging epidemics. While numerous predictive studies were published during the 2016-2017 Zika Virus (ZIKV) pandemic, it remains unknown how timely, reproducible and actionable the information produced by these studies was.METHODS To improve the functional use of mathematical modeling in support of future infectious disease outbreaks, we conducted a systematic review of all ZIKV prediction studies published during the recent ZIKV pandemic using the PRISMA guidelines. Using MEDLINE, EMBASE and grey literature review, we identified studies that forecasted, predicted or simulated ecological or epidemiological phenomenon related to the Zika pandemic that were published as of March 01, 2017. Eligible studies underwent evaluation of objectives, data sources, methods, timeliness, reproducibility, accessibility and clarity by independent reviewers.RESULTS 2034 studies were identified, of which n = 73 met eligibility criteria. Spatial spread, R0 (basic reproductive number) and epidemic dynamics were most commonly predicted, with few studies predicting Guillain-Barré Syndrome burden (4%), sexual transmission risk (4%) and intervention impact (4%). Most studies specifically examined populations in the Americas (52%), with few African-specific studies (4%). Case count (67%), vector (41%) and demographic data (37%) were the most common data sources. Real-time internet data and pathogen genomic information were used in 7% and 0% of studies, respectively, and social science and behavioral data were typically absent in modeling efforts. Deterministic models were favored over stochastic approaches. Forty percent of studies made model data entirely available, 29% provided all relevant model code, 43% presented uncertainty in all predictions and 54% provided sufficient methodological detail allowing complete reproducibility. Fifty-one percent of predictions were published after the epidemic peak in the Americas. While the use of preprints improved the accessibility of ZIKV predictions by a median 119 days sooner than journal publication dates, they were used in only 30% of studies.CONCLUSIONS Many ZIKV predictions were published during the 2016-2017 pandemic. The accessibility, reproducibility, timeliness, and incorporation of uncertainty in these published predictions varied and indicates that there is substantial room for improvement. To enhance the utility of analytical tools for outbreak response, it is essential to improve the sharing of model data, code, and preprints for future outbreaks, epidemics and pandemics.Author summary Researchers published many studies which sought to predict and forecast important features of Zika virus (ZIKV) infections and their spread during the 2016-2017 ZIKV pandemic. We conducted a comprehensive review of such ZIKV prediction studies and evaluated their aims, the data sources they used, which methods were used, how timely they were published, and whether they provided sufficient information to be used or reproduced by others. Of the 73 studies evaluated, we found that the accessibility, reproducibility, timeliness, and incorporation of uncertainty in these published predictions varied and indicates that there is substantial room for improvement. We identified that the release of study findings before formal journal publication (‘pre-prints’) increased the timeliness of Zika prediction studies, but note they were infrequently used during this public health emergency. Addressing these areas can improve our understanding of Zika and other outbreaks and ensure that forecasts can inform preparedness and response to future outbreaks, epidemics and pandemics. |
Nowcasting by Bayesian Smoothing: A flexible, generalizable model for real-time epidemic tracking (preprint)
McGough SF , Johansson MA , Lipsitch M , Menzies NA . bioRxiv 2019 663823 ![]() Delays in case reporting are common to disease surveillance systems, making it difficult to track diseases in real-time. “Nowcast” approaches attempt to estimate the complete case counts for a given reporting date, using a time series of case reports that is known to be incomplete due to reporting delays. Modeling the reporting delay distribution is a common feature of nowcast approaches. However, many nowcast approaches ignore a crucial feature of infectious disease transmission—that future cases are intrinsically linked to past reported cases—and are optimized to a single application, which may limit generalizability. Here, we present a Bayesian approach, NobBS (Nowcasting by Bayesian Smoothing) capable of producing smooth and accurate nowcasts in multiple disease settings. We test NobBS on dengue in Puerto Rico and influenza-like illness (ILI) in the United States to examine performance and robustness across settings exhibiting a range of common reporting delay characteristics (from stable to time-varying), and compare this approach with a published nowcasting package. We show that introducing a temporal relationship between cases considerably improves performance when the reporting delay distribution is time-varying, and we identify trade-offs in the role of moving windows to accurately capture changes in the delay. We present software implementing this new approach (R package “NobBS”) for widespread application.Significance Achieving accurate, real-time estimates of disease activity is challenged by delays in case reporting. However, approaches that seek to estimate cases in spite of reporting delays often do not consider the temporal relationship between cases during an outbreak, nor do they identify characteristics of robust approaches that generalize to a wide range of surveillance contexts with very different reporting delays. Here, we present a smooth Bayesian nowcasting approach that produces accurate estimates that capture the time evolution of the epidemic curve and outperform a previous approach in the literature. We assess the performance for two diseases to identify important features of the reporting delay distribution that contribute to the model’s performance and robustness across surveillance settings. |
Heterogeneous local dynamics revealed by classification analysis of spatially disaggregated time series data (preprint)
Perkins TA , Rodriguez-Barraquer I , Manore C , Siraj AS , Espana G , Barker CM , Johansson MA , Reiner RCJr . bioRxiv 2019 276006 Time series data provide a crucial window into infectious disease dynamics, yet their utility is often limited by the spatially aggregated form in which they are presented. When working with time series data, violating the implicit assumption of homogeneous dynamics below the scale of spatial aggregation could bias inferences about underlying processes. We tested this assumption in the context of the 2015-2016 Zika epidemic in Colombia, where time series of weekly case reports were available at national, departmental, and municipal scales. First, we performed a descriptive analysis, which showed that the timing of departmental-level epidemic peaks varied by three months and that departmental-level estimates of the time-varying reproduction number, R(t), showed patterns that were distinct from a national-level estimate. Second, we applied a classification algorithm to six features of proportional cumulative incidence curves, which showed that variability in epidemic duration, the length of the epidemic tail, and consistency with a cumulative normal density curve made the greatest contributions to distinguishing groups. Third, we applied this classification algorithm to data simulated with a stochastic transmission model, which showed that group assignments were consistent with simulated differences in the basic reproduction number, R0. This result, along with associations between spatial drivers of transmission and group assignments based on observed data, suggests that the classification algorithm is capable of detecting differences in temporal patterns that are associated with differences in underlying drivers of incidence patterns. Overall, this diversity of temporal patterns at local scales underscores the value of spatially disaggregated time series data. |
A Collaborative Multi-Model Ensemble for Real-Time Influenza Season Forecasting in the U.S (preprint)
Reich NG , McGowan CJ , Yamana TK , Tushar A , Ray EL , Osthus D , Kandula S , Brooks LC , Crawford-Crudell W , Gibson GC , Moore E , Silva R , Biggerstaff M , Johansson MA , Rosenfeld R , Shaman J . bioRxiv 2019 566604 ![]() Seasonal influenza results in substantial annual morbidity and mortality in the United States and worldwide. Accurate forecasts of key features of influenza epidemics, such as the timing and severity of the peak incidence in a given season, can inform public health response to outbreaks. As part of ongoing efforts to incorporate data and advanced analytical methods into public health decision-making, the United States Centers for Disease Control and Prevention (CDC) has organized seasonal influenza forecasting challenges since the 2013/2014 season. In the 2017/2018 season, 22 teams participated. A subset of four teams created a research consortium called the FluSight Network in early 2017. During the 2017/2018 season they worked together to produce a collaborative multi-model ensemble that combined 21 separate component models into a single model using a machine learning technique called stacking. This approach creates a weighted average of predictive densities where the weight for each component is based on that component’s forecast accuracy in past seasons. In the 2017/2018 influenza season, one of the largest seasonal outbreaks in the last 15 years, this multi-model ensemble performed better on average than all individual component models and placed second overall in the CDC challenge. It also outperformed the baseline multi-model ensemble created by the CDC that took a simple average of all models submitted to the forecasting challenge. This project shows that collaborative efforts between research teams to develop ensemble forecasting approaches can bring measurable improvements in forecast accuracy and important reductions in the variability of performance from year to year. Efforts such as this, that emphasize real-time testing and evaluation of forecasting models and facilitate the close collaboration between public health officials and modeling researchers, are essential to improving our understanding of how best to use forecasts to improve public health response to seasonal and emerging epidemic threats. |
Minimum Information for Reusable Arthropod Abundance Data (MIReAAD) (preprint)
Rund SSC , Braak K , Cator L , Copas K , Emrich SJ , Giraldo-Calderon GI , Johansson MA , Heydari N , Hobern D , Kelly SA , Lawson D , Lord C , MacCallum RM , Roche DG , Ryan SJ , Schigel D , Vandegrift K , Watts M , Zaspel JM , Pawar S . bioRxiv 2018 429142 Arthropods play a dominant role in natural and human-modified terrestrial ecosystem dynamics. Spatially-explicit population time-series are crucial for statistical or mathematical models of these dynamics and assessment of their veterinary, medical, agricultural, and ecological impacts. Arthropod data have been collected world-wide for over a century, but remain scattered and largely inaccessible. With the ever-present and growing threat of arthropod vectors of infectious diseases and pest species, there are enormous amounts of historical and ongoing surveillance. These data are currently reported in a wide variety of formats, typically lacking sufficient metadata to make reuse and re-analysis possible. We present the first minimum information standard for arthropod abundance. Developed with broad stakeholder collaboration, it balances sufficiency for reuse with the practicality of preparing the data for submission. It is designed to optimize data (re-)usability from the “FAIR,” (Findable, Accessible, Interoperable, and Reusable) principles of public data archiving (PDA). This standard will facilitate data unification across research initiatives and communities dedicated to surveillance for detection and control of vector-borne diseases and pests. |
Forecasting seasonal influenza in the U.S.: A collaborative multi-year, multi-model assessment of forecast performance (preprint)
Reich NG , Brooks LC , Fox SJ , Kandula S , McGowan CJ , Moore E , Osthus D , Ray EL , Tushar A , Yamana TK , Biggerstaff M , Johansson MA , Rosenfeld R , Shaman J . bioRxiv 2018 397190 Influenza infects an estimated 9 to 35 million individuals each year in the United States and is a contributing cause for between 12,000 and 56,000 deaths annually. Seasonal outbreaks of influenza are common in temperate regions of the world, with highest incidence typically occurring in colder and drier months of the year. Real-time forecasts of influenza transmission can inform public health response to outbreaks. We present the results of a multi-institution collaborative effort to standardize the collection and evaluation of forecasting models for influenza in the US for the 2010/2011 through 2016/2017 influenza seasons. For these seven seasons, we assembled weekly real-time forecasts of 7 targets of public health interest from 22 different models. We compared forecast accuracy of each model relative to a historical baseline seasonal average. Across all regions of the US, over half of the models showed consistently better performance than the historical baseline when forecasting incidence of influenza-like illness 1, 2 and 3 weeks ahead of available data and when forecasting the timing and magnitude of the seasonal peak. In some regions, delays in data reporting were strongly and negatively associated with forecast accuracy. More timely reporting and an improved overall accessibility to novel and traditional data sources are needed to improve forecasting accuracy and its integration with real-time public health decision-making. |
Downgrading disease transmission risk estimates using terminal importations (preprint)
Fox SJ , Bellan SE , Perkins TA , Johansson MA , Meyers LA . bioRxiv 2018 265942 As emerging and re-emerging infectious diseases like dengue, Ebola, chikungunya, and Zika threaten new populations worldwide, officials scramble to assess local severity and transmissibility, with little to no epidemiological history to draw upon. Standard methods for assessing autochthonous (local) transmission risk make either indirect estimates based on ecological suitability or direct estimates only after local cases accumulate. However, an overlooked source of epidemiological data that can meaningfully inform risk assessments prior to outbreak emergence is the absence of transmission by imported cases. Here, we present a method for updating a priori ecological estimates of transmission risk using real-time importation data. We demonstrate our method using Zika importation and transmission data from Texas in 2016, a high-risk region in the southern United States. Our updated risk estimates are lower than previously reported, with only six counties in Texas likely to sustain a Zika epidemic, and consistent with the number of autochthonous cases detected in 2017. Importation events can thereby provide critical, early insight into local transmission risks as infectious diseases expand their global reach. |
COVID-19 reopening strategies at the county level in the face of uncertainty: Multiple Models for Outbreak Decision Support (preprint)
Shea K , Borchering RK , Probert WJM , Howerton E , Bogich TL , Li S , van Panhuis WG , Viboud C , Aguás R , Belov A , Bhargava SH , Cavany S , Chang JC , Chen C , Chen J , Chen S , Chen Y , Childs LM , Chow CC , Crooker I , Valle SYD , España G , Fairchild G , Gerkin RC , Germann TC , Gu Q , Guan X , Guo L , Hart GR , Hladish TJ , Hupert N , Janies D , Kerr CC , Klein DJ , Klein E , Lin G , Manore C , Meyers LA , Mittler J , Mu K , Núñez RC , Oidtman R , Pasco R , Piontti APY , Paul R , Pearson CAB , Perdomo DR , Perkins TA , Pierce K , Pillai AN , Rael RC , Rosenfeld K , Ross CW , Spencer JA , Stoltzfus AB , Toh KB , Vattikuti S , Vespignani A , Wang L , White L , Xu P , Yang Y , Yogurtcu ON , Zhang W , Zhao Y , Zou D , Ferrari M , Pannell D , Tildesley M , Seifarth J , Johnson E , Biggerstaff M , Johansson M , Slayton RB , Levander J , Stazer J , Salerno J , Runge MC . medRxiv 2020 Policymakers make decisions about COVID-19 management in the face of considerable uncertainty. We convened multiple modeling teams to evaluate reopening strategies for a mid-sized county in the United States, in a novel process designed to fully express scientific uncertainty while reducing linguistic uncertainty and cognitive biases. For the scenarios considered, the consensus from 17 distinct models was that a second outbreak will occur within 6 months of reopening, unless schools and non-essential workplaces remain closed. Up to half the population could be infected with full workplace reopening; non-essential business closures reduced median cumulative infections by 82%. Intermediate reopening interventions identified no win-win situations; there was a trade-off between public health outcomes and duration of workplace closures. Aggregate results captured twice the uncertainty of individual models, providing a more complete expression of risk for decision-making purposes. |
Projected resurgence of COVID-19 in the United States in July-December 2021 resulting from the increased transmissibility of the Delta variant and faltering vaccination (preprint)
Truelove S , Smith CP , Qin M , Mullany LC , Borchering RK , Lessler J , Shea K , Howerton E , Contamin L , Levander J , Salerno J , Hochheiser H , Kinsey M , Tallaksen K , Wilson S , Shin L , Rainwater-Lovett K , Lemaitre JC , Dent J , Kaminsky J , Lee EC , Perez-Saez J , Hill A , Karlen D , Chinazzi M , Davis JT , Mu K , Xiong X , Piontti APY , Vespignani A , Srivastava A , Porebski P , Venkatramanan S , Adiga A , Lewis B , Klahn B , Outten J , Schlitt J , Corbett P , Telionis PA , Wang L , Peddireddy AS , Hurt B , Chen J , Vullikanti A , Marathe M , Hoops S , Bhattacharya P , Machi D , Chen S , Paul R , Janies D , Thill JC , Galanti M , Yamana T , Pei S , Shaman J , Reich NG , Healy JM , Slayton RB , Biggerstaff M , Johansson MA , Runge MC , Viboud C . medRxiv 2021 WHAT IS ALREADY KNOWN ABOUT THIS TOPIC? The highly transmissible SARS-CoV-2 Delta variant has begun to cause increases in cases, hospitalizations, and deaths in parts of the United States. With slowed vaccination uptake, this novel variant is expected to increase the risk of pandemic resurgence in the US in July-December 2021. WHAT IS ADDED BY THIS REPORT? Data from nine mechanistic models project substantial resurgences of COVID-19 across the US resulting from the more transmissible Delta variant. These resurgences, which have now been observed in most states, were projected to occur across most of the US, coinciding with school and business reopening. Reaching higher vaccine coverage in July-December 2021 reduces the size and duration of the projected resurgence substantially. The expected impact of the outbreak is largely concentrated in a subset of states with lower vaccination coverage. WHAT ARE THE IMPLICATIONS FOR PUBLIC HEALTH PRACTICE? Renewed efforts to increase vaccination uptake are critical to limiting transmission and disease, particularly in states with lower current vaccination coverage. Reaching higher vaccination goals in the coming months can potentially avert 1.5 million cases and 21,000 deaths and improve the ability to safely resume social contacts, and educational and business activities. Continued or renewed non-pharmaceutical interventions, including masking, can also help limit transmission, particularly as schools and businesses reopen. |
A systematic review of the data, methods and environmental covariates used to map Aedes-borne arbovirus transmission risk (preprint)
Lim AY , Jafari Y , Caldwell JM , Clapham HE , Gaythorpe KAM , Hussain-Alkhateeb L , Johansson MA , Kraemer MUG , Maude RJ , McCormack CP , Messina JP , Mordecai EA , Rabe IB , Reiner RC , Ryan SJ , Salje H , Semenza JC , Rojas DP , Brady OJ . medRxiv 2023 20 Background Aedes (Stegomyia)-borne diseases are an expanding global threat, but gaps in surveillance make comprehensive and comparable risk assessments challenging. Geostatistical models combine data from multiple locations and use links with environmental and socioeconomic factors to make predictive risk maps. Here we systematically review past approaches to map risk for different Aedesborne arboviruses from local to global scales, identifying differences and similarities in the data types, covariates, and modelling approaches used. Methods We searched on-line databases for predictive risk mapping studies for dengue, Zika, chikungunya, and yellow fever with no geographical or date restrictions. We included studies that needed to parameterise or fit their model to real-world epidemiological data and make predictions to new spatial locations of some measure of population-level risk of viral transmission (e.g. incidence, occurrence, suitability, etc). Results We found a growing number of arbovirus risk mapping studies across all endemic regions and arboviral diseases, with a total of 183 papers published 2002-2022 with the largest increases shortly following major epidemics. Three dominant use cases emerged: i) global maps to identify limits of transmission, estimate burden and assess impacts of future global change, ii) regional models used to predict the spread of major epidemics between countries and iii) national and sub-national models that use local datasets to better understand transmission dynamics to improve outbreak detection and response. Temperature and rainfall were the most popular choice of covariates (included in 50% and 40% of studies respectively) but variables such as human mobility are increasingly being included. Surprisingly, few studies (22%, 33/148) robustly tested combinations of covariates from different domains (e.g. climatic, sociodemographic, ecological, etc) and only 48% of studies assessed predictive performance via out-of-sample validation procedures. Conclusions Here we show that approaches to map risk for different arboviruses have diversified in response to changing use cases, epidemiology and data availability. We outline specific recommendations for future studies regarding aims and data choice, covariate selection, model formulation and evaluation. Copyright The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available for use under a CC0 license. |
Age-specific case data reveal varying dengue transmission intensity in US states and territories (preprint)
Kada S , Paz-Bailey G , Adams L , Johansson MA . medRxiv 2023 08 Dengue viruses (DENV) are endemic in the US territories of Puerto Rico, American Samoa, and the US Virgin Islands, with focal outbreaks also reported in the states of Florida and Hawaii. However, little is known about the intensity of dengue virus transmission over time and how dengue viruses have shaped the level of immunity in these populations, despite the importance of understanding how and why levels of immunity against dengue may change over time. These changes need to be considered when responding to future outbreaks and enacting dengue management strategies, such as guiding vaccine deployment. We used catalytic models fitted to case surveillance data stratified by age from the ArboNET national arboviral surveillance system to reconstruct the history of recent dengue virus transmission in Puerto Rico, American Samoa, US Virgin Islands, Florida, Hawaii, and Guam. We estimated average annual transmission intensity (i.e., force of infection) of DENV between 2010 and 2019 and the level of seroprevalence by age group in each population. We compared models and found that treating all reported cases as secondary infections generally fit the surveillance data better than models considering cases as primary infections. Using the secondary case model, we found that force of infection was highly heterogeneous between jurisdictions and over time within jurisdictions, ranging from 0.00003 (95% CI: 0.00002-0.0004) in Florida to 0.08 (95% CI: 0.044-0.14) in American Samoa during the 2010-2019 period. For early 2020, we estimated that seropositivity in 10 year-olds ranged from 0.09% (0.02%-0.54%) in Florida to 56.3% (43.7%-69.3%) in American Samoa. In the absence of serological data, age-specific case notification data collected through routine surveillance combined with mathematical modeling are powerful tools to monitor arbovirus circulation, estimate the level of population immunity, and design dengue management strategies. Copyright The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available for use under a CC0 license. |
- Page last reviewed:Feb 1, 2024
- Page last updated:Apr 18, 2025
- Content source:
- Powered by CDC PHGKB Infrastructure