As part of the response to the highly pathogenic avian influenza A(H5N1) virus outbreak in U.S. cattle and poultry and the associated human cases, CDC and partners are monitoring influenza A virus levels and detection of the H5 subtype in wastewater. Among 48 states and the District of Columbia that performed influenza A testing of wastewater during May 12-July 13, 2024, a weekly average of 309 sites in 38 states had sufficient data for analysis, and 11 sites in four states reported high levels of influenza A virus. H5 subtype testing was conducted at 203 sites in 41 states, with H5 detections at 24 sites in nine states. For each detection or high level, CDC and state and local health departments evaluated data from other influenza surveillance systems and partnered with wastewater utilities and agriculture departments to investigate potential sources. Among the four states with high influenza A virus levels detected in wastewater, three states had corresponding evidence of human influenza activity from other influenza surveillance systems. Among the 24 sites with H5 detections, 15 identified animal sources within the sewershed or adjacent county, including eight milk-processing inputs. Data from these early investigations can help health officials optimize the use of wastewater surveillance during the upcoming respiratory illness season.

Understanding whether influenza vaccine promotion strategies produce community-wide indirect effects is important for establishing vaccine coverage targets and optimizing vaccine delivery. Empirical epidemiologic studies and mathematical models have been used to estimate indirect effects of vaccines but rarely for the same estimand in the same dataset. Using these approaches together could be a powerful tool for triangulation in infectious disease epidemiology because each approach is subject to distinct sources of bias. We triangulated evidence about indirect effects from a school-located influenza vaccination program using two approaches: a difference-in-difference (DID) analysis, and an age-structured, deterministic, compartmental model. The estimated indirect effect was substantially lower in the mathematical model than in the DID analysis (2.1% (95% Bayesian credible intervals 0.4 - 4.4%) vs. 22.3% (95% CI 7.6% - 37.1%)). To explore reasons for differing estimates, we used sensitivity analyses and probabilistic bias analyses. When we constrained model parameters such that projections matched the DID analysis, results only aligned with the DID analysis with substantially lower pre-existing immunity among school-age children and older adults. Conversely, DID estimates corrected for potential bias only aligned with mathematical model estimates under differential outcome misclassification. We discuss how triangulation using empirical and mathematical modelling approaches could strengthen future studies.

Isolation of symptomatic infectious persons can reduce influenza transmission. However, virus shedding that occurs without symptoms will be unaffected by such measures. Identifying effective isolation strategies for influenza requires understanding the interplay between individual virus shedding and symptom presentation. From 2017 to 2020, we conducted a case-ascertained household transmission study using influenza real-time RT-qPCR testing of nasal swabs and daily symptom diary reporting for up to 7 days after enrolment (≤14 days after index onset). We assumed real-time RT-qPCR cycle threshold (Ct) values were indicators of quantitative virus shedding and used symptom diaries to create a score that tracked influenza-like illness (ILI) symptoms (fever, cough, or sore throat). We fit phenomenological nonlinear mixed-effects models stratified by age and vaccination status and estimated two quantities influencing isolation effectiveness: shedding before symptom onset and shedding that might occur once isolation ends. We considered different isolation end points (including 24 h after fever resolution or 5 days after symptom onset) and assumptions about the infectiousness of Ct shedding trajectories. Of the 116 household contacts with ≥2 positive tests for longitudinal analyses, 105 (91%) experienced ≥1 ILI symptom. On average, children <5 years experienced greater peak shedding, longer durations of shedding, and elevated ILI symptom scores compared with other age groups. Most individuals (63/105) shed <10% of their total shed virus before symptom onset, and shedding after isolation varied substantially across individuals, isolation end points, and infectiousness assumptions. Our results can inform strategies to reduce transmission from symptomatic individuals infected with influenza.

Asymptomatic influenza virus infection occurs but may vary by factors such as age, influenza vaccination status, or influenza season. We examined the frequency of influenza virus infection and associated symptoms using data from two case-ascertained household transmission studies (conducted from 2017-2023) with prospective, systematic collection of respiratory specimens and symptoms. From the 426 influenza virus infected household contacts that met our inclusion criteria, 8% were asymptomatic, 6% had non-respiratory symptoms, 23% had acute respiratory symptoms, and 62% had influenza-like illness symptoms. Understanding the prevalence of asymptomatic and mildly symptomatic influenza cases is important for implementing effective influenza prevention strategies and enhancing the effectiveness of symptom-based surveillance systems.

Accurate forecasts can enable more effective public health responses during seasonal influenza epidemics. For the 2021-22 and 2022-23 influenza seasons, 26 forecasting teams provided national and jurisdiction-specific probabilistic predictions of weekly confirmed influenza hospital admissions for one-to-four weeks ahead. Forecast skill is evaluated using the Weighted Interval Score (WIS), relative WIS, and coverage. Six out of 23 models outperform the baseline model across forecast weeks and locations in 2021-22 and 12 out of 18 models in 2022-23. Averaging across all forecast targets, the FluSight ensemble is the 2(nd) most accurate model measured by WIS in 2021-22 and the 5(th) most accurate in the 2022-23 season. Forecast skill and 95% coverage for the FluSight ensemble and most component models degrade over longer forecast horizons. In this work we demonstrate that while the FluSight ensemble was a robust predictor, even ensembles face challenges during periods of rapid change.

Nucleocapsid antibody assays can be used to estimate SARS-CoV-2 infection prevalence in regions implementing spike-based COVID-19 vaccines. However, poor sensitivity of nucleocapsid antibody assays in detecting infection after vaccination has been reported. We derived a lower cutoff for identifying previous infections in a large blood donor cohort (N = 142,599) by using the Ortho VITROS Anti-SARS-CoV-2 Total-N Antibody assay, improving sensitivity while maintaining specificity >98%. We validated sensitivity in samples donated after self-reported swab-confirmed infections diagnoses. Sensitivity for first infections in unvaccinated donors was 98.1% (95% CI 98.0-98.2) and for infection after vaccination was 95.6% (95% CI 95.6-95.7) based on the standard cutoff. Regression analysis showed sensitivity was reduced in the Delta compared with Omicron period, in older donors, in asymptomatic infections, <30 days after infection, and for infection after vaccination. The standard Ortho N antibody threshold demonstrated good sensitivity, which was modestly improved with the revised cutoff.

Group testing is the process of testing items as an amalgamation, rather than separately, to determine the binary status for each item. Its use was especially important during the COVID-19 pandemic through testing specimens for SARS-CoV-2. The adoption of group testing for this and many other applications is because members of a negative testing group can be declared negative with potentially only one test. This subsequently leads to significant increases in laboratory testing capacity. Whenever a group testing algorithm is put into practice, it is critical for laboratories to understand the algorithm's operating characteristics, such as the expected number of tests. Our paper presents the binGroup2 package that provides the statistical tools for this purpose. This R package is the first to address the identification aspect of group testing for a wide variety of algorithms. We illustrate its use through COVID-19 and chlamydia/gonorrhea applications of group testing.

BACKGROUND: Novel influenza viruses pose a potential pandemic risk, and rapid detection of infections in humans is critical to characterizing the virus and facilitating the implementation of public health response measures. METHODS: We use a probabilistic framework to estimate the likelihood that novel influenza virus cases would be detected through testing in different community and healthcare settings (urgent care, emergency department, hospital, and intensive care unit [ICU]) while at low frequencies in the United States. Parameters were informed by data on seasonal influenza virus activity and existing testing practices. RESULTS: In a baseline scenario reflecting the presence of 100 novel virus infections with similar severity to seasonal influenza viruses, the median probability of detecting at least one infection per month was highest in urgent care settings (72%) and when community testing was conducted at random among the general population (77%). However, urgent care testing was over 15 times more efficient (estimated as the number of cases detected per 100,000 tests) due to the larger number of tests required for community testing. In scenarios that assumed increased clinical severity of novel virus infection, median detection probabilities increased across all healthcare settings, particularly in hospitals and ICUs (up to 100%) where testing also became more efficient. CONCLUSIONS: Our results suggest that novel influenza virus circulation is likely to be detected through existing healthcare surveillance, with the most efficient testing setting impacted by the disease severity profile. These analyses can help inform future testing strategies to maximize the likelihood of novel influenza detection.

During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020 to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to inform pandemic-related decision making.

We reviewed the tools that have been developed to characterize and communicate seasonal influenza activity in the United States. Here we focus on systematic surveillance and applied analytics, including seasonal burden and disease severity estimation, short-term forecasting, and longer-term modeling efforts. For each set of activities, we describe the challenges and opportunities that have arisen because of the COVID-19 pandemic. In conclusion, we highlight how collaboration and communication have been and will continue to be key components of reliable and actionable influenza monitoring, forecasting, and modeling activities.

In July 2023, the Center of Excellence in Respiratory Pathogens organized a two-day workshop on infectious diseases modelling and the lessons learnt from the Covid-19 pandemic. This report summarizes the rich discussions that occurred during the workshop. The workshop participants discussed multisource data integration and highlighted the benefits of combining traditional surveillance with more novel data sources like mobility data, social media, and wastewater monitoring. Significant advancements were noted in the development of predictive models, with examples from various countries showcasing the use of machine learning and artificial intelligence in detecting and monitoring disease trends. The role of open collaboration between various stakeholders in modelling was stressed, advocating for the continuation of such partnerships beyond the pandemic. A major gap identified was the absence of a common international framework for data sharing, which is crucial for global pandemic preparedness. Overall, the workshop underscored the need for robust, adaptable modelling frameworks and the integration of different data sources and collaboration across sectors, as key elements in enhancing future pandemic response and preparedness.

BACKGROUND: Alpha-gal syndrome (AGS) is an allergy to galactose-α-1,3-galactose (alpha-gal), a carbohydrate found in most mammals. Evidence indicates that AGS develops following a tick bite, and in the United States, AGS is most associated with bites from Amblyomma americanum (lone star tick); however, not all persons bitten by ticks develop clinical AGS. OBJECTIVE: This study investigated intrinsic risk factors associated with the development of AGS. METHODS: We performed a case-control study among adults presenting for diagnosis or management of AGS at an allergy clinic in North Carolina during 2019-2020 and compared them to controls enrolled from two nearby internal medicine clinics. A questionnaire gathered epidemiologic and tick exposure data and blood was obtained for alpha-gal specific IgE (sIgE) and other testing. RESULTS: The 82 enrolled case patients and 191 controls did not differ significantly by age or sex. Case patients were more likely than controls to have A or O blood types (non-B-antigen), have experienced childhood allergies, and have a family history of AGS and other food allergies. Case patients were also more likely to report experiencing long healing times for insect bites or stings and a family history of allergy to stinging or biting insects. CONCLUSION: This study suggests that intrinsic factors contribute to risk of developing AGS. Some traits are genetic, but common behaviors among households and family units likely also contribute. Identification of these risk factors can inform personal risk, aid healthcare providers in understanding susceptible populations, and contribute to ongoing understanding of AGS epidemiology.

Before the COVID-19 pandemic, the role of asymptomatic influenza virus infections in influenza transmission was uncertain. However, the importance of asymptomatic infection with SARS-CoV-2 for onward transmission of COVID-19 has led experts to question whether the role of asymptomatic influenza virus infections in transmission had been underappreciated. We discuss the existing evidence on the frequency of asymptomatic influenza virus infections, the extent to which they contribute to infection transmission, and remaining knowledge gaps. We propose priority areas for further evaluation, study designs, and case definitions to address existing knowledge gaps.

BACKGROUND: Antiviral chemoprophylaxis is recommended for use during influenza outbreaks in nursing homes to prevent transmission and severe disease among non-ill residents. Centers for Disease Control and Prevention (CDC) guidance recommends prophylaxis be initiated for all non-ill residents once an influenza outbreak is detected and be continued for at least 14 days and until seven days after the last laboratory-confirmed influenza case is identified. However, not all facilities strictly adhere to this guidance and the impact of such partial adherence is not fully understood. METHODS: We developed a stochastic compartmental framework to model influenza transmission within an average-sized U.S. nursing home. We compared the number of symptomatic illnesses and hospitalizations under varying prophylaxis implementation strategies, in addition to different levels of prophylaxis uptake and adherence by residents and healthcare personnel (HCP). RESULTS: Prophylaxis implemented according to current guidance reduced total symptomatic illnesses and hospitalizations among residents by an average of 12% and 36%, respectively, compared with no prophylaxis. We did not find evidence that alternative implementations of prophylaxis were more effective: compared to full adoption of current guidance, partial adoption resulted in increased symptomatic illnesses and/or hospitalizations, and longer or earlier adoption offered no additional improvements. In addition, increasing uptake and adherence among nursing home residents was effective in reducing resident illnesses and hospitalizations, but increasing HCP uptake had minimal indirect impacts for residents. CONCLUSIONS: The greatest benefits of influenza prophylaxis during nursing home outbreaks will likely be achieved through increasing uptake and adherence among residents and following current CDC guidance.

Our ability to forecast epidemics far into the future is constrained by the many complexities of disease systems. Realistic longer-term projections may, however, be possible under well-defined scenarios that specify the future state of critical epidemic drivers. Since December 2020, the U.S. COVID-19 Scenario Modeling Hub (SMH) has convened multiple modeling teams to make months ahead projections of SARS-CoV-2 burden, totaling nearly 1.8 million national and state-level projections. Here, we find SMH performance varied widely as a function of both scenario validity and model calibration. We show scenarios remained close to reality for 22 weeks on average before the arrival of unanticipated SARS-CoV-2 variants invalidated key assumptions. An ensemble of participating models that preserved variation between models (using the linear opinion pool method) was consistently more reliable than any single model in periods of valid scenario assumptions, while projection interval coverage was near target levels. SMH projections were used to guide pandemic response, illustrating the value of collaborative hubs for longer-term scenario projections.

BACKGROUND: The SARS-CoV-2 pandemic has underscored the need for field specimen collection and transport to diagnostic and public health laboratories. Self-collected nasal swabs transported without dependency on a cold chain have the potential to remove critical barriers to testing, expand testing capacity, and reduce opportunities for exposure of health professionals in the context of a pandemic. OBJECTIVE: We compared nasal swab collection by study participants from themselves and their children at home to collection by trained research staff. METHODS: Each adult participant collected 1 nasal swab, sampling both nares with the single swab, after which they collected 1 nasal swab from 1 child. After all the participant samples were collected for the household, the research staff member collected a separate single duplicate sample from each individual. Immediately after the sample collection, the adult participants completed a questionnaire about the acceptability of the sampling procedures. Swabs were placed in temperature-stable preservative and respiratory viruses were detected by shotgun RNA sequencing, enabling viral genome analysis. RESULTS: In total, 21 households participated in the study, each with 1 adult and 1 child, yielding 42 individuals with paired samples. Study participants reported that self-collection was acceptable. Agreement between identified respiratory viruses in both swabs by RNA sequencing demonstrated that adequate collection technique was achieved by brief instructions. CONCLUSIONS: Our results support the feasibility of a scalable and convenient means for the identification of respiratory viruses and implementation in pandemic preparedness for novel respiratory pathogens.

During the 2022-23 influenza season, early increases in influenza activity, co-circulation of influenza with other respiratory viruses, and high influenza-associated hospitalization rates, particularly among children and adolescents, were observed. This report describes the 2022-23 influenza season among children and adolescents aged <18 years, including the seasonal severity assessment; estimates of U.S. influenza-associated medical visits, hospitalizations, and deaths; and characteristics of influenza-associated hospitalizations. The 2022-23 influenza season had high severity among children and adolescents compared with thresholds based on previous seasons' influenza-associated outpatient visits, hospitalization rates, and deaths. Nationally, the incidences of influenza-associated outpatient visits and hospitalization for the 2022-23 season were similar for children aged <5 years and higher for children and adolescents aged 5-17 years compared with previous seasons. Peak influenza-associated outpatient and hospitalization activity occurred in late November and early December. Among children and adolescents hospitalized with influenza during the 2022-23 season in hospitals participating in the Influenza Hospitalization Surveillance Network, a lower proportion were vaccinated (18.3%) compared with previous seasons (35.8%-41.8%). Early influenza circulation, before many children and adolescents had been vaccinated, might have contributed to the high hospitalization rates during the 2022-23 season. Among symptomatic hospitalized patients, receipt of influenza antiviral treatment (64.9%) was lower than during pre-COVID-19 pandemic seasons (80.8%-87.1%). CDC recommends that all persons aged ≥6 months without contraindications should receive the annual influenza vaccine, ideally by the end of October.

California serogroup viruses (CSGVs) of medical importance in the United States include La Crosse virus, Jamestown Canyon virus (JCV), California encephalitis virus, and snowshoe hare virus. Current diagnosis of CSGVs relies heavily on serologic techniques for detecting immunoglobulin M (IgM), an indication of a recent CSGV infection. However, human-positive control sera reactive to viruses in the serogroup are scarce because detection of recent infections is rare. Here, we describe the development of new murine monoclonal antibodies (MAbs) reactive to CSGVs and the engineering of a human-murine chimeric antibody by combining the variable regions of the broadly CSGV cross-reactive murine MAb, 3-3B6/2-3B2 and the constant region of the human IgM. MAb 3-3B6/2-3B2 recognizes a tertiary epitope on the Gn/Gc heterodimer, and epitopes important in JCV neutralization were mapped to the Gc glycoprotein. This engineered human IgM constitutively expressed in a HEK-293 stable cell line can replace human-positive control sera in diagnostic serological techniques such as IgM antibody capture enzyme-linked immunosorbent assay (MAC-ELISA). Compared to the parent murine MAbs, the human-chimeric IgM antibody had identical serological activity to CSGVs in ELISA and demonstrated equivalent reactivity compared to human immune sera in the MAC-ELISA.IMPORTANCEOrthobunyaviruses in the California serogroup cause severe neurological disease in children and adults. While these viruses are known to circulate widely in North America, their occurrence is rare. Serological testing for CSGVs is hindered by the limited availability and volumes of human-positive specimens needed as controls in serologic assays. Here, we described the development of a murine monoclonal antibody cross-reactive to CSGVs engineered to contain the variable regions of the murine antibody on the backbone of human IgM. The chimeric IgM produced from the stably expressing HEK293 cell line was evaluated for use as a surrogate human-positive control in a serologic diagnostic test.

Beginning in December 2020, the COVID-19 Scenario Modeling Hub has provided quantitative scenario-based projections for cases, hospitalizations, and deaths, aggregated across up to nine modeling groups. Projections spanned multiple months into the future and provided timely information on potential impacts of epidemiological uncertainties and interventions. Projections results were shared with the public, public health partners, and the Centers for Disease Control COVID-19 Response Team. The projections provided insights on situational awareness and informed decision-making to mitigate COVID-19 disease burden (e.g., vaccination strategies). By aggregating projections from multiple modeling teams, the Scenario Modeling Hub provided rapidly synthesized information in times of great uncertainty and conveyed possible trajectories in the presence of emerging variants. Here we detail several use cases of these projections in public health practice and communication, including assessments of whether modeling results directly or indirectly informed public health communication or guidance. These include multiple examples where comparisons of projected COVID-19 disease outcomes under different vaccination scenarios were used to inform Advisory Committee for Immunization Practices recommendations. We also describe challenges and lessons learned during this highly beneficial collaboration.

Academic researchers, government agencies, industry groups, and individuals have produced forecasts at an unprecedented scale during the COVID-19 pandemic. To leverage these forecasts, the United States Centers for Disease Control and Prevention (CDC) partnered with an academic research lab at the University of Massachusetts Amherst to create the US COVID-19 Forecast Hub. Launched in April 2020, the Forecast Hub is a dataset with point and probabilistic forecasts of incident hospitalizations, incident cases, incident deaths, and cumulative deaths due to COVID-19 at national, state, and county levels in the United States. Included forecasts represent a variety of modeling approaches, data sources, and assumptions regarding the spread of COVID-19. The goal of this dataset is to establish a standardized and comparable set of short-term forecasts from modeling teams. These data can be used to develop ensemble models, communicate forecasts to the public, create visualizations, compare models, and inform policies regarding COVID-19 mitigation. These open-source data are available via download from GitHub, through an online API, and through R packages.Competing Interest StatementAV, MC, and APP report grants from Metabiota Inc outside the submitted work. Funding StatementFor teams that reported receiving funding for their work, we report the sources and disclosures below: AIpert-pwllnod: Natural Sciences and Engineering Research Council of Canada; Caltech-CS156: Gary Clinard Innovation Fund; CEID-Walk: University of Georgia; CMU-TimeSeries: CDC Center of Excellence, gifts from Google and Facebook; COVIDhub: This work has been supported by the US Centers for Disease Control and Prevention (1U01IP001122) and the National Institutes of General Medical Sciences (R35GM119582). The content is solely the responsibility of the authors and does not necessarily represent the official views of CDC, NIGMS or the National Institutes of Health; Johannes Bracher was supported by the Helmholtz Foundation via the SIMCARD Information &amp; Data Science Pilot Project; Tilmann Gneiting gratefully acknowledges support by the Klaus Tschira Foundation; CU-select: NSF DMS-2027369 and a gift from the Morris-Singer Foundation; DDS-NBDS: NSF III-1812699; epiforecasts-ensemble1: Wellcome Trust (210758/Z/18/Z) FDANIHASU: supported by the Intramural Research Program of the NIH/NIDDK; GT_CHHS-COVID19: William W. George Endowment, Virginia C. and Joseph C. Mello Endowment, NSF DGE-1650044, NSF MRI 1828187, research cyberinfrastructure resources and services provided by the Partnership for an Advanced Computing Environment (PACE) at Georgia Tech, and the following benefactors at Georgia Tech: Andrea Laliberte, Joseph C. Mello, Richard Rick E. &amp; Charlene Zalesky, and Claudia &amp; Paul Raines, CDC MInD-Healthcare U01CK000531-Supplement; IHME: This work was supported by the Bill &amp; Melinda Gates Foundation, as well as funding from the state of Washington and the National Science Foundation (award no. FAIN: 2031096); Imperial-ensemble1: SB acknowledges funding from the Wellcome Trust (219415); Institute of Business Forecasting: IBF; IowaStateLW-STEM: NSF DMS-1916204, Iowa State University Plant Sciences Institute Scholars Program, NSF DMS-1934884, Laurence H. Baker Center for Bioinformatics and Biological Statistics; IUPUI CIS: NSF; JHU_CSSE-DECOM: JHU CSSE: National Science Foundation (NSF) RAPID Real-time Forecasting of COVID-19 risk in the USA. 2021-2022. Award ID: 2108526. National Science Foundation (NSF) RAPID Development of an interactive web-based dashboard to track COVID-19 in real-time. 2020. Award ID: 2028604; JHU_IDD-CovidSP: State of California, US Dept of Health and Human Services, US Dept of Homeland Security, Johns Hopkins Health System, Office of the Dean at Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University Modeling and Policy Hub, Centers for Disease Control and Prevention (5U01CK000538-03), University of Utah Immunology, Inflammation, &amp; Infectious Disease Initiative (26798 Seed Grant); JHU_UNC_GAS-StatMechP ol: NIH NIGMS: R01GM140564; JHUAPL-Bucky: US Dept of Health and Human Services; KITmetricslab-select_ensemble: Daniel Wolffram gratefully acknowledges support by the Klaus Tschira Foundation; LANL-GrowthRate: LANL LDRD 20200700ER; MIT-Cassandra: MIT Quest for Intelligence; MOBS-GLEAM_COVID: COVID Supplement CDC-HHS-6U01IP001137-01; CA NU38OT000297 from the Council of State and Territorial Epidemiologists (CSTE); NotreDame-FRED: NSF RAPID DEB 2027718; NotreDame-mobility: NSF RAPID DEB 2027718; PSI-DRAFT: NSF RAPID Grant # 2031536; QJHong-Encounter: NSF DMR-2001411 and DMR-1835939; SDSC_ISG-TrendModel: The development of the dashboard was partly funded by the Fondation Privee des Hopitaux Universitaires de Geneve; UA-EpiCovDA: NSF RAPID Grant # 2028401; UChicagoCHATTOPADHYAY-UnIT: Defense Advanced Research Projects Agency (DARPA) #HR00111890043/P00004 (I. Chattopadhyay, University of Chicago); UCSB-ACTS: NSF RAPID IIS 2029626; UCSD_NEU-DeepGLEAM: Google Faculty Award, W31P4Q-21-C-0014; UMass-MechBayes: NIGMS #R35GM119582, NSF #1749854, NIGMS #R35GM119582; UMich-RidgeTfReg: This project is funded by the University of Michigan Physics Department and the University of Michigan Office of Research; UVA-Ensemble: National Institutes of Health (NIH) Grant 1R01GM109718, NSF BIG DATA Grant IIS-1633028, NSF Grant No.: OAC-1916805, NSF Expeditions in Computing Grant CCF-1918656, CCF-1917819, NSF RAPID CNS-2028004, NSF RAPID OAC-2027541, US Centers for Disease Control and Prevention 75D30119C05935, a grant from Google, University of Virginia Strategic Investment Fund award number SIF160, Defense Threat Reduction Agency (DTRA) under Contract No. HDTRA1-19-D-0007, and Virginia Dept of Health Grant VDH-21-501-0141; Wadnwani_AI-BayesOpt: This study is made possible by the generous support of the American People through the United States Agency for International Development (USAID). The work described in this article was implemented under the TRACETB Project, managed by WIAI under the terms of Cooperative Agreement Number 72038620CA00006. The contents of this manuscript are the sole responsibility of the authors and do not necessarily reflect the views of USAID or the United States Government; WalmartLabsML-LogForecasting: Team acknowledges Walmart to support this study Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data produced are available online at https://github.com/reichlab/covid19-forecast-hub https://github.com/reichlab/covid19-forecast-hub

Influenza pandemics typically occur in multiple waves of infection, often associated with initial emergence of a novel virus, followed (in temperate regions) by a later resurgence accompanying the onset of the annual influenza season. Here, we examined whether data collected from an initial pandemic wave could be informative, for the need to implement non-pharmaceutical measures in any resurgent wave. Drawing from the 2009 H1N1 pandemic in 10 states in the USA, we calibrated simple mathematical models of influenza transmission dynamics to data for virologically confirmed hospitalisations during the initial ‘spring’ wave. We then projected pandemic outcomes (cumulative hospitalisations) during the fall wave, and compared these projections with data. Model results show reasonable agreement for all states that reported a substantial number of cases in the spring wave. Using this model we propose a probabilistic decision framework that can be used to determine the need for pre-emptive measures such as postponing school openings, in advance of a fall wave. This work illustrates how model-based evidence synthesis, in real-time during an early pandemic wave, could be used to inform timely decisions for pandemic response.Competing Interest StatementThe authors have declared no competing interest.Funding StatementAll work funded by the USA Centre for Disease Control and Prevention.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:NAAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data (FluSurNet) is freely available online. https://www.cdc.gov/flu/weekly/influenza-hospitalization-surveillance.htm

SARS-CoV-2 serosurveys can estimate cumulative incidence for monitoring epidemics but require characterization of employed serological assays performance to inform testing algorithm development and interpretation of results. We conducted a multi-laboratory evaluation of 21 commercial high-throughput SARS-CoV-2 serological assays using blinded panels of 1,000 highly-characterized blood-donor specimens. Assays demonstrated a range of sensitivities (96%-63%), specificities (99%-96%) and precision (IIC 0.55-0.99). Durability of antibody detection in longitudinal samples was dependent on assay format and immunoglobulin target, with anti-spike, direct, or total Ig assays demonstrating more stable, or increasing reactivity over time than anti-nucleocapsid, indirect, or IgG assays. Assays with high sensitivity, specificity and durable antibody detection are ideal for serosurveillance. Less sensitive assays demonstrating waning reactivity are appropriate for other applications, including characterizing antibody responses after infection and vaccination, and detection of anamnestic boosting by reinfections and vaccine breakthrough infections. Assay performance must be evaluated in the context of the intended use.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work was supported by research contracts from the Centers for Disease Control and Prevention (CDC Contract 75D30120C08170).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:All blood donors consented to use of de-identified, residual specimens for further research purposes. UCSF IRB provided explicit approval for VRI self-certification that use of the de-identified CCP donations in this study does not meet the criteria for human subjects research. CDC investigators reviewed and relied on this determination as consistent with applicable federal law and CDC policy (45 C.F.R. part 46, 21 C.F.R. part 56; 42 U.S.C. Sect. 241(d); 5 U.S.C. Sect. 552a; 44 U.S.C. Sect. 3501).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe analytic data set is available upon request.

Short-term probabilistic forecasts of the trajectory of the COVID-19 pandemic in the United States have served as a visible and important communication channel between the scientific modeling community and both the general public and decision-makers. Forecasting models provide specific, quantitative, and evaluable predictions that inform short-term decisions such as healthcare staffing needs, school closures, and allocation of medical supplies. In 2020, the COVID-19 Forecast Hub (https://covid19forecasthub.org/) collected, disseminated, and synthesized hundreds of thousands of specific predictions from more than 50 different academic, industry, and independent research groups. This manuscript systematically evaluates 23 models that regularly submitted forecasts of reported weekly incident COVID-19 mortality counts in the US at the state and national level. One of these models was a multi-model ensemble that combined all available forecasts each week. The performance of individual models showed high variability across time, geospatial units, and forecast horizons. Half of the models evaluated showed better accuracy than a naïve baseline model. In combining the forecasts from all teams, the ensemble showed the best overall probabilistic accuracy of any model. Forecast accuracy degraded as models made predictions farther into the future, with probabilistic accuracy at a 20-week horizon more than 5 times worse than when predicting at a 1-week horizon. This project underscores the role that collaboration and active coordination between governmental public health agencies, academic modeling teams, and industry partners can play in developing modern modeling capabilities to support local, state, and federal response to outbreaks.Competing Interest StatementAV, MC, and APP report grants from Metabiota Inc outside the submitted work.Funding StatementFor teams that reported receiving funding for their work, we report the sources and disclosures below. CMU-TimeSeries: CDC Center of Excellence, gifts from Google and Facebook. CU-select: NSF DMS-2027369 and a gift from the Morris-Singer Foundation. COVIDhub: This work has been supported by the US Centers for Disease Control and Prevention (1U01IP001122) and the National Institutes of General Medical Sciences (R35GM119582). The content is solely the responsibility of the authors and does not necessarily represent the official views of CDC, NIGMS or the National Institutes of Health. Johannes Bracher was supported by the Helmholtz Foundation via the SIMCARD Information&amp; Data Science Pilot Project. Tilmann Gneiting gratefully acknowledges support by the Klaus Tschira Foundation. DDS-NBDS: NSF III-1812699. EPIFORECASTS-ENSEMBLE1: Wellcome Trust (210758/Z/18/Z) GT_CHHS-COVID19: William W. George Endowment, Virginia C. and Joseph C. Mello Endowments, NSF DGE-1650044, NSF MRI 1828187, research cyberinfrastructure resources and services provided by the Partnership for an Advanced Computing Environment (PACE) at Georgia Tech, and the following benefactors at Georgia Tech: Andrea Laliberte, Joseph C. Mello, Richard Rick E. &amp; Charlene Zalesky, and Claudia &amp; Paul Raines GT-DeepCOVID: CDC MInD-Healthcare U01CK000531-Supplement. NSF (Expeditions CCF-1918770, CAREER IIS-2028586, RAPID IIS-2027862, Medium IIS-1955883, NRT DGE-1545362), CDC MInD program, ORNL and funds/computing resources from Georgia Tech and GTRI. IHME: This work was supported by the Bill &amp; Melinda Gates Foundation, as well as funding from the state of Washington and the National Science Foundation (award no. FAIN: 2031096). IowaStateLW-STEM: Iowa State University Plant Sciences Institute Scholars Program, NSF DMS-1916204, NSF CCF-1934884, Laurence H. Baker Center for Bioinformatics and Biological Statistics. JHU_IDD-CovidSP: State of California, US Dept of Health and Human Services, US Dept of Homeland Security, US Office of Foreign Disaster Assistance, Johns Hopkins Health System, Office of the Dean at Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University Modeling and Policy Hub, Centers fo Disease Control and Prevention (5U01CK000538-03), University of Utah Immunology, Inflammation, &amp; Infectious Disease Initiative (26798 Seed Grant). LANL-GrowthRate: LANL LDRD 20200700ER. MOBS-GLEAM_COVID: COVID Supplement CDC-HHS-6U01IP001137-01. NotreDame-mobility and NotreDame-FRED: NSF RAPID DEB 2027718 UA-EpiCovDA: NSF RAPID Grant # 2028401. UCSB-ACTS: NSF RAPID IIS 2029626. UCSD-NEU: Google Faculty Award, DARPA W31P4Q-21-C-0014, COVID Supplement CDC-HHS-6U01IP001137-01. UMass-MechBayes: NIGMS R35GM119582, NSF 1749854. UMich-RidgeTfReg: The University of Michigan Physics Department and the University of Michigan Office of Research.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:UMass-Amherst IRBAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data and code referred to in the manuscript are publicly available. https://github.com/reichlab/covid19-forecast-hub/ https://github.com/reichlab/covidEnsembles https://zoltardata.com/project/44

Emerging epidemics are challenging to track. Only a subset of cases is recognized and reported, as seen with the Zika virus (ZIKV) epidemic where large proportions of infection were asymptomatic. However, multiple imperfect indicators of infection provide an opportunity to estimate the underlying incidence of infection. We developed a modeling approach that integrates a generic Time-series Susceptible-Infected-Recovered epidemic model with assumptions about reporting biases in a Bayesian framework and applied it to the 2016 Zika epidemic in Puerto Rico using three indicators: suspected arboviral cases, suspected Zika-associated Guillain-Barré Syndrome cases, and blood bank data. Using this combination of surveillance data, we estimated the peak of the epidemic occurred during the week of August 15, 2016 (the 33rd week of year), and 120 to 140 (50% credible interval [CrI], 95% CrI: 97 to 170) weekly infections per 10,000 population occurred at the peak. By the end of 2016, we estimated that approximately 890,000 (95% CrI: 660,000 to 1,100,000) individuals were infected in 2016 (26%, 95% CrI: 19% to 33%, of the population infected). Utilizing multiple indicators offers the opportunity for real-time and retrospective situational awareness to support epidemic preparedness and response.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe author(s) received no specific funding for this work.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Exemption was obtained from the CDC Human Subjects Research Office as the data were collected as part of regular surveillance activities.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll relevant data are within the manuscript and its Supporting Information files.

INTRODUCTION Epidemic forecasting and prediction tools have the potential to provide actionable information in the midst of emerging epidemics. While numerous predictive studies were published during the 2016-2017 Zika Virus (ZIKV) pandemic, it remains unknown how timely, reproducible and actionable the information produced by these studies was.METHODS To improve the functional use of mathematical modeling in support of future infectious disease outbreaks, we conducted a systematic review of all ZIKV prediction studies published during the recent ZIKV pandemic using the PRISMA guidelines. Using MEDLINE, EMBASE and grey literature review, we identified studies that forecasted, predicted or simulated ecological or epidemiological phenomenon related to the Zika pandemic that were published as of March 01, 2017. Eligible studies underwent evaluation of objectives, data sources, methods, timeliness, reproducibility, accessibility and clarity by independent reviewers.RESULTS 2034 studies were identified, of which n = 73 met eligibility criteria. Spatial spread, R0 (basic reproductive number) and epidemic dynamics were most commonly predicted, with few studies predicting Guillain-Barré Syndrome burden (4%), sexual transmission risk (4%) and intervention impact (4%). Most studies specifically examined populations in the Americas (52%), with few African-specific studies (4%). Case count (67%), vector (41%) and demographic data (37%) were the most common data sources. Real-time internet data and pathogen genomic information were used in 7% and 0% of studies, respectively, and social science and behavioral data were typically absent in modeling efforts. Deterministic models were favored over stochastic approaches. Forty percent of studies made model data entirely available, 29% provided all relevant model code, 43% presented uncertainty in all predictions and 54% provided sufficient methodological detail allowing complete reproducibility. Fifty-one percent of predictions were published after the epidemic peak in the Americas. While the use of preprints improved the accessibility of ZIKV predictions by a median 119 days sooner than journal publication dates, they were used in only 30% of studies.CONCLUSIONS Many ZIKV predictions were published during the 2016-2017 pandemic. The accessibility, reproducibility, timeliness, and incorporation of uncertainty in these published predictions varied and indicates that there is substantial room for improvement. To enhance the utility of analytical tools for outbreak response, it is essential to improve the sharing of model data, code, and preprints for future outbreaks, epidemics and pandemics.Author summary Researchers published many studies which sought to predict and forecast important features of Zika virus (ZIKV) infections and their spread during the 2016-2017 ZIKV pandemic. We conducted a comprehensive review of such ZIKV prediction studies and evaluated their aims, the data sources they used, which methods were used, how timely they were published, and whether they provided sufficient information to be used or reproduced by others. Of the 73 studies evaluated, we found that the accessibility, reproducibility, timeliness, and incorporation of uncertainty in these published predictions varied and indicates that there is substantial room for improvement. We identified that the release of study findings before formal journal publication (‘pre-prints’) increased the timeliness of Zika prediction studies, but note they were infrequently used during this public health emergency. Addressing these areas can improve our understanding of Zika and other outbreaks and ensure that forecasts can inform preparedness and response to future outbreaks, epidemics and pandemics.

Seasonal influenza results in substantial annual morbidity and mortality in the United States and worldwide. Accurate forecasts of key features of influenza epidemics, such as the timing and severity of the peak incidence in a given season, can inform public health response to outbreaks. As part of ongoing efforts to incorporate data and advanced analytical methods into public health decision-making, the United States Centers for Disease Control and Prevention (CDC) has organized seasonal influenza forecasting challenges since the 2013/2014 season. In the 2017/2018 season, 22 teams participated. A subset of four teams created a research consortium called the FluSight Network in early 2017. During the 2017/2018 season they worked together to produce a collaborative multi-model ensemble that combined 21 separate component models into a single model using a machine learning technique called stacking. This approach creates a weighted average of predictive densities where the weight for each component is based on that component’s forecast accuracy in past seasons. In the 2017/2018 influenza season, one of the largest seasonal outbreaks in the last 15 years, this multi-model ensemble performed better on average than all individual component models and placed second overall in the CDC challenge. It also outperformed the baseline multi-model ensemble created by the CDC that took a simple average of all models submitted to the forecasting challenge. This project shows that collaborative efforts between research teams to develop ensemble forecasting approaches can bring measurable improvements in forecast accuracy and important reductions in the variability of performance from year to year. Efforts such as this, that emphasize real-time testing and evaluation of forecasting models and facilitate the close collaboration between public health officials and modeling researchers, are essential to improving our understanding of how best to use forecasts to improve public health response to seasonal and emerging epidemic threats.

Influenza infects an estimated 9 to 35 million individuals each year in the United States and is a contributing cause for between 12,000 and 56,000 deaths annually. Seasonal outbreaks of influenza are common in temperate regions of the world, with highest incidence typically occurring in colder and drier months of the year. Real-time forecasts of influenza transmission can inform public health response to outbreaks. We present the results of a multi-institution collaborative effort to standardize the collection and evaluation of forecasting models for influenza in the US for the 2010/2011 through 2016/2017 influenza seasons. For these seven seasons, we assembled weekly real-time forecasts of 7 targets of public health interest from 22 different models. We compared forecast accuracy of each model relative to a historical baseline seasonal average. Across all regions of the US, over half of the models showed consistently better performance than the historical baseline when forecasting incidence of influenza-like illness 1, 2 and 3 weeks ahead of available data and when forecasting the timing and magnitude of the seasonal peak. In some regions, delays in data reporting were strongly and negatively associated with forecast accuracy. More timely reporting and an improved overall accessibility to novel and traditional data sources are needed to improve forecasting accuracy and its integration with real-time public health decision-making.

Policymakers make decisions about COVID-19 management in the face of considerable uncertainty. We convened multiple modeling teams to evaluate reopening strategies for a mid-sized county in the United States, in a novel process designed to fully express scientific uncertainty while reducing linguistic uncertainty and cognitive biases. For the scenarios considered, the consensus from 17 distinct models was that a second outbreak will occur within 6 months of reopening, unless schools and non-essential workplaces remain closed. Up to half the population could be infected with full workplace reopening; non-essential business closures reduced median cumulative infections by 82%. Intermediate reopening interventions identified no win-win situations; there was a trade-off between public health outcomes and duration of workplace closures. Aggregate results captured twice the uncertainty of individual models, providing a more complete expression of risk for decision-making purposes.