Skip to content

Commit 64bf5ad

Browse files
mmkerrbsweger
authored andcommitted
Update publications.yml
Corrected 2024 publication date and moved to 2024 section
1 parent f5f4953 commit 64bf5ad

File tree

1 file changed

+27
-28
lines changed

1 file changed

+27
-28
lines changed

_data/publications.yml

Lines changed: 27 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,33 @@
1616
Our results can assist collaborative forecasting efforts by identifying target participation rates
1717
and improving ensemble forecast performance.
1818
19+
- title: 'Challenges of COVID-19 Case Forecasting in the US, 2020-2021'
20+
slug: covid_case_challenges
21+
authors: Lopez V, Cramer EY, Pagano R, ... Biggerstaff M, Reich NG, Johansson MA
22+
preprint: https://www.medrxiv.org/content/10.1101/2023.05.30.23290732v1
23+
pdf: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1011200
24+
year: 2024
25+
journal: PLOS Computational Biology
26+
doi: 10.1371/journal.pcbi.1011200
27+
keywords: forecasting, covid-19
28+
abstract: >
29+
During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers
30+
alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by
31+
the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately
32+
9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020
33+
to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts
34+
relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across
35+
epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models,
36+
with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger
37+
jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported
38+
cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases
39+
of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics.
40+
However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key
41+
phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data,
42+
addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across
43+
spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to
44+
inform pandemic-related decision making.
45+
1946
# 2023
2047

2148
- title: 'Evaluating infectious disease forecasts with allocation scoring rules'
@@ -95,7 +122,6 @@
95122
probabilistic forecast scoring measures using MechBayes when compared to a baseline model. We show that MechBayes ranks as one of the top models
96123
out of those submitted to the COVID-19 Forecast Hub. Finally, we demonstrate that MechBayes performs significantly better than the classical SEIR model.
97124
98-
99125
- title: 'Mixture distributions for probabilistic forecasts of disease outbreaks'
100126
slug: mix-distrib
101127
authors: Wadsworth S, Niemi J, Reich NG
@@ -147,33 +173,6 @@
147173
Combination techniques that explicitly adjust for known calibration issues in linear pooling should be considered
148174
to improve probabilistic scores in outbreak settings.
149175
150-
- title: 'Challenges of COVID-19 Case Forecasting in the US, 2020-2021'
151-
slug: covid_case_challenges
152-
authors: Lopez V, Cramer EY, Pagano R, ... Biggerstaff M, Reich NG, Johansson MA
153-
preprint: https://www.medrxiv.org/content/10.1101/2023.05.30.23290732v1
154-
pdf: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1011200
155-
year: 2023
156-
journal: PLOS Computational Biology
157-
doi: 10.1371/journal.pcbi.1011200
158-
keywords: forecasting, covid-19
159-
abstract: >
160-
During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers
161-
alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by
162-
the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately
163-
9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020
164-
to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts
165-
relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across
166-
epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models,
167-
with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger
168-
jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported
169-
cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases
170-
of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics.
171-
However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key
172-
phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data,
173-
addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across
174-
spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to
175-
inform pandemic-related decision making.
176-
177176
- title: 'Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations'
178177
slug: euro-evals
179178
authors: Sherratt K, Gruson H, Grah R, ... Gibson GC, Ray EL, Reich NG, Sheldon D, Wang Y, Wattanachit N, ... Bracher J, Funk S

0 commit comments

Comments
 (0)