|
16 | 16 | Our results can assist collaborative forecasting efforts by identifying target participation rates
|
17 | 17 | and improving ensemble forecast performance.
|
18 | 18 |
|
| 19 | +- title: 'Challenges of COVID-19 Case Forecasting in the US, 2020-2021' |
| 20 | + slug: covid_case_challenges |
| 21 | + authors: Lopez V, Cramer EY, Pagano R, ... Biggerstaff M, Reich NG, Johansson MA |
| 22 | + preprint: https://www.medrxiv.org/content/10.1101/2023.05.30.23290732v1 |
| 23 | + pdf: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1011200 |
| 24 | + year: 2024 |
| 25 | + journal: PLOS Computational Biology |
| 26 | + doi: 10.1371/journal.pcbi.1011200 |
| 27 | + keywords: forecasting, covid-19 |
| 28 | + abstract: > |
| 29 | + During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers |
| 30 | + alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by |
| 31 | + the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately |
| 32 | + 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020 |
| 33 | + to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts |
| 34 | + relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across |
| 35 | + epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, |
| 36 | + with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger |
| 37 | + jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported |
| 38 | + cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases |
| 39 | + of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. |
| 40 | + However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key |
| 41 | + phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, |
| 42 | + addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across |
| 43 | + spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to |
| 44 | + inform pandemic-related decision making. |
| 45 | + |
19 | 46 | # 2023
|
20 | 47 |
|
21 | 48 | - title: 'Evaluating infectious disease forecasts with allocation scoring rules'
|
|
95 | 122 | probabilistic forecast scoring measures using MechBayes when compared to a baseline model. We show that MechBayes ranks as one of the top models
|
96 | 123 | out of those submitted to the COVID-19 Forecast Hub. Finally, we demonstrate that MechBayes performs significantly better than the classical SEIR model.
|
97 | 124 |
|
98 |
| -
|
99 | 125 | - title: 'Mixture distributions for probabilistic forecasts of disease outbreaks'
|
100 | 126 | slug: mix-distrib
|
101 | 127 | authors: Wadsworth S, Niemi J, Reich NG
|
|
147 | 173 | Combination techniques that explicitly adjust for known calibration issues in linear pooling should be considered
|
148 | 174 | to improve probabilistic scores in outbreak settings.
|
149 | 175 |
|
150 |
| -- title: 'Challenges of COVID-19 Case Forecasting in the US, 2020-2021' |
151 |
| - slug: covid_case_challenges |
152 |
| - authors: Lopez V, Cramer EY, Pagano R, ... Biggerstaff M, Reich NG, Johansson MA |
153 |
| - preprint: https://www.medrxiv.org/content/10.1101/2023.05.30.23290732v1 |
154 |
| - pdf: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1011200 |
155 |
| - year: 2023 |
156 |
| - journal: PLOS Computational Biology |
157 |
| - doi: 10.1371/journal.pcbi.1011200 |
158 |
| - keywords: forecasting, covid-19 |
159 |
| - abstract: > |
160 |
| - During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers |
161 |
| - alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by |
162 |
| - the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately |
163 |
| - 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020 |
164 |
| - to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts |
165 |
| - relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across |
166 |
| - epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, |
167 |
| - with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger |
168 |
| - jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported |
169 |
| - cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases |
170 |
| - of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. |
171 |
| - However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key |
172 |
| - phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, |
173 |
| - addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across |
174 |
| - spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to |
175 |
| - inform pandemic-related decision making. |
176 |
| -
|
177 | 176 | - title: 'Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations'
|
178 | 177 | slug: euro-evals
|
179 | 178 | authors: Sherratt K, Gruson H, Grah R, ... Gibson GC, Ray EL, Reich NG, Sheldon D, Wang Y, Wattanachit N, ... Bracher J, Funk S
|
|
0 commit comments