Observation-Aware Calibration of Agent-Based Epidemic Simulations from Public Aggregate Reports: A COVID-19 City-Report Benchmark Study
Main Article Content
Abstract
City reports record confirmation, recovery or discharge, and death by publication date; agent-based simulations track latent disease events. We calibrated Covasim through an observation layer that converts cumulative reports to daily increments and aligns them with simulation outputs. A two-parameter Optuna-TPE search estimated transmission and initial infections. Shenzhen was reproduced under fixed stochastic settings, followed by independent recalibration in 12 non-Hubei first-wave cities. The Shenzhen fit reproduced the reported peak within one day (RMSE 7.2072, MAE 5.5848) but underestimated total reported cases by 20.66%. Gompertz fitted the same short curve more closely (RMSE 3.6874). Across the city panel, median RMSE was 3.3049 and peak-normalized RMSE was 0.1933. The framework links report-curve calibration to stochastic, auxiliary, and scenario outputs within a historical COVID-19 benchmark. Policy evaluation lies outside this benchmark.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
R. K. Nash, P. Nouvellet, A. Cori, et al., “Estimating epidemic dynamics from reporting-delay-adjusted incidence data,” PLOS Computational Biology, vol. 19, no. 8, 2023, Art. no. e1011439.
K. M. Gostic, L. McGough, E. Baskerville, et al., “Practical considerations for measuring the effective reproduction number in real time,” Epidemics, vol. 38, 2022, Art. no. 100543.
J. Ma, “Estimating epidemic exponential and sub-exponential growth dynamics in emerging outbreaks,” Journal of Theoretical Biology, vol. 520, 2021, Art. no. 110638.
C. C. Kerr, R. M. Stuart, D. Mistry, et al., “Covasim: an agent-based model of COVID-19 dynamics and interventions,” PLOS Computational Biology, vol. 17, no. 7, 2021, Art. no. e1009149.
K. Prem, K. Van Zandvoort, P. Klepac, et al., “Projecting social contact matrices in 152 countries using demographic data,” Nature Communications, vol. 12, 2021, Art. no. 386.
A. Aleta, D. Martin-Corral, A. Pastore y Piontti, et al., “Modeling the impact of testing, contact tracing and household quarantine,” Nature Communications, vol. 13, 2022, Art. no. 642.
K. Deb and H. Jain, “An evolutionary many-objective optimization algorithm using reference-point-based selection,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 2, pp. 417–430, 2022.
P. Nouvellet, T. Ganyani, C. Colijn, et al., “Human mobility and intervention effects in epidemic spread modeling,” Nature Reviews Physics, vol. 4, pp. 701– 715, 2022.
D. C. Adam, P. Wu, J. Y. Wong, et al., “Clustering and superspreading in COVID-19 transmission,” Nature Reviews Microbiology, vol. 21, no. 2, pp. 103–118, 2023.
Q. Bi, Y. Wu, S. Mei, et al., “Epidemiology and transmission of COVID-19 in Shenzhen, China,” The Lancet Infectious Diseases, vol. 21, no. 1, pp. 1–10, 2021.
W. O. Kermack and A. G. McKendrick, “A contribution to the mathematical theory of epidemics,” Proceedings of the Royal Society A, vol. 115, no. 772, pp. 700–721, 1927.
H. W. Hethcote, “The mathematics of infectious diseases,” SIAM Review, vol. 42, no. 4, pp. 599–653, 2000.
F. Brauer, “Mathematical epidemiology: Past, present, and future,” Infectious Disease Modelling, vol. 6, pp. 603–615, 2021.
H. J. Wearing, P. Rohani, and M. J. Keeling, “Appropriate models for infectious disease dynamics,” PLOS Biology, vol. 20, no. 3, 2022, Art. no. e3001571.
B. Bischl, M. Binder, and M. Lang, “Hyperparameter optimization and AutoML: A survey,” Journal of Machine Learning Research, vol. 24, no. 1, pp. 1–50, 2023.
T. Akiba, S. Sano, and T. Yanase, et al., “Optuna: a next-generation hyperparameter optimization framework,” in Proc. KDD, 2019, pp. 2623–2631.
DXY, “DXYArea.csv city-level COVID-19 public dataset (cumulative confirmed, recovered/discharged, deaths),” 2020.