Document Type
Article
Publication Date
2025
Abstract
Objective: To evaluate effectiveness of open-source generative models in producing high-quality tabular synthetic data using a Health and Demographic Surveillance System (HDSS) dataset from rural Kenya, as a proof of concept in a low- and middle-income (LMIC) setting.
Materials and Methods: Three open-source models (CTGAN, TableGAN, and CopulaGAN) were used to generate synthetic data from the Kaloleni/ Rabai HDSS dataset. To assess the quality of the synthetic datasets generated by each model, we performed fidelity, utility, and privacy tests.
Results: CTGAN outperformed the other models, producing synthetic data that closely mirrored the statistical properties of the real dataset while preserving privacy. Both CopulaGAN and TableGAN performed poorly, with TableGAN completely failing to generate realistic synthetic data. For the utility tests, Random Forest models trained on CTGAN-generated synthetic data achieved comparable performance to models trained on real data (accuracy: 72.4% vs 72.0%, P¼.38; F1 score: 71.4% vs 68.3%, P¼.22), indicating no statistically significant loss in predictive utility. The CTGAN model also yielded higher precision and recall than CopulaGAN, suggesting that the synthetic data generated by CTGAN better preserved the underlying structure of the real data.
Discussion: CTGAN demonstrated superior performance in generating high-quality synthetic tabular HDSS data. CopulaGAN and TableGAN produced lower quality data, though these results may not generalize to other datasets.
Conclusion: Synthetic data generation of tabular data using HDSS data, particularly via CTGAN, may enhance the accessibility of datasets in LMICs by creating synthetic datasets that preserve the characteristics and statistical properties of the original data, while upholding privacy and confidentiality.
Recommended Citation
Mwigereri, Dorcas G., Niegel T. Kamotho, Akbar K. Waljee, Ryan T. Rego, Eileen M. Weinheimer-Haus, Farhana Alarakhiya, Anthoney K. Ngugi, W. Nicholson Price II, Ji Zhu, Stephen Peter Wong, Geoffrey H. Siwo. "Synthetic Data Generation of Health and Demographic Surveillance Systems Data: A Case Study in a Low- and Middle-Income Country." Journal of the American Medical Informatics Association 8, no. 6 (2025). DOI: https://doi.org/10.1093/jamiaopen/ooaf137
Comments
© The Author(s) 2025. Published by Oxford University Press on behalf of the American Medical Informatics Association.
This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact reprints@oup.com for reprints and translation rights for reprints. All other permissions can be obtained through our RightsLink service via the Permissions link on the article page on our site—for further information please contact journals.permissions@oup.com.