BiasFairnessExplainabilitycs.LG
Addressing Challenges in Data Quality and Model Generalization for Malaria Detection
Kiswendsida Kisito Kabore, Desire Guel
December 31, 2024
Journal of Sensor Networks and Data Communications
5 citations
Key Takeaways
-
Data imbalance is a critical problem: When training datasets have unequal numbers of malaria-positive and malaria-negative samples, AI model performance drops significantly—by as much as 20% in diagnostic accuracy metrics. This means models trained on imbalanced data may miss cases or produce unreliable results in real clinical settings.
-
AI models struggle to work across different regions: Models trained in one geographic area often perform poorly when deployed in another due to regional biases in the data. Domain adaptation techniques like transfer learning can improve cross-region performance by up to 25%, suggesting that building geographically diverse training datasets is essential for equitable global health applications.
-
Synthetic data generation shows promise but isn't a complete solution: Using AI to generate artificial training data (GAN-based augmentation) improved accuracy by 15-20%, helping balance datasets and increase diversity. However, this technological fix alone is insufficient without addressing underlying data collection challenges.
-
Global collaboration on data-sharing is fundamental: The paper emphasizes that developing diverse, shared datasets across countries and institutions is essential for creating reliable malaria detection tools that work equitably worldwide, particularly in resource-limited regions where malaria burden is highest.
-
Explainability matters for clinical trust: Making AI decision-making transparent and interpretable is crucial for doctors and health workers to adopt these tools in practice, suggesting that technical accuracy alone is insufficient for real-world implementation in healthcare.