ExplainabilityBiasFairnesscs.CV
Explainable Multimodal Sentiment Analysis on Bengali Memes
Kazi Toufique Elahi, Tasnuva Binte Rahman, Shakil Shahriar, Samir Sarker, Sajib Kumar Saha Joy, Faisal Muhammad Shah
December 20, 2023
2023 26th International Conference on Computer and Information Technology (ICCIT)
11 citations
1 influential
Key Takeaways
-
Multimodal AI outperforms single-modality approaches for understanding memes: The study demonstrates that combining both image and text analysis (using ResNet50 for images and BanglishBERT for text) achieves better sentiment detection than analyzing either images or text alone, suggesting that memes require holistic interpretation to capture their full emotional meaning.
-
Low-resource languages face significant AI gaps: Bengali meme sentiment analysis remains understudied compared to English-language research, with limited publicly available datasets and lower model performance (0.71 weighted F1-score), highlighting how responsible AI development must address underrepresented languages to avoid creating technology that only serves wealthy, English-speaking populations.
-
Explainability is essential for culturally-sensitive content moderation: The paper emphasizes using XAI (explainable artificial intelligence) techniques to interpret model decisions, which is critical for meme analysis since sentiment often depends on cultural context, sarcasm, and humor—areas where AI systems can easily make mistakes without transparent reasoning that humans can verify.
-
Dataset quality directly impacts AI fairness: The study identifies that the existing MemoSen dataset suffers from imbalanced distribution, demonstrating how poor data quality perpetuates biased AI systems that may misclassify certain sentiment categories, a key concern for responsible deployment in content moderation or social media monitoring.