Examining Risks Through a Characterization of the AI Companion Application Ecosystem: A Stratified Sample from the Apple App Store and Google Play Store

The AI companion app ecosystem is largely unregulated: Researchers identified 489 AI companion apps across major app stores, yet found significant risks related to sensitive data collection and sharing with minimal apparent safeguards, suggesting current app store policies may be insufficient for this emerging category.

These apps use design features that encourage unhealthy attachment: The analysis identified concerning engagement mechanisms and anthropomorphism strategies (making AI seem human-like) that may foster dependency, particularly problematic given that some apps are marketed to minors without adequate age-gating or content warnings.

Sexual content and intimate imagery risks are widespread: The study found that many AI companion apps enable sexual interactions and have the capability to generate synthetic nonconsensual intimate imagery (deepfake pornography), creating potential harms for both users and individuals whose likenesses could be misused without consent.

User data vulnerability is a critical concern: Apps collect sensitive personal information through intimate conversations but lack transparent privacy practices, with unclear data sharing policies that could expose vulnerable users—particularly minors and those experiencing mental health challenges—to exploitation.

Multiple stakeholders must act to reduce harms: The researchers call for responsibility across app stores (better review standards), developers (privacy protections and age-appropriate design), regulators (clearer guidelines), and researchers (ongoing monitoring), rather than relying on any single entity to address these risks.