TransparencyAccountabilityTrustworthinesscs.CY
AI Transparency in Academic Search Systems: An Initial Exploration
Yifan Liu, Peter Sullivan, Luanne Sinnamon
August 2, 2024
Proceedings of the Association for Information Science and Technology
9 citations
Key Takeaways
-
Significant transparency gaps exist: The study found that 50% of AI-enhanced academic search systems examined provide only partial or minimal information about how they work, meaning researchers may be using tools without understanding their underlying mechanisms.
-
Universities are recommending opaque tools: Academic institutions are guiding researchers toward these systems through library guides despite many lacking adequate transparency, potentially compromising the ability to verify and reproduce research findings.
-
Research integrity is at risk: The opacity of these systems raises concerns about reproducibility and researcher responsibility—core principles of scholarly work—since researchers cannot fully explain or justify how their search results were generated.
-
Trust in search outcomes cannot be assured: Without clear information about AI mechanisms, researchers cannot confidently determine whether search results are reliable or whether the systems introduce bias, errors, or other issues that could affect the validity of their work.
-
Urgent action needed from system developers: The wide variation in transparency levels (from detailed to none) suggests that standardized disclosure practices for AI-enhanced academic tools are needed to protect research integrity and maintain trust in the scholarly ecosystem.