Overview
Recommender systems shape content exposure on online platforms, and a growing body of research suggests these systems—optimized for engagement—can promote filter bubbles, reduce ideological diversity, and in some cases, heighten online radicalization. This paper investigates how LLM-based reranking of YouTube recommendations reshapes political content exposure, and whether prompt-level constraints can reduce the promotion of conspiratorial and extremist content without sacrificing personalization. Here are the key findings:
- LLM-based content reranking improves personalization and aligns video recommendations more closely to a user’s prior viewing. LLM-based rankings also made suggestions more strongly aligned with the ideological leaning of a user’s watch history, compared to YouTube’s baseline. For users with watch histories containing conspiratorial or extremist content, it amplified exposure to that material.
- Safer prompt guidelines reduced exposure to problematic content without hampering personalization of video recommendations. This suggests that, “it is not language-based models per se that promote problematic content, but the absence of explicit regularization.”
- For topics like abortion and immigration, the LLM prioritized topic relevance over partisan alignment—sometimes even surfacing opposing viewpoints. For broader topics like elections, where partisan language is more intertwined with other issues, it prioritized partisan alignment over topic. This mixed behavior suggests LLMs operate on statistical language patterns rather than ideological understanding.
Why Is This Important?
Platforms recommend content to maximize engagement and time spent on the platform, which has reinforced filter bubbles and undermined ideological diversity. This paper shows that naively deploying LLM-based recommendation systems can reproduce—and even amplify—these harms. However, with appropriate prompting safeguards, the authors show that LLM-based systems can mitigate these threats without sacrificing personalization.