Reddit, often described as “the most human place on the internet,” is grappling with the rise of artificial intelligence-generated content, which threatens to erode the authenticity that the platform is known for. As AI content becomes more prevalent, moderators of some of Reddit’s most popular forums express concerns about its impact on the community’s integrity.
Travis Lloyd, a doctoral student in information science, highlighted three primary concerns among moderators: the decline in content quality, disruption of social dynamics, and the challenges of governance. “They were concerned about it on three levels: decreasing content quality, disrupting social dynamics and being difficult to govern,” Lloyd explained. In response, moderators are establishing new rules to maintain community standards, though enforcement remains a significant challenge.
The Research Behind the Concerns
The findings are part of a study titled “‘There Has To Be a Lot That We’re Missing’: Moderating AI-Generated Content on Reddit,” which Lloyd co-authored with Mor Naaman, a professor at Cornell Tech, and Joseph Reagle, an associate professor at Northeastern University. This research is set to be presented at the ACM SIGCHI Conference on Computer-Supported Cooperative Work and Social Computing in Bergen, Norway.
Reddit hosts over 110 million daily active users who engage in discussions spanning a wide array of topics. The platform allows users to post content, comment, and vote, with each subreddit setting its own criteria for engagement. Previous research by Lloyd and Naaman explored how Reddit communities were reacting to AI content, but this latest study delves deeper by engaging directly with content moderators.
Challenges in Detecting AI Content
Initiated in 2023, shortly after the release of ChatGPT, the study aimed to understand how AI tools were affecting Reddit’s information ecosystem. “We had a hard time studying it because it (AI-generated content) is hard to detect,” Lloyd noted. This difficulty extends to moderators, who often struggle to identify AI-generated posts.
The research involved interviews with 15 moderators overseeing more than 100 subreddits, ranging from small communities to those with over 32 million members. While some moderators acknowledged the potential benefits of AI, such as aiding in language translation, the overall sentiment was negative.
Impact on Content Quality and Social Dynamics
One of the primary concerns is the quality of AI-generated content. According to a moderator interviewed for the study, AI content often fails to meet the depth and substance expected in typical posts, with frequent errors in style and accuracy. These issues contribute to a perceived decline in the quality of discussions.
Social dynamics are also at risk, with moderators fearing that AI could diminish meaningful interactions and strain community relationships. “I would rate it as the most threatening concern,” said the moderator of r/explainlikeimfive. “It’s often hard to detect and we do see it as very disruptive to the actual running of the site.”
The Burden on Moderators
Moderators, who volunteer their time to maintain Reddit’s community standards, are facing increased pressure due to the influx of AI content. Naaman emphasized the challenge, stating, “It remains a huge question of how they will achieve that goal. A lot of it will inevitably go to the moderators, who are in limited supply and are overburdened.”
Despite these challenges, there is hope. Lloyd noted that the desire for human interaction persists. “This study showed us there is an appetite for human interaction, too,” he said. “And as long as there is that desire, which I don’t see going away, I think people will try to create these human-only spaces. I don’t think it’s hopeless.”
Looking Forward
The study underscores the need for platforms like Reddit, along with the research community, to address the challenges posed by AI-generated content. Without intervention, these online communities risk being overwhelmed by AI.
This research was supported in part by funding from the National Science Foundation, highlighting the importance of understanding and managing the impact of AI on digital communities.
