AI isn't enough to protect social media communities from AI: study

Even where online community moderators actively use tools to flag AI-generated content, they still can't keep pace with the scale of the problem, a Cornell and Northeastern study finds. Researchers interviewed 15 Reddit moderators who collectively oversee more than 100 subreddits, ranging from 10 to over 32 million members.

The authors describe AI-generated content as a "triple threat" to communities: it decreases content quality, disrupts social dynamics, and creates governance difficulties. One moderator described a typical AI post this way: "tries to meet the substance and depth of a typical post... however, there are frequent glaring errors in both style and content." Another moderator admitted: "It's often hard to detect and we do see it as very disruptive." Work on the study began in 2023, shortly after ChatGPT's release, and covered communities including r/AskHistorians, r/WritingPrompts, and r/explainlikeimfive. The paper received an honorable mention for best paper at the ACM SIGCHI Conference on Computer-Supported Cooperative Work and Social Computing.

“We see the obvious stuff and we prune the obvious stuff... but there has to be a lot that we're missing.”

— r/news moderator, quoted in the study

• 15 moderators interviewed, overseeing 100+ subreddits (10 to 32+ million members)
• AI content described as a "triple threat": content quality, social dynamics, community governance
• Reddit has 110+ million daily active users — a scale that makes manual review impossible

This study directly intersects with something we've been covering: just days ago, Reddit itself launched Rules Hub, a suite of AI-powered tools for moderating subreddits, and around the same time we wrote about how xAI's Grokipedia, Elon Musk's AI encyclopedia, has gone months without processing reader edits. A discouraging pattern is emerging: platforms are betting on AI as the tool for controlling content quality, while this study directly shows that AI itself remains the source of a problem it can't yet reliably solve.

None of this should be read as personalized investment advice.