Even cozy games can get toxic

engadget.com:

Former professional esports player Dennis Fong founded GGWP in 2022, more than a year before companies like Microsoft and Google debuted their natural-language search engines and the AI revolution officially gripped the globe. GGWP is an AI-powered moderation system that identifies and takes action against in-game harassment and hate speech, and after two years on the scene, it’s now integrated into titles at more than 25 studios.

Fong may be a veteran of the Doom and Quake esports scenes, but he’s interested in protecting players from abuse in every genre, especially as social features become easier to implement for studios of all sizes. GGWP is live in thatgamecompany’s social adventure title Sky: Children of the Light, the meditation app TRIPP VR, the kids-focused MMO Toontown Rewritten, the first-person MOBA Predecessor, Fatshark’s action shooter Warhammer 40,000: Darktide, the metaverse platform The Sandbox, and it powers Unity’s anti-abuse toolset.

These aren’t all gritty military sims or hardcore competitive franchises like Counter-Strike or League of Legends, where you might expect emotional outbursts and increased toxicity. One-third of the games that utilize GGWP are co-op and PvE experiences, rather than competitive PvP settings, according to Fong. Turns out, cozy games need moderation too.

“Cozy games tend to see a lot more chat activity when compared to competitive games, so naturally there tend to be far more incidents that are chat-related as compared to gameplay,” Fong said. “That said, users are clever and are always discovering new ways to turn something intended to be positive, like a ‘thank you’ emote, into something negative by using it after a player makes a mistake. We help companies understand what’s happening and then implement tools to help curb that behavior.”

GGWP’s Unity partnership is particularly notable, if only because of its potential scale. GGWP powers Unity’s Safe Text and Safe Voice products, including its Vivox voice chat