Powder, an AI clipping tool for gaming, can detect when a creator yells during a stream

techcrunch.com:

Powder, AI-powered clipping software that takes highlights from gaming streams and turns them into short-form videos, will soon be able to detect shouting for gamers to create even better montages. The platform is also working on speech-to-text software so creators can get a transcript of their entire stream and search for keywords.

Powder has developed over 40 proprietary game-specific AI models, including audio analysis and laughter detection, as well as standalone models for popular titles like Fortnite, Valorant, Apex Legends, Call of Duty, Rocket League, Fall Guys, Elden Ring and Among Us. The company is also launching a model for Counter-Strike 2.

All the models work similarly; the AI scans the stream recordings – whether from Twitch, YouTube or an MP4 file — and finds spikes in activity, including victories, assists, kills and other performance-based in-game moments. Powder takes these highlights and creates short montages for creators to upload to social media.

Image Credits: Powder

Similar to its laughter recognition capability, the platform will soon launch another AI tool that recognizes fluctuations in voice so creators can generate clips of them shouting—a common reaction when playing intense ranked matches. The company anticipates a mid-December launch.

“From uncontrollable laughter and rage quits to even when there’s nothing obvious happening on-screen, the best moments when gaming is highly subjective and need to be reflected with several different perspectives that extend beyond the gameplay itself,” Powder co-founder and CEO Barthélémy Kiss told TechCrunch. “This made us certain that we needed to capture the emotion of playing games with your community. This combination of skill-based moments and deeply