Google's Open Source AI Tool Is a Major Step Forward for Accessibility in Gaming

ign.com:

Google has released a new AI tool that allows users to control mouse input using only their face and head movements.

Project Gameface is an open-source hands-free gaming mouse. The tool can mimic cursor movements by using a webcam and machine learning to move the cursor based on the user's facial and head movements.

Google brought the tech to power the tool to life using MediaPipe to develop a tool that can detect 468 points on the user's face. And the tool's UI allows players to assign different actions and shortcuts for each facial expression.

For example, you could assign the mouse to right-click when you open your mouth.

Project Gameface Screenshot | Image Credit: Google

The release of Project Gameface is a significant step forward toward accessibility in gaming. While hardware such as Microsoft's Xbox Adaptive Controller and Adaptive Mouse and PlayStation is currently working on Project Leonardo, rthe implementation of machine learning helps expand and improve the accessibility of gaming to more people, such as Lance Carr, a gamer with a form of muscular dystrophy who teamed up with engineers at Google to create the AI tool.

While AI has become quite a controversial topic in various industries, Project Gameface is one example of how AI can make a positive impact in people's lives. Project Gameface is still in development, but a preview build is available through GitHub for those looking to try it out.

Project Gameface is one of many projects announced this week by Google. On Wednesday, the company held its annual I/O, which saw a handful of AI and hardware announcements, including the first foldable Pixel phone.

Taylor is a Reporter at IGN. You can follow her on Twitter @TayNixster.