Sony Leaks AI-Powered PlayStation Character Prototype

A leaked internal Sony video reveals the company's exploration of AI-powered PlayStation characters. The Verge reported on a PlayStation Studios' advanced technology group video showcasing AI-powered Aloy from the *Horizon* games. The video, subsequently removed from YouTube due to a copyright claim from Muso (a Sony client), features Sony Interactive Entertainment director of software engineering, Sharwin Raghoebardajal, conversing with an AI Aloy. The technology uses OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue, Sony's Emotional Voice Synthesis (EVS) for speech, and Mockingbird for facial animation.

The AI Aloy, voiced by a robotic text-to-speech generator (not Ashly Burch), displays stiff facial movements and lifeless eyes. In the demo, Raghoebardajal asks Aloy about her well-being and her search for her mother. Aloy's responses, generated by the AI, reflect plot points from the *Horizon* games, such as her discovery of being a clone of Dr. Elizabeth Sobeck.

The demo transitions to *Horizon Forbidden West*'s game world, where Raghoebardajal continues the conversation while playing. The interaction, while showcasing the technology, highlights the contrast between AI-generated dialogue and the in-game experience. The demo, a prototype developed with Guerrilla Games, is presented as a demonstration of potential, with Sony yet to confirm its use in any released product.

Sony's AI exploration aligns with industry trends. Microsoft's AI, Muse, generates game design ideas, while Keywords Studios' experiment with fully AI-generated games failed, highlighting the limitations of current AI technology. EA and Capcom have also expressed interest in AI for game development, emphasizing its potential for generating vast amounts of content. Asad Qizilbash, Head of PlayStation Productions and head of product at PlayStation Studios, noted the importance of AI-driven personalization for younger Gen Z and Gen Alpha gamers.

Activision's recent admission of using generative AI for some *Call of Duty: Black Ops 6* assets, amidst criticism over AI-generated content, underscores the ongoing debate surrounding AI's role in game development and the need to balance innovation with ethical considerations and quality control.

What's The Best PlayStation 5 Game?

Pick a winner