Stunning new ChatGPT-powered game lets you walk inside your dreams

A new ‘Dream Simulator’ game harnesses the power of ChatGPT to recreate people’s dreams in 3D – instantly.

The PC game called Project Electric Sheep uses OpenAI’s GPT-3 AI, where people type what they dream about and then watch the landscape come to life around them.

A voice asks, “What do you want to dream about?” Then the player types in their choices and the game creates the world around them in 3D in seconds.

Users can move around in their dreams with a mouse and interact and talk to the people in their dreams.

Users are asked: ‘What do you want to dream about?’

Recent demos at SXSW have seen users recreate dreams from a space wedding in Las Vegas, recreating 1980s East Berlin to partying on top of a mountain on Pluto using Project Electric Sheep.

Gadney said, “People were stunned. I think people with ChatGPT expect them to type in prompts and try to hack their high school essay or whatever.

“But we plugged it directly into a video game engine to create these worlds — and people are surprised to be able to step into their dreams. There’s a lot of surprise.’

Games companies are rushing to update games with generative AI, using artificial intelligence to do everything from creating landscapes in games to creating “intelligent” characters.

Gaming giant Ubisoft has announced a new AI tool, Ghostwriter, that can automatically create scripts for non-player characters (NPCs).

Gadney says Project Electric Sheep is meant to be an art project, but he believes AI will be a big part of the future of games.

The game creates strange landscapes

Users can interact with characters and move around with a mouse

The dreams begin when you approach the bed

An unfinished version of Project Electric Sheep is available for free for PC via Steam Early Access, with an expected launch date in the second quarter of 2023.

“There’s something really dreamy about AI right now,” said Guy Gadney, CEO and co-founder of Charisma.

“The lyrics aren’t perfect – and that’s why we chose the idea to create that dreamscape, I think it’s a good fit!”

Users simply type in their dream (several suggested dreams come up as you type), and the GPT-3 technology in the game generates landscapes and characters.

“When you go into the game, the question is, ‘What do you want to dream about?’ says Gadney.

You could type, “A castle in the middle of a field on a sunny day,” and the game will generate that description in 3D.

In The Kraken Wakes, users can interact with AI-powered characters

In The Kraken Wakes, users can interact with AI-powered characters

Gadney says Project Electric Sheep isn’t as simple as plugging ChatGPT into a 3D game engine.

He says, “It’s building a layer in between that allows this stuff to come to life in interesting ways. The goal was to do something no one has ever done before.’

Gadney’s London-based studio, Charisma.ai, is also developing an AI-powered game based on John Wyndham’s classic novel The Kraken Wakes.

In the Kraken Wakes, the AI ​​allows players to talk to in-game characters in natural language – and have them respond, just like chatting with ChatGPT.

There are some script elements to make sure the story moves forward, says Gadney.

Gadney says, “It’s smoother than the normal ‘split path’ you get in a video game: the responses are much more natural conversational.

“The analogy we use sometimes is it’s like a skateboarding half-pipe, you know, where the story goes down, driven by tension and pace, and it has to move forward.

“Move forward is how we engage. But you know, people can go up and down and have conversations about conspiracy theories or whatever they want.”

Gadney says he believes games where people have unwritten conversations with AI will become popular, but says it will never replace scripted entertainment.

The team started working on Electric Sheep with OpenAI’s previous language model GPT-2, then plugged in GPT-3 when it came out.

“As all this generative AI has come into being, we rode that wave and understood it to see what we could do,” says Gadney.

We want to push the technology further creatively than anyone else. But I have no doubt that this kind of AI will have a huge impact on video games.”

Gadney says he imagined Electric Sheep could help people live troubled dreams — in a “safe” way on their PCs.

He says, “Reliving the stress can be part of the healing, so reliving a dream can be one way of healing.”