Thanks to the efforts of ChatGPT and Microsoft to integrate the natural language processing tool with Bing, you can’t help but mention AI in the last few weeks of tech news. But while some wring their hands and think this is the genesis of the rise of machines, others have been quick to point out the stupid answers these “artificial intelligence” tools are spewing out.
And as it stands, I’m not convinced that journalists and people with expertise will be easily replaced by intelligent algorithms and chatbots that aren’t quite as dumb as before. But as I pondered this idea and ChatGPT’s potential to be more than a flash in the pan, I had an idea: AI-powered chatbots and advanced natural language processing could really be a boon to virtual reality games and experiences.
Shortly after my PSVR 2 review, I thought about whether VR could really break out of the niche it’s in; although this niche is a bit big. While Horizon Call of the Mountain has impressed so far, and I think PSVR 2 has a lot of potential, there are still few VR experiences that offer an experience that’s more than, ‘Oh, I can look around and get a feel for it Depth’ and ‘Oh, I’m getting dizzy dangling off a virtual cliff.’
As good as PSVR 2 is at communicating feedback, I’ve had experience climbing structures in VR and enjoying kinetic battles like SuperHot. With all the tech that PSVR 2 has and the power of the PS5 at my disposal, I was excited for a VR game that really does something completely new. I think AI and ChatGPT could help here.
AI and VR could offer engaging virtual experiences
(Image credit: Future)
Most VR games are very linear or have limited options to make your experience feel different from others. That’s understandable as I can’t quite imagine open world games would work well with current VR headsets – the PSVR 2 is comfortable but I can’t imagine wearing it for extended gaming sessions.
While I’ll never turn my nose up at being able to line arrow shots in the eyes of a roaming sentinel or throw an unloaded weapon to smash an approaching enemy, I’d like a fresher take on a virtual world to interact.
Now PSVR 2 features eye-tracking, where NPCs in some games can appear to respond to your gaze – it wasn’t obvious in my testing, but it’s early days – what if that were paired with some sort of AI-powered chatbot ? You could have a game where NPCs can use natural language processing and reading one’s own gaze to create unique conversations with the player.
I understand the basics of a neural network and how AI systems can learn, but I’m no expert and I can totally understand why these ideas could be a technical nightmare. But as even people like Siri get better at handling natural language requests, there’s more scope for chatbots to better analyze what people are saying.
Imagine, if you will, a VR Mass Effect game where you can wander around a ship and talk to a variety of characters like you can in the regular Mass Effect games. Only, rather than picking rough answers via a conversation wheel, reply your own way, using AI processing to figure out what you mean and using eye and gesture tracking technology to understand the relationship between your words, looks, and Interpret movements to better figure out how to say something. In a way, you could think of this as the near-final conclusion to text-based adventures, only you’re feeding an AI many more variables and natural language.
Prompts or crude interaction prompts could be used to get the player to say something that the AI could process (e.g. a game’s story and world and so on, even for the most advanced AI technology of today and the near future be a bit much.
Also, safeguards would be needed against people trying to push the limits of AI, e.g. B. when Liara raises her eyebrows at a certain rude remark. Or have Garrus go back to his calibrations if the player keeps asking him what his favorite sandwich is or some other nonsense like that.
Alternatively, we could use the combination of AI, procedural generation, and a headset’s tracking technology to better customize and evolve a person’s experience in a game or virtual environment. For example, a route around an area could be adjusted based on how fast the player is moving or what they are looking at. That could help make such dives in VR feel unique and fresh, rather than an evolution of what came before.
Again, I’m aware that this could be an extremely ambitious use of ChatGPT and OpenAI based technology. But using AI to further deepen a virtual reality experience beyond haptics and a better sense of space could be the key to really making VR games stand out and more than casual experiences.
Of course, I’m still looking forward to delving more into Horizon Call of the Mountain and trying out Gran Turismo 7 in VR. But I’m hoping that PSVR 2 will help spearhead a new wave of VR games that look at dealing with virtual reactions a little differently than following my attempts to toss the bird at an annoying NPC.
Today’s best Sony PlayStation Pulse 3D Wireless Headset deals
