Coming to a workplace near you? — They plugged GPT-4 into Minecraftand unearthed new potential for AI A bot plays the video game by tapping the text generator to pick up new skills.

Will Knight, wired.com – Jun 3, 2023 10:54 am UTC EnlargeMicrosoft reader comments 88 with

The technology that underpins ChatGPT has the potential to do much more than just talk. Linxi Jim Fan, an AI researcher at the chipmaker Nvidia, worked with some colleagues to devise a way to set the powerful language model GPT-4the brains behind ChatGPT and a growing number of other apps and servicesloose inside the blocky video game Minecraft.

The Nvidia team, which included Anima Anandkumar, the companys director of machine learning and a professor at Caltech, created a Minecraft bot called Voyager that uses GPT-4 to solve problems inside the game. The language model generates objectives that help the agent explore the game, and code that improves the bots skill at the game over time.

Voyager doesnt play the game like a person, but it can read the state of the game directly, via an API. It might see a fishing rod in its inventory and a river nearby, for instance, and use GPT-4 to suggest the goal of doing some fishing to gain experience. It will then use this goal to have GPT-4 generate the code needed to have the character achieve it.

The most novel part of the project is the code that GPT-4 generates to add behaviors to Voyager. If the code initially suggested doesnt run perfectly, Voyager will try to refine it using error messages, feedback from the game, and a description of the code generated by GPT-4.

Over time, Voyager builds a library of code in order to learn to make increasingly complex things and explore more of the game. A chart created by the researchers shows how capable it is compared to other Minecraft agents. Voyager obtains more than three times as many items, explores more than twice as far, and builds tools 15 times more quickly than other AI agents. Fan says the approach may be improved in the future with the addition of a way for the system to incorporate visual information from the game. Advertisement

While chatbots like ChatGPT have wowed the world with their eloquence and apparent knowledgeeven if they often make things upVoyager shows the huge potential for language models to perform helpful actions on computers. Using language models in this way could perhaps automate many routine office tasks, potentially one of the technologys biggest economic impacts.

The process that Voyager uses with GPT-4 to figure out how to do things in Minecraft might be adapted for a software assistant that works out how to automate tasks via the operating system on a PC or phone. OpenAI, the startup that created ChatGPT, has added plugins to the bot that allow it to interact with online services such as grocery delivery app Instacart. Microsoft, which owns Minecraft, is also training AI programs to play it, and the company recently announced Windows 11 Copilot, an operating system feature that will use machine learning and APIs to automate certain tasks. It may be a good idea to experiment with this kind of technology inside a game like Minecraft, where flawed code can do relatively little harm.

Video games have long been a test bed for AI algorithms, of course. AlphaGo, the machine learning program that mastered the extremely subtle board game Go back in 2016, cut its teeth by playing simple Atari video games. AlphaGo used a technique called reinforcement learning, which trains an algorithm to play a game by giving it positive and negative feedback, for example from the score inside a game.

It is more difficult for this method to guide an agent in an open-ended game such as Minecraft, where there is no score or set of objectives and where a players actions may not pay off until much later. Whether or not you believe we should be preparing to contain the existential threat from AI right now, Minecraft seems like an excellent playground for the technology.

This story originally appeared on wired.com. reader comments 88 with Advertisement Channel Ars Technica ← Previous story Next story → Related Stories Today on Ars