Last updated: February 25, 2023, 8:36 AM IST
ChatGPT has been tested as a language-based interface between a non-technical user and a drone.
Microsoft has done research to see if ChatGPT can think outside the text and think about the physical world to help with robot tasks.
To test whether people can use ChatGPT to instruct robots without knowing programming languages or understanding robot systems, Microsoft has done research to see if it can think outside the text and think about the physical world to aid in robot tasks.
“The main challenge here is to teach ChatGPT how to solve problems, taking into account the laws of physics, the context of the work environment, and how the robot’s physical actions can change the state of the world,” Microsoft said in a blog post.
“It turns out that ChatGPT can do a lot by itself, but still needs some help. Our technical paper describes a set of design principles that can be used to guide language models in solving robotic tasks. These include, and are not limited to, special prompt structures, high-quality APIs and human feedback via text,” he added.
After ChatGPT accessed object detection and object distance data through application interfaces, the Microsoft researchers explored the possibility of generating code, mostly in Python, for robotics scenarios such as zero-shot planning and code generation.
Because the AI chatbot has been trained on a large amount of code and written text, it can generate code.
The system can fix coding problems and debug programs, as well as respond to dialogue and seek clarification, the researchers said.
In addition, ChatGPT was tested as a language-based interface between a non-technical user and a drone, taking into account these dialogue and clarification capabilities.
The researchers note that while GPT-3, LaMDA and Codex showed good results when it comes to robotics planning and coding, ChatGPT stands out as “a potentially more versatile tool for robotics because it incorporates natural language and code generation models with dialog flexibility.”
“ChatGPT asked clarifying questions when the user’s instructions were ambiguous and wrote complex code structures for the drone, such as a zigzag pattern to visually inspect shelves,” the researchers said.
Microsoft tested ChatGPT using a robotic arm to move blocks to form the Microsoft logo, writing an algorithm for a drone to reach a point without crashing into obstacles, and whether ChatGPT can decide where a robot should go based on sensor feedback in real-time.
Read all the latest technical news here
(This story has not been edited by News18 staff and was published from a syndicated news agency feed)
