AI tool GPT-3 found to reason as well as undergraduate students
GPT-3, the popular AI-powered tool, was found to reason as well as college undergraduate students, scientists have found.
The artificial intelligence large language model (LLM) was asked to solve reasoning problems that were typical of intelligence tests and standardised tests such as the SAT, used by colleges and universities in the US and other countries to make admissions decisions.
The researchers from the University of California - Los Angeles (UCLA), US, asked GPT-3 to predict the next shape which followed a complicated arrangement of shapes. They also asked the AI to answer SAT analogy questions, all the while ensuring that the AI would have never encountered these questions before.
They also asked 40 UCLA undergraduate students to solve the same problems.
In the shape prediction test, GPT-3 was seen to solve 80 per cent of the problems correctly, between the humans' average score of just below 60 per cent and their highest scores.
"Surprisingly, not only did GPT-3 do about as well as humans but it made similar mistakes as well," said UCLA psychology professor Hongjing Lu, senior author of the study published in the journal Nature Human Behaviour.
In solving SAT analogies, the AI tool was found to perform better than the humans' average score. Analogical reasoning is solving never-encountered problems by comparing them to familiar ones and extending those solutions to the new ones.
The questions asked test-takers to select pairs of words that share the same type of relationships. For example, in the problem "'Love' is to 'hate' as 'rich' is to which word?," the solution would be "poor".
However, in solving analogies based on short stories, the AI did less well than students. These problems involved reading one passage and
Read more on tech.hindustantimes.com
