Gadgets Now | Sourabh Kulesh Feb 22, 2023 8:33 AM IST
ChatGPT launched late last year and has become a rage. The AI chatbot, which uses the GPT-3 language model, has both haters and ardent supporters. The chat tool’s capabilities have led people to experiment with the tool. This includes passing some of the tough international tests across streams. Here is a list of some competitive trials that ChatGPT has cracked and one major trial that hasn’t existed before.
Subscribe to Gadgets Now Alerts for the latest tech news, reviews and more
Business degree from the Wharton School of Business at the University of Pennsylvania
In a business course, ChatGPT received a B to B grade, which is considered a respectable score for a student on the course. According to an article, Wharton economics professor Christian Terwiesch said the chatbot “did an amazing job” at answering simple questions related to operations management and process analysis questions.
However, ChatGPT had problems and sometimes made mistakes in sixth grade math calculations. Terwiesch said that the AI has the ability to modify its answer when given hints about the correct answer.
Law exams at the University of Minnesota
ChatGPT has passed law exams in four courses at the University of Minnesota. It answered 95 multiple choice questions and 12 essay questions and scored a C+. According to a recently published paper written by four professors from the university’s law school, the professors gave ChatGPT a “low but passing grade in all four courses.”
Professors also said that although ChatGPT would have been a mediocre law student, “his performance was sufficient to successfully earn a J.D. degree from a highly selective law school.”
Multi-State Bar Examination (MBE)
In this legal exam, ChatGPT achieved an accuracy of 50% in completing the multiple choice questions of the bar exam. The MBE is the first of three exams that qualify a student to practice the law.
United States Medical Licensing Examination (USMLE)
The United States Medical Licensing Examination is considered one of the toughest medical exams in the world. The USMLE, a three-tier exam, reportedly requires over four years of study to pass because it consists of questions ranging from basic science to medical management.
Researchers found that ChatGPT managed to pass all three exams with over 60% scores and 50% accuracy on most questions.
According to Alex Berezow, a science writer and editor-in-chief of Big Think, ChatGPT tested with a 10-question microbiology quiz. He said the questions were suitable for a college student final exam and ChatGPT “blew it away”.
AP English essay
ChatGPT also passed the 12th grade AP literature class test and received a grade that fell in the B to C range. The AI chatbot wrote a “500- to 1,000-word essay crafting an argument ‘that attempts to position Ferris Bueller’s Day Off as an existentialist text.'”
Google coding interview
ChatGPT reportedly passed Google’s Level 3 Engineer Programming Interview after a team asked questions to test a candidate’s skills for a Level 3 engineer position. “Amazingly, ChatGPT is hired at L3 when interviewed for a programming position,” reads an internal document.
Multiple reports also suggest that ChatGPT passed the SAT, a standardized test commonly used for college admissions in the United States. According to College Board data, the AI chatbot achieved the 52nd percentile. It scored 500 in math and 520 in reading and writing.
Still to pass: IIT exam
Interestingly, the famous chatbot has yet to pass the exam of an Indian Institute of Technology (IIT) in India. It is not known if no attempt has been made yet or if ChatGPT has failed this test.