Surprise results of ChatGPT when taking the final exam at top law and business schools in the US

Surprise results of ChatGPT when taking the final exam at top law and business schools in the US

 192 total views

2023-01-29 20:49:00

According to CNN, ChatGPT – OpenAI’s powerful new AI chatbot tool has passed the final exam for law at the University of Minnesota and another at the University of Pennsylvania’s Wharton School of Business (USA). These are all top schools in the US today in training subjects such as business and law.

Accordingly, to test how ChatGPT performed on the exam after completing 4 law courses, professors at the University of Minnesota Law School recently graded the tests in a ‘blind’ format – i.e. not knowing which test is being performed by the AI.

After completing 95 multiple choice questions and 12 essay questions, ChatGPT scored at C + – the average level of a C + student, which is low but enough to pass in all four courses.

ChatGPT got better results in the final exam of MBA program (Master of Business Administration program). at Wharton, where this AI chatbot scored B to B- in Operations Management.

Developed by OpenAI, ChatGPT can answer any questions about users’ in-depth knowledge, or even personal problems. Photo: Internet

Christian Terwiesch, professor of business at the Wharton School, says “Performs excellently at basic operations and process analysis questions, including those based on case studies.

However, the professor at the Wharton School noted that ChatGPT still has shortcomings, including being difficult to encounter “more advanced process analysis questions“At the same time, ChatGPT still makes “surprising errors” with basic math. He writes: “These mistakes can be very serious“.

Is ChatGPT beneficial or harmful?

ChatGPT’s surprising achievement comes as more and more schools and teachers are expressing concern about ChatGPT’s immediate impact on students, and how this chatbot can help with the development of students. cheating when doing homework.

Some educators are now dramatically changing the way their assignments are designed to respond to ChatGPT, even if it’s unclear how popular the tool is with students and how much of an impact it will have. its real impact on learning.

Talking to CNN, Jon Choi, one of the law professors at the University of Minnesota, affirmed that the goal of the tests is to explore the potential of ChatGPT in assisting lawyers as they practice. Usually, exam questions are based on situations that lawyers have to deal with in real life.

At the same time, the university wants to see how much this AI chatbot can help Law students in exams, regardless of whether their professor allows to use this chatbot or not.

“ChatGPT has struggled with the most classic questions of the law school exam, such as detecting potential legal problems, or scrutinizing to find ways to apply legal rules to cases. details of a case,” Professor Choi said.

But ChatGPT can be very helpful in creating a first draft that students can then edit.”

He argues that the collaboration between humans and AI is the biggest benefit we can get from ChatGPT and similar technology.

I have a strong hunch that AI assistants will become the standard tool for lawyers in the near future. Law schools should prepare their students for that situation“.

Of course, if law professors want to continue to test their students’ ability to remember legal rules and doctrines, they will need to introduce restrictions such as banning internet use during exams to enforce this rule. there.”

Likewise, Wharton professor Terwiesch found that ChatGPT was “very good” at modifying its responses after receiving human feedback, showing the potential for humans to work alongside AI. .

However, in the short term, there are still certain concerns about whether students should use ChatGPT and how to use it. For example, public schools in New York City and Seattle (USA) have banned students and teachers from using ChatGPT on district networks and devices.

On this issue, educators themselves are also confused and have different views. With Professor Terwiesch, he agrees that restrictions should be imposed on students-students when they take the test.

“Bans are necessary. After all, when you give a medical doctor a degree, you want them to know about medicine, not about how to use chat bots. The same applies to certifications. other skills, including law and business.“, he shared.

But Terwiesch believes the technology will eventually have its place in the classroom.

If all we have is the same education system as before, we have wasted a great opportunity that ChatGPT has to offer.“, he confirmed.

Refer to CNN

#Surprise #results #ChatGPT #final #exam #top #law #business #schools

Leave a Reply

Your email address will not be published. Required fields are marked *