Thursday, May 25, 2023

ChatGPT does not pass American College of Gastroenterology tests

The natural language processing model Chat Generative Pretrained Transformer (ChatGPT) does not pass the American College of Gastroenterology (ACG) Self-Assessment Tests.

The researchers found that ChatGPT-3 and ChatGPT-4 scored 65.1% and 62.4%, respectively, on 455 included questions across the two exams.