The natural language processing model Chat Generative Pretrained Transformer (ChatGPT) does not pass the American College of Gastroenterology (ACG) Self-Assessment Tests.
The researchers found that ChatGPT-3 and ChatGPT-4 scored 65.1% and 62.4%, respectively, on 455 included questions across the two exams.