New Delhi: According to a study by Tiffany Kung, Victor Tseng, and colleagues, ChatGPT can score at or near the 60 percent passing threshold for the United States Medical Licensing Examination (USMLE), providing coherent, internal understanding and consistent insight. Is. AnsibleHealth which was published on February 9, 2023 in the open-access journal PLOS Digital Health.
A large language model (LLM), or new artificial intelligence (AI) system, called ChatGPT, aims to produce writing that is similar to a person’s by predicting future word sequences. Unlike most chatbots, ChatGPT is unable to perform online searches. Instead, it produces text based on word relationships that are predicted by internal processes. ,Also Read: Google Introduces Bard To Tackle Rival ChatGPT; Here’s how netizens reacted,
Kung and colleagues tested ChatGPT’s performance on the USMLE, a highly standardized and regulated series of three exams (Steps 1, 2CK, and 3) required for medical licensure in the United States. ,Also Read: Price Drop Alert! Samsung Galaxy S23 Ultra price cut by Rs 8000: Check discount offers on Amazon and Flipkart,
Taken among medical students and physicians in training, the USMLE assesses knowledge spanning most medical disciplines, from biochemistry to clinical reasoning to bioethics. After screening to remove image-based questions, the authors tested the software on 350 of the 376 public questions available from the June 2022 USMLE release.
After uncertain responses were removed, ChatGPT scored between 52.4 percent and 75.0 percent on the three USMLE exams. The passing limit each year is around 60 percent.
ChatGPT demonstrated 94.6 percent concordance across all of its responses and produced at least one significant insight (something that was new, non-obvious, and clinically valid) for 88.9 percent of responses.