NDLI: Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam

Content Provider	Springer Nature : BioMed Central
Author	Buldur, Mehmet Sezer, Berkant
Abstract	Background The use of artificial intelligence in the field of health sciences is becoming widespread. It is known that patients benefit from artificial intelligence applications on various health issues, especially after the pandemic period. One of the most important issues in this regard is the accuracy of the information provided by artificial intelligence applications. Objective The purpose of this study was to the frequently asked questions about dental amalgam, as determined by the United States Food and Drug Administration (FDA), which is one of these information resources, to Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) and to compare the content of the answers given by the application with the answers of the FDA. Methods The questions were directed to ChatGPT-4 on May 8th and May 16th, 2023, and the responses were recorded and compared at the word and meaning levels using ChatGPT. The answers from the FDA webpage were also recorded. The responses were compared for content similarity in “Main Idea”, “Quality Analysis”, “Common Ideas”, and “Inconsistent Ideas” between ChatGPT-4’s responses and FDA’s responses. Results ChatGPT-4 provided similar responses at one-week intervals. In comparison with FDA guidance, it provided answers with similar information content to frequently asked questions. However, although there were some similarities in the general aspects of the recommendation regarding amalgam removal in the question, the two texts are not the same, and they offered different perspectives on the replacement of fillings. Conclusions The findings of this study indicate that ChatGPT-4, an artificial intelligence based application, encompasses current and accurate information regarding dental amalgam and its removal, providing it to individuals seeking access to such information. Nevertheless, we believe that numerous studies are required to assess the validity and reliability of ChatGPT-4 across diverse subjects.
Related Links	https://bmcoralhealth.biomedcentral.com/counter/pdf/10.1186/s12903-024-04358-8.pdf
Ending Page	12
Page Count	12
Starting Page	1
File Format	HTM / HTML
ISSN	14726831
DOI	10.1186/s12903-024-04358-8
Journal	BMC Oral Health
Issue Number	1
Volume Number	24
Language	English
Publisher	BioMed Central
Publisher Date	2024-05-24
Access Restriction	Open
Subject Keyword	Dentistry Oral and Maxillofacial Surgery Artificial intelligence Public health Dental amalgam Health informatics Mercury poisoning ChatGPT ChatGPT-4
Content Type	Text
Resource Type	Article
Subject	Dentistry
Journal Impact Factor	2.6/2023
5-Year Journal Impact Factor	3.2/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Dental amalgam and urinary mercury concentrations: a descriptive study

ChatGPT- versus human-generated answers to frequently asked questions about diabetes: a Turing test-inspired survey among employees of a Danish diabetes center

ChatGPT-4 Omni’s superiority in answering multiple-choice oral radiology questions

Evaluating the accuracy and relevance of ChatGPT responses to frequently asked questions regarding total knee replacement

An assessment of ChatGPT’s responses to frequently asked questions about cervical and breast cancer

Medical text prediction and suggestion using generative pre-trained transformer models with dental medical notes

Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses

Treatment Outcomes of Leiomyosarcoma Metastasis Affecting the Brachial Plexus: A Comparative Case Report Using Chat Generative Pre-trained Transformer (ChatGPT).

Responses to Medical Students' Frequently Asked Questions About Family Medicine.

Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam

Similar Documents

Dental amalgam and urinary mercury concentrations: a descriptive study

ChatGPT- versus human-generated answers to frequently asked questions about diabetes: a Turing test-inspired survey among employees of a Danish diabetes center

ChatGPT-4 Omni’s superiority in answering multiple-choice oral radiology questions

Evaluating the accuracy and relevance of ChatGPT responses to frequently asked questions regarding total knee replacement

An assessment of ChatGPT’s responses to frequently asked questions about cervical and breast cancer

Medical text prediction and suggestion using generative pre-trained transformer models with dental medical notes

Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses

Treatment Outcomes of Leiomyosarcoma Metastasis Affecting the Brachial Plexus: A Comparative Case Report Using Chat Generative Pre-trained Transformer (ChatGPT).

Responses to Medical Students' Frequently Asked Questions About Family Medicine.

Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam