AI showdown: info accuracy on protein quality content in foods from ChatGPT 3.5, ChatGPT 4, bard AI and bing chat
dc.authorid | BAYRAM, HATICE MERVE/0000-0002-7073-2907 | |
dc.contributor.author | Bayram, Hatice Merve | |
dc.contributor.author | Ozturkcan, Arda | |
dc.date.accessioned | 2024-09-11T19:51:44Z | |
dc.date.available | 2024-09-11T19:51:44Z | |
dc.date.issued | 2024 | |
dc.department | İstanbul Gelişim Üniversitesi | en_US |
dc.description.abstract | Purpose - This study aims to assess the effectiveness of different AI models in accurately aggregating information about the protein quality (PQ) content of food items using four artificial intelligence (AI) models - ChatGPT 3.5, ChatGPT 4, Bard AI and Bing Chat. Design/methodology/approach - A total of 22 food items, curated from the Food and Agriculture Organisation (FAO) of the United Nations (UN) report, were input into each model. These items were characterised by their PQ content according to the Digestible Indispensable Amino Acid Score (DIAAS). Findings - Bing Chat was the most accurate AI assistant with a mean accuracy rate of 63.6% for all analyses, followed by ChatGPT 4 with 60.6%. ChatGPT 4 (Cohen's kappa: 0.718, p < 0.001) and ChatGPT 3.5 (Cohen's kappa: 0.636, p: 0.002) showed substantial agreement between baseline and 2nd analysis, whereas they showed a moderate agreement between baseline and 3rd analysis (Cohen's kappa: 0.538, p: 0.011 for ChatGPT 4 and Cohen's kappa: 0.455, p: 0.030 for ChatGPT 3.5). Originality/value - This study provides an initial insight into how emerging AI models assess and classify nutrient content pertinent to nutritional knowledge. Further research into the real-world implementation of AI for nutritional advice is essential as the technology develops. | en_US |
dc.description.sponsorship | The manuscript presents a research study that used AI chatbots for its investigations. In particular, it involved the use of ChatGPT versions GPT-3.5 and GPT-4.0, both developed by OpenAI. Additionally, this study used Bing Chat and Bard AI. All authors had access to the data and played a substantial role in writing the manuscript. | en_US |
dc.identifier.doi | 10.1108/BFJ-02-2024-0158 | |
dc.identifier.endpage | 3346 | en_US |
dc.identifier.issn | 0007-070X | |
dc.identifier.issn | 1758-4108 | |
dc.identifier.issue | 9 | en_US |
dc.identifier.scopus | 2-s2.0-85197474303 | en_US |
dc.identifier.startpage | 3335 | en_US |
dc.identifier.uri | https://doi.org/10.1108/BFJ-02-2024-0158 | |
dc.identifier.uri | https://hdl.handle.net/11363/7844 | |
dc.identifier.volume | 126 | en_US |
dc.identifier.wos | WOS:001263254600001 | en_US |
dc.identifier.wosquality | N/A | en_US |
dc.indekslendigikaynak | Web of Science | en_US |
dc.language.iso | en | en_US |
dc.publisher | Emerald Group Publishing Ltd | en_US |
dc.relation.ispartof | British Food Journal | en_US |
dc.relation.publicationcategory | Makale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı | en_US |
dc.rights | info:eu-repo/semantics/closedAccess | en_US |
dc.snmz | 20240903_G | en_US |
dc.subject | Sustainable diet | en_US |
dc.subject | Sustainability | en_US |
dc.subject | Artificial intelligence | en_US |
dc.subject | Al models | en_US |
dc.subject | Food assessment | en_US |
dc.subject | ChatGPT | en_US |
dc.subject | Bard AI | en_US |
dc.subject | Bing chat | en_US |
dc.title | AI showdown: info accuracy on protein quality content in foods from ChatGPT 3.5, ChatGPT 4, bard AI and bing chat | en_US |
dc.type | Article | en_US |