+New Chat: Artificial Intelligence and Dietetic Practice
Posted:
2023-08-28
What’s happening?
ChatGPT is a publicly available artificial intelligence (AI) chatbot that uses human-like conversation to respond to user-generated questions (1). ChatGPT can interact with individuals by reacting to prompts with synthesized information from the Internet about various topics, including food and nutrition. Opportunities and challenges of relying on AI have been noted, particularly in research (2), education (3) and nutrition and dietetic practice.
How accurate is ChatGPT in giving nutrition information and recommendations?
Researchers “asked” ChatGPT to define the ideal diets for individuals living with type 2 diabetes and those who were undergoing hemodialysis (1). The authors noted that, overall, the guidance provided was reasonably detailed and accurate and in line with current evidence-informed practices. Consulting a health care provider or registered dietitian for more information was often included in the recommendations. However, limitations were noted by the authors, including recommendations that were provided without considering assessment information (e.g. individual’s age, sex), the consistency of responses varied over time in response to the same prompt, and plausible but inaccurate answers were sometimes given (e.g. when asked to define a one-day menu, planned menus were similar and included foods not optimal for individuals undergoing hemodialysis). ChatGPT also appeared challenged in generating accurate nutritional diagnoses according to the Nutrition Care Process Terminology (NCPT), including repetitive and generic diagnoses that were not unique and not generated in the correct form (1). Of note, the National Eating Disorders Association (NEDA) recently stated that, “Once again artificial intelligence (AI) proves it is not yet ready for primetime in the mental health space,” after having to suspend their chatbot when it provided inaccurate and harmful messages earlier this year (4).
ChatGPT may make it easy for individuals to quickly access readable nutrition information but it does not replace the specialized practice knowledge and expertise of dietitians to understand the complexities of what influences food choices, including factors relating to income, food literacy and cooking skills, and the availability of social support (1). It is important to note that it does not prioritize sources based on evidence, may use non-scientific opinions and references are not cited. Providing credible nutrition recommendations from a registered dietitian is overlooked and may exacerbate the public’s confusion about the importance of relying on trained professionals for food and nutrition advice (1). Further, the growing complexity and uncertainty of nutrition and dietetics, particularly in the areas of sustainable food systems, household food insecurity and weight bias, requires a competent response to practice safely and effectively (5).
Now what?
As we learn more about the opportunities and challenges associated with using AI in practice, dietitians can:
- Continue to promote dietitians as trained, regulated health professionals who provide personalized food and nutrition guidance to meet client needs.
- Stay up-to-date on recommendations from professional regulators related to the ethical, competent and safe use of AI in practice.
- Consider leveraging AI bots like ChatGPT to brainstorm ideas for communication (e.g. social media posts, posters) and simplify routine tasks like developing a template welcoming a new client (1).
- Continue to support and engage in outcomes-related, practice-based research (6) that demonstrates dietitians' roles in making differences in individuals, families, groups and communities' health and well-being.
The PEN Team will continue to monitor evidence on the impact of AI on dietetic practice, but rest assured that human minds will continue to develop the PEN System practice recommendations. And if you were wondering how ChatGPT would answer the question, How accurate is ChatGPT in giving nutrition information and recommendations?, ChatGPT said:
"ChatGPT can provide general information and recommendations about nutrition, but its accuracy may vary depending on the specific question and the currency of its knowledge. As of my last knowledge update in September 2021, I can provide information based on the knowledge available up to that point. However, keep in mind the following important points:
General Information: ChatGPT can offer general information about nutrition, such as the basic principles of a balanced diet, the importance of various nutrients, and common dietary guidelines. This information is typically accurate and reliable.
Specific Recommendations: When it comes to specific recommendations, such as personalized dietary plans for individuals with specific health conditions or dietary restrictions, ChatGPT's accuracy might be limited. It cannot provide personalized advice without detailed information about a person's health, dietary preferences, and other factors.
Currency of Information: Nutrition science is an evolving field, and recommendations can change over time as new research emerges. ChatGPT's knowledge is based on information available up to September 2021, so it might not be aware of the latest dietary guidelines or research findings.
Consult a Professional: For personalized nutrition advice or recommendations related to specific health conditions, it's always best to consult a registered dietitian, nutritionist, or a healthcare professional. They can provide tailored guidance based on your individual needs and the most up-to-date scientific evidence.
Verification: If you receive nutrition information or recommendations from ChatGPT, it's a good practice to verify that information with trusted sources or professionals to ensure its accuracy and relevance to your specific situation.
In summary, ChatGPT can offer general nutrition information, but it's essential to use it as a starting point and seek personalized advice from qualified professionals when making significant dietary decisions or addressing specific health concerns. Additionally, always verify information obtained from AI models like ChatGPT with up-to-date and reliable sources." (7).
Want to learn more? Check out Dietitians of Canada's Learning On Demand session from dietitian and MSc student Alyshia Guan:
References
- Chatelan A, Clerc A, Fonta PA. ChatGPT and future AI chatbots: what may be the impact on credentialed nutrition and dietetics practitioners? J Acad Nutr Diet. 2023 Aug 4:S2212-2672(23)01308-4. doi: 10.1016/j.jand.2023.08.001. Epub ahead of print. PMID: 37544375. Abstract available from: https://pubmed.ncbi.nlm.nih.gov/37544375/
- Hill-Yardin EL, Hutchinson MR, Laycock R, Spencer SJ. A Chat(GPT) about the future of scientific publishing. Brain Behav Immun. 2023 May;110:152-4. doi: 10.1016/j.bbi.2023.02.022. Epub 2023 Mar 1. PMID: 36868432. Abstract available from: https://pubmed.ncbi.nlm.nih.gov/36868432/
- Kasneci E, Sessler K, Küchemann S, Bannert M, Dementieva D, Fischer F, et al. ChatGPT for good? On opportunities and challenges of large language models for education. Learn Individ Differ. 2023;103:102274. https://doi.org/10.1016/j.lindif.2023.102274
- Psychiatrist.com. NEDA Suspends AI Chatbot for Giving Harmful Eating Disorder Advice. 2023 Jun 5. Available from: https://www.psychiatrist.com/news/neda-suspends-ai-chatbot-for-giving-harmful-eating-disorder-advice/
- Palermo C. Leadership and practice in times of complexity and uncertainty. Nutr Diet. 2020 Nov;77(5):487-9. doi: 10.1111/1747-0080.12646. PMID: 33150690. Abstract available from: https://pubmed.ncbi.nlm.nih.gov/33150690/
- Johnson F, Black AT, Koh JC. Practice-based research program promotes dietitians' participation in research. Can J Diet Pract Res. 2016 Mar;77(1):43-6. doi: 10.3148/cjdpr-2015-034. Epub 2015 Nov 16. PMID: 26567762. Abstract available from: https://pubmed.ncbi.nlm.nih.gov/26567762/
- Chat GPT. “How accurate is ChatGPT in giving nutrition information and recommendations?” prompt. ChatGPT, GPT-4, OpenAI; 2023 Aug 28. Available from: chat.openai.com/chat