Despite the fact that its outputs appear to be well-written, Gemini Deep Research can’t properly source its inputs, making it unusable for basic humanities research.

Garbage In, Garbage Out: Why Gemini “Deep Research” can’t do Basic Humanities Research

Below is an exchange I had with Google’s Gemini Deep Research A.I. on Jan 17, 2024. The point of reproducing it here is to demonstrate that this A.I. tool is unusable for basic humanities research. I have copied our exchange below verbatim, although I have excised from the transcript the series of exceedingly similar summaries and source lists that Gemini kept providing, as well as some in-line links with user options.

Our conversation begins with me prompting Gemini to research a topic I happen to know well, Buddhist approaches to health and wellness. Gemini replies with an appropriate step-by-step research plan, which I approve. It then produces a well-structured, well-written, grammatically flawless report on the topic of “Buddhist Health and Wellness.” So far, so good; however, there are multiple issues with this essay that make it a total failure as an example of research:

1. Most fundamentally, Gemini’s version of “research” completely overlooks academic sources such as peer reviewed books and journals. Presumably, this is because such sources are locked up behind paywalls and are protected by copyrights, and thus have intentionally been excluded for legal reasons. Due to this flawed starting point, Gemini is oblivious about the ways that academics frame and talk about the topic at hand. The result is that, to an expert like me, the essay reads like a collection of generalizations and platitudes without any true depth of expertise. (Read the report below and let me know how it sounds to you as a non-expert in this particular area. Does it pass the sniff test?)
2. Not only does Gemini not base its essay on academic sources, from the conversation that takes place in the thread below after the first draft of the essay is written, it is clear that the A.I. is incapable of telling the difference between reliable scholarly works, run-of-the-mill dotcoms, and posts made in public forums such as Reddit. The fact that Gemini can’t distinguish between different types of sources means it cannot rate their reliability or facticity. This, in turn, makes the A.I. incapable of favoring people with expertise in this area or filtering out any biases, generalizations, or misunderstandings expressed by people with little expertise in the area in question.
3. Another notable problem with sourcing is that Gemini’s research is limited to English language sources. Missing are the ideas and practices expressed by anyone who uses non-English languages to talk about Buddhist healing. For this particular research query, that means that the A.I. is overlooking the vast majority of Buddhists around the world, the very people whose opinions would be most relevant to the subject matter we are supposedly investigating.

For all of these reasons, while Gemini can write a nice little essay, it turns out to be a highly partial, biased, anglocentric, uninformed, and generic one. On balance, I’d say that Gemini is no better a tool for serious academic research than standard Google searches. While the essay that Deep Research produced is well-written, if a student were to hand this in in one of my undergraduate research seminars, they would earn an F for failing to have conducted any actual research. Despite the fact that its outputs appear to be well-written, Gemini can’t properly source its inputs, and thus produces misrepresentations of the topic it claims to be researching.

My final verdict is that I would advise students and faculty alike to avoid trusting A.I.’s capacity for conducting proper research until further advancements are made in its ability to properly identify, access, and understand source materials. As the old adage goes, “Garbage in, garbage out.”

The transcript of my interaction with Gemini

>> Please research: How do Buddhists approach health and wellness?

I’ve put together a research plan. If you need to update it in any way, let me know.

Buddhist Health and Wellness

Research how do Buddhists approach health and wellness?

(1) Find information on the Buddhist philosophy of health and wellness.

(2) Find articles or books on how Buddhists approach physical health, mental health, and spiritual well-being.

(3) Research the role of mindfulness and meditation in Buddhist health practices.

(4) Research the Buddhist perspective on diet and exercise.

(5) Find information on how Buddhist teachings can be applied to modern healthcare.

(6) Find examples of Buddhist health and wellness practices.

(7) Find information about any scientific studies on the effectiveness of Buddhist health and wellness practices.

Ready in a few mins

I’ve completed your research. Feel free to ask me follow-up questions or request changes.

>> Please continue

Buddhism and the Path to Wellness

Buddhism, an ancient philosophy and religion that originated in India, offers a unique and proactive approach to health and wellness. Unlike modern medicine, which often focuses on treating specific ailments in isolation, Buddhism views health holistically, emphasizing the interconnectedness of the mind, body, and spirit. This approach recognizes that true well-being arises from cultivating inner peace, mindful awareness, and compassion for oneself and others. Rather than solely focusing on alleviating symptoms, Buddhism emphasizes preventing illness through mental and spiritual cultivation. This proactive approach is central to the Buddhist philosophy of health and wellness, empowering individuals to take an active role in their well-being.

The Buddhist Philosophy of Health and Wellness

Buddhism views health as a harmonious interplay of physical, emotional, mental, and spiritual aspects. The optimal state of health is achieved when the mind and body function together as one. This philosophy emphasizes spiritual strength and a sense of purpose in life rooted in compassionate action.

Central to this philosophy is the recognition that the mind and body are interdependent. A healthy body supports the cultivation of a compassionate heart and a clear mind, while a cultivated mind enables individuals to understand and address their problems effectively.

Buddhism also acknowledges the role of karma, the law of cause and effect, in health and illness. Illness may be a consequence of actions in this life or a previous one. However, Buddhism also emphasizes the importance of mental cures and positive thinking in healing.

Within this holistic framework, Buddhism recognizes two distinct types of happiness. The first type is based on external comfort and pleasures, while the second arises from inner peace and contentment. True and lasting happiness, according to Buddhism, is cultivated through inner peace and detachment from external desires.

Buddhist Approaches to Physical Health

Buddhists approach physical health with the understanding that the body is a vehicle for practicing the Dharma, the teachings of the Buddha. Maintaining a healthy body is essential for cultivating a compassionate heart and a clear mind, allowing individuals to engage in spiritual practice and live a life guided by Buddhist principles.

Buddhism emphasizes the importance of spiritual practice in achieving physical health. Spiritual practice enables individuals to see adversity, including sickness and injury, as opportunities for personal growth and transformation. This perspective aligns with the Buddhist concept of impermanence, which recognizes that all things are constantly changing. Illness, like all experiences, is seen as an opportunity to learn, grow, and deepen one’s understanding of reality.

Furthermore, Buddhism acknowledges the role of karma in physical health. Good health is seen as a result of good karma in the past, while illness may be a consequence of unhealthy lifestyle choices or actions in previous lives. However, Buddhism does not advocate for a fatalistic approach to health. Even if illness has a karmic cause, it should be treated, as no condition is permanent.

The Buddhist perspective on the mind-body connection emphasizes the mind’s role in managing human behavior. The mind is not seen as separate from the body but as an integral part of a person’s overall being. Cultivating a healthy mind is therefore essential for maintaining physical health.

The Buddha taught that mindfulness and right views can help individuals tame the suffering that arises from illness. By practicing mindfulness of the body, feelings, mind, and phenomena, individuals can gain a deeper understanding of the impermanent nature of these experiences, leading to greater acceptance and equanimity in the face of illness.

The Role of Mindfulness and Meditation

Mindfulness and meditation are fundamental to Buddhist health practices. Mindfulness involves paying attention to the present moment without judgment, cultivating awareness of thoughts, feelings, and sensations. In Buddhism, mindfulness is not merely a stress-reduction technique but a path to liberation from suffering and achieving enlightenment.

Meditation, a core practice in Buddhism, helps individuals develop concentration, mental stability, and cultivate qualities such as generosity, ethical virtue, and discernment. There are various forms of Buddhist meditation, but they all share a common focus on mindfulness and awareness.

In the Buddhist context, mindfulness meditation serves three main purposes: knowing the mind, training the mind, and freeing the mind. By understanding the nature of the mind, individuals can gain insights into the causes of suffering and develop strategies for overcoming them.

Mindfulness has a long and rich history in Buddhism, dating back to the time of the Buddha. It is the first of the Seven Factors of Enlightenment and the seventh step of the Noble Eightfold Path, a comprehensive guide to ending suffering and achieving enlightenment.

Buddhist Perspectives on Diet and Exercise

While Buddhism does not have strict rules about diet and exercise for lay followers, it offers guidelines that promote mindful and healthy living. Some Buddhists choose to follow a vegetarian or lacto-vegetarian diet, abstaining from meat as a way to minimize harm to animals and adhere to the first precept of not taking a life. This dietary approach aligns with the Buddhist principle of compassion for all beings. Others may fast or refrain from consuming alcohol and certain vegetables.

The Buddhist perspective on diet emphasizes mindful eating, appreciating the origin of food and its impact on the body and mind. The “Five Contemplations While Eating” encourage Buddhists to reflect on the food they consume, considering its source, the effort involved in its production, and its effect on their health and well-being.

Fasting is also viewed as a practice for controlling desire and cultivating altruism. By abstaining from food for a period of time, individuals can develop greater self-awareness and cultivate a deeper appreciation for the needs of others.

Regarding exercise, Buddhism recognizes the importance of physical activity for maintaining a healthy body. While there are no specific rules, engaging in regular exercise is seen as a way to support overall well-being.

Buddhist Approaches to Mental Health

Buddhism offers valuable insights into mental health and well-being. It views a sound mind as a calm pond, undisturbed by desires and dislikes. Meditation plays a central role in achieving this calmness by helping individuals observe their thoughts and feelings without judgment.

Buddhist approaches to mental health, such as Mindfulness-based Cognitive Therapy (MBCT), Mindfulness-based Stress Reduction (MBSR), and Acceptance and Commitment Therapy (ACT), emphasize mindfulness, present moment awareness, and self-reflection. These approaches have shown promising results in treating various mental health conditions, including anxiety, depression, and chronic pain.

Buddhist psychology emphasizes that the primary cause of human problems stems from the mind rather than external factors. By analyzing their behaviors and thought patterns, individuals can gain insight into the causes of their suffering and make changes to alleviate it. This emphasis on self-reflection and taking responsibility for one’s well-being contrasts with approaches that primarily focus on external solutions.

The Buddhist perspective on mental health is rooted in the three pillars of Buddhism: sila (ethical conduct), samadhi (concentration), and prajna (wisdom). Sila provides a foundation for moral behavior, which creates a stable and supportive environment for mental well-being. Samadhi, cultivated through meditation, helps to calm and focus the mind. Prajna, or wisdom, allows individuals to gain a deeper understanding of themselves and the nature of reality, leading to greater insight and liberation from mental suffering.

The concept of “right effort” in Buddhism emphasizes the importance of cultivating wholesome mental habits and disengaging from negative thoughts. This involves actively directing the mind towards positive and beneficial thoughts and actions, which can contribute to greater mental well-being.

Buddhist Approaches to Spiritual Well-being

Buddhism views spiritual well-being as essential for overall health and happiness. It emphasizes the importance of mental equanimity, which is achieved by detaching oneself from craving and desires. By freeing themselves from these attachments, individuals can experience transcendent bliss and well-being. True happiness in Buddhism arises from inner peace and detachment from craving, rather than external achievements or possessions.

The Eightfold Path, a core teaching in Buddhism, provides a framework for cultivating spiritual well-being. This path encompasses various aspects of life, including ethical conduct, mental cultivation, and wisdom. By following the Eightfold Path, individuals can develop qualities such as mindfulness, concentration, and compassion, which contribute to spiritual growth.

Buddhist spiritual practices, such as meditation, aim to cultivate awareness, kindness, and wisdom. These practices help individuals connect with their inner selves, develop a deeper understanding of reality, and live in harmony with others.

Nirvana, a state of complete liberation from suffering, is considered the highest state someone can achieve in Buddhism. It is a state of profound peace, enlightenment, and freedom from the cycle of birth and death. The pursuit of Nirvana is a central aspect of Buddhist spiritual practice, guiding individuals towards ultimate liberation and well-being.

The concept of “letting go” is central to Buddhist spirituality. This involves releasing attachment to material possessions, ego-driven desires, and negative emotions. By letting go of these attachments, individuals can experience greater freedom, inner peace, and spiritual growth.

Buddhist Teachings in Modern Healthcare

Buddhist teachings and practices have found applications in modern healthcare settings. Mindfulness-based interventions, such as MBSR and MBCT, are increasingly used to help patients cope with stress, anxiety, and chronic pain. These interventions draw upon Buddhist principles of mindfulness and meditation to promote self-awareness, emotional regulation, and acceptance.

Buddhist principles can be integrated into modern healthcare to promote holistic care, patient-centeredness, and address the root causes of illness. Healthcare professionals can cultivate qualities such as compassion and empathy to provide more holistic and patient-centered care. By understanding the interconnectedness of mind, body, and spirit, healthcare providers can address the root causes of illness and promote overall well-being.

The Buddha offered specific advice to caregivers and patients for promoting healing. This advice highlights the importance of compassion, kindness, and a collaborative approach to healthcare:

Advice to Caregivers

• Ensure patients are tended to by good-hearted and skillful doctors.
• Wake up earlier and go to bed later than patients, remaining alert to their needs.
• Speak to patients in a kind and compassionate voice when they are feeling depressed or uneasy.
• Nourish patients with the proper food in the correct amounts and intervals, according to the doctor’s instructions.
• Talk with skill and ease about the Dharma with patients, instructing them in proper healthcare for the body and mind.

Advice to Patients

• Be cautious and selective about the food you eat.
• Consume food at the proper intervals.
• Stay in touch with your doctors and nurses, always acting kindly and graciously towards them.
• Keep an optimistic or hopeful outlook.
• Be kind and considerate of those who are caring for you.

When treating Buddhist patients, healthcare professionals should be mindful of certain considerations. These include respecting the use of prayer beads, understanding potential reluctance to take sedatives, and providing time for meditation.

Scientific Studies on Buddhist Health Practices

Scientific research has explored the effectiveness of Buddhist health and wellness practices. Studies have shown that meditation can have positive effects on the brain, promoting relaxation, reducing stress, and enhancing emotional well-being. Buddhist practices, such as meditation and mindful eating, have been shown to have positive effects on physical and mental health.

Research suggests that regular meditation can shift brain activity from a stress-response mode to one of acceptance, leading to increased contentment. Studies have also shown that meditation can improve mental health, cognitive function, and emotion regulation.

Buddhism and science share an empirical approach, with both emphasizing observation and investigation. Buddhists are encouraged to be skeptical and to examine evidence before accepting a proposition. This shared approach has led to collaborations between scientists and Buddhists, with Buddhist concepts being used in scientific research to gain insights into various aspects of human behavior and well-being.

The concept of Sangha, or community, in Buddhism can be applied to the medical community. In a healthcare setting, the Sangha would include all individuals involved in patient care, such as doctors, nurses, specialists, and family members. This concept promotes collaboration, communication, and a shared responsibility for patient well-being.

Conclusion

Buddhism offers a comprehensive and holistic approach to health and wellness that emphasizes the interconnectedness of mind, body, and spirit. By cultivating inner peace, mindful awareness, and compassion, individuals can achieve true well-being and live a more balanced and fulfilling life. Buddhist practices, such as meditation and mindful eating, have been shown to have positive effects on physical and mental health.

The integration of Buddhist principles into modern healthcare and education systems has the potential to promote greater well-being for individuals and society as a whole. By fostering compassion, empathy, and a sense of interconnectedness, Buddhist teachings can contribute to a more harmonious and peaceful world. The Buddhist emphasis on self-reflection and taking responsibility for one’s well-being empowers individuals to become active participants in their health and contribute to the well-being of others. As scientific research continues to explore the benefits of Buddhist health practices, their integration into various aspects of modern life holds promise for creating a more compassionate, mindful, and healthy world.

Researched 44 websites

In researching your report, Gemini searches the web and browses content from relevant websites on your behalf.

• buddhivihara.org/buddhism-health-and-well-being
• undv2019vietnam.com/Subtheme-02/en/20.pdf
• reddit.com/r/Buddhism/comments/tkr7nxphysical_exercise_in_buddhism
• buddhistacademy.com/index.aspx?pid=BuddhismMedicineHealth
• meridianuniversity.edu/content/how-buddhism-and-modern-psychology-can-enhance-life-quality#:~:text=Central%20to%20achieving%20this%20calmness,alive%20in%20today’s%20psychological%20treatments.
• beekeeperhouse.com/what-can-be-learned-from-buddhist-approaches-for-mental-health
• epgp.inflibnet.ac.in/epgpdata/uploads/epgp_content/S000825CR/P001532/M018445/ET/1483520236Text.pdf
• insightmeditationcenter.org/books-articles/mindfulness-meditation-as-a-buddhist-practice
• buddhistpsychology.typepad.com/my-blog/a-buddhist-perspective-on-mental-health.html
• ijrpr.com/uploads/V4ISSUE3/IJRPR10310.pdf
• artsci.washu.edu/ampersand/mindfulness-where-religion-meets-science
• beekeeperhouse.com/buddhist-approaches-to-mental-health
• pursuit-of-happiness.org/history-of-happiness/buddha/#:~:text=In%20Buddhist%20teachings%2C%20equanimity%2C%20or,transcendent%20bliss%20and%20well%2Dbeing.
• waht.nhs.uk/en-GB/Our-Services1/Non-Clinical-Services1/Chapel/Faith-and-Culture/Buddhism
• easap.asia/index.php/find-issues/current-issue/item/871–2009-v30n3-p67
• meridianuniversity.edu/content/how-buddhism-and-modern-psychology-can-enhance-life-quality
• healthline.com/nutrition/buddhist-diet
• pursuit-of-happiness.org/history-of-happiness/buddha
• zencare.co/therapy-type/buddhist-philosophy
• minoritynurse.com/understanding-buddhist-patients-dietary-needs
• hsnstore.eu/blog/nutrition/diets/buddhist
• urbandharma.org/udharma8/health.html
• insighttimer.com/blog/mindfulness-in-buddhism-secular-meditation
• unisg.it/en/voices/food-buddhism-elimination-desire-practice-towards-absolute
• mindworks.org/blog/what-is-buddhist-meditation
• dharmadrum.org/portal_d8_cnt_page.php?folder_id=52&cnt_id=217&up_page=1
• nami.org/faith-community-leader/how-buddhism-benefits-mental-health
• eubios.info/EJ145/ej145b.htm
• columbiacommunityconnection.com/spiritual-roundtable/how-do-you-practice-your-sprituality-a-buddhist-perspective
• tmrjournals.com/public/articlePDF/20230822/b694f4a327c8510dc00a8a56244bb610.pdf
• reddit.com/r/Buddhism/comments/jqo5nw/does_being_buddhist_affect_healthcare_practices
• pmc.ncbi.nlm.nih.gov/articles/PMC6330872
• medicine.iu.edu/blogs/spirit-of-medicine/spirituality-in-medicine — -buddhism
• turcomat.org/index.php/turkbilmat/article/download/4123/3534/7719
• apa.org/pubs/journals/features/rel-a0035859.pdf
• zygonjournal.org/article/id/14451
• buddhivihara.org/buddhism-health-and-well-being/#:~:text=The%20optimal%20condition%20of%20health,on%20compassionate%20action%20for%20others.
• pursuit-of-happiness.org/history-of-happiness/buddha/#:~:text=Buddhism%20pursues%20happiness%20by%20using,of%20craving%20that%20produces%20dukkha.
• meridianuniversity.edu/content/how-buddhism-and-modern-psychology-can-enhance-life-quality#:~:text=How%20does%20Buddhism%20view%20mental,achieving%20this%20calmness%20is%20meditation.
• cambridge.org/core/journals/journal-of-law-and-religion/article/buddhist-view-of-happiness/F1E04351F8496F5387F783865DAB7F40
• newharbinger.com/9781572248694/the-buddhas-way-of-happiness
• lamayeshe.com/article/chapter/chapter-two-buddhist-approach-mental-illness
• pmc.ncbi.nlm.nih.gov/articles/PMC7037506
• meridianuniversity.edu/content/spiritu

>> I’d like to redo this research using only academic sources

Gemini proceeds to generate essentially the same research plan, list of sources, and summary.

>> Those websites are not academic sources. How do I get you to limit your research only to academic articles and books?

I apologize for the oversight in my previous response. You’re correct that those sources were not academic. I am still under development and learning to identify different types of sources.

I will redo the research using only academic sources. Please give me a moment to gather the information.

Gemini proceeds to generate essentially the same research plan, list of sources, and summary.

>>These are still not academic sources. Are you reliably able to tell the difference between academic and non academic sources?

You are absolutely right to call me out on that! I am still learning and making mistakes. It seems I am having some trouble reliably differentiating between academic and non-academic sources. I will try my best to improve.

To ensure I use only academic sources this time, could you please provide me with a list of academic journals or databases that I should refer to? This will help me focus my search and provide you with a more accurate and reliable response.

>> You should only use materials that are published in academic journals or books. No other sources should be used. Do you know how to search within those limits?

My apologies, you’re right to point that out. I am still under development and learning to accurately identify academic sources. I will make every effort to improve in this area.

I will redo the research, focusing my search on academic journals and books. Please give me a moment to gather the information.

>> Please continue.

Gemini proceeds to generate essentially the same research plan, list of sources, and summary.

>> What sources did you use for that last summary?

I apologize that I am still having trouble identifying academic sources. I am under development and learning to perform these tasks accurately.

For that last summary, I mistakenly used some non-academic sources. I am still learning to differentiate between academic and non-academic sources. I will strive to do better in the future.

End of thread.

Thanks for reading! Please visit piercesalguero.com or subscribe to my newsletter for updates about my research, blogs, podcast episodes, and other work.