Investigating Any Flaws in ChatGPT’s Shield
Best AI for Chatting? Clashing Titans - ChatGPT and Google Bard Face-Off
Bard is Google’s answer to the AI explosion rapidly becoming the most disruptive technology of the century. Generative AI chatbots are changing how we interact with technology, and the tech giants are rushing to claim a slice of the pie.
It’s fair to say that the first iteration of Google Bard was given a lukewarm reception. However, this is a rapidly evolving technology, and Google announced a whole raft of updates during Google I/O 2023.
Let’s see how these improvements perform as we check out Google Bard vs. ChatGPT.
ChatGPT vs. Google Bard: Comparing the Underlying Technology
Both rely on large language models (LLMs) to generate their “human-like” responses.
A simple definition for this complex topic is thatLLMs are machine learning models designed to perform natural language processing (NLP) tasks.
Google Bard and ChatGPT run on different LLMs:
- GPT-3.5 (ChatGPT) : The GPT-3.5 LLM is the catalyst that kick-started generative AI chatbots. One issue with this model is the age of the dataset. Although it has received some topical updates, the model’s dataset is limited to 2021.
- GPT-4 (ChatGPT Plus) : The premium version of OpenAI’s LLM includes a more recent dataset, access to live information, and image processing capabilities. As well as the OpenAI version, you can also accessGPT-4 through its integration with various apps .
- PaLM 2 (Google Bard) : The first iteration of Bard used the LaMDA LLM. However,the latest version uses PaLM 2 . According to Google,PaLM 2 is a substantial upgrade that offers better creative writing, coding skills, math problem-solving, and support for Japanese and Korean languages, with 40 more to follow.
Let’s look at both models in action and analyze their performance.
Testing and Comparing ChatGPT and Google Bard
To test the tools, we devised an exercise to compare their performance across various metrics. But the first step in the Google Bard vs. ChatGPT head-to-head has to be getting the tools running on your machine.
- ChatGPT : You can accessChatGPT via the OpenAI official website. You only need to create an account on OpenAI to get started. As noted, the free version is restricted to the older GPT-3.5 LLM.
- Google Bard : Bard it is still only available in certain countries. Exclusions include EU countries and Canada, not an insubstantial omission. You can sign in with an existing Gmail account or create a new one on theGoogle Bard official website.
Signing up for both tools is simple, although the Google Bard country restriction is inconvenient. However, it may be possible tocircumvent these restrictions using a VPN .
Comparing Google Bard and ChatGPT-3.5’s Accuracy
Both chatbots are quick to point out that the accuracy of their responses should not be taken at face value. A point proved by asking Google Bard a simple question that it shouldn’t have any problems with: “What large language model is Google Bard using?”
As you can see, this is a dated response that justifies the statement that response accuracy should always be double-checked. But a couple of other recent updates are apparent in the response too.
The first is the inclusion of dark mode, which was omitted from the first iteration. The second is the inclusion of aGoogle it button and suggested follow on questions.
These are both welcome updates to the tool.
Now let’s see how it compares with the free version of ChatGPT. We asked both tools a simple question: “How many fans attended the 2022 World Cup in Qatar?”
Google Bard’s response gave us precise figures and added some other attendance stats.
ChatGPT was unable to provide up-to-date information.
Next, we tried to test on non-topical data. We asked both chatbots to answer this question: “How long would it take to drive to the sun?”
Google Bard first; it answered with some comprehensive details.
We were quite disappointed with the ChatGPT response. This should have been recognized as a hypothetical question, with the result only requiring some basic arithmetic.
To give ChatGPT a second chance, we reworded the question and asked: “How long would it take me to travel to the sun at 65mph?”
- Title: Investigating Any Flaws in ChatGPT’s Shield
- Author: Frank
- Created at : 2024-08-16 14:43:12
- Updated at : 2024-08-17 14:43:12
- Link: https://tech-revival.techidaily.com/investigating-any-flaws-in-chatgpts-shield/
- License: This work is licensed under CC BY-NC-SA 4.0.