Comparing Giants in AI: The Critical Variances Between GPT-4 and GPT-3.5

After all the speculation and claims regarding the abilities of GPT-4, the much anticipated fourth iteration of the GPT family of language models launched on March 14, 2023.

GPT-4 didn’t come with some of the much-touted features it was rumored to have. However, the latest model significantly improves on GPT-3.5 and its predecessors. But how is GPT-4 different from GPT-3.5? We’ll take you through some key differences between GPT-4 and GPT-3.5.

1. GPT-4 vs. GPT-3.5: Creativity

One of the most pronounced advantages of the GPT-4 model over GPT-3.5 is its ability to provide more creative replies to prompts. Don’t get me wrong; GPT-3.5 is very creative. There’s a long list ofcreative things you can do with ChatGPT that uses the model . However, it already outperforms many large language models in terms of creativity.

However, GPT-4 raises the bar even further. Although GPT-4’s creative advantage may not be apparent when trying to solve basic problems, the difference in creativity between both models becomes apparent as the task becomes harder and requires a higher level of creativity.

For example, if you ask both models to complete a creative task like writing a poem using both English and French on each line of the poem,ChatGPT powered by the latest GPT-4 model will deliver better results. While GPT-4’s response would use both languages on every line, GPT-3.5 would alternate between both languages instead, with each line using one language and the next using the other.

2. GPT-4 vs. GPT-3.5: Image or Visual Inputs

While GPT-3.5 can only accept text prompts, GPT-4 is multi-modal and can accept both text and visual inputs. To be clear, when we say visual inputs, the image doesn’t have to be an image of a typed prompt—it can be an image of anything. So from an image of a handwritten math problem to Reddit memes, GPT-4 can understand and describe almost any image.

Unlike GPT-3, GPT-4 is both a language and a visual model.

During the GPT-4 announcement live stream, an OpenAI engineer fed the model with a screenshot of a Discord server. GPT-4 could describe every detail on it, including the names of users online at the time. An image of a hand-drawn mockup of a joke website was also fed to the model with instructions to turn it into a website, and amazingly, GPT-4 provided a working code for a website that matched the image.

3. GPT-4 vs. GPT-3.5: Safer Responses

While GPT-4 is not perfect, the measures it adopts to ensure safer responses are a welcomed upgrade from that of the GPT-3.5 model. With GPT-3.5, OpenAI took a more moderation-based approach to safety. In other words, some of the safety measures were more of an afterthought. OpenAI monitored what users did and the questions they asked, identified flaws, and tried to fix them on the go.

With GPT-4, most safety measures are already baked into the system at the model level. To understand the difference, it’s like building a house with robust materials from the get-go versus using anything that goes and then trying to patch things as faults emerge. According toOpenAI’s GPT-4 technical report [PDF], GPT-4 produces toxic responses only 0.73% of the time compared to GPT-3.5’s 6.48% of toxic replies.

4. GPT-4 vs. GPT-3.5: Factuality of Response

One of GPT-3.5’s flaws is its tendency to produce nonsensical and untruthful information confidently. In AI lingo, this is called “AI hallucination” and can cause distrust of AI-generated information.

​​​​​​

In GPT-4, hallucination is still a problem. However, according to the GPT-4 technical report, the new model is 19% to 29% less likely to hallucinate when compared to the GPT-3.5 model. But this isn’t just about the technical report. Responses from the GPT-4 model on ChatGPT are noticeably more factual.

5. GPT-4 vs. GPT-3.5: Context Window

A less talked about difference between GPT-4 and GPT-3.5 is the context window and context size. A context window is how much data a model can retain in its “memory” during a chat session and for how long. GPT-4 has a significantly better context size and window than its predecessor model.

In practical terms, this means that GPT-4 can better remember the context of a conversation for longer, as well as the instructions given during the conversation.

An issue with GPT-3.5 is the propensity of the model to go off-topic or fail to follow instructions as you progress during the course of a conversation. You could, for instance, tell the model to address you by your name, and it would do so for a while but then fail to follow the instructions along the way. Although this problem still exists with the GPT-4 model, it is less of an issue because of a better context window.

Another issue is the limitation on the volume of text you can use in a prompt at once. Summarizing long text using GPT-3 typically means splitting the text into multiple chunks and summarizing them bit by bit. The improvement in context length in the GPT-4 model means you can paste entire PDFs at a go and get the model to summarize without splitting it into chunks.

GPT-4: A Step Up from GPT-3.5

Undoubtedly, GPT-4 is a significant step up from its predecessor models. While it is still plagued with some of the limitations of GPT-3.5, significant improvements in several areas and the addition of new capabilities make the model an exciting new step in the pursuit of truly intelligent AI language models.

Also read: