[2023/03/01] The latest rumors about GPT-4

ChatGPT appears to be the fastest ever to reach 100 million active users in January 2023 since its launch late last year. At this point in time, it can read minds at the same level as a 9-year-old child and has the performance to pass graduate school exams.

ChatGPT is said to be currently tuned based on GPT-3 (3.5), and the next version, GPT-4, is rumored to be much more powerful than GPT-3. Since there seems to be no official comment yet, here is a rough summary of the rumors as of the time of writing.

1. Scheduled to be released within 2023

It is generally rumored to be released by the end of 2023. Some said it would be released in February 2023, but it still seems to take some time.

It may take some time because ChatGPT has attracted attention from all over the world and there are more requirements to be verified, but I would definitely like to try it out soon.

Reference: OpenAI CEO Sam Altman on GPT-4: ‘People are begging to be disappointed and they will be’ – THE VERGE

2. beta version is already complete.

As of August 2022, the beta version of GPT-4 is already being tested, and beta users have remarked that they are seeing a fairly large leap in performance. (In many cases, testimonials from acquaintances of beta users)

Reference: GPT-4 Rumors From Silicon Valley – The Algorithmic Bridge

3. 100 times as many reference parameters as GPT-3

While GPT-3 has 175 billion parameters, GPT-4 seems to have more than 100 trillion parameters. The number of parameters may represent the performance of a language model, but it does not seem that more parameters does not equal higher performance.
(I could not find a clear definition of the number of parameters)

Reference: GPT-4: Facts, Rumors and Expectations about next-gen AI models – UX Planet

4. remain text-based

It is said that multimodal functions such as image generation will not be added, and that the model will follow a text-based evolution.

Reference: GPT-4 Is Coming – What We Know So Far – Forbes

5. Multimodal functionality will be included.

According to beta users, GPT-4 will be multimodal and will be able to generate not only text, but also images, audio, and video.
Earlier, forbes, here is a testimonial from a beta user. There is a small information war going on. Personally, I feel that the theory of updating to GPT-4 while remaining text-based is more likely.

Reference: GPT-4 Rumors From Silicon Valley- The Verge

6. Window size expansion

Currently, ChatGPT responses are limited to a maximum of 4,096 tokens. (0.7 words per token?).
This limit may be extended to 8,000 ~ 32,000 tokens. It is likely to increase the number of applications that can take advantage of this feature very much.

Reference: OpenAI leak gives clue to GPT-4 performance – the decoder

7. Code generation capabilities will increase dramatically.

It seems to be better at code generation than ever before. There may not be any specific new features, but I would be happy just to see an increase in accuracy.

Reference: GPT-4 Is Coming – What We Know So Far – Forbes

8. Improve accuracy, etc.

The GPT-4 seems to be tuned to respond in accordance with people’s values, such as accuracy of information, politics, religion, philosophy, and culture, so that the responses will be more in line with people’s intentions. This reflects a lot of human feedback.

Reference: GPT-4 Is Coming Soon. Here’s What We Know About It – Towards Data Science

Other.

GPT-4 rumors are bullshit.

Sam Altman, CEO of OpenAI, comments that the rumors about GPT-4 that have infected the Internet are complete and utter nonsense.

Reference: GPT-4 is Still a Rumor – Shelly Palmer

ChatGPT and API are not the same thing.

ChatGPT’s API and OpenAI’s API (text-davinci-3 model) are different. Both are GPT-3 (3.5), but ChatGPT has been highly tuned from the GPT-3 model to specialize in chat.

Although ChatGPT and GPT-3 APIs are sometimes treated as close, it takes some ingenuity to add the ability to talk with AI directly from OpenAI’s API.

Reference: Are “ChatGPT’s API” and “GPT-3’s API” the same thing? Are they different? About

Summary

I guess this is the main part. I have touched the OpenAI API a little, so I will write about that later.
I’m sure there is some missing or new information, so please feel free to add to it in the comments!

Original my article: https://zenn.dev/gohan_dao/articles/435ce51fae0a2f
Translated with www.DeepL.com/Translator