ChatGPT appears to be the fastest ever to reach 100 million active users in January 2023 since its launch late last year. At this point in time, it can read minds at the same level as a 9-year-old child and has the performance to pass graduate school exams.
ChatGPT is said to be currently tuned based on GPT-3 (3.5), and the next version, GPT-4, is rumored to be much more powerful than GPT-3. Since there seems to be no official comment yet, here is a rough summary of the rumors as of the time of writing.
- 1 1. Scheduled to be released within 2023
- 2 2. beta version is already complete.
- 3 3. 100 times as many reference parameters as GPT-3
- 4 4. remain text-based
- 5 5. Multimodal functionality will be included.
- 6 6. Window size expansion
- 7 7. Code generation capabilities will increase dramatically.
- 8 8. Improve accuracy, etc.
- 9 Other.
- 10 Summary
1. Scheduled to be released within 2023
It is generally rumored to be released by the end of 2023. Some said it would be released in February 2023, but it still seems to take some time.
It may take some time because ChatGPT has attracted attention from all over the world and there are more requirements to be verified, but I would definitely like to try it out soon.
2. beta version is already complete.
As of August 2022, the beta version of GPT-4 is already being tested, and beta users have remarked that they are seeing a fairly large leap in performance. (In many cases, testimonials from acquaintances of beta users)
3. 100 times as many reference parameters as GPT-3
While GPT-3 has 175 billion parameters, GPT-4 seems to have more than 100 trillion parameters. The number of parameters may represent the performance of a language model, but it does not seem that more parameters does not equal higher performance.
(I could not find a clear definition of the number of parameters)
4. remain text-based
It is said that multimodal functions such as image generation will not be added, and that the model will follow a text-based evolution.
5. Multimodal functionality will be included.
According to beta users, GPT-4 will be multimodal and will be able to generate not only text, but also images, audio, and video.
Earlier, forbes, here is a testimonial from a beta user. There is a small information war going on. Personally, I feel that the theory of updating to GPT-4 while remaining text-based is more likely.
Reference: GPT-4 Rumors From Silicon Valley- The Verge
6. Window size expansion
Currently, ChatGPT responses are limited to a maximum of 4,096 tokens. (0.7 words per token?).
This limit may be extended to 8,000 ~ 32,000 tokens. It is likely to increase the number of applications that can take advantage of this feature very much.
7. Code generation capabilities will increase dramatically.
It seems to be better at code generation than ever before. There may not be any specific new features, but I would be happy just to see an increase in accuracy.
8. Improve accuracy, etc.
The GPT-4 seems to be tuned to respond in accordance with people’s values, such as accuracy of information, politics, religion, philosophy, and culture, so that the responses will be more in line with people’s intentions. This reflects a lot of human feedback.
GPT-4 rumors are bullshit.
Sam Altman, CEO of OpenAI, comments that the rumors about GPT-4 that have infected the Internet are complete and utter nonsense.
Reference: GPT-4 is Still a Rumor – Shelly Palmer
ChatGPT and API are not the same thing.
ChatGPT’s API and OpenAI’s API (text-davinci-3 model) are different. Both are GPT-3 (3.5), but ChatGPT has been highly tuned from the GPT-3 model to specialize in chat.
Although ChatGPT and GPT-3 APIs are sometimes treated as close, it takes some ingenuity to add the ability to talk with AI directly from OpenAI’s API.
I guess this is the main part. I have touched the OpenAI API a little, so I will write about that later.
I’m sure there is some missing or new information, so please feel free to add to it in the comments!
Original my article: https://zenn.dev/gohan_dao/articles/435ce51fae0a2f
Translated with www.DeepL.com/Translator