https://medium.com/@mehtamegh/chatgpt-is-slow-heres-the-best-alternative-645e3fcd7066
It’s 2024 and everyone has been using ChatGPT for at least a year now. Some say it’s magical, some that it’s a simpler version of Google, and most people at this point say it’s SLOW.
A year ago giving ChatGPT a prompt to write an essay and seeing the outputs seemed magical. ChatGPT was capable of writing 200-word essays within 15 seconds.
However, using it for over a year now, people believe that this is pretty slow. Whenever you give the prompt to ChatGPT, it thinks for a second and then writes the answer down in a manner that the user feels someone is writing it. Here is what I mean:
This was fantastic a year ago, but now it just tests the patience level of a person.
What if I tell you, there is a new tool that gives answers as good as ChatGPT but takes less than a second to prompt answers (prompts that are even more complex than just writing a simple essay).
Introducing to you Groq.
Groq’s UI is simple. Just a prompt bar asking you to enter your prompt
After inputting it gives you the results almost instantaneously.
This Twitter post by Dina Yerlan shows a comparison of ChatGPT and Groq concerning their response times.
What makes it so good?
Groq uses LPU (language processing units) architecture instead of GPU (graphics processing unit), enabling more efficient and faster speeds. This enables Groq to hit blazing speeds of 500 tokens per second, compared to 30–50 for GPT 3.5.
To understand the speeds Groq achieves, you truly have to see it to believe it. Near-instant responses open up a new world of potential for AI and user experiences, while the efficiency and affordability of LPUs could offer an alternative to in-demand GPUs on the market.
Try out Groq: https://groq.com/
Enjoyed the article? Connect with me on LinkedIn for more. If you’re feeling generous, buy me a coffee! 🚀☕
Thank You!