Groq#52
About
Groq is an American AI semiconductor company that builds LPU (Language Processing Unit) inference hardware and the GroqCloud platform for ultra-fast, low-cost AI model inference. It was founded in 2016 by former Google engineers who helped design Google's TPU.
From X
Taken Sep 1, 2016 when @JonathanRoss321 convinced me we could take on the giants, build new silicon and that AI was coming. In typical SV fashion, we didn’t even have a company yet - just a term sheet from me to invest and the three of us. I spent the next month recruiting as many of the TPU team from Google Wisconsin as I could. “Welcome to chips”, I thought. The company, as with all important companies, went through its own trials and tribulations including promoting Jonathan from CTO to CEO and the inevitable falling out and repair of his and my relationship. Anyways, it all happened for a reason. Today we close this almost decade chapter and Jonathan starts a new one with nVidia. I can’t thank him enough. Sometimes it’s simply better to be lucky than good and be fortunate enough to work with great people and follow them into battle. That is me here. Jonathan was not only the father of TPU when he was at Google but he is a technical genius of biblical proportions. He also assembled a great team with folks like @sundeep and @GavinSherry to back him up. They will also do incredible things at nvidia. Separately, whenever something I’m involved in either crashes or wins, I reread my thoughts when I first did it. Was it luck? Was it skill? What did I learn? What do I do now? YMMV, but I am attaching the original investment memo I wrote a decade ago. I’ll do a more substantive view on why this deal matters and what my guess is about the future of AI silicon from here on an upcoming episode of the pod. In the meantime, Merry Christmas. I am very thankful. So thank you Jonathan, Sunny, Gavin and the entire Groq team. 🙏🏽🙏🏽🙏🏽
It’s true that we divested both Groq and xAI. I wouldn’t have mentioned this except for the fact that the MSM continually lies about this, claiming I took a government role to make money when in fact the opposite is true.
Who said TPUs can't be fast! This is roughly Groq speeds out of TPU 8i, but with Gemini Flash model so far more intelligent https://t.co/J39FF2yCm6
Today Groq entered into a non-exclusive licensing agreement with Nvidia for Groq’s inference technology. Along with other members of the Groq team, I’ll be joining Nvidia to help integrate the licensed technology. GroqCloud will continue to operate without interruption. Learn more here: https://t.co/1Lgv1EKZNH
holy shit groq + k2 is fast af - video not sped up stuff is changing real fast https://t.co/KCGBsdBl1U
The next phase of AI silicon is all about cheap, abundant decode. Groq was just the appetizer…This paper is a very good guide.
News
Polls
Will Groq's LPUs power a majority of AI inference workloads by 2030?
