Recently overheard a Groq employee: apparently their per-token costs are 1-2 orders of magnitude higher than what they charge, and the new chip won't materially help. There's no credible plan to fix this. This is why they aren't raising rate limits. Very bearish.
