In a report, Groq claims its LPUs are scalable and will be connected together utilizing optical interconnect across 264 chips. it could even more be scaled utilizing switches, but it will eventually include to latency. https://www.sincerefans.com/blog/groq-funding-and-products