For existing chips in the market, there's a really uncomfortable trade-off between latency and throughput. Chips that are best at throughput have historically been the chips that are based on HPM as the memory... but that hasn't been so good at latency.
1mo ago