- The GPU type PCIE card offers FP4 10pflops calculation power and 2 GB of SRAM
- SRAM is generally used in small quantities as cache in processors (L1 to L3)
- He also uses LPDDR5 rather than much more expensive HBM memory
Silicon Valley Startup D-Matrix, which is supported by Microsoft, has developed a solution based on chiplet designed for fast and small lot of llms in business environments. Its architecture adopts a digital memory calculation approach, using modified SRAM cells for speed and energy efficiency.
Corsair’s current product, D-Matrix, is described as the “AI first calculation platform of its kind” and has two ASICS D-Matrix on a full length and full PCIe card, with four chiplets per Asic . It reaches a total of 9.6 pflops FP4 Power calculation with 2 GB of performance based on SRAM. Unlike traditional conceptions based on expensive HBM, Corsair uses LPDDR5 capacity memory, with up to 256 GB per card to manage larger models or workloads in lots.
D-Matrix says that Corsair offers better interactive performance, 3X energy efficiency and 3x cost-cost performance compared to GPU alternatives, such as the extremely popular Nvidia H100.
A jump of faith
Sree Ganesan, chief of the D-Matrix product, said Ee times“-Matrix focused on the bandwidth of memory and innovation on the memory barrier.”
D-Matrix’s approach eliminates the bottleneck by allowing the calculation directly in memory.
“We have built a digital memory calculation kernel where the accumulated multiplication occurs in memory and you can enjoy a very high bandwidth – we are talking about 150 teraoctets per second,” said Ganesan. “This, in combination with the series of other innovations, allows us to resolve the challenge of the memory wall.”
CEO Sid Sheth said Ee times The company was founded in 2019 after the comments of the hyperscalers suggested by inference were the future. “It was an act of faith, because inference alone as an antique was not perceived as being too large in 2019,” he said. “Of course, everything changed after 2022 and Chatgpt. We also bet on transforming [networks] fairly early in the company. »»
Corsair is entering mass production in the second quarter of 2025, and D-Matrix is already planning its new generation ASIC, Raptor, which will integrate 3D DRAM to support the workloads of reasoning and larger memory capacities.
