Composable infrastructure company Liqid has created a cost-effective and scalable solution for organizations looking to deploy high-performance inference capabilities in their data centers.
Unveiled at Dell Technologies World 2024, the UltraStack 30 packs a whopping thirty Nvidia L40S GPUs into a single Dell PowerEdge R760 server.
Liqid previously published a white paper for its UltraStack server on Nvidia GTC 2024 and at the time had only managed to fit up to 20 Nvidia L40S into a PowerEdge server, so it's a big jump in a short period of time.
AMD and Intel support is coming
Nvidia L40S GPUs have fewer cores and are generally less powerful than Nvidia's H100 and A100 accelerators, as well as the newer Blackwell GB200 and B200 systems. However, they are suitable for a variety of high-performance tasks, including artificial intelligence, data analysis, and 3D rendering. This makes them a versatile choice for modern data centers and professional workloads, and they are also more economical. L40Ss typically cost between $7,000 and $8,000, compared to H100s, which can cost between $25,000 and $30,000.
UltraStack 30 delivers enhanced enterprise-level GPU infrastructure capabilities and builds on previous solutions, with improvements in operations per second and total cost of ownership compared to similar GPU density solutions. It also features an energy-efficient design capable of delivering high performance while reducing energy consumption and operating costs.
This is just the beginning and the company has big plans for UltraStack 30. Sumit Puri, co-founder and chief strategy officer at Liqid, said: “As we move forward, we recognize that optimal memory bandwidth will be crucial to maximizing performance. “That’s why composableCXL (Compute Express Link) is on Liqid’s horizon, promising to further enhance our capabilities to deliver high-performance, low-latency solutions.”
Blocks and files adds: “It is our understanding that Liqid may support GPUs and other accelerators from vendors such as AMD and Intel. “It is also aware of the possibility of marketing its SmartStack and UltraStack technologies to MSPs who wish to supply GPUs for rent.”
