Tiny corp., a startup that runs the tinygrad neural network framework, has unveiled a new artificial intelligence system that uses six AMD Radeon RX 7900 XTX graphics cards. The tinybox, priced at $15,000, aims to democratize PetaFLOPS-class performance for artificial intelligence.
The tinybox system is a compact powerhouse that packs six of AMD's fastest gaming GPUs into a 12U rack case. The GPUs are connected via 'full fabric' PCIe 4.0 x16 links to ensure maximum bandwidth. Small corporation. says it chose the Radeon RX 7900
Tom Hardware reports that “the tinybox can deliver up to 738 FP16 TFLOPS (0.738 FP16 TFLOPS) of performance along with 96 GB of GDDR6 memory offering 21 TB/s of aggregate memory bandwidth. To put the numbers in context, a tinybox offers 37% of the computing performance of the Nvidia H100 (FP16), but slightly more memory (96 GB instead of 80 GB) and considerably more maximum memory bandwidth ( 21 TB/s instead of 3.35 TB/s).
Prompt shipping
The tinybox includes five 1TB Western Digital SN850X SSDs (4 in RAID, 1 for boot) and also features an empty 16x OCP 3.0 slot for networking. It will ship with Ubuntu 22.04 and the tinygrad framework, although tinycorp is happy for buyers to run other machine learning frameworks like PyTorch and JAX on AMD hardware. As the company says, “your hardware is your hardware… you can buy it for any purpose.”
However, not everyone is excited about the idea of the little box. As a Tom Hardware The reader commented: “Oh cool, yet another startup that will drive up gaming GPU prices.”
The BOM cost of the tinybox machine is reportedly around $10,000, but the company will sell it for $15,000, which is considerably lower than Nvidia's H100, which can sell for over $40,000. . To date, the company says it has received 583 pre-orders and plans to start shipping in April. It is possible to reserve the tinybox for $100.
The company says about the future of its creation: “We will push the limits of what is possible in this box. The hardware is solid, but the software is a long journey. I'm excited to take that journey together with all of you soon-to-be tinybox owners. To metal. We will squeeze every last failure out of this.”
