GPTshop.ai has unveiled the world's first supercomputer powered by the Nvidia GH200 Grace Hopper Superchip, and it's an absolute beast. Housed in a sleek and compact desktop form factor, it currently holds the title of the fastest ARM desktop PC out there.
The PC is optimized for memory-intensive AI tasks, particularly LLM inference and tuning, and HPC applications such as genome sequencing. It can function as a server or desktop workstation and offers the flexibility of offline use.
As expected, the machine delivers impressive performance, clocking in at up to 284x faster than x86, helped in no small part by an impressive 576GB+ of RAM, making it capable of running the largest LLMs currently available.
Even more RAM if you need it
Despite its high performance, manufacturers say it is energy efficient and easy to transport. It operates silently and has a visually attractive design. It runs on Linux and requires no special infrastructure to operate.
GPTshop.ai says that compared to 19-inch server models, this desktop format has several advantages. It's quieter, more transportable, and can be quickly and easily deployed almost anywhere. Offers virtually zero latency when used as a desktop/workstation.
Its manufacturer also claims that it outperforms alternative systems in terms of cost, power consumption and performance. Compared to 8x Nvidia H100, GH200 is 5 times cheaper, consumes 10 times less power and offers comparable performance.
The base PC configuration includes an Nvidia GH200 Grace Hopper superchip, a 72-core NVIDIA Grace CPU, an NVIDIA H100 Tensor Core GPU, and 576GB or 624GB of hot-access memory. You can customize the desktop however you want with a variety of cards, drives, and ports.
The PC is available in two color options: Titanium Gray and Champagne Gold. The cost of this desktop supercomputer currently starts at $43,500.
Manufacturers are currently working on a selection of models with alternative casings. These include 'Special Edition', 'Liquid', 'Glass', 'Glass Special Edition' and 'Liquid Glass', and will be available in the coming months.