Summary of TinyBox AI Accelerator Article

TLDR:

• TinyBox AI accelerator now available starting at $15k
• Affordable option compared to Nvidia H100 or AMD MI300X accelerators

The TinyBox AI accelerator is now available for purchase on the tinygrad website, priced at $15k. This small 16.25-inch deep, 12U freestanding unit features six AMD Radeon RX 7900XTX or Nvidia GeForce RTX 4090 GPUs designed for deep learning and AI acceleration applications. Despite being more expensive than consumer gaming desktop PCs, it offers a more affordable alternative to other high-end accelerators in the market.

Tinygrad founder George Hotz announced that the company has 13 units in stock as of August 27 and claims that the TinyBox offers the best performance per dollar in the world and is fully networkable. Despite initial challenges with the AMD GPUs used in the system, the company has solved these issues and also added Nvidia GPU options for a 67% premium. The company has already received 583 pre-orders for the system, indicating a strong demand for the product.

Companies interested in the TinyBox AI accelerator can choose between the more affordable AMD GPU option or the Nvidia system. While there were initial concerns about the AMD driver instability, the company is confident that it has addressed these issues. However, the company has no plans to ship Intel Arc-powered models of the TinyBox at this time.