NVIDIA DGX Spark: A Box of AI Chocolates ➹

Looks pretty, although the fact that it cannot beat a 5090 in inference should tip you off that it’s designed to hold a lot of RAM, not necessarily be on the bleeding edge of performance.

In my mind it feels like the modern day equivalent of the NVIDIA Shield–not because it’s for media, but because it’s a small, self-contained box that will expand NVIDIA’s footprint well enough, and is easy to set up and use: No fiddling with CUDA versions, no worrying about dependencies, no need to do anything unusual to set up your development environment.

But unlike a Mac or a generic AMD box, these are a pretty beefy commitment–almost a single-purpose box…