Nvidia CEO showcases $249 desktop AI computer for local model running

Nvidia CEO Jensen Huang has a flair for the theatrical. During a recent presentation, he pulled a $249 AI computer out of a kitchen oven, because apparently that’s how you launch hardware when you’re worth $100B+. The device, called the Jetson Orin Nano Super Developer Kit, is designed to run large language models locally, no cloud subscription required. The pitch is simple: run AI models like Llama 3, Mistral, Gemma, and DeepSeek on a compact box sitting on your desk. No recurring API fees. No sending your data to someone else’s server. Just plug it in and go. What’s actually inside this thing The Jetson Orin Nano Super pushes 67 to 70 TOPS, or trillion operations per second, while sipping just 25 watts of power. For context, that’s roughly the energy draw of a standard lightbulb. The device packs 8 GB of memory with bandwidth clocking in at 1,023 GB/s. Nvidia claims it doubles the performance of its predecessor, the original Jetson Orin Nano, while delivering 50% more memory bandwidth. That’s a meaningful jump for a device in the same price bracket. Nvidia even says the device can handle workflows that were previously the domain of its much larger HGX AI supercomputers. Why local...