General Compute taps Positron AI to split inference work between GPUs and memory-first chips

1 week ago 9



General Compute has signed a strategic partnership with Positron AI that splits AI inference work between two kinds of hardware. GPUs will handle the prefill stage, and Positron’s memory-first accelerators will take over decoding. The companies announced the deal on October 20, 2026. First hardware deployments for customers are expected to come online in Q1 2027. What the deal actually covers Under the agreement, General Compute will buy Positron’s Atlas inference systems at cluster scale. That means rows of machines, not a handful of test boxes. General Compute has also committed to bringing Positron’s next-generation Titan systems into its operations. Titan is slated for production in 2027. The core idea is what the industry calls heterogeneous inference. Instead of asking one type of chip to do every job, the workload gets divided by task. In AI terms, prefill is the stage where a model reads and processes the incoming prompt. Decoding is the stage where it produces its response, token by token. General Compute will keep prefill on GPUs and route decoding to Positron’s accelerators. Positron’s pitch centers on memory bandwidth, which it treats as the critical bottleneck in servi...

Read Entire Article









피플앤툴즈 네트워크
🛍 샵