NVIDIA completed its acquisition of Run:ai yesterday after receiving approval from the EU antitrust investigation body. The $700 million acquisition of Run:ai was announced in April. The Israeli-based startup makes software that helps manage and optimize AI hardware infrastructure.
Immediately after the acquisition was finalized, Run:ai said its software would go open source. Until now, it only supported NVIDIA hardware, but will now also support hardware from other manufacturers such as AMD.
Run:ai's software reduces the number of GPUs needed to perform AI processing. It does so by optimizing performance, making neural networks more efficient. According to Run:ai, an AI infrastructure powered by its software can perform AI processing ten times faster than existing systems.
For example, Run:Ai's software can run two AI models simultaneously with 75% GPU utilization, compared to just one model using only 60% GPU in a data center. This optimization of GPU usage will not only reduce energy consumption, which is a major issue in AI, but will also increase profits as the hardware is better utilized.