The Arm AGI CPU features up to 136 cores per CPU and boasts double the performance per watt compared to x86 chips.
After many years of licensing its chip designs for others to manufacture, UK-based Arm has introduced its first self-produced chip. Known as the Arm AGI CPU, this chip is intended for inference, particularly useful in AI tools that manage extensive cloud processing tasks. Meta will be the first to utilize this chip, as they have faced challenges in deploying their own AI chips.
Meta is partnering as both the lead partner and co-developer, aiming for multiple generations of data center CPUs. These CPUs will be used alongside other vendors’ hardware, such as Nvidia and AMD. Companies like Amazon AWS, Microsoft, Google, and more praised the announcement, though Qualcomm, which recently achieved a court victory over Arm, was absent from the list of congratulators.
Details on the financial terms of Arm’s deal with Meta and the number of CPUs to be used remain undisclosed. The Arm AGI CPU, built on the Neoverse platform, promises significantly improved performance while reducing traditional CPU limitations like memory bottlenecks.
Additional customers for Arm’s chip include Cerebras, Cloudflare, F5, OpenAI, Positron, Rebellions, SAP, and SK Telecom. Arm’s AI division aims to serve companies unable to develop their own processors, according to Mohamed Awad, Arm’s cloud AI head, as reported by CNBC.