Omar Marques | Sopa Pictures | Lightrocket | Getty Pictures
Meta Platforms unveiled particulars on Wednesday concerning the subsequent technology of the corporate’s in-house synthetic intelligence accelerator chip.
Reuters reported earlier this 12 months that Meta deliberate to deploy a brand new model of a customized information middle chip to handle the swelling quantity of computing energy essential to run AI merchandise in Fb, Instagram and WhatsApp. The chip, referred to internally as “Artemis,” will assist Meta scale back its reliance on Nvida’s AI chips and scale back its vitality prices total.
“This chip’s structure is essentially centered on offering the suitable steadiness of compute, reminiscence bandwidth, and reminiscence capability for serving rating and suggestion fashions,” the corporate wrote in a weblog submit.
The brand new Meta Coaching and Inference Accelerator (MTIA) chip is a part of a broad customized silicon effort on the firm that features taking a look at different {hardware} programs too. Past constructing the chips and {hardware}, Meta has made vital investments in growing the software program essential to harness the ability of its infrastructure in essentially the most environment friendly means.
The corporate can be spending billions on shopping for Nvidia and different AI chips: This 12 months CEO Mark Zuckerberg mentioned the corporate deliberate to accumulate roughly 350,000 flagship H100 chips from Nvidia. Mixed with different suppliers, Meta plans to build up the equal of 600,000 H100 chips this 12 months, he mentioned.
Taiwan Semiconductor Manufacturing Co will produce the brand new chip on its “5nm” course of. Meta mentioned it’s able to 3 times the efficiency of its first technology processor.
The chip has been deployed within the information middle and is engaged in serving AI purposes. The corporate mentioned it has a number of packages underway “aimed toward increasing the scope of MTIA, together with help of (generative AI) workloads.”
