The Business Times

Meta debuts new AI chip, aiming to decrease reliance on Nvidia

Published Thu, Apr 11, 2024 · 06:56 AM

META Platforms is deploying a new homegrown chip to help power its artificial intelligence (AI) services, aiming to decrease its reliance on semiconductors from Nvidia and other outside companies.

The chip, announced on Wednesday (Apr 10), is the latest version of the Meta Training and Inference Accelerator, or MTIA, which helps rank and recommend content across Facebook and Instagram. Meta released the first MTIA product last year.

Meta’s pivot to AI services has brought increased demand for computing power. Last year, the social media giant released its own version of an AI model to compete with OpenAI’s ChatGPT. It also added new generative AI features to its social apps, including customised stickers and celebrity-faced chatbot characters.

In October, the company said it would spend as much as US$35 billion on infrastructure to support AI, including data centres and hardware. “AI will be our biggest investment area in 2024,” chief executive officer Mark Zuckerberg told investors that month.

A significant amount of that spending will likely still flow to Nvidia, which builds the popular H100 graphics cards that power AI models. Earlier this year, Zuckerberg said the company would acquire 350,000 of those chips, which cost tens of thousands of US dollars each.

But there is a growing movement among tech giants to develop chips in-house. Meta is joining rivals Amazon.com’s AWS, Microsoft and Alphabet’s Google in trying to wean themselves off a very expensive dependency. It will not be a quick fix, though. So far, the efforts have not made a dent in the industry’s insatiable need for Nvidia’s AI accelerators.

GET BT IN YOUR INBOX DAILY

Start and end each day with the latest news stories and analyses delivered straight to your inbox.

VIEW ALL

The AI boom has helped turn Nvidia into the world’s third-most-valuable tech company, behind only Microsoft and Apple. Its sales to data centre operators totalled US$47.5 billion in fiscal 2024, up from just US$15 billion the year before. Analysts predict that the sum will more than double again in fiscal 2025. BLOOMBERG

READ MORE

BT is now on Telegram!

For daily updates on weekdays and specially selected content for the weekend. Subscribe to  t.me/BizTimes

Telcos, Media & Tech

SUPPORT SOUTH-EAST ASIA'S LEADING FINANCIAL DAILY

Get the latest coverage and full access to all BT premium content.

SUBSCRIBE NOW

Browse corporate subscription here