AMD gives peek at upcoming line of AI processors in challenge to rival Nvidia

    • Like much of the chip industry, AMD is racing to meet booming demand for AI computing.
    • Like much of the chip industry, AMD is racing to meet booming demand for AI computing. PHOTO: REUTERS
    Published Wed, Jun 14, 2023 · 08:29 AM

    ADVANCED Micro Devices (AMD) showcased its upcoming line of artificial intelligence (AI) processors, aiming to help data centres handle a crush of AI traffic and challenge Nvidia’s dominance in the burgeoning market.

    The company’s Instinct MI300 series will include an accelerator that can speed processing for generative AI – the technology used by ChatGPT and other chatbots – AMD said during a presentation in San Francisco on Tuesday (Jun 13). The product, called MI300X, is part of a lineup that was unveiled at the CES conference in January.

    Like much of the chip industry, AMD is racing to meet booming demand for AI computing. Popular services that rely on large language models – algorithms that crunch massive amounts of data in order to answer queries and generate images – are pushing data centres to the limit. And so far, Nvidia has had an edge in supplying the technology needed to handle these workloads.

    “We are still very, very early in the life cycle of AI,” AMD chief executive officer Lisa Su said at the event.

    The total addressable market for data centre AI accelerators will rise fivefold to more than US$150 billion in 2027, she said. “It’s going to be a lot.”

    Still, the presentation failed to dazzle investors, who already have sky-high expectations for AI growth. They had bid up AMD shares 99 per cent this year through Monday’s close, but the stock drifted down more than 3 per cent during Tuesday’s event.

    Executives from Amazon.com’s AWS and Meta Platforms joined Su on stage to talk about using new AMD processors in their data centres. The chipmaker also announced the general availability of the latest version of its Epyc server processors and a new variant called Bergamo that is aimed at cloud computing uses.

    The MI300X accelerator is based on AMD’s CDNA 3 technology and uses as much as 192 gigabytes of memory to handle workloads for large language models and generative AI, the Santa Clara, California-based company said.

    Key customers will start sampling the technology in the third quarter, with full production starting in the fourth, AMD said. Another model, the Instinct MI300A, is going out to customers now. BLOOMBERG

    Share with us your feedback on BT's products and services