First crack in Nvidia AI wall? Meta set to use own AI chips in its servers in 2024 — but it will still use Nvidia H100 GPUs as well in its datacenters for now
Meta Platforms, the parent company of Facebook, plans to deploy its own custom-designed artificial intelligence chips, codenamed Artemis, into its data centers this year, according to an internal document seen by Reuters. This move could potentially reduce Meta’s dependence on Nvidia‘s market dominant H100 chips and control the escalating costs of running AI workloads.
Meta has been investing billions of dollars to boost its computing capacity for the power-hungry generative AI products that it is integrating into services such as Facebook, Instagram, and WhatsApp. This involves acquiring specialized chips and reconfiguring data centers to accommodate them.
According to Dylan Patel, founder of the silicon research group SemiAnalysis, the successful deployment of Meta’s own chip could potentially save the company hundreds of millions of dollars in annual energy costs and billions in chip purchasing costs.
Still reliant on Nvidia, for now
Despite this move toward self-reliance, Meta will continue to use Nvidia’s H100 GPUs in its data centers for the foreseeable future. CEO Mark Zuckerberg has stated that by the end of this year, the company plans to have roughly 350,000 H100 processors in service.
The deployment of its own chip marks a positive turn for Meta’s in-house AI silicon project, following a decision in 2022 to discontinue the chip’s first iteration in favor of Nvidia’s GPUs.
The new chip, Artemis, like its predecessor, is designed for AI inference, which involves using algorithms to make ranking judgments and generate responses to user prompts.
“We see our internally developed accelerators to be highly complementary to commercially available GPUs in delivering the optimal mix of performance and efficiency on Meta-specific workloads,” a Meta spokesperson said.
While Meta’s move to reduce its dependence on Nvidia’s processors could perhaps signal the first crack in Nvidia’s AI wall, it’s clear that for now, Nvidia’s GPUs will continue to play a significant role in Meta’s AI infrastructure.
More from TechRadar Pro
Meta Platforms, the parent company of Facebook, plans to deploy its own custom-designed artificial intelligence chips, codenamed Artemis, into its data centers this year, according to an internal document seen by Reuters. This move could potentially reduce Meta’s dependence on Nvidia‘s market dominant H100 chips and control the escalating costs…
Recent Posts
- Quordle today – hints and answers for Sunday, May 19 (game #846)
- Blue Origin’s first crewed launch since 2022: Where to watch
- This modder proves everything’s better with a GBA SP screen attached
- Mobile industry is quietly preparing for the biggest change to your smartphone in a decade — iSIM will hasten the end of SIM cards and allow networks to preload plans on devices
- Replacing the OLED iPad Pro’s battery is easier than ever
Archives
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- December 2011