The High Bandwidth Memory (HBM) Market: A Surge in Demand and Prices
Wednesday, May 08, 2024The HBM Market: A Surge in Demand and Prices
The High Bandwidth Memory (HBM) market is witnessing a significant surge in demand and prices. This is largely due to the increasing need for AI GPUs and the rapid development of AI applications.
The Race for HBM3 Dominance
Samsung and SK Hynix are currently leading the race for HBM3 dominance. Both companies have seen a huge influx of orders from the AI industry. The demand for HBM has been so high that SK Hynix revealed in their Q3 earnings that all orders for HBM have been sold out for the next year. The situation is similar at Samsung.
HBM is a crucial component in highly-demanded AI GPUs, offering high transfer speeds, faster bandwidth, and increased memory capacities. This is why companies like Samsung and SK Hynix have stepped in to capitalize on the opportunity.
The Future of HBM
The advent of HBM3e will mark a new transition in the industry. This process is expected to bring huge performance gains and will likely debut in NVIDIA’s Blackwell AI GPUs along with Team Red’s Instinct MI400s.
Memory manufacturers are moving quickly when it comes to developing existing facilities to cope with the immense hype surrounding HBM3e. SK Hynix believes that the HBM industry can increase by 60-80% over the next five years.
The Impact on Prices
The HBM memory industry is witnessing a huge economic rebound with the immense demand from AI. This has taken the prices to new levels, reportedly a whopping five times increment. With the huge volumes of AI accelerators being produced by firms such as NVIDIA and AMD, HBM prices have soared to new levels.
Conclusion
The surge in AI developments has definitely prompted rapid growth in the AI industry, creating a gap for other players to enter as well. The future of the HBM market looks promising with a compound annual rate of 45% over the next five years. With the debut of future HBM products such as HBM4 in the upcoming years, the market is seen with high optimism.