China faces a significant challenge in the realm of hardware development for artificial intelligence (AI) applications. Currently, Chinese chip manufacturers are lagging in the production of solutions that can compete with the most advanced memory technologies developed by South Korean giants Samsung and SK Hynix, as well as American innovator Micron Technology . The performance of GPUs utilized for AI is heavily reliant on HBM memory chips ( High Bandwidth Memory ). Unfortunately, the current capabilities from China in this area leave much to be desired.
Leading competitors like SK Hynix , Samsung , and Micron are manufacturing 12-layer HBM3e memories at scale, although their success rates differ. In a significant future development, both South Korean companies are poised to produce HBM4 chips on a large scale in the second half of 2025, while Micron aims to follow suit in 2026. However, CXMT ( Changxin Memory Technologies ), a Chinese firm specializing in memory production, is not set to launch its first HBM3E chips until 2027. With the ongoing competition between the US and China, it is crucial for China to close this two-year gap in HBM memory production capabilities.
Encouragingly, recent reports suggest that this delay may soon be addressed. The Chinese state media outlet Securities Times has announced that Huawei is on the verge of unveiling a technological advancement aimed at reducing China’s dependence on foreign HBM memory chips . A subsequent report from Digitimes Asia has revealed significant news: Huawei is currently testing its first HBM3 chips , which are entirely manufactured in China. This milestone is critical for the nation, as it may enable China to access technology that has previously been beyond its reach.
Huawei’s Relentless Pursuit of Innovation
Huawei invests over $25 billion annually in the development of its AI hardware, indicating that it is not far from achieving performance levels comparable to those of graphics processing units produced by NVIDIA and AMD . Historically, Huawei has faced two major obstacles: its lack of capability to manufacture chips using extreme ultraviolet photolithography equipment (EUV) sourced from the Dutch company ASML , and its struggle to gain access to integrated HBM memory circuits made overseas. Fortunately, the latter issue appears to be resolved.
<img alt="Samsung's cutting-edge QD-OLED technology" width="375" height="142" src="https://i.blogs.es/62cefd/samsungs95f-ap/375_142.jpeg"/>Huawei invests over $25 billion annually in AI hardware development
Recently, during the Financial Reasoning Applications Forum held in Shanghai , Huawei announced an innovative algorithm known as UCM ( Unified Cache Manager ). This unique algorithm is designed to drastically accelerate inference processes for large AI models. A key point to remember is that inference, in a broad sense, refers to the computational process carried out by language models to generate appropriate responses based on incoming requests.
To achieve its objectives, the UCM algorithm utilizes a clever strategy that determines where each piece of data should be stored based on latency requirements . Essentially, UCM acts like a massive cache, ensuring that data is directed to the most suitable form of memory, including HBM3, thereby minimizing latency during inference operations. For frequently accessed data, HBM3—a rapid memory type—will be utilized for storage. According to Huawei, this technology has the potential to cut inference latency by an impressive 90% . Furthermore, the company has plans to open-source the UCM algorithm in September.
For more insights, you can check Digitimes Asia to stay updated on Huawei’s developments in the memory chip industry.
As the global tech landscape continues to evolve, it is clear that China’s steps toward autonomy in AI hardware are significant and necessary. With ongoing investments from corporations like Huawei and innovations in memory technology, it’s only a matter of time before China plays a larger role in the global AI sector. The ability to compete with established industry leaders like Samsung, SK Hynix, and Micron will not only benefit China’s tech aspirations but also shift the dynamics of technological innovation dynamics worldwide.