8 Ways China is changing AI on the edge

Published on: Oct 15, 2026
Author: Jian Wu

China’s innovation story is no longer just about scale in the cloud or manufacturing muscle in hardware. It is also moving straight onto the device in your hand. The latest example comes from Beijing, where ModelBest and the OpenBMB community have released MiniCPM-V 4.7, an open-source multimodal AI model designed for phones and tablets with about 3GB of memory. For investors and analysts watching where practical AI adoption goes next, this is a strong signal: China is pushing advanced model capability into everyday hardware, while keeping the software open, portable, and globally relevant.

The new release arrives in two versions, 35B-A3B and 1B, and it extends a fast-moving Chinese open-source ecosystem that now claims more than 60 million cumulative downloads for the MiniCPM series. That kind of user base matters. It suggests real developer adoption, a broad testing ground, and a distribution model that can travel well beyond China’s domestic market. Just as important, the release is built for iOS, Android, and HarmonyOS, with Day-0 chip support from major names including AMD, Apple, Arm, Intel, NVIDIA, Rockchip, and Houmo AI.

A bigger model, but built to fit on devices

ModelBest describes MiniCPM-V 4.7 35B-A3B as “the first open-source MoE model to run smoothly on-device without compromising performance.” That claim is central to why this release stands out. The model activates about 3 billion parameters per token, while most experts stay on SSD storage and load as needed. In practical terms, the design aims to bring large-model multimodal capability to mobile and edge devices without forcing every user into the cloud. That is exactly the kind of engineering advance that can expand AI access in emerging markets and in price-sensitive consumer segments.

The company says the model handles image understanding, document and chart interpretation, STEM problem solving, OCR, and long-video understanding. It also says MiniCPM-V 4.7 “achieves a higher overall score in less inference time than Qwen3.6 35B-A3B.” Those are company claims, not independent findings, but they still show where Chinese AI labs are focusing: not just raw size, but a better balance of capability, cost, and latency. In AI, that combination is often more important than a headline parameter count.

Speed is becoming the real moat

ModelBest’s Lookahead Expert Scheduling, or LES, is a useful sign of how China’s AI teams are chasing efficiency gains through systems design. The company says LES predicts which experts the next layer will need and loads them while the current layer computes. In most scenarios, it prepares more than 80% of required experts in advance without additional training. The original router still makes the final expert selection, so the outputs remain identical whether LES is enabled or disabled. That is a neat engineering solution: better speed, no change in model behavior.

According to the company, LES works with layer-wise quantization and contiguous expert storage to lift average generation speed by approximately 5x on an iPad Pro M4 with 16GB of memory. It says the model reaches more than 17 tokens per second on that device and more than 13 tokens per second on the iPhone 17 Pro Max. Those figures are vendor-reported and should be treated that way, but they still matter because they point to a broader trend. China’s AI competition is increasingly about turning big-model intelligence into usable consumer-grade performance.

More compression, more reach

MiniCPM-V 4.7 also supports both 4× and 16× visual token compression, giving developers a choice between more detail and more speed. At 16× compression, ModelBest says the model still scores 90.9 on MMBench and 90.4 on OCRBench. Again, those are company-reported numbers, but the strategic message is clear: China’s model makers are optimizing for deployment, not just demos. That matters for real-world use cases such as document processing, field services, retail search, education, and industrial inspection.

The 1B version pushes that logic even further. Built on MiniCPM-V 4.6, it is designed for lightweight edge devices and supports general vision, OCR, chart reasoning, and multi-image understanding. The company says it can run smoothly on entry-level devices, bringing multimodal AI to more everyday hardware. For global observers, this is a reminder that China’s AI rollout is not confined to premium phones or data-center-class infrastructure. It is being engineered for mass adoption at the device layer.

Open source and global chips reinforce the strategy

Another important piece is openness. According to the current fact pack, the model weights, code, and documentation are published under the Apache-2.0 license via OpenBMB’s GitHub. That makes the release more than a product launch; it is also a developer ecosystem play. Open distribution can accelerate third-party experimentation, improve trust, and widen international uptake. In a field where closed systems often dominate the conversation, China’s open-source AI builders are showing they can compete through transparency and portability as well.

The chip support list is equally telling. MiniCPM-V 4.7 has Day-0 support from AMD, Apple, Arm, Houmo AI, Intel, Rockchip, and NVIDIA. Through the FlagOS software stack, it also supports AI and edge chips from CIX Technology, Huawei, Hygon, Iluvatar CoreX, Kunlunxin, MetaX, Moore Threads, Sunrise, T-Head, and TsingMicro. For analysts, that breadth signals something important: China’s AI push is not isolated. It is increasingly integrated with both domestic and global hardware ecosystems, which makes deployment more flexible and more commercially relevant.

No market move yet, but the strategic signal is strong

There is no traded asset or market reaction reported here, so this is not a price story. It is a technology story with investment implications. The release also carries a note of caution: AMD’s Day-0 support article said throughput, time-to-first-token, and GPU memory usage had not yet been reported, which means independent performance validation is still pending. Even so, the direction of travel is unmistakable. Chinese teams are proving they can compress advanced multimodal AI into practical mobile form factors while keeping the architecture open and adaptable.

That combination is powerful because it aligns with several of China’s strengths at once: model engineering, supply-chain depth, device-scale distribution, and policy support for innovation. It also fits the needs of emerging markets, where affordability, offline performance, and broad device compatibility often matter more than a premium cloud experience. If the future of AI is increasingly hybrid, distributed, and edge-native, then China is helping define the blueprint.

For investors and analysts, MiniCPM-V 4.7 is worth watching not because it promises a single winner, but because it shows how fast China can turn research into deployable infrastructure. The release is open, multilingual in hardware support, and designed for real devices rather than abstract benchmarks alone. That is the kind of execution that keeps China at the center of the global AI conversation, not just as a participant, but as a shaper of where the industry goes next.

AI China News