Cerebras says its chips run a trillion-parameter AI model nearly 7 times faster than GPU clouds

Less than a week after completing the largest tech IPO of 2026, Cerebras Systems is making its most aggressive play yet to dominate the fast-growing AI inference market. On Monday, the Sunnyvale-based chipmaker announced that it is now running Kimi K2.6 — a trillion-parameter open-weight model developed by Beijing-based Moonshot AI — for enterprise customers at nearly 1,000 tokens per second, a speed no GPU-based provider has come close to matching.

The result, independently verified by benchmarking firm Artificial Analysis, clocked in at 981 output tokens per second, making Cerebras 6.7 times faster than the next-fastest GPU-based cloud provider and 23 times faster than the median. For a standard agentic coding request involving 10,000 input tokens, Cerebras delivered the full response — including prompt processing, reasoning, and 500 output tokens — in 5.6 seconds, compared to 163.7 seconds on the official Kimi endpoint. That’s a 29-fold improvement in time to final answer.

«We’re really wanting to be very clear and show that we can do the largest models,» James Wang, Cerebras’ director of product marketing, told VentureBeat in an exclusive interview ahead of the announcement. «In this case, Kimi K2.6 — a trillion-parameter MoE model on the wafer-scale architecture — and it runs also at this same incredible speed that we’re famous for.»

The announcement marks a critical inflection point for Cerebras, which has long battled a perception that its unorthodox wafer-scale chips, while blindingly fast, could only handle small and mid-sized models. Kimi K2.6 is the first trillion-parameter open-weight model the company has ever served in production. And with a freshly minted $95 billion market cap and $5.55 billion in IPO proceeds burning a hole in its balance sheet, Cerebras is signaling to Wall Street that it intends to compete not just at the frontier of speed, but at the frontier of model scale.

Why Cerebras chose a Chinese-built model as its trillion-parameter flagship

The choice of Kimi K2.6 reflects both a technical milestone and a commercial calculus. Released on April 20 by Moonshot AI — a Beijing-based company founded in 2023 by Tsinghua University alumni and dubbed one of China’s «AI Tiger» companies — K2.6 is a trillion-parameter Mixture-of-Experts model that has rapidly established itself as the most capable open-weight model available for coding and agentic tasks. The model tops SWE-Bench Pro at 58.6, outperforming Claude Opus 4.6 and matching GPT-5.4, while posting leading scores on agentic benchmarks like Humanity’s Last Exam and DeepSearchQA. Its architecture uses 32 billion activated parameters per token out of a total of 1 trillion, with 384 experts, of which 8 are selected plus 1 shared per forward pass, operating over a 256,000-token context window.

In practical terms, K2.6 is one of the first open-weight models that enterprises can plausibly use as a drop-in replacement for expensive, capacity-constrained closed-source APIs from Anthropic and OpenAI — particularly for the coding and agentic workloads that have become the highest-value application of large language models. The version 2.6 release extends K2.6’s capabilities from front-end design into full-stack workflows, including authentication, database operations, and long-horizon agent execution.

Wang was blunt about what is driving enterprise interest. «They’re very motivated, first of all, to have an alternative to Anthropic,» he told VentureBeat. «Anthropic’s models are fantastic. I use them. I’m sure you probably use them. But they’re quite expensive, and they’re constantly running out of capacity.» He described a personal experience in which an application running on Anthropic’s API failed over a weekend because it ran out of capacity — an anecdote that, he said, resonates deeply with enterprise buyers.

The geopolitical dimension of this arrangement is worth noting, however. Kimi K2.6 is a Chinese-developed model being served by an American chipmaker to American enterprise customers. Moonshot AI operates out of Beijing, and K2.6’s adoption in the West arrives during a period of heightened scrutiny of Chinese AI companies in the U.S. market. Enterprise buyers with strict compliance requirements — particularly those in financial services, healthcare, and defense — will need to evaluate this dimension alongside the model’s technical capabilities.

How wafer-scale chips solve the trillion-parameter speed problem that GPUs cannot

Understanding why Cerebras can achieve these speeds requires understanding what makes its hardware fundamentally different from anything else on the market. Most AI inference today runs on clusters of Nvidia GPUs — typically organized in racks of 72 GPUs, what Nvidia markets as the NVL72 configuration. In these setups, the model’s parameters are distributed across many discrete chips connected by high-speed networking fabric. Data must constantly shuttle between chips, and the interconnect bandwidth between GPUs becomes a bottleneck, particularly for large models with hundreds of billions or trillions of parameters.

Cerebras takes a radically different approach. Its Wafer-Scale Engine 3 is a single chip the size of an entire silicon wafer — roughly the size of a dinner plate — containing 44 gigabytes of on-chip SRAM. Unlike the high-bandwidth memory used in GPUs, SRAM sits directly on the processor die, offering dramatically lower latency and higher bandwidth for data access. For Kimi K2.6, Cerebras stores the model’s weights in their original 4-bit precision while performing computation at 16-bit floating point. The weights are distributed across multiple wafers in a cluster of approximately 20 CS-3 systems, with activations streamed between them. Critically, all the experts for a given MoE layer are placed on the same wafer, meaning the all-to-all communication required for expert routing happens at SRAM speeds. According to Cerebras’ technical description, the on-wafer network fabric delivers over 200 times the bandwidth of NVLink on NVL72.

Wang explained the architecture using an analogy. «Our single units are much larger and much higher capacity — they’re on the order of 20 racks, as opposed to 72 GPUs,» he said. Each layer in the transformer can, in effect, serve a separate user simultaneously. «They’re just like a queue, like you’re queuing for bagels or something — they’re all occupying a different part of the hardware. But because they move across so fast, the actual experience, tokens per second, single user, on your end is still what you’re used to.» Combined with custom kernels and speculative decoding, this allows Cerebras to serve the trillion-parameter MoE model at close to 1,000 tokens per second — a speed the company calls a world record achievable only with wafer-scale hardware.

Fortune 500 companies are already testing Cerebras’ trillion-parameter inference in production

Cerebras is not opening K2.6 to the general public. Instead, the company is positioning this as an enterprise-first offering, with Fortune 500 companies in software, financial services, and healthcare currently running cloud trials of their production workloads on the platform. «These are logos that you’ve definitely heard of,» Wang said, though he declined to identify specific customers due to confidentiality agreements.

The enterprise-first approach is deliberate. Cerebras has historically prioritized its largest customers over its consumer-facing API, in part because of hardware capacity constraints. «Everyone is in a capacity crunch. We prioritize our enterprise customers, so we don’t show it in the consumer-facing gateway or the API, where you get very unpredictable traffic, where a single user can, in effect, take over your whole cluster,» Wang explained. Serving K2.6 also limits the company’s ability to simultaneously offer other large models. «We can’t simultaneously, you know, have six other models,» he acknowledged. «It’s just kind of a mutual constraint of reality.»

On pricing, Wang said that while the enterprise deployment does not carry public pricing, the company’s costs are broadly competitive with GPU-based providers. «On all the models we have served with pricing, the pricing is very comparable — maybe in the middle, kind of middle-upper range of GPU pricing,» he said. «It’s not like, because we run fast, it costs many, many fold more.» He drew a line, however, at the lowest end of the market: if you are willing to run K2.6 at 20 tokens per second on bargain GPU infrastructure, Cerebras will not try to compete on price. «We’re an automaker in the pickup truck market. We don’t do that market,» Wang said. For speed-sensitive workloads — particularly agentic coding, where developers wait in real time for the model to generate and iterate on code — the value proposition is straightforward: comparable per-token cost, but an order of magnitude faster delivery.

The competitive threat from Nvidia’s $20 billion Groq acquisition looms large

Cerebras’ announcement arrives at a pivotal moment in the AI chip industry, one in which the inference market is rapidly overtaking training as the most commercially important compute workload. As AI agents proliferate in enterprise software, the speed of inference directly determines how useful those agents are in practice — and the competitive pressures are intensifying accordingly.

The most significant competitive development in recent months was Nvidia’s acquisition of Groq for $20 billion, a deal that gave the GPU giant access to proprietary inference technology built around specialized Language Processing Units. Wang referenced the deal directly. «I think Nvidia is now sensing fast inference is an extremely important market,» he told VentureBeat. «That’s why they’re willing to spend $20 billion on acquiring a company like that.»

But Wang expressed confidence that Cerebras’ architectural advantages are durable. Both Nvidia and Cerebras operate on roughly annual hardware refresh cycles. «We refresh our hardware on a periodic cycle. You will hear some news about that from us soon,» Wang said, hinting at a forthcoming hardware announcement without providing details. On the software side, Wang pointed to the company’s track record of rapidly adapting to the fast-evolving open-weight model ecosystem. «We started with Llama, we supported all the Qwen models, and then when developers told us they wanted GLM, we brought GLM online. And now they’re telling us Kimi is the best — so we’re giving them Kimi,» he said. «At the same time, we’ve also supported the best companies in running their closed models — OpenAI, Cognition, Mistral.»

The mention of OpenAI underscores one of the most unusual business relationships in the AI industry. OpenAI and Cerebras struck a deal in early 2026 reportedly worth more than $20 billion for computing capacity and related services. Wang confirmed that Cerebras serves OpenAI’s «internal coding models forthcoming» but declined to disclose specifics, as neither party has publicly detailed the technical arrangement.

Inside Cerebras’ plan to serve the smartest AI models faster than anyone else

Wang framed the K2.6 deployment as a stepping stone, not a destination. Cerebras started serving inference in late 2024 with relatively small models and has spent over a year scaling from 70 billion parameters to 1 trillion-plus. «We couldn’t have launched that in November 2024,» he said. «But we’re there now.»

The company’s next challenge is to move from serving the best open-weight frontier model to serving the best frontier models, period — including closed-source models from the likes of Anthropic and OpenAI that sit at the absolute top of the intelligence leaderboards. «This is the first open-weight frontier one that we now have clear demonstrated evidence for,» Wang said. «I think over the course of the year, you will see us serving true frontier, frontier at the speed that we’re famous for. And you should hold us up for that.»

When asked whether the current rollout would be overtaken by the pace of hardware improvement at Nvidia and others, Wang was unfazed. «Nvidia has a very clear roadmap. They publish every year at GTC. They’re roughly on a yearly product cycle, and so are we. You will hear some news about that from us soon,» he said, hinting at new hardware without offering details.

He also addressed the question of vendor lock-in — a concern that any CTO evaluating a single-vendor inference provider would raise. «These enterprises rarely commit fully to one vendor,» Wang said. «They have strategies to make sure that some traffic can go to us, some traffic can go to someone else, and there’s load balancing between the two. This is not a new problem. This is just generally how you manage cloud resources.»

The pitch, ultimately, is about more than speeds and feeds. Wang sees the AI industry converging on a world in which autonomous agents — not human developers — are the primary consumers of inference compute, and in which the speed of those agents determines competitive outcomes for the companies that deploy them. «The world economy is kind of getting rebuilt on agents,» Wang said. «Speed will determine who wins or loses.»

It is a bold claim from a company that, until last week, had never traded on a public exchange. But for Cerebras, the logic is straightforward: if the future of enterprise software is built by AI agents that think at the speed of their hardware, then the company that provides the fastest hardware provides the fastest thinking. And in a market where enterprises are spending billions to shave seconds off their AI response times, a company that can serve a trillion-parameter model in the time it takes to pour a cup of coffee might just have the most compelling pitch in Silicon Valley.