Open-weight AI just hit 2.8 trillion parameters…

Open-weight AI just hit 2.8 trillion parameters…

More

Descriptions:

Fireship’s Code Report covers the release of Kimi K3 from Chinese AI lab Moonshot AI — a 2.8 trillion parameter open-source mixture-of-experts model that has become the largest open-weight model in existence. With a 1 million token context window, 896 total experts (16 active per token), and roughly 2.5x better scaling efficiency than its predecessor K2, K3 claims benchmark performance competitive with Claude Fable and GPT-5.6 Soul on coding tasks. It tops the Frontend Code Arena leaderboard at a 1,679 Elo rating and places in the top three on the Artificial Analysis Intelligence Index.

The video urges caution, however: Moonshot ran key evaluations using its own Kimiko harness rather than standardized frameworks, and independent measurement by Artificial Analysis found a 51% hallucination rate. K3 trails frontier models by roughly 10 points on Humanity’s Last Exam and tends toward excessive token generation, which can offset its lower listed pricing. Weights are expected to drop July 27th, though self-hosting the model requires data-center-scale GPU arrays. Alibaba also released Qwen 3.8 simultaneously — a 2.4 trillion parameter open-weight model — signaling rapid acceleration across Chinese open-source AI.

The geopolitical dimension may be the most consequential storyline: China’s Communist Party has become the loudest champion of open AI weights internationally, while U.S. policymakers are reportedly considering entity-listing Chinese AI labs and Polymarket puts the odds of a Chinese model ban at 29% as of publication.


📺 Source: Fireship · Published July 22, 2026
🏷️ Format: News Analysis

1 Item

Channels

1 Item

Companies