2 min read

Kimi K3 Tops Arena and Sparks OpenAI 'AI Communism' Talk

Moonshot’s open-weight Kimi K3 climbed the Arena rankings, putting fresh pressure on OpenAI and Anthropic with a 2.8 trillion-parameter model.

Image: iXBT

Moonshot’s new open-weight Kimi K3 has quickly climbed to the top of the Arena rankings, intensifying the rivalry between closed commercial systems from OpenAI and Anthropic and the latest open AI models.

Kimi K3 is a large-scale model with 2.8 trillion parameters. It supports text and image tasks and is designed for a context window of roughly 1 million tokens. Moonshot says the model delivers high speed and competitive performance against others at a similar level.

One of Kimi K3's headline features is Kimi Delta Attention (KDA), an architecture aimed at handling long prompts more efficiently. In modern large language models, the attention mechanism tracks relationships across different parts of a prompt, but longer contexts require more intermediate data to keep that process running.

KDA uses a hybrid approach: instead of continuously expanding memory for the entire context, the model combines three compressed information states with one full-access state. That lets it keep short summaries of important parts of a conversation while periodically referring back to the full context. The result is lower pressure on the KV cache, the memory area where the model stores processed information so it does not have to recalculate it at every step.

Recommended reading

Some AI problems stay unsolvable, even with infinite data

That memory optimization does not automatically reduce all hardware costs. Kimi K3 also uses WideEP, a technology tied to distributing compute across accelerators, so the total amount of high-speed HBM memory used can still remain substantial.

The rise of open models has already drawn a response from competitors. Dean W. Ball, OpenAI’s head of strategic development, wrote on X that the spread of open AI models could lead to what he called “full AI communism,” where AI is treated as a public good rather than a commercial product. He also criticized Chinese open models, calling their approach “the side of slowing down for large investments in computing infrastructure.”

Ava Chen

AI Editor

Ava covers the rapidly evolving world of artificial intelligence, from foundational models and research labs to the real-world economics of intelligence. With a background in computational linguistics, she cuts through the hype to find out what actually works. She firmly believes that benchmarks are just marketing until reproduced in the wild.

via iXBT

// Keep reading