China's Open-Weight Bombshell: Is Kimi K3 Actually Beating Claude and GPT-5.6?

This episode breaks down Moonshot AI's Kimi K3, a 2.8-trillion-parameter open-weight model that topped LMArena's Frontend Code benchmark and sent ripples through rival Chinese AI stocks. Alex and Jordan explain how the model's Mixture-of-Experts architecture and new attention techniques allow such a massive system to run efficiently, activating only a small fraction of its network per token while supporting a 1-million-token context window and vision capabilities.

Listeners will learn why 'open-weight' doesn't necessarily mean 'open-source,' what hardware is actually required to self-host a model of this scale, and why the July 27 weight release date matters for independent verification. The hosts also apply a healthy dose of skepticism, examining self-reported benchmarks, revisiting Anthropic's distillation accusation against Moonshot, and questioning whether K3's pricing undercuts the open-model narrative. The episode closes by zooming out to the broader open-versus-closed AI race and what it signals about the shrinking gap between US and Chinese AI labs.

• Kimi K3's 2.8-trillion-parameter Mixture-of-Experts design and why only about 1.8% of the network activates per token
• The distinction between open-weight and open-source, and what it means for K3's July 27 release
• Hardware requirements and practical realities of self-hosting a model this size
• Unverified benchmarks, Anthropic's distillation claim, and the pricing jump from K2.6
• What the shrinking open-versus-closed AI gap means for the industry going forward

Tune in for a grounded look at one of the most talked-about model releases of the year, and what to watch for when K3's weights actually drop.