#moe

Kimi K3 puts a 1M-token context window into open weights

Moonshot AI released the open weights of Kimi K3 — a 2.8-trillion-parameter multimodal MoE with a 1,048,576-token context window — bringing frontier-scale long context to a model you can self-host.