Best explainer on Kimi K3 i've read. It walks you through how the model works & the elegant innovation behind it: - K3 is the biggest open model anyone has released: 2.8 trillion parameters total, though only 104 billion of them do the work on any given word. - The problem Moonshot went after is memory. Normally a model keeps notes on every word it has read, and that pile grows with every token, which is why long conversations get slow and expensive. - K3 mostly stops the memory pile from…