# Kimi K2 stretches to 256K, Switzerland opens Apertus

> Week of 1 Sept 2025: Kimi K2 0905, the Swiss Apertus models, EmbeddingGemma, Voyager, plus Anthropic's Series F.

Published 13 Oct 2026. Coverage: 1 Sept 2025 to 7 Sept 2025. By Ali Asif.

## Items

1. **Kimi K2 Instruct 0905** (Moonshot AI, Open weights): Context goes from 128K to 256K tokens and the agentic coding behavior is tuned, still as open weights. [Primary source](https://huggingface.co/moonshotai/Kimi-K2-Instruct-0905)
2. **Apertus 70B** (Swiss AI (EPFL, ETH Zurich, CSCS), Open weights): A fully open 8B and 70B family from Swiss public institutions, with the training recipe published. [Primary source](https://huggingface.co/swiss-ai/Apertus-70B-2509)
3. **EmbeddingGemma 300M** (Google, Open weights): A small multilingual embedding model built to run on a phone or laptop with no server. [Primary source](https://huggingface.co/google/embeddinggemma-300m)
4. **HunyuanWorld-Voyager** (Tencent, Image, video, world): Takes one image and a camera path and produces a video of a world that stays geometrically consistent. [Primary source](https://huggingface.co/tencent/HunyuanWorld-Voyager)
5. **Hunyuan-MT-7B** (Tencent, Open weights): A 7B translation model covering 33 languages, small enough to self-host. [Primary source](https://huggingface.co/tencent/Hunyuan-MT-7B)
6. **Anthropic raises Series F** (Anthropic, Policy and business): A $13B round at a $183B post-money valuation, with run-rate revenue the company says passed $5B. [Primary source](https://www.anthropic.com/news/anthropic-raises-series-f-at-usd183b-post-money-valuation)
7. **Why language models hallucinate** (OpenAI, Science): Argues that benchmarks reward confident guessing, so models learn to bluff instead of saying they don't know. [Primary source](https://cdn.openai.com/pdf/d04913be-3f6f-4d2b-b283-ff432ef4aaa5/why-language-models-hallucinate.pdf)

Moonshot shipped a point update this week and I think it's the most useful thing on the list for anyone who builds with agents. Kimi K2 Instruct 0905 doubles the context window to 256K tokens and tunes the model for agentic coding, and it stays open weights.

Why does that matter to someone running a company on AI tooling? Because the long-context, tool-heavy jobs are exactly where I hit limits. A tender pack is hundreds of pages. An estimate pulls from a dozen quotes. When a model that I can host myself holds that much in view, I stop paying per token for the boring middle of the workflow, and I stop worrying about what leaves my machine.

Close behind it is Apertus from Switzerland. EPFL, ETH Zurich and the national supercomputing center released 8B and 70B models, and the point is openness: weights, data recipe and training details. I won't pretend it beats the Chinese labs on raw capability. What it gives you is something a regulated buyer can point at and audit. I've sat in enough compliance meetings to know that is worth more than a leaderboard spot.

## The small and the strange

Google put out EmbeddingGemma, a 300M-parameter multilingual embedding model meant for on-device use. Tencent released HunyuanWorld-Voyager, which turns a single image plus a camera path into a video of a consistent 3D world, and Hunyuan-MT-7B, a compact translator for 33 languages. For Arabic and English work, a translator I can run locally is a real tool, not a toy.

## Money and a paper

Anthropic closed a $13B Series F at a $183B post-money valuation and said its run-rate revenue passed $5B. I read that less as a valuation story and more as a signal that companies are paying real invoices for agents and coding tools.

OpenAI published a paper on why language models hallucinate. The short version is that current benchmarks score a wrong answer and a blank the same, so guessing wins. That is an incentive problem, and incentives are something an operator can change in his own evals.

## What I'd watch next

Whether Qwen answers Kimi on long-context agents. The Qwen team has been teasing something big, and I'd like to see it open.

## My take

The model I care about most this week is the unglamorous one. A 300M embedding model that runs on a laptop means a Khobar procurement team can search its own supplier PDFs without sending a single page to anyone's cloud. And the hallucination paper matches what I see running agents: the failure is incentive, so I write evals that pay for 'I don't know'.

## Sources

- https://huggingface.co/moonshotai/Kimi-K2-Instruct-0905
- https://huggingface.co/swiss-ai/Apertus-70B-2509
- https://huggingface.co/google/embeddinggemma-300m
- https://huggingface.co/tencent/HunyuanWorld-Voyager
- https://huggingface.co/tencent/Hunyuan-MT-7B
- https://www.anthropic.com/news/anthropic-raises-series-f-at-usd183b-post-money-valuation
- https://cdn.openai.com/pdf/d04913be-3f6f-4d2b-b283-ff432ef4aaa5/why-language-models-hallucinate.pdf

Canonical: https://heyaliasif.com/ai/2025-09-01-week-in-ai