The AI log, agents and coding · science · robotics
20 Oct 2026
Voxtral 3, Eleven Realtime, TorchTPU, Claude's toxin binders
Two voice stacks land on the same day, PyTorch gets a native TPU backend, and Anthropic reports lab results for Claude-designed protein binders.
By Ali Asif, published
What shipped
- Mistral
Voxtral 3
A speech model family plus a voice agent SDK: transcription in 50+ languages, realtime transcription under 500ms, text-to-speech, and EU-hosted or self-deployed options.
- ElevenLabs
Eleven Realtime
Speech-to-speech models for voice agents, in Mini and Max sizes, with Artificial Analysis reporting 98.8% on Big Bench Audio for Max and a 0.57 s time to first audio.
- Hugging Face
TorchTPU
A native PyTorch backend that treats TPU as a normal device, so Transformers and Diffusers run with device_map="tpu" or pipe.to("tpu").
- Anthropic
Claude designed protein binders against scorpion neurotoxins
Of 211 tested designs, 17 met the binder criteria, with two reaching single-digit nanomolar affinity to the Cn2 toxin; no neutralization or animal testing yet.
- IBM Research
ALTK-Evolve
Learns guidelines from an agent's own attempts and adds them to the system prompt, lifting held-out retail accuracy on tau2-bench from 78.1% to 82.5% with no weight updates.
- NVIDIA
Cosmos3-H-Dreams
A 16B-parameter-based real-time surgical simulator with live kinematic control that runs interactively on a single RTX PRO 6000, released as a research simulator only.
Voice dominated the day, with a TPU backend, a biology result and two agent and simulation papers behind it. I opened each primary page. The figures are the publishers' own and I did not reproduce any of them.
Voxtral 3 and Eleven Realtime
Mistral shipped Voxtral 3 as a family: Small Transcribe 3 with diarization and end-of-turn detection, a 4B Mini Transcribe 3 for batch work, a Realtime Transcribe model with sub-500ms latency, and a text-to-speech model. On top sits a voice agent SDK built on LiveKit that runs listening, reasoning, tool calling and speaking as one streaming pipeline. Transcription covers 50+ languages including the 24 official EU languages, and the page lists per-minute prices, from $0.0035 for batch to $0.04 for the full agent API with Mistral Small 4. You can use Mistral's EU, US or global endpoints, or self-deploy by talking to sales.
ElevenLabs answered with Eleven Realtime, speech-to-speech models in two sizes. Artificial Analysis evaluated them: Max scores 98.8% on Big Bench Audio with 0.57 s average time to first audio, and 87.1% tool completion, while Mini is cheaper, scores 60.3% on tool use and is recommended for conversation rather than workflows. It supports 90+ languages, works with the 17,000+ voices in the library, and its Realtime API follows OpenAI's spec, so switching is an endpoint and model name change.
The two take different bets. Mistral sells a composable pipeline with data residency in Europe, and ElevenLabs sells a single model per agent. Arabic coverage is the thing I would test first in either.
TorchTPU
Hugging Face describes TorchTPU as a native PyTorch backend where TPU is just another device. Transformers takes device_map="tpu" and Diffusers takes pipe.to("tpu"). Reported numbers include a Qwen-Image-2.1 run at 3.5 s compiled against 8.0 s eager on a v6e-4, and 96.5% of the runnable Transformers tests passing.
Claude's scorpion toxin binders
Anthropic let a research model design minibinders against five scorpion neurotoxins over 64 hours. Of 211 designs tested in the lab, 17 met the binder criteria, and two bound the Cn2 toxin with single-digit nanomolar affinity. Anthropic states it has not shown neutralization in cells or animals and does not claim an antivenom. I value that restraint, and the designs are public on Hugging Face.
ALTK-Evolve and Cosmos3-H-Dreams
IBM's ALTK-Evolve appends learned guidelines to the system prompt. On held-out retail tasks it moved a GPT-4.1 agent from 78.1% to 82.5%, at 65% higher cost per conversation. NVIDIA's Cosmos3-H-Dreams is a surgical simulator trained on cholecystectomy recordings, built on a 16B model and explicitly not validated for patient care.
What I'd watch next
Independent latency numbers for Voxtral Realtime against Eleven Realtime, whether TorchTPU's nightly CI lands, and the first neutralization data for the Cn2 binders.
Sources
Topics: Anthropic, NVIDIA, Mistral, Voxtral, ElevenLabs, Hugging Face, IBM, IBM Research