AIToday
Large Language ModelsSimon Willison's WeblogPublished: Apr 30, 2026, 07:00 JST1 min read

LLM 0.32a0 alpha refactors Python library to handle diverse input and output types via messages and typed streaming parts

LLM 0.32a0 alpha refactors Python library to handle diverse input and output types via messages and typed streaming parts

3 Key Points

  1. Simon Willison released LLM 0.32a0 on 29th April 2026, an alpha version of his LLM Python library and CLI tool. The release introduces two key changes: model inputs can now be represented as a sequence of messages (matching the conversational turn format used by major vendor APIs), and model responses can be composed of a stream of differently typed parts rather than plain text.

  2. Previously, LLM modeled prompts and responses as simple text-in/text-out. The new interface supports feeding in previous conversations at the start using `model.prompt(messages=[user(...), assistant(...), ...])`, and responses can now stream mixed content types—reasoning output, text, JSON tool calls, tool outputs, and other formats—allowing the library to represent capabilities like OpenAI's code interpreter or Anthropic's web search.

  3. The CLI tool can now display "thinking" text in a different color from final response text, with thinking text sent to stderr so it does not affect piped results. The prior `prompt=` option still works but is upgraded to a single-item messages array behind the scenes.

Ask the AI about this article →

Simon Willison's WeblogRead Original Article

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • Anthropic launches Claude Fable 5.1 after $35B Lambda dealSiliconANGLE AI · 21m ago
  • Anthropic launches Claude Fable 5.1, cuts costs up to 45%THE DECODER · 21m ago
  • Anthropic opens Claude AI text detection to regulators, media, fact-checkers, and othersTHE DECODER · 21m ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleSeer: open-source browser extension for local AI image descriptions via screen readers, using PaliGemma2 model with no cloud upload or API key required.