AIToday
Large Language ModelsSimon Willison's WeblogPublished: Apr 30, 2026, 07:00 JST1 min read

LLM 0.32a0 alpha refactors Python library to handle diverse input and output types via messages and typed streaming parts

LLM 0.32a0 alpha refactors Python library to handle diverse input and output types via messages and typed streaming parts

3 Key Points

  1. Simon Willison released LLM 0.32a0 on 29th April 2026, an alpha version of his LLM Python library and CLI tool. The release introduces two key changes: model inputs can now be represented as a sequence of messages (matching the conversational turn format used by major vendor APIs), and model responses can be composed of a stream of differently typed parts rather than plain text.

  2. Previously, LLM modeled prompts and responses as simple text-in/text-out. The new interface supports feeding in previous conversations at the start using `model.prompt(messages=[user(...), assistant(...), ...])`, and responses can now stream mixed content types—reasoning output, text, JSON tool calls, tool outputs, and other formats—allowing the library to represent capabilities like OpenAI's code interpreter or Anthropic's web search.

  3. The CLI tool can now display "thinking" text in a different color from final response text, with thinking text sent to stderr so it does not affect piped results. The prior `prompt=` option still works but is upgraded to a single-item messages array behind the scenes.

Ask the AI about this article →

Simon Willison's WeblogRead Original Article

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • DeepMind chief: frontier AI leadership is all that mattersTHE DECODER · 1h ago
  • John Deere launches AI chatbot for farmersThe Verge AI · 1h ago
  • Google Pics launches with AI image editing for WorkspaceThe Verge AI · 1h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleSeer: open-source browser extension for local AI image descriptions via screen readers, using PaliGemma2 model with no cloud upload or API key required.