What does datasette-llm actually do?

It is the intermediate plugin for Datasette that supports configuring LLMs for use with other Datasette plugins.

How do I run Datasette with a local model?

The release shows a uvx command that launches Datasette with datasette-agent, passing a default_model setting with an api_base such as http://localhost:1234/v1.

Large Language ModelsOpen-Source AISimon Willison's Weblog9h agoNov 15, 2026, 10:01 JST

datasette-llm 0.1a11 adds OpenAI-compatible endpoints

Send on LINE

3 Key Points

What happened
datasette-llm 0.1a11, the intermediate plugin that configures LLMs for other Datasette plugins, now supports OpenAI-compatible endpoints, so Datasette can point at any host speaking the OpenAI web protocol.
Why it matters
the plugin's configuration now covers LLMs served through that protocol rather than a narrower set of backends, which widens where a Datasette deployment can source its model from.

WHO IT HITSTeams running Datasette who want to point it at a locally hosted model can now configure it through the OpenAI-compatible protocol instead of being limited to other backends, based on the release notes.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Get these free every morning

Context & Analysis

datasette-llm sits between Datasette and the other plugins that actually use a model, so any change to what it can connect to propagates to those plugins. This release widens that connection layer to the OpenAI pseudo-standard web protocol, which is the same interface used by several locally run model servers.

The practical effect is in deployment: instead of a configuration tied to one backend, the plugin's default_model settings can now include an api_base pointing at a host that speaks that protocol. The example in the release pairs this with datasette-agent and a local endpoint to stand up a working instance.

FAQ

What does datasette-llm actually do?: It is the intermediate plugin for Datasette that supports configuring LLMs for use with other Datasette plugins.
How do I run Datasette with a local model?: The release shows a uvx command that launches Datasette with datasette-agent, passing a default_model setting with an api_base such as http://localhost:1234/v1.

Simon Willison's WeblogRead Original Article

Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Get it free

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.