The datasette-llm 0.1a11 release adds support for OpenAI-compatible endpoints. The plugin acts as an intermediate layer for Datasette, allowing language models to be configured for use by other Datasette plugins.
With the new support, Datasette can connect to models hosted anywhere that use an OpenAI-compatible web protocol. This includes locally hosted models served by tools such as LM Studio, Ollama or llama.cpp, which recently reached version 1.0.0.
An example provided with the release uses uvx to start Datasette with the datasette-agent plugin. Its configuration sets qwen/qwen3.8-27b, served by LM Studio at http://localhost:1234/v1, as the default model. The result is a local server running Datasette Agent with the local model.



