AIToday
Large Language ModelsOpen-Source AIGIGAZINE AIPublished: Oct 1, 2026, 22:00 JST

Ollaya runs decision models locally, up to 255 options

Ollaya runs decision models locally, up to 255 options

3 Key Points

  1. What happened

    Ollaya, an open-source app released under the Apache License Version 2.0, runs decision models locally on Windows, macOS and Linux, supporting up to 255 options per request against Ollama's 15.

  2. Why it matters

    Running these models locally means users avoid API-based services and can execute more capable models than Ollama currently offers.

  3. What to watch

    How it performs depends on the user's own hardware, and the body shows local results approaching Jev's accuracy with shorter latency only for some models, not all.

WHO IT HITSThis lands on developers and data teams who want to experiment with decision models without sending data to an external API, and who may already use Ollama-style local tooling.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Ollaya follows the release of Jev, a decision model that appeared on September 15, 2026, and drew wide attention for generating judgments and confidence scores across multiple options quickly and at low cost. The article cites its speed and low cost relative to frontier models like Claude and GPT series, and says applications built on Jev have been developing quickly, with new decision models inspired by its ideas appearing one after another. Many of these decision models are open, meaning they can be run locally.

Ollaya is modeled on what Ollama did for LLMs: making local execution simple. It runs on Windows, macOS and Linux, and the article notes that Ollama's version 0.35 added decision-model support but was limited to three models at the time of writing, while Ollaya can run more capable ones. The option count also differs, with Ollama capped at 15 per request and Ollaya at 255.

The article's comparison suggests local execution can approach Jev's accuracy and shorten latency for some models, though not uniformly. The practical test for readers weighing local decision models is likely their own GPU and workload, since the example used a GeForce RTX 4070 and latency figures depend on the model chosen. Whether local setups narrow the gap further is something to watch as more models appear.

FAQ
What models can Ollaya run?
The article shows Ollaya running the decision model Winnow-E4B locally.
How does Ollaya compare with Ollama?
Ollama's version 0.35 supports only three decision models, and caps options at 15 per request. Ollaya supports more capable models and up to 255 options.
Is Ollaya open source, and under what license?
Yes, its source code is published on GitHub under the Apache License Version 2.0.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleSatlyt raises $8 million to run AI on satellites