Strands Decider 2B Turns Tool Calls Into Millisecond Local Yes-or-No Gates

On October 1, 2026, AWS Strands Labs released Apache-2.0 Strands Decider 2B—a ~2B Qwen-based decision model with open weights, training data, and scripts for local agent routing, tool checks, and guardrails.

Strands Decider 2B scoring local yes-no gates before agent tool calls
Strands Decider 2B scoring local yes-no gates before agent tool calls

On October 1, 2026, Strands Labs—the experimental agent track around AWS’s Strands Agents work—released Strands Decider 2B, a roughly two-billion-parameter decision model aimed at local, low-latency choices inside agent loops rather than another hosted chat endpoint. The project posts Apache-2.0 weights on Hugging Face as StrandsAgents/strands-decider-2B-hobson-v19, ships code and training materials in strands-labs/strands-decider, and packages a strands-decider CLI so developers can ask choice or yes/no questions against a state string without standing up a private inference cluster first.

Decision models, sometimes called system-one models after the wave kicked off by Typesafe’s Jev, do not write essays. They pick among options the caller supplies—“billing / sales / retail,” “true / false,” or a short ordinal scale—and attach confidence and probability mass. In return they stay small, always land on a schema-valid answer, and expose reliability scores that typical frontier APIs do not. Strands’ blog is frank about the trade: the single parallel pass that makes them fast also makes them worse at complex problems than reasoning models, and the missing language head rules out coding, chat, and summarization. The intended home is the boring, high-frequency fork inside an agent—route this ticket, allow that tool, score this memory hit—where a 100-millisecond local call beats a full LLM round trip.

Architecturally, Decider 2B starts from a Qwen3.5-2B torso, strips the LM head, and adds a pointer head of just over a million parameters that scores each option’s hidden state against the end-of-prompt position. The torso is fine-tuned with a rank-16 LoRA. The release note identifies the checkpoint as v19 after an earlier slot-head design underperformed; the repository documents those iterations so others can reproduce or diverge. On accuracy and calibration, Strands reports competitive standing on JevBench’s public set—third of 33 in the 2B class, first of 30 when models just over 2B are excluded—and plots both accuracy and Brier score improving across the training trajectory. Latency on a local NVIDIA RTX 3090 is described as a median around 115 ms for meaningful tasks, rising roughly linearly with task size; an M3 MacBook is cited near 153 ms median for small tasks. Those numbers are Strands’ own measurements on v18/v19 hardware they name; they are a starting point for teams benchmarking on their own silicon.

The agent integration story is where Decider stops being a leaderboard curiosity. A documented Strands agent example keeps a deliberately eager weather tool and system prompt that would invent a city when the user omits one. Before the tool runs, an InterventionHandler.before_tool_call asks Decider two noul questions: are the argument values grounded in anything the user said, and is the call premature? A few lines of Python map probabilities to Proceed, Deny, Confirm, or Guide—typed interventions the harness already understands—so the agent asks for the city instead of fabricating Seattle. That pattern generalizes to model routing, tool selection, evaluations, guardrails, memory and context management, and policy classification: the same cheap decision surface can sit where an LLM call would be too slow or too expensive.

Openness is the strategic differentiator against hosted-only decision APIs. Strands Labs publishes not only weights but training data and scripts, and the CLI path (pip install strands-decider then strands-decider ask …) downloads the Hobson v19 snapshot automatically. There is no claim of a managed Decider API in the launch post; builders supply CPU or GPU. Hybrid agents that keep a Bedrock or other frontier model for hard turns while Decider handles rote gates are explicitly encouraged. The 2B size is framed as a sweet spot for experimentation—small enough to train and run on hardware people already own, large enough that Strands reports 100% on JevBench’s easy tasks.

Caveats belong in the same paragraph as the hype. Decision models do not replace planning or tool-using LLMs; they specialize the fork. Benchmark ranks will move as Cloudflare Clef, Jev, and other peers iterate. Thresholds and question wording in the weather demo were hand-picked illustrations, not a shipped policy pack. Still, for teams already on the Strands harness, a local Apache-2.0 decider with reproducible training is a concrete October 1 addition to the agent toolkit.

For Writeble’s ai-agents desk, Strands Decider 2B is the self-hostable counterweight in the October 1 decision-model surge—milliseconds and open recipes instead of another closed classifier API.

Topics
  • #AI Agents
  • #Decision Models
  • #Open Source
  • #AWS
  • #Strands
Raj M

Author

Raj M

Contributor

AI Systems Architect is a seasoned technology leader with over 15 years of experience in the IT industry working with Fortune 500 companies. With a solid foundation in multi-agent systems, open-source LLM infrastructure, and enterprise deployment, he excels at building scalable production-grade AI platforms.