swarm ui: a soft context limit field in an agent's inference settings
A whole percent from 5 to 100 of the model's context window, sent as soft_context_percent next to max_subagents. The inference row shows it, the edit dialog and the create form take it, and an archetype can carry it.
This commit is contained in:
parent
b19b730a3a
commit
e9af6cf2c7
1 changed files with 109 additions and 7 deletions
|
|
@ -714,11 +714,11 @@ text stays.
|
|||
An opened agent card shows, in its **settings** section, its model and effort under **inference**, each
|
||||
with where it comes from: the swarm, its agent.nix, its own pick, or the
|
||||
default. Below them are the subagent model list the swarm sets, or "its own"
|
||||
when it sets none, and the subagent cap, which reads "no cap" when unset.
|
||||
**edit** opens a dialog with the four fields, filled with what the swarm
|
||||
when it sets none, the subagent cap, which reads "no cap" when unset, and the
|
||||
soft context limit, which reads "its own" when unset. **edit** opens a dialog with the five fields, filled with what the swarm
|
||||
stores; saving does a `PUT /api/agents/{agent}/inference` of
|
||||
the whole value. A field you leave empty stays out of it, so the agent keeps
|
||||
its own value for that field; an empty max subagents is no cap. **clear the swarm's setting** sends the `DELETE`.
|
||||
its own value for that field; an empty max subagents is no cap, and an empty soft context limit leaves the agent's own. The soft context limit is a whole percent from 5 to 100 of the model's context window: the agent compacts at the end of a turn once its context passes it, and a turn can run past it. **clear the swarm's setting** sends the `DELETE`.
|
||||
The card reads `GET /api/agents/{agent}/inference`; before the agent's first
|
||||
report reaches the controller, it shows the swarm's stored values only.
|
||||
[inference](../swarm/inference.md) describes the settings themselves.
|
||||
|
|
|
|||
Loading…
Reference in a new issue