swarm: per-agent inference settings (model, effort, subagent_models) in KV
swarm-controller keeps each agent's inference settings in a new
`agent-inference` KV bucket, one key per agent, and is its only writer
(`GET`/`PUT`/`DELETE /api/agents/{name}/inference`; `swarmctl agent
inference get|set|clear`). Every field is optional. Each agent reads its
own key every 10 s through a direct-get grant on that key alone, and a
set `model` or `effort` replaces the Bus value, so the next turn runs on
it and the badge follows.
The swarm value is applied without persisting it: `Bus::set_model` and
`set_effort` are split into a persisting setter and a non-persisting
`apply_*`, and the poller uses the latter. Otherwise the swarm value
would overwrite `hyperhive-model`/`hyperhive-effort`, and clearing it, or
a restart, would no longer find the agent's own value. An unset field
changes nothing; a field cleared after being applied goes back to the
local value (`harness_state::local_model`/`local_effort`, the same
resolution `Bus::new` uses), read again at the clear.
`subagent_models` is validated, stored and shown by `get`; no agent
applies it yet.
Refs #5034
This commit is contained in:
parent
29d956140e
commit
916fdb35b8
24 changed files with 1432 additions and 34 deletions
|
|
@ -404,7 +404,7 @@ async fn open_or_create_definitions(client: &async_nats::Client) -> anyhow::Resu
|
|||
|
||||
/// The value of `key` decoded, with the revision to write it back against.
|
||||
/// An absent or deleted key is the default value.
|
||||
async fn read<T: Default + serde::de::DeserializeOwned>(
|
||||
pub(crate) async fn read<T: Default + serde::de::DeserializeOwned>(
|
||||
store: &Store,
|
||||
key: &str,
|
||||
) -> anyhow::Result<(T, Option<u64>)> {
|
||||
|
|
@ -425,7 +425,7 @@ async fn read<T: Default + serde::de::DeserializeOwned>(
|
|||
|
||||
/// Write `value` to `key` against `revision`. `Ok(false)` when another write
|
||||
/// landed first.
|
||||
async fn write<T: Serialize>(
|
||||
pub(crate) async fn write<T: Serialize>(
|
||||
store: &Store,
|
||||
key: &str,
|
||||
value: &T,
|
||||
|
|
@ -549,7 +549,7 @@ pub(crate) fn spawn_reconcile(
|
|||
}
|
||||
|
||||
/// The connected queue client, or the problem.
|
||||
fn queue(state: &AppState) -> Result<async_nats::Client, (StatusCode, String)> {
|
||||
pub(crate) fn queue(state: &AppState) -> Result<async_nats::Client, (StatusCode, String)> {
|
||||
let status = state.status.as_ref().ok_or_else(|| {
|
||||
(
|
||||
StatusCode::SERVICE_UNAVAILABLE,
|
||||
|
|
@ -566,12 +566,12 @@ fn queue(state: &AppState) -> Result<async_nats::Client, (StatusCode, String)> {
|
|||
Ok(client)
|
||||
}
|
||||
|
||||
fn refused((status, detail): (StatusCode, String)) -> ProblemDetails {
|
||||
pub(crate) fn refused((status, detail): (StatusCode, String)) -> ProblemDetails {
|
||||
error_problem(status, &detail)
|
||||
}
|
||||
|
||||
/// Every agent some hive declares and has not destroyed.
|
||||
async fn live(state: &AppState) -> Result<BTreeSet<String>, ProblemDetails> {
|
||||
pub(crate) async fn live(state: &AppState) -> Result<BTreeSet<String>, ProblemDetails> {
|
||||
let Some(wanted) = state.wanted.as_ref() else {
|
||||
return Err(error_problem(
|
||||
StatusCode::SERVICE_UNAVAILABLE,
|
||||
|
|
|
|||
Loading…
Reference in a new issue