Watch
0
0
Fork
You've already forked hyperhive
0

hyperhive: make the values the meta-flake render reads swarm-wide

Five host options whose values hive-c0re renders into every agent's
build move under services.hyperhive.swarm, so the swarm states each of
them once instead of every hive carrying its own copy:

  c0re.dashboardPort          -> swarm.dashboardPort
  c0re.claudeCodePackage      -> swarm.claudeCodePackage
  github.enable               -> swarm.github.enable
  otel.collector.port         -> swarm.hiveOtel.collectorPort
  otel.extraResourceAttributes -> swarm.hiveOtel.extraResourceAttributes

Every old path is a mkRenamedOptionModule alias, so a host that sets one
keeps its value and gets an eval warning naming the new path. Types and
defaults are unchanged, so the rendered meta flake, serve.json and
hive-c0re's environment are the same as before on a host that sets
none of them.

The readers move with them: serve.json and its gc-root assertion, the
hive-c0re environment, the hive collector's listen address and bridge
port, the swarm collector's port-collision assertion, and the
claude-login and review-classifier containers' claude pin. The
swarm-services-switch fixture sets the swarm path and now also checks
that serve.json carries the pinned claude.

Part of #4857 (slice 2).
This commit is contained in:
atlas 2026-10-16 03:31:45 +02:00 • committed by mara
commit fc32f57481
25 changed files with 189 additions and 138 deletions

View file

@ -19,17 +19,17 @@ needed — an agent gains GitHub by having a PAT stored for it.
<!-- vale write-good.Passive = YES --> <!-- vale write-good.Passive = YES -->
To turn it off for the whole hive, set the host option: To turn it off for the whole swarm, set the swarm option:
```nix ```nix
services.hyperhive.github.enable = false; services.hyperhive.swarm.github.enable = false;
``` ```
hive-c0re's meta-flake renderer then injects `services.hyperhive.agent.github.enable = false` hive-c0re's meta-flake renderer then injects `services.hyperhive.agent.github.enable = false`
into every agent, so no agent ships the `gh` wrapper, the credential helper into every agent, so no agent ships the `gh` wrapper, the credential helper
or the token fetch. or the token fetch.
(`services.hyperhive.agent.github.enable` also exists per-agent for completeness, but the (`services.hyperhive.agent.github.enable` also exists per-agent for completeness, but the
hive-wide host switch is the intended control.) swarm-wide switch is the intended control.)
github.com only. The token **value** never touches nix — the agent writes it github.com only. The token **value** never touches nix — the agent writes it
to `<state>/github-token` at runtime (see [Provisioning](#provisioning)). to `<state>/github-token` at runtime (see [Provisioning](#provisioning)).

View file

@ -129,7 +129,7 @@ The name sits under the swarm domain so authelia's session cookie reaches it, wh
nginx is the one external entry point. The per-agent web-port range (`8100`–`8999`) stays closed: agents serve their UI on a unix socket ([Per-agent unix-socket upstream](#per-agent-unix-socket-upstream)), and the hashed TCP port (`lifecycle::agent_web_port`) is only a fallback bind for an agent missing `HIVE_WEB_SOCKET` — the gateway never proxies through it. nginx is the one external entry point. The per-agent web-port range (`8100`–`8999`) stays closed: agents serve their UI on a unix socket ([Per-agent unix-socket upstream](#per-agent-unix-socket-upstream)), and the hashed TCP port (`lifecycle::agent_web_port`) is only a fallback bind for an agent missing `HIVE_WEB_SOCKET` — the gateway never proxies through it.
The dashboard port (`services.hyperhive.c0re.dashboardPort`, default 7000) binds `127.0.0.1` only, so remote dashboard access goes through the gateway. The dashboard can stop, rebuild and destroy agents; don't expose it without a reverse proxy in front. The dashboard port (`services.hyperhive.swarm.dashboardPort`, default 7000) binds `127.0.0.1` only, so remote dashboard access goes through the gateway. The dashboard can stop, rebuild and destroy agents; don't expose it without a reverse proxy in front.
nginx serves its `stub_status` counters on `127.0.0.1:<statusPort>` (`services.hyperhive.gateway.statusPort`, default 8085) at `/stub_status`, from a server of its own outside the vhost tree. The hive's collector reads them with its `nginx` receiver, and the `gateway` Grafana dashboard plots them. The receiver only dials `http://`, which is why this is loopback TCP rather than a unix socket. nginx serves its `stub_status` counters on `127.0.0.1:<statusPort>` (`services.hyperhive.gateway.statusPort`, default 8085) at `/stub_status`, from a server of its own outside the vhost tree. The hive's collector reads them with its `nginx` receiver, and the `gateway` Grafana dashboard plots them. The receiver only dials `http://`, which is why this is loopback TCP rather than a unix socket.

View file

@ -11,7 +11,7 @@ exist because something already went wrong without them.
- `MAX_AGENT_NAME` in `hive-c0re/src/lifecycle/mod.rs` enforces the cap. - `MAX_AGENT_NAME` in `hive-c0re/src/lifecycle/mod.rs` enforces the cap.
- Per-agent web UI port = `WEB_PORT_BASE + FNV1a(name) % WEB_PORT_RANGE` - Per-agent web UI port = `WEB_PORT_BASE + FNV1a(name) % WEB_PORT_RANGE`
(8100..8999) for every agent; dashboard (8100..8999) for every agent; dashboard
`services.hyperhive.c0re.dashboardPort` (default 7000). `services.hyperhive.swarm.dashboardPort` (default 7000).
## Hive identity (label + domain + display names) ## Hive identity (label + domain + display names)

View file

@ -140,7 +140,7 @@ _different_ nixpkgs by itself: a container only ever sees the one
nixpkgs the meta flake injects, so an `agent.nix` naming the host's nixpkgs the meta flake injects, so an `agent.nix` naming the host's
`nixpkgs-unstable` has nothing to name. A release channel can trail `nixpkgs-unstable` has nothing to name. A release channel can trail
unstable by weeks on this package, which is what unstable by weeks on this package, which is what
`services.hyperhive.c0re.claudeCodePackage` is for — set it host-side `services.hyperhive.swarm.claudeCodePackage` is for — set it host-side
and every agent runs that build. and every agent runs that build.
What crosses is the **store path**, not the derivation. Containers What crosses is the **store path**, not the derivation. Containers
@ -228,7 +228,7 @@ agent (different hash → different port) and rebuilding. No state
file, no probing, no port-allocation drift — the value is file, no probing, no port-allocation drift — the value is
reproducible from just the name. Every agent hashes into reproducible from just the name. Every agent hashes into
8100..8999 via the same FNV-1a; dashboard 8100..8999 via the same FNV-1a; dashboard
at `services.hyperhive.c0re.dashboardPort` (default 7000). at `services.hyperhive.swarm.dashboardPort` (default 7000).
### Restart races on TCP bind ### Restart races on TCP bind

View file

@ -179,9 +179,12 @@ To let agents reach some other host-local service of your own →
The nix module (`nix/host-modules/otel.nix`) generates every The nix module (`nix/host-modules/otel.nix`) generates every
`services.hyperhive.otel.*` option's full type, default, description and `services.hyperhive.otel.*` option's full type, default, description and
example into the [options reference](https://hyperhive.darkest.space/options/) example into the [options reference](https://hyperhive.darkest.space/options/)
(host options — `nix build .#docs-host` for a local render). That's the (host options — `nix build .#docs-host` for a local render). The values every
reference; this page covers what a per-option listing can't: the two-tier hive and its agents share live in the same module under
architecture, the security model, and how the options interact. `services.hyperhive.swarm.hiveOtel.*`: the collector port and
`extraResourceAttributes`, set once for the swarm. That's the reference;
this page covers what a per-option listing can't: the two-tier architecture,
the security model, and how the options interact.
## Built-in resource labels ## Built-in resource labels

View file

@ -7,8 +7,8 @@ agent's harness installs them from there.
Where it runs and how it's enabled: [`services.md`](services.md#claude-login-minter). Where it runs and how it's enabled: [`services.md`](services.md#claude-login-minter).
The service runs the `claude-code` that `services.hyperhive.c0re.claudeCodePackage` The service runs the `claude-code` that `services.hyperhive.swarm.claudeCodePackage`
pins for agents, and its container's own nixpkgs' where the hive pins none. pins for agents, and its container's own nixpkgs' where the swarm pins none.
## What happens on a login ## What happens on a login

View file

@ -145,8 +145,8 @@ config) and an empty directory of its own. The prompt reaches it on stdin as
one user message in `--input-format stream-json`, so that it can carry content one user message in `--input-format stream-json`, so that it can carry content
blocks (see [Shared context](#shared-context)). blocks (see [Shared context](#shared-context)).
The `claude` is the one `services.hyperhive.c0re.claudeCodePackage` pins for The `claude` is the one `services.hyperhive.swarm.claudeCodePackage` pins for
agents, or its container's own nixpkgs' where the hive pins none. agents, or its container's own nixpkgs' where the swarm pins none.
On the ACP runtime, each classification is one prompt on a new `opencode acp` On the ACP runtime, each classification is one prompt on a new `opencode acp`
session. Its config and opencode's state live in a directory of its own, session. Its config and opencode's state live in a directory of its own,

View file

@ -32,8 +32,8 @@ to the bus.
harness unit's PATH. By default that's the `claude-code` in the agent's harness unit's PATH. By default that's the `claude-code` in the agent's
own nixpkgs (the meta flake's `nixpkgs` input) via own nixpkgs (the meta flake's `nixpkgs` input) via
`environment.systemPackages`. Since that's typically a release channel and `environment.systemPackages`. Since that's typically a release channel and
this package moves fast, the operator can pin one hive-wide with this package moves fast, the operator can pin one swarm-wide with
`services.hyperhive.c0re.claudeCodePackage`: hive-c0re writes its `services.hyperhive.swarm.claudeCodePackage`: hive-c0re writes its
store path into each agent's flake, and `claude` on PATH becomes a symlink to it store path into each agent's flake, and `claude` on PATH becomes a symlink to it
instead of the container's own `claude-code` — so there's only ever one instead of the container's own `claude-code` — so there's only ever one
`claude` in the container. Agents pick up a new build on their `claude` in the container. Agents pick up a new build on their

View file

@ -54,7 +54,7 @@ pub struct Coordinator {
pub nixpkgs_flake: String, pub nixpkgs_flake: String,
/// Store path of the `claude-code` build every agent runs, written /// Store path of the `claude-code` build every agent runs, written
/// into each per-agent flake as `services.hyperhive.agent.claudeCodePath`. Set by /// into each per-agent flake as `services.hyperhive.agent.claudeCodePath`. Set by
/// the NixOS module option `services.hyperhive.c0re.claudeCodePackage` /// the NixOS module option `services.hyperhive.swarm.claudeCodePackage`
/// (which resolves the package and hands us its path). `None` = every /// (which resolves the package and hands us its path). `None` = every
/// agent keeps the `claude-code` from its own nixpkgs. /// agent keeps the `claude-code` from its own nixpkgs.
/// ///

View file

@ -551,8 +551,8 @@ fn hive_ca_source() -> Option<String> {
} }
/// Hive-wide OTEL config injected into every agent's build, read off /// Hive-wide OTEL config injected into every agent's build, read off
/// hive-c0re's own unit env (set from `services.hyperhive.otel.*`). A /// hive-c0re's own unit env (set from `services.hyperhive.otel.*` and
/// present, non-empty /// `services.hyperhive.swarm.hiveOtel.*`). A present, non-empty
/// `HYPERHIVE_OTEL_ENDPOINT` is the enable signal — the host module /// `HYPERHIVE_OTEL_ENDPOINT` is the enable signal — the host module
/// asserts the endpoint is set whenever `otel.enable` is true, so /// asserts the endpoint is set whenever `otel.enable` is true, so
/// "endpoint present" == "OTEL on". The optional fields map to the /// "endpoint present" == "OTEL on". The optional fields map to the
@ -922,8 +922,8 @@ where
// operation the tests exercise directly. // operation the tests exercise directly.
push_forwarded_var_options(&mut out, &forwarded_env_vars()); push_forwarded_var_options(&mut out, &forwarded_env_vars());
// GitHub integration is on by default in every agent // GitHub integration is on by default in every agent
// (`services.hyperhive.agent.github.enable`); the host turns it off hive-wide via // (`services.hyperhive.agent.github.enable`); the host turns it off swarm-wide via
// `services.hyperhive.github.enable = false`, surfaced here as the // `services.hyperhive.swarm.github.enable = false`, surfaced here as the
// `HYPERHIVE_GITHUB_DISABLED` env on hive-c0re's unit. Only the OFF // `HYPERHIVE_GITHUB_DISABLED` env on hive-c0re's unit. Only the OFF
// override is propagated — the enabled default needs no per-agent line. // override is propagated — the enabled default needs no per-agent line.
if std::env::var_os("HYPERHIVE_GITHUB_DISABLED").is_some() { if std::env::var_os("HYPERHIVE_GITHUB_DISABLED").is_some() {
@ -1986,7 +1986,7 @@ mod tests {
#[test] #[test]
fn render_flake_injects_github_disable_only_when_signalled() { fn render_flake_injects_github_disable_only_when_signalled() {
// services.hyperhive.github.enable = false -> HYPERHIVE_GITHUB_DISABLED // services.hyperhive.swarm.github.enable = false -> HYPERHIVE_GITHUB_DISABLED
// on hive-c0re's unit -> `services.hyperhive.agent.github.enable = false` injected into // on hive-c0re's unit -> `services.hyperhive.agent.github.enable = false` injected into
// every agent. On by default, so nothing is emitted unless disabled. // every agent. On by default, so nothing is emitted unless disabled.
// //

View file

@ -96,7 +96,7 @@ in
nixpkgs. nixpkgs.
Set by the generated meta flake when the operator sets Set by the generated meta flake when the operator sets
`services.hyperhive.c0re.claudeCodePackage` host-side, so a hive `services.hyperhive.swarm.claudeCodePackage` host-side, so a swarm
can run a claude built from a *different* nixpkgs than the one can run a claude built from a *different* nixpkgs than the one
its agents evaluate against — a release channel can trail its agents evaluate against — a release channel can trail
unstable by weeks on this one package. It arrives as a path and unstable by weeks on this one package. It arrives as a path and
@ -109,7 +109,7 @@ in
there is only ever one claude in the container. Note that neither there is only ever one claude in the container. Note that neither
the symlink nor anything else in the container's closure *refers* the symlink nor anything else in the container's closure *refers*
to the target — keeping it alive is the host's job, see to the target — keeping it alive is the host's job, see
`services.hyperhive.c0re.claudeCodePackage`. `services.hyperhive.swarm.claudeCodePackage`.
''; '';
}; };
@ -255,7 +255,7 @@ in
# The symlink registers no store reference — the target isn't # The symlink registers no store reference — the target isn't
# among this derivation's inputs, so nothing here keeps the # among this derivation's inputs, so nothing here keeps the
# binary alive. That is deliberate and it is the host's job: # binary alive. That is deliberate and it is the host's job:
# see `services.hyperhive.c0re.claudeCodePackage`. # see `services.hyperhive.swarm.claudeCodePackage`.
pkgs.runCommandLocal "claude-code-pinned" { } '' pkgs.runCommandLocal "claude-code-pinned" { } ''
mkdir -p "$out/bin" mkdir -p "$out/bin"
ln -s ${config.services.hyperhive.agent.claudeCodePath}/bin/claude "$out/bin/claude" ln -s ${config.services.hyperhive.agent.claudeCodePath}/bin/claude "$out/bin/claude"

View file

@ -55,8 +55,8 @@ in
a compromised agent can act within the token's scopes --- scope is the a compromised agent can act within the token's scopes --- scope is the
real blast-radius limiter. real blast-radius limiter.
On by default. Host-driven: set `services.hyperhive.github.enable = false` On by default. Host-driven: set `services.hyperhive.swarm.github.enable = false`
to turn the integration off hive-wide (meta.rs propagates the override to turn the integration off swarm-wide (meta.rs propagates the override
into every agent). into every agent).
''; '';
}; };

View file

@ -125,7 +125,7 @@ in
Extra comma-separated entries appended to Extra comma-separated entries appended to
`OTEL_RESOURCE_ATTRIBUTES` after the built-in `OTEL_RESOURCE_ATTRIBUTES` after the built-in
`service.name` / `agent` / `swarm` labels. `service.name` / `agent` / `swarm` labels.
Host-driven via `services.hyperhive.otel.extraResourceAttributes`. Host-driven via `services.hyperhive.swarm.hiveOtel.extraResourceAttributes`.
''; '';
}; };

View file

@ -12,6 +12,7 @@
}: }:
let let
cfg = config.services.hyperhive.c0re; cfg = config.services.hyperhive.c0re;
swarmCfg = config.services.hyperhive.swarm;
# `/run/hyperhive`'s mode. Held in one place because whichever of the two # `/run/hyperhive`'s mode. Held in one place because whichever of the two
# units below activates first creates the directory, so they cannot be # units below activates first creates the directory, so they cannot be
@ -110,8 +111,8 @@ let
# anything that drops it. The failure mode is a garbage-collected # anything that drops it. The failure mode is a garbage-collected
# `claude` and a hive that can't take a turn, weeks after the commit # `claude` and a hive that can't take a turn, weeks after the commit
# that caused it. # that caused it.
claude_code_path = cfg.claudeCodePackage; claude_code_path = swarmCfg.claudeCodePackage;
dashboard_port = cfg.dashboardPort; dashboard_port = swarmCfg.dashboardPort;
agent_cpu_quota = cfg.agentCpuQuota; agent_cpu_quota = cfg.agentCpuQuota;
agent_memory_max = cfg.agentMemoryMax; agent_memory_max = cfg.agentMemoryMax;
agent_cpu_weight = cfg.agentCpuWeight; agent_cpu_weight = cfg.agentCpuWeight;
@ -163,9 +164,10 @@ in
# `claude`, at whatever unrelated moment the gc runs. Cheap # `claude`, at whatever unrelated moment the gc runs. Cheap
# enough to just check. # enough to just check.
assertion = assertion =
cfg.claudeCodePackage == null || builtins.hasContext (builtins.toJSON cfg.claudeCodePackage); swarmCfg.claudeCodePackage == null
|| builtins.hasContext (builtins.toJSON swarmCfg.claudeCodePackage);
message = '' message = ''
services.hyperhive.c0re.claudeCodePackage lost its store services.hyperhive.swarm.claudeCodePackage lost its store
context on the way into /etc/hyperhive/serve.json, so the context on the way into /etc/hyperhive/serve.json, so the
package is no longer gc-rooted by the system closure and package is no longer gc-rooted by the system closure and
`nix-collect-garbage` may delete the claude every agent runs. `nix-collect-garbage` may delete the claude every agent runs.

View file

@ -65,27 +65,29 @@ in
// lib.optionalAttrs (config.services.hyperhive.swarm.name != null) { // lib.optionalAttrs (config.services.hyperhive.swarm.name != null) {
HYPERHIVE_SWARM_NAME = config.services.hyperhive.swarm.name; HYPERHIVE_SWARM_NAME = config.services.hyperhive.swarm.name;
} }
// lib.optionalAttrs (!config.services.hyperhive.github.enable) { // lib.optionalAttrs (!config.services.hyperhive.swarm.github.enable) {
# GitHub integration is on by default; only signal the OFF override to # GitHub integration is on by default; only signal the OFF override to
# meta.rs, which then injects `services.hyperhive.agent.github.enable = false` into # meta.rs, which then injects `services.hyperhive.agent.github.enable = false` into
# every agent. See services.hyperhive.github.enable. # every agent. See services.hyperhive.swarm.github.enable.
HYPERHIVE_GITHUB_DISABLED = "1"; HYPERHIVE_GITHUB_DISABLED = "1";
} }
// lib.optionalAttrs config.services.hyperhive.otel.enable ( // lib.optionalAttrs config.services.hyperhive.otel.enable (
# Hive-wide OTEL config -> read by meta.rs::otel_config and # OTEL config (`swarm.hiveOtel`, gated on this hive's `otel.enable`) ->
# injected as build-time `services.hyperhive.agent.otel.*` into every agent. # read by meta.rs::otel_config and injected as build-time
# `services.hyperhive.agent.otel.*` into every agent.
# Endpoint presence is the enable signal on the meta side; the # Endpoint presence is the enable signal on the meta side; the
# optional fields are only emitted when set so absent values # optional fields are only emitted when set so absent values
# don't render no-op env lines. # don't render no-op env lines.
let let
otel = config.services.hyperhive.otel; otel = config.services.hyperhive.otel;
hiveOtel = config.services.hyperhive.swarm.hiveOtel;
# The first hop, this hive's own collector, under the two spellings its # The first hop, this hive's own collector, under the two spellings its
# two kinds of caller need. Agents get the swarm-wide name, so their # two kinds of caller need. Agents get the swarm-wide name, so their
# builds carry nothing hive-specific; this daemon gets the bridge # builds carry nothing hive-specific; this daemon gets the bridge
# address, because on the host the name may resolve to loopback # address, because on the host the name may resolve to loopback
# (`gateway.localHostsEntry`), where the receiver does not listen. # (`gateway.localHostsEntry`), where the receiver does not listen.
agentFirstHop = "http://${otel.collector.host}:${toString otel.collector.port}"; agentFirstHop = "http://${otel.collector.host}:${toString hiveOtel.collectorPort}";
hostFirstHop = "http://${config.services.hyperhive.network.bridgeIp}:${toString otel.collector.port}"; hostFirstHop = "http://${config.services.hyperhive.network.bridgeIp}:${toString hiveOtel.collectorPort}";
in in
{ {
# `otel.endpoint` means "where telemetry ultimately goes" and keeps # `otel.endpoint` means "where telemetry ultimately goes" and keeps
@ -113,8 +115,8 @@ in
# what has to honour it (see nix/host-modules/otel.nix). # what has to honour it (see nix/host-modules/otel.nix).
HYPERHIVE_OTEL_PROTOCOL = "http/protobuf"; HYPERHIVE_OTEL_PROTOCOL = "http/protobuf";
} }
// lib.optionalAttrs (otel.extraResourceAttributes != "") { // lib.optionalAttrs (hiveOtel.extraResourceAttributes != "") {
HYPERHIVE_OTEL_EXTRA_RESOURCE_ATTRIBUTES = otel.extraResourceAttributes; HYPERHIVE_OTEL_EXTRA_RESOURCE_ATTRIBUTES = hiveOtel.extraResourceAttributes;
} }
# HYPERHIVE_OTEL_HEADERS_CREDENTIAL is deliberately NOT emitted, and # HYPERHIVE_OTEL_HEADERS_CREDENTIAL is deliberately NOT emitted, and
# its absence is the security half of this design: that variable would # its absence is the security half of this design: that variable would

View file

@ -3,17 +3,29 @@
# `nixosModules.default` wires to its own outputs (they carry no # `nixosModules.default` wires to its own outputs (they carry no
# in-module defaults; see ../../../flake.nix). The read-only # in-module defaults; see ../../../flake.nix). The read-only
# `servedFrontend` option lives in ./theme.nix with the stylix wiring # `servedFrontend` option lives in ./theme.nix with the stylix wiring
# that computes it. # that computes it. The swarm-wide values the meta-flake render hands
# every agent are declared here too, under `services.hyperhive.swarm`.
{ {
pkgs, pkgs,
lib, lib,
... ...
}: }:
let
renamedToSwarm =
name:
lib.mkRenamedOptionModule
[ "services" "hyperhive" "c0re" name ]
[ "services" "hyperhive" "swarm" name ];
in
{ {
imports = [ imports = [
(lib.mkRemovedOptionModule [ "services" "hyperhive" "c0re" "managerToplevel" ] '' (lib.mkRemovedOptionModule [ "services" "hyperhive" "c0re" "managerToplevel" ] ''
Every agent, ruth included, builds from `agentBaseToplevel`. Remove this definition. Every agent, ruth included, builds from `agentBaseToplevel`. Remove this definition.
'') '')
]
++ map renamedToSwarm [
"claudeCodePackage"
"dashboardPort"
]; ];
options.services.hyperhive.c0re = { options.services.hyperhive.c0re = {
@ -119,56 +131,6 @@
of the host's channel. of the host's channel.
''; '';
}; };
claudeCodePackage = lib.mkOption {
type = lib.types.nullOr lib.types.package;
default = null;
example = lib.literalExpression "inputs.nixpkgs-unstable.legacyPackages.x86_64-linux.claude-code";
description = ''
The `claude-code` build every agent runs, or `null` (the
default) to leave each agent on the `claude-code` from its own
nixpkgs — i.e. whatever `nixpkgsFlake` resolves to.
This is the one binary the whole hive is built around, and it
moves fast enough that a release channel routinely trails
unstable by weeks on it. An agent cannot fix that for itself:
agents evaluate against the single nixpkgs hive-c0re injects,
so an `agent.nix` has no other tree to reach for. Set this from
a second nixpkgs in the host flake and every agent follows,
without moving the nixpkgs the rest of the container is built
from.
What travels into the container is the **store path**, not the
derivation: agents share the host's `/nix/store`, so the binary
and its full closure are already reachable there — nothing
needs rebuilding or copying. hive-c0re writes the path into
each agent's generated flake as a plain string literal (a bare
path fed to `lib.types.package` would run `builtins.storePath`,
which is illegal under pure evaluation) and the agent module
puts its `bin/` on the harness's PATH.
The flip side of a plain string is that nothing in the agent's
own closure refers to it, so the container cannot keep it
alive. The **host** does that instead: this package is
interpolated into `/etc/hyperhive/serve.json`, which puts it in
the host's system closure — so it is gc-rooted by the running
generation for exactly as long as that generation is the one
the agents were rendered from. The cost is that
`nix-collect-garbage` cannot reclaim an old `claude-code` until
every agent has been rebuilt past it and the old generations
are gone.
The swarm's `swarm-claude-login` and `swarm-review-classifier`
containers, where this host runs them, follow the same pin and
keep their own nixpkgs' `claude-code` when it is `null`. They are
not agents, so pinning an older build for an agent-side
regression pins them too.
'';
};
dashboardPort = lib.mkOption {
type = lib.types.port;
default = 7000;
description = "TCP port the hive-c0re dashboard listens on.";
};
preBuildAgentTemplates = lib.mkOption { preBuildAgentTemplates = lib.mkOption {
type = lib.types.bool; type = lib.types.bool;
default = false; default = false;
@ -377,4 +339,59 @@
''; '';
}; };
}; };
# What every agent in the swarm is handed through the meta-flake render,
# whichever hive builds it. Swarm-wide so that no hive's agents differ.
options.services.hyperhive.swarm = {
claudeCodePackage = lib.mkOption {
type = lib.types.nullOr lib.types.package;
default = null;
example = lib.literalExpression "inputs.nixpkgs-unstable.legacyPackages.x86_64-linux.claude-code";
description = ''
The `claude-code` build every agent runs, or `null` (the
default) to leave each agent on the `claude-code` from its own
nixpkgs — i.e. whatever `c0re.nixpkgsFlake` resolves to.
This is the one binary the whole swarm is built around, and it
moves fast enough that a release channel routinely trails
unstable by weeks on it. An agent cannot fix that for itself:
agents evaluate against the single nixpkgs hive-c0re injects,
so an `agent.nix` has no other tree to reach for. Set this from
a second nixpkgs in the host flake and every agent follows,
without moving the nixpkgs the rest of the container is built
from.
What travels into the container is the **store path**, not the
derivation: agents share the host's `/nix/store`, so the binary
and its full closure are already reachable there — nothing
needs rebuilding or copying. hive-c0re writes the path into
each agent's generated flake as a plain string literal (a bare
path fed to `lib.types.package` would run `builtins.storePath`,
which is illegal under pure evaluation) and the agent module
puts its `bin/` on the harness's PATH.
The flip side of a plain string is that nothing in the agent's
own closure refers to it, so the container cannot keep it
alive. The **host** does that instead: this package is
interpolated into `/etc/hyperhive/serve.json`, which puts it in
the host's system closure — so it is gc-rooted by the running
generation for exactly as long as that generation is the one
the agents were rendered from. The cost is that
`nix-collect-garbage` cannot reclaim an old `claude-code` until
every agent has been rebuilt past it and the old generations
are gone.
The swarm's `swarm-claude-login` and `swarm-review-classifier`
containers, where this host runs them, follow the same pin and
keep their own nixpkgs' `claude-code` when it is `null`. They are
not agents, so pinning an older build for an agent-side
regression pins them too.
'';
};
dashboardPort = lib.mkOption {
type = lib.types.port;
default = 7000;
description = "TCP port every hive's hive-c0re dashboard listens on.";
};
};
} }

View file

@ -62,7 +62,7 @@ in
description = '' description = ''
TCP port the gateway proxies non-static requests to. Defaults TCP port the gateway proxies non-static requests to. Defaults
to `7000` (hive-c0re's out-of-the-box dashboard port). Operators to `7000` (hive-c0re's out-of-the-box dashboard port). Operators
who change `services.hyperhive.c0re.dashboardPort` should set who change `services.hyperhive.swarm.dashboardPort` should set
`upstreamPort` to match — kept as a hardcoded default rather `upstreamPort` to match — kept as a hardcoded default rather
than a cross-reference to keep this module's options eval than a cross-reference to keep this module's options eval
independent of c0re's option tree shape. independent of c0re's option tree shape.

View file

@ -29,7 +29,7 @@ let
networkBase = builtins.bitAnd (ipToInt cfg.bridgeIp) (4294967295 - hostCount + 1); networkBase = builtins.bitAnd (ipToInt cfg.bridgeIp) (4294967295 - hostCount + 1);
# Every switch that runs a hyperhive service on this host. Left out: # Every switch that runs a hyperhive service on this host. Left out:
# `github.enable` (on by default, runs nothing by itself), the gateway's # `swarm.github.enable` (on by default, runs nothing by itself), the gateway's
# and matrix's sub-features, and `allSwarmServices`/`singleHostSwarm`, # and matrix's sub-features, and `allSwarmServices`/`singleHostSwarm`,
# which only take effect through the switches listed here. # which only take effect through the switches listed here.
anyServiceEnabled = anyServiceEnabled =

View file

@ -17,6 +17,10 @@ in
ruth from the swarm dashboard like any other agent; a ruth container that ruth from the swarm dashboard like any other agent; a ruth container that
already exists keeps starting with the hive. already exists keeps starting with the hive.
'') '')
(lib.mkRenamedOptionModule
[ "services" "hyperhive" "github" "enable" ]
[ "services" "hyperhive" "swarm" "github" "enable" ]
)
]; ];
# Canonical hive DNS domain shared by every subsystem that needs a # Canonical hive DNS domain shared by every subsystem that needs a
@ -192,15 +196,15 @@ in
# the values it asserts. It is a deployment mode rather than a setting # the values it asserts. It is a deployment mode rather than a setting
# this module's options read, so it lives with its consequences. # this module's options read, so it lives with its consequences.
options.services.hyperhive.github.enable = lib.mkOption { options.services.hyperhive.swarm.github.enable = lib.mkOption {
type = lib.types.bool; type = lib.types.bool;
default = true; default = true;
example = false; example = false;
description = '' description = ''
Hive-wide switch for the per-agent GitHub integration (the `gh` CLI Swarm-wide switch for the per-agent GitHub integration (the `gh` CLI
wrapper + git credential helper, per `services.hyperhive.agent.github.enable`). On by wrapper + git credential helper, per `services.hyperhive.agent.github.enable`). On by
default: every agent gets the integration, inert until an operator links default: every agent gets the integration, inert until an operator links
a PAT for it in the swarm UI. Set `false` to turn it off for the whole hive --- the a PAT for it in the swarm UI. Set `false` to turn it off for the whole swarm --- the
meta-flake renderer (`hive-c0re/src/meta.rs`) then injects meta-flake renderer (`hive-c0re/src/meta.rs`) then injects
`services.hyperhive.agent.github.enable = false` into every agent. Exposed to hive-c0re `services.hyperhive.agent.github.enable = false` into every agent. Exposed to hive-c0re
as `HYPERHIVE_GITHUB_DISABLED` (set only when the integration is off). as `HYPERHIVE_GITHUB_DISABLED` (set only when the integration is off).

View file

@ -57,6 +57,14 @@ in
hostUnit = true; hostUnit = true;
enable = config.services.hyperhive.otel.enable; enable = config.services.hyperhive.otel.enable;
}) })
(lib.mkRenamedOptionModule
[ "services" "hyperhive" "otel" "collector" "port" ]
[ "services" "hyperhive" "swarm" "hiveOtel" "collectorPort" ]
)
(lib.mkRenamedOptionModule
[ "services" "hyperhive" "otel" "extraResourceAttributes" ]
[ "services" "hyperhive" "swarm" "hiveOtel" "extraResourceAttributes" ]
)
]; ];
options.services.hyperhive.otel = { options.services.hyperhive.otel = {
@ -147,17 +155,6 @@ in
''; '';
}; };
extraResourceAttributes = lib.mkOption {
type = lib.types.str;
default = "";
example = "deployment.environment=prod";
description = ''
Extra comma-separated entries appended to
`OTEL_RESOURCE_ATTRIBUTES` after the built-in
`service.name` / `agent` / `hive` / `swarm` labels.
'';
};
collector.upstreamHeaderName = lib.mkOption { collector.upstreamHeaderName = lib.mkOption {
type = lib.types.str; type = lib.types.str;
default = "Authorization"; default = "Authorization";
@ -178,21 +175,6 @@ in
''; '';
}; };
collector.port = lib.mkOption {
type = lib.types.port;
default = 4318;
description = ''
Port the collector's OTLP/HTTP receiver listens on, at
`services.hyperhive.network.bridgeIp`. 4318 is the OTLP/HTTP
default.
The port is contributed to
`services.hyperhive.network.exposeHostPorts`, which opens it on
the bridge interface only — so it is reachable from agent
containers and not from the outside world.
'';
};
collector.host = lib.mkOption { collector.host = lib.mkOption {
type = lib.types.str; type = lib.types.str;
readOnly = true; readOnly = true;
@ -296,14 +278,46 @@ in
}; };
}; };
# Shared by every hive's otel tier and its agents, so an agent's build
# carries the same values whichever hive renders it.
options.services.hyperhive.swarm.hiveOtel = {
collectorPort = lib.mkOption {
type = lib.types.port;
default = 4318;
description = ''
Port of every hive collector's OTLP/HTTP receiver, at that hive's
`services.hyperhive.network.bridgeIp`: the port agents dial at
`services.hyperhive.otel.collector.host`. 4318 is the OTLP/HTTP
default.
The port is contributed to
`services.hyperhive.network.exposeHostPorts`, which opens it on
the bridge interface only — so it is reachable from agent
containers and not from the outside world.
'';
};
extraResourceAttributes = lib.mkOption {
type = lib.types.str;
default = "";
example = "deployment.environment=prod";
description = ''
Extra comma-separated entries appended to
`OTEL_RESOURCE_ATTRIBUTES` after the built-in
`service.name` / `agent` / `hive` / `swarm` labels.
'';
};
};
config = lib.mkIf config.services.hyperhive.otel.enable ( config = lib.mkIf config.services.hyperhive.otel.enable (
let let
otel = config.services.hyperhive.otel; otel = config.services.hyperhive.otel;
autheliaCfg = config.services.hyperhive.swarm.authelia; autheliaCfg = config.services.hyperhive.swarm.authelia;
deployCfg = config.services.hyperhive.deploy; deployCfg = config.services.hyperhive.deploy;
swarmOtelCfg = config.services.hyperhive.swarm.otel; swarmOtelCfg = config.services.hyperhive.swarm.otel;
hiveOtelCfg = config.services.hyperhive.swarm.hiveOtel;
hiveName = config.services.hyperhive.hiveName; hiveName = config.services.hyperhive.hiveName;
listen = "${config.services.hyperhive.network.bridgeIp}:${toString otel.collector.port}"; listen = "${config.services.hyperhive.network.bridgeIp}:${toString hiveOtelCfg.collectorPort}";
swarmName = "otlphttp/swarm"; swarmName = "otlphttp/swarm";
gatewayCfg = config.services.hyperhive.gateway; gatewayCfg = config.services.hyperhive.gateway;
authName = "oauth2client/swarm"; authName = "oauth2client/swarm";
@ -351,7 +365,7 @@ in
{ {
# Reachable from agent containers and nowhere else: this opens # Reachable from agent containers and nowhere else: this opens
# the port on the bridge interface only. # the port on the bridge interface only.
services.hyperhive.network.exposeHostPorts = [ otel.collector.port ]; services.hyperhive.network.exposeHostPorts = [ hiveOtelCfg.collectorPort ];
# The name agents dial, answered with the bridge IP the receiver binds. # The name agents dial, answered with the bridge IP the receiver binds.
services.hyperhive.gateway.localNames = [ otel.collector.host ]; services.hyperhive.gateway.localNames = [ otel.collector.host ];

View file

@ -23,12 +23,12 @@ let
hyperhiveCfg = config.services.hyperhive; hyperhiveCfg = config.services.hyperhive;
# The `claude-code` the agents run, so this container does not trail them on # The `claude-code` the agents run, so this container does not trail them on
# the CLI; `fallback`, the container's own nixpkgs', only where the hive pins # the CLI; `fallback`, the container's own nixpkgs', only where the swarm pins
# none. # none.
claudeCode = claudeCode =
fallback: fallback:
if hyperhiveCfg.c0re.claudeCodePackage != null then if hyperhiveCfg.swarm.claudeCodePackage != null then
hyperhiveCfg.c0re.claudeCodePackage hyperhiveCfg.swarm.claudeCodePackage
else else
fallback; fallback;
cfg = hyperhiveCfg.deploy.claude-login; cfg = hyperhiveCfg.deploy.claude-login;

View file

@ -67,7 +67,7 @@ in
with it. with it.
⚠️ **Deliberately not 4318**, the OTLP/HTTP default, because the ⚠️ **Deliberately not 4318**, the OTLP/HTTP default, because the
hive tier already uses it (`services.hyperhive.otel.collector.port`) hive tier already uses it (`services.hyperhive.swarm.hiveOtel.collectorPort`)
and every swarm container shares the host's network namespace. Two and every swarm container shares the host's network namespace. Two
listeners claiming one port on one host is not a build failure — listeners claiming one port on one host is not a build failure —
it is a runtime coin toss over which one gets it, with nothing in it is a runtime coin toss over which one gets it, with nothing in

View file

@ -779,7 +779,7 @@ in
others = [ others = [
cfg.telemetryPort cfg.telemetryPort
cfg.producerPort cfg.producerPort
otelCfg.collector.port config.services.hyperhive.swarm.hiveOtel.collectorPort
] ]
++ map (p: p.port) (lib.attrValues serviceProducers); ++ map (p: p.port) (lib.attrValues serviceProducers);
all = derived ++ others; all = derived ++ others;

View file

@ -24,12 +24,12 @@ let
hyperhiveCfg = config.services.hyperhive; hyperhiveCfg = config.services.hyperhive;
# The `claude-code` the agents run, so this container does not trail them on # The `claude-code` the agents run, so this container does not trail them on
# the CLI; `fallback`, the container's own nixpkgs', only where the hive pins # the CLI; `fallback`, the container's own nixpkgs', only where the swarm pins
# none. # none.
claudeCode = claudeCode =
fallback: fallback:
if hyperhiveCfg.c0re.claudeCodePackage != null then if hyperhiveCfg.swarm.claudeCodePackage != null then
hyperhiveCfg.c0re.claudeCodePackage hyperhiveCfg.swarm.claudeCodePackage
else else
fallback; fallback;
cfg = hyperhiveCfg.deploy.review-classifier; cfg = hyperhiveCfg.deploy.review-classifier;
@ -100,7 +100,7 @@ let
otelEnv = lib.optionalAttrs otelCfg.enable { otelEnv = lib.optionalAttrs otelCfg.enable {
CLAUDE_CODE_ENABLE_TELEMETRY = "1"; CLAUDE_CODE_ENABLE_TELEMETRY = "1";
OTEL_METRICS_EXPORTER = "otlp"; OTEL_METRICS_EXPORTER = "otlp";
OTEL_EXPORTER_OTLP_ENDPOINT = "http://${networkCfg.bridgeIp}:${toString otelCfg.collector.port}"; OTEL_EXPORTER_OTLP_ENDPOINT = "http://${networkCfg.bridgeIp}:${toString hyperhiveCfg.swarm.hiveOtel.collectorPort}";
OTEL_EXPORTER_OTLP_PROTOCOL = "http/protobuf"; OTEL_EXPORTER_OTLP_PROTOCOL = "http/protobuf";
# Claude Code defaults to delta, which the metrics store drops. # Claude Code defaults to delta, which the metrics store drops.
OTEL_EXPORTER_OTLP_METRICS_TEMPORALITY_PREFERENCE = "cumulative"; OTEL_EXPORTER_OTLP_METRICS_TEMPORALITY_PREFERENCE = "cumulative";

View file

@ -99,11 +99,11 @@ let
deploy.builder.enable = false; deploy.builder.enable = false;
}; };
# Same, with the claude-code build the agents run pinned on the hive. Any # Same, with the claude-code build the agents run pinned for the swarm. Any
# package serves: only the path the containers are pointed at is read. # package serves: only the path the containers are pointed at is read.
swarmServicesPinnedClaude = hiveWithController { swarmServicesPinnedClaude = hiveWithController {
deploy.allSwarmServices = true; deploy.allSwarmServices = true;
c0re.claudeCodePackage = pkgs.hello; swarm.claudeCodePackage = pkgs.hello;
}; };
# Same, with one of those services placed on another host. Every derivation # Same, with one of those services placed on another host. Every derivation
@ -283,14 +283,23 @@ let
{ {
# The CLI is the one the agents run, not the container's own nixpkgs'. # The CLI is the one the agents run, not the container's own nixpkgs'.
# Unpinned is the control: it falls back to the container's own `claude-code`. # Unpinned is the control: it falls back to the container's own `claude-code`.
name = "the claude login minter and the review classifier run the claude-code the hive pins"; # serve.json is what hive-c0re renders every agent's `claudeCodePath` from.
name = "the agents, the claude login minter and the review classifier run the claude-code the swarm pins";
ok = ok =
let let
claudeOf = claudeOf =
host: container: unit: var: host: container: unit: var:
host.containers.${container}.config.systemd.services.${unit}.environment.${var}; host.containers.${container}.config.systemd.services.${unit}.environment.${var};
pinned = "${pkgs.hello}/bin/claude"; pinned = "${pkgs.hello}/bin/claude";
servedClaude =
host:
(builtins.fromJSON (
builtins.unsafeDiscardStringContext host.environment.etc."hyperhive/serve.json".text
)).claude_code_path;
in in
servedClaude swarmServicesPinnedClaude == "${pkgs.hello}"
&& servedClaude swarmServicesHere == null
&&
claudeOf swarmServicesPinnedClaude "swarm-claude-login" "swarm-claude-login" claudeOf swarmServicesPinnedClaude "swarm-claude-login" "swarm-claude-login"
"SWARM_CLAUDE_LOGIN_CLAUDE" == pinned "SWARM_CLAUDE_LOGIN_CLAUDE" == pinned
&& &&