mara/hyperhive
mara/hyperhive
Watch
0
0
Fork
You've already forked hyperhive
 0
Code Activity

swarm: a failed facts copy counts in the held-deploys gauge

Browse source
This commit is contained in:
atlas 2026-11-07 12:28:43 +01:00
commit 1b6d7f3c99
1 changed files with 136 additions and 18 deletions
Download patch file Download diff file Expand all files Collapse all files

5
nix/host-modules/swarm-grafana.nix
View file

@ -1762,7 +1762,8 @@ in
# stay in the grouping so the alert names the holder.
# Agents whose deploy the build gate holds back, from the gauge
# swarm-controller exports (`held_deploys.rs`): a build that
# fails, or that keeps getting no answer from the builder.
# fails, or that keeps getting no answer from the builder. A deploy
# whose facts copy to its hive fails is held too.
# Thirty minutes covers a builder restart and the controller's
# ten-minute retries.
(metricThresholdRule {
@ -1771,7 +1772,7 @@ in
expr = ''sum({__name__="swarm.deploys.held"})'';
threshold = 0;
for = "30m";
summary = "swarm-controller is holding back the deploy of one or more agents because the builder's build of internal/meta fails or gets no answer; the failed `build_meta` node on the Jobs page says which";
summary = "swarm-controller is holding back the deploy of one or more agents because the builder's build of internal/meta fails or gets no answer, or the cache facts can't be copied to its hive; the failed `build_meta` or `copy_attic_facts` node on the Jobs page says which";
})
(metricThresholdRule {
uid = "hh-bao-client-cert-lifetime";