2026-10-07T15:16:05+02:00 demo-hp systemd[1]: Started felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.853+02:00 level=INFO msg="felhom-agent daemon starting" version=0.151.0 host_id=demo-hp-bb76ea hub_url=https://hub.felhom.eu interval_s=900
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.864+02:00 level=INFO msg="daemon: operator signers pinned" count=2
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="local-api leaf LOADED" fingerprint_sha256=34122ac2ace991685ad9adaaf882702581ae931837203dbeb25f0d9e493a837d cert=/var/lib/felhom-agent/local-api.crt
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="backup tier armed" target=local cadence=24h0m0s keep_last=1 wait_timeout=30m0s prune_pbs_allowed=false primary=true
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="backup tier armed" target=felhom-pbs cadence=168h0m0s keep_last=0 wait_timeout=12h0m0s prune_pbs_allowed=false primary=false
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="lanresolver: enabled" host_ip=192.168.0.104 upstreams="[1.1.1.1 8.8.8.8]" interval_s=300
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="wgtunnel: enabled" interval_s=60 state_dir=/var/lib/felhom-agent
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="poke: agent-plane sync listener enabled" port=51822
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.871+02:00 level=INFO msg="felhomsshd (OOB): enabled" interval_s=60 state_dir=/var/lib/felhom-agent
2026-10-07T15:16:05+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:05.872+02:00 level=INFO msg="pbsdr: bridge enabled (hub-driven; no-op until a pbs_dr descriptor arrives)"
2026-10-07T15:16:06+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:06.808+02:00 level=INFO msg="capabilities self-check" ok=68 total=68 degraded=0 inactive=0
2026-10-07T15:16:06+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:06.809+02:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
2026-10-07T15:16:06+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:06.809+02:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
2026-10-07T15:16:06+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:06.809+02:00 level=INFO msg="storage: watchdog starting" interval=5s debounce=15s
2026-10-07T15:16:06+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:06.809+02:00 level=INFO msg="poke: listening for hub sync-pokes (WG-confined, contentless)" addr=10.77.0.3:51822
2026-10-07T15:16:06+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:06.809+02:00 level=INFO msg="fast-tick armed: 30s out-of-band cadence while desired-state is unapplied" interval=30s
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.595+02:00 level=INFO msg="guest-attach: drive bound under shared parent (normalized to one bind, live)" vmid=9201 where=/mnt/hdd_1 stable=/mnt/felhom-drives/hdd_1 prior_binds=0
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.595+02:00 level=INFO msg="reconcile: enrolled drive bound under shared parent (live, no reboot)" vmid=9201 where=/mnt/hdd_1 guest_path=/mnt/felhom-drives/hdd_1 durable_id=uuid:91d2dc2d-2d28-4929-9bdd-3e11fa2f41ae
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.595+02:00 level=INFO msg="selfheal: node watchdog starting" mode=appliance interval_s=60
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.595+02:00 level=INFO msg="guestnet: watchdog starting" interval=1m0s min_heal_interval=10m0s max_heals_per_hour=3 settle=3m0s
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.613+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.616+02:00 level=INFO msg="guest-power: watchdog started" interval=1m0s max_attempts=3
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.616+02:00 level=INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0m0s guests_dir=/var/lib/felhom-agent/guests
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.616+02:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.617+02:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or restore-test"
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.617+02:00 level=INFO msg="local-api server listening" addr=169.254.253.1:8443
2026-10-07T15:16:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:07.619+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
2026-10-07T15:16:07+02:00 demo-hp felhom-priv-apply[1599]: felhom-priv-apply: SAME sshd-config /etc/felhom-sshd/sshd_config
2026-10-07T15:16:08+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:08.339+02:00 level=INFO msg="felhomsshd: config applied" port=8822 action=reload
2026-10-07T15:16:08+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:08.395+02:00 level=INFO msg="felhomsshd belt: set synced" set=ssh_port elements=8822
2026-10-07T15:16:08+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:08.930+02:00 level=INFO msg="desired: updated from hub" generation=9 guests=0
2026-10-07T15:16:08+02:00 demo-hp felhom-priv-apply[1911]: felhom-priv-apply: SAME sshd-key /etc/felhom-sshd/authorized_keys/felhom-op
2026-10-07T15:16:09+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:09.008+02:00 level=INFO msg="felhomsshd: operator authorized_keys updated" user=felhom-op present=true
2026-10-07T15:16:09+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:09.083+02:00 level=INFO msg="felhomsshd belt: set synced" set=operator_ips elements=10.77.0.250
2026-10-07T15:16:09+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:09.581+02:00 level=INFO msg="lanresolver: guest IP not yet leased — skipping (will retry)" vmid=9201
2026-10-07T15:16:10+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:10.562+02:00 level=INFO msg="lanresolver: guest IP not yet leased — skipping (will retry)" vmid=9202
2026-10-07T15:16:23+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:23.620+02:00 level=WARN msg="local-api: storage view unavailable for class hints" err="storage: NodeStorage: proxmox: GET /nodes/demo-hp/storage: Get \"https://127.0.0.1:8006/api2/json/nodes/demo-hp/storage\": context canceled"
2026-10-07T15:16:28+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:28.656+02:00 level=INFO msg="guest-attach: drive bound under shared parent (normalized to one bind, live)" vmid=9201 where=/mnt/hdd_1 stable=/mnt/felhom-drives/hdd_1 prior_binds=1
2026-10-07T15:16:28+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:28.657+02:00 level=INFO msg="reconcile: enrolled drive bound under shared parent (live, no reboot)" vmid=9201 where=/mnt/hdd_1 guest_path=/mnt/felhom-drives/hdd_1 durable_id=uuid:91d2dc2d-2d28-4929-9bdd-3e11fa2f41ae
2026-10-07T15:16:37+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:37.744+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
2026-10-07T15:16:39+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:39.272+02:00 level=INFO msg="controller-supervisor: slow counter restored from disk" vmid=9201 restarts_24h=0 slow_crashloop_since=2026-09-17T09:22:29Z
2026-10-07T15:16:48+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:48.483+02:00 level=INFO msg="reconcile: enrolled drive bound under shared parent (live, no reboot)" vmid=9201 where=/mnt/hdd_1 guest_path=/mnt/felhom-drives/hdd_1 durable_id=uuid:91d2dc2d-2d28-4929-9bdd-3e11fa2f41ae
2026-10-07T15:16:55+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:16:55.099+02:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-10-07T15:17:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:17:07.712+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
2026-10-07T15:17:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:17:07.725+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
2026-10-07T15:17:07+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:17:07.737+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
2026-10-07T15:17:08+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:17:08.416+02:00 level=INFO msg="reconcile: enrolled drive bound under shared parent (live, no reboot)" vmid=9201 where=/mnt/hdd_1 guest_path=/mnt/felhom-drives/hdd_1 durable_id=uuid:91d2dc2d-2d28-4929-9bdd-3e11fa2f41ae
2026-10-07T15:17:28+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:17:28.462+02:00 level=INFO msg="reconcile: enrolled drive bound under shared parent (live, no reboot)" vmid=9201 where=/mnt/hdd_1 guest_path=/mnt/felhom-drives/hdd_1 durable_id=uuid:91d2dc2d-2d28-4929-9bdd-3e11fa2f41ae
2026-10-07T15:17:37+02:00 demo-hp felhom-agent[1306]: time=2026-10-07T15:17:37.717+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
