2026-10-21T07:45:25Z INFO [scheduler] Running job: agent-channel-health
2026-10-21T07:45:32Z INFO [scheduler] Job agent-channel-health completed (took 7.206s)
2026-10-21T07:46:32Z INFO [scheduler] Job agent-channel-health completed (took 7.239s)
2026-10-21T07:47:33Z INFO [scheduler] Job agent-channel-health completed (took 7.55s)
2026-10-21T07:48:34Z INFO [scheduler] Job agent-channel-health completed (took 8.814s)
2026-10-21T07:49:34Z INFO [scheduler] Job agent-channel-health completed (took 8.3s)
2026-10-21T07:49:39Z ERROR [quiesce] cycle error: check due: agentapi: GET /backup/tiers: Get "https://169.254.253.1:8443/backup/tiers": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2026-10-21T07:50:33Z INFO [scheduler] Job agent-channel-health completed (took 7.25s)
2026-10-21T07:51:32Z INFO [scheduler] Job agent-channel-health completed (took 7.24s)
2026-10-21T07:52:32Z INFO [scheduler] Job agent-channel-health completed (took 7.249s)
2026-10-21T07:53:32Z INFO [scheduler] Job agent-channel-health completed (took 7.229s)
agent-logs http 200 {'data': {'entries': [{'timestamp': '2026-10-21T09:44:10.609+02:00', 'level': 'INFO', 'message': 'msg="felhom-agent daemon starting" version=0.161.0 host_id=Tester4-816e21 hub_url=https://hub.felhom.eu interval_s=900'}, {'timestamp': '2026-10-21T09:44:10.615+02:00', 'level': 'INFO', 'message': 'msg=
09:44:26.268 DEBUG msg="reconcile: guest-bind re-assert pass" guests=1 resolved_mounts=3
09:44:26.403 INFO msg="guest-attach: drive bound under shared parent (normalized to one bind, live)" vmid=9201 where=/mnt/belso stable=/mnt/felhom-drives/belso prior_binds=0
09:44:26.403 INFO msg="reconcile: enrolled drive bound under shared parent (live, no reboot)" vmid=9201 where=/mnt/belso guest_path=/mnt/felhom-drives/belso durable_id=uuid:5aa4f4f8-2402-4d8c-841a-53bd4858e35d
09:44:26.558 INFO msg="selfheal: node watchdog starting" mode=appliance interval_s=60
09:44:26.565 INFO msg="guestnet: watchdog starting" interval=1m0s min_heal_interval=10m0s max_heals_per_hour=3 settle=3m0s
09:44:26.593 DEBUG msg="selfheal: node check healthy" heal=networking
09:44:26.676 INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
09:44:26.794 INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0m0s guests_dir=/var/lib/felhom-agent/guests
09:44:26.794 INFO msg="guest-power: watchdog started" interval=1m0s max_attempts=3
09:44:26.794 INFO msg="local-api server listening" addr=169.254.253.1:8443
09:44:26.795 INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
09:44:26.795 INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or restore-test"
09:44:26.85+ DEBUG msg="pbs: credential probe inconclusive (not a rejection)" storage=felhom-pbs err="pbs: GET /version: Get \"https://10.77.0.1:8007/api2/json/version\": context deadline exceeded"
09:44:26.85+ DEBUG msg="pbs: live list failed; using last-known-good" datastore=felhom-offsite err="pbs: GET /admin/datastore/felhom-offsite/snapshots?ns=Tester4: Get \"https://10.77.0.1:8007/api2/json/admin/datastore/felhom-offsite/snapshots?ns=Tes
09:44:27.752 INFO msg="felhomsshd: config applied" port=8822 action=reload
09:44:27.853 INFO msg="felhomsshd belt: set synced" set=ssh_port elements=8822
09:44:33.405 DEBUG msg="guestnet: guest network healthy" vmid=9201 mode=dhcp has_route=true dhclient_alive=true
09:44:34.913 DEBUG msg="hub: report sent" guests=1 duration_ms=23389 blocked=false desired_generation=2 has_signed_ops=false
09:44:34.913 DEBUG msg="desired: generation advanced — fetching desired-state" have_generation=0 envelope_generation=2
09:44:34.926 DEBUG msg="desired: fetched" generation=2 duration_ms=13
09:44:34.926 INFO msg="desired: updated from hub" generation=2 guests=0
09:44:35.02+ INFO msg="felhomsshd: operator authorized_keys updated" user=felhom-op present=true
09:44:35.115 INFO msg="felhomsshd belt: set synced" set=operator_ips elements=10.77.0.250
09:44:37.818 INFO msg="local-api: same-disk" vmid=9201 a=/mnt/sys_drive b=/mnt/felhom-drives/belso different=false proven=true reason=same_disk
09:44:37.818 DEBUG msg="local-api: request" method=POST path=/disks/same-disk status=200 duration_ms=7228
09:44:41.573 WARN msg="pbs: verify trigger failed; reporting current snapshot state" datastore=felhom-offsite err="pbs: POST /admin/datastore/felhom-offsite/verify: Post \"https://10.77.0.1:8007/api2/json/admin/datastore/felhom-offsite/verify\": co
09:44:55.34+ DEBUG msg="local-api: /host/crash-guard served" vmid=9201 last_boot_at=2026-10-21T07:43:58Z last_boot_unclean=false tripped=true
09:44:55.34+ DEBUG msg="local-api: request" method=GET path=/host/crash-guard status=200 duration_ms=0
09:45:03.144 DEBUG msg="local-api: request" method=GET path=/disks status=200 duration_ms=7397
09:45:11.574 WARN msg="pbs: snapshot list failed" datastore=felhom-offsite err="pbs: GET /admin/datastore/felhom-offsite/snapshots?ns=Tester4: Get \"https://10.77.0.1:8007/api2/json/admin/datastore/felhom-offsite/snapshots?ns=Tester4\": context dea
09:45:32.956 DEBUG msg="local-api: request" method=GET path=/storage status=200 duration_ms=7204
09:46:11.039 WARN msg="local-api: could not read the backup storage for the due-check — falling back to the in-memory record" vmid=9201 target=felhom-pbs err="proxmox: GET /nodes/felhom/storage/felhom-pbs/content: Get \"https://127.0.0.1:8006/api2/
09:46:11.039 DEBUG msg="local-api: request" method=GET path=/backup/status status=200 duration_ms=15001
09:46:25.467 DEBUG msg="local-api: request" method=GET path=/backup/tiers status=200 duration_ms=14427
09:46:40.054 INFO msg="local-api: same-disk" vmid=9201 a=/mnt/felhom-drives/hdd_1 b=/mnt/sys_drive different=true proven=false reason=vm
09:49:26.796 DEBUG msg="fstrim: outside the daytime window — not looking" local="Wed 09:49"
09:49:39.71+ WARN msg="local-api: storage view unavailable for the tier presence report" target=felhom-pbs err="storage: NodeStorage: proxmox: GET /nodes/felhom/storage: Get \"https://127.0.0.1:8006/api2/json/nodes/felhom/storage\": context cancele
09:51:12.002 DEBUG msg="local-api: request" method=GET path=/debug/logs status=200 duration_ms=1
09:54:39.068 INFO msg="guest-power: watchdog alive" sweeps_since_boot=10 guests_evaluated=1 currently_stopped=0
09:54:40.09+ INFO msg="controller-supervisor: alive" sweeps_since_boot=20 guests_evaluated=1 controllers_not_running=0
