# host-clock demo-hp taken 2026-11-11T10:03:57Z from DooPlex

=== in-flight ===
checked

=== clock ===
utc 2026-11-11T10:03:57.824658172Z
local 2026-11-11T11:03:57 CET +0100
/usr/share/zoneinfo/Europe/Budapest
Timezone=Europe/Budapest
LocalRTC=no
CanNTP=yes
NTP=yes
NTPSynchronized=yes
TimeUSec=Wed 2026-11-11 11:03:57 CET
RTCTimeUSec=Wed 2026-11-11 11:03:58 CET
               Local time: Wed 2026-11-11 11:03:57 CET
           Universal time: Wed 2026-11-11 10:03:57 UTC
                 RTC time: Wed 2026-11-11 10:03:58
                Time zone: Europe/Budapest (CET, +0100)
System clock synchronized: yes
              NTP service: active
          RTC in local TZ: no

=== who keeps the time ===
chrony: active
   enabled: enabled
chronyd: active
   enabled: alias
systemd-timesyncd: inactive
   enabled: not-found
ntp: inactive
   enabled: not-found
ntpsec: inactive
   enabled: not-found
openntpd: inactive
   enabled: not-found
Reference ID    : 25DDD118 (37.221.209.24)
Stratum         : 3
Ref time (UTC)  : Wed Nov 11 09:59:51 2026
System time     : 0.000200578 seconds fast of NTP time
Last offset     : +0.000003393 seconds
RMS offset      : 0.000097092 seconds
Frequency       : 12.934 ppm slow
Residual freq   : +0.000 ppm
Skew            : 0.017 ppm
Root delay      : 0.016422609 seconds
Root dispersion : 0.002579133 seconds
Update interval : 1036.9 seconds
Leap status     : Normal
MS Name/IP address         Stratum Poll Reach LastRx Last sample               
===============================================================================
^- 62.112.195.56                 2  10   377   301  -2821us[-2817us] +/-   33ms
^* 37.221.209.24                 2  10   377   246  -3262us[-3259us] +/-   14ms
^+ 81.0.124.253                  3  10   377    76  -2267us[-2267us] +/-   25ms
^+ 195.111.92.55                 2  10   377   741  -2832us[-2828us] +/-   52ms
Failed to query server: The name org.freedesktop.timesync1 was not provided by any .service files
pool 2.debian.pool.ntp.org iburst
sourcedir /run/chrony-dhcp
sourcedir /etc/chrony/sources.d
keyfile /etc/chrony/chrony.keys
driftfile /var/lib/chrony/chrony.drift
ntsdumpdir /var/lib/chrony
logdir /var/log/chrony
maxupdateskew 100.0
rtcsync
makestep 1 3
leapseclist /usr/share/zoneinfo/leap-seconds.list
confdir /etc/chrony/conf.d
/etc/chrony/conf.d:
README

/etc/chrony/sources.d:
README

=== start with no time ===
ls: cannot access '/var/lib/systemd/timesync/clock': No such file or directory
/var/lib/chrony/:
total 4
-rw-r--r-- 1 _chrony _chrony 42 2026-11-11 10:59:52.023776089 +0100 chrony.drift
2026-11-11 11:03:58.342660+01:00
1794391439
1794391438

=== boots ===
2026-11-10 15:42:49
 -5 182af91122a941ec97ac7ee247a4d470 Sun 2026-10-04 21:42:08 CEST Sun 2026-10-04 21:43:33 CEST
 -4 bb68aee4240244718d8a7f39d999a3a8 Wed 2026-11-04 21:06:10 CET  Tue 2026-11-10 02:53:28 CET
 -3 b6e0edea2b5647dfa36f5bb3825adc3a Tue 2026-11-10 02:53:57 CET  Tue 2026-11-10 13:56:35 CET
 -2 d1167d9431bf459abf2a569e8997a569 Tue 2026-11-10 13:57:04 CET  Tue 2026-11-10 15:32:31 CET
 -1 e2cc9e3e60f14bde8949f01d7ba35ccf Tue 2026-11-10 15:32:59 CET  Tue 2026-11-10 15:42:26 CET
  0 bed106f79e804eb1ace314a26da7f049 Tue 2026-11-10 15:42:54 CET  Wed 2026-11-11 11:03:57 CET

=== timers ===
NEXT                            LEFT LAST                              PASSED UNIT                           ACTIVATES
Wed 2026-11-11 11:04:28 CET      29s Wed 2026-11-11 11:03:28 CET      30s ago felhom-mgmt-watchdog.timer     felhom-mgmt-watchdog.service
Wed 2026-11-11 11:59:19 CET    55min Wed 2026-11-11 10:59:19 CET 4min 39s ago felhom-crash-guard-check.timer felhom-crash-guard-check.service
Wed 2026-11-11 15:29:36 CET 4h 25min Tue 2026-11-10 23:19:19 CET      11h ago apt-daily.timer                apt-daily.service
Wed 2026-11-11 15:57:49 CET 4h 53min Tue 2026-11-10 15:57:49 CET      19h ago systemd-tmpfiles-clean.timer   systemd-tmpfiles-clean.service
Thu 2026-11-12 00:00:00 CET      12h Wed 2026-11-11 00:00:19 CET      11h ago dpkg-db-backup.timer           dpkg-db-backup.service
Thu 2026-11-12 00:11:48 CET      13h Wed 2026-11-11 00:16:19 CET      10h ago logrotate.timer                logrotate.service
Thu 2026-11-12 01:46:13 CET      14h Wed 2026-11-11 02:22:58 CET       8h ago pve-daily-update.timer         pve-daily-update.service
Thu 2026-11-12 06:13:04 CET      19h Wed 2026-11-11 06:44:19 CET 4h 19min ago apt-daily-upgrade.timer        apt-daily-upgrade.service
Thu 2026-11-12 07:37:24 CET      20h Wed 2026-11-11 02:10:19 CET       8h ago man-db.timer                   man-db.service
Sun 2026-11-15 03:10:25 CET   3 days Sun 2026-11-08 03:10:49 CET            - xfs_scrub_all.timer            xfs_scrub_all.service
Sun 2026-11-15 03:10:43 CET   3 days Sun 2026-11-08 03:10:49 CET            - e2scrub_all.timer              e2scrub_all.service
Mon 2026-11-16 00:02:01 CET   4 days Mon 2026-11-09 01:25:39 CET            - fstrim.timer                   fstrim.service

12 timers listed.

=== timer units (all) ===
--- apt-daily-upgrade.timer [enabled/active]
OnCalendar=*-*-* 6:00
RandomizedDelaySec=60m
Persistent=true
Unit=apt-daily-upgrade.service NextElapseUSecRealtime=Thu 2026-11-12 06:13:04 CET LastTriggerUSec=Wed 2026-11-11 06:44:19 CET 
--- apt-daily.timer [enabled/active]
OnCalendar=*-*-* 6,18:00
RandomizedDelaySec=12h
Persistent=true
Unit=apt-daily.service NextElapseUSecRealtime=Wed 2026-11-11 15:29:36 CET LastTriggerUSec=Tue 2026-11-10 23:19:19 CET 
--- apt-listchanges.timer [disabled/inactive]
OnCalendar=hourly
Unit=apt-listchanges.service NextElapseUSecRealtime= LastTriggerUSec= 
--- chrony-dnssrv@.timer [disabled/]
OnActiveSec=0
OnUnitInactiveSec=1h

--- dpkg-db-backup.timer [enabled/active]
OnCalendar=daily
Persistent=true
Unit=dpkg-db-backup.service NextElapseUSecRealtime=Thu 2026-11-12 00:00:00 CET LastTriggerUSec=Wed 2026-11-11 00:00:19 CET 
--- e2scrub_all.timer [enabled/active]
OnCalendar=Sun *-*-* 03:10:00
RandomizedDelaySec=60
Persistent=true
Unit=e2scrub_all.service NextElapseUSecRealtime=Sun 2026-11-15 03:10:43 CET LastTriggerUSec=Sun 2026-11-08 03:10:49 CET 
--- felhom-crash-guard-check.timer [enabled/active]
OnBootSec=15min
OnUnitActiveSec=1h
Unit=felhom-crash-guard-check.service NextElapseUSecRealtime= LastTriggerUSec=Wed 2026-11-11 10:59:19 CET 
--- felhom-mgmt-watchdog.timer [enabled/active]
OnBootSec=30s
OnUnitActiveSec=60s
AccuracySec=5s
Persistent=true
Unit=felhom-mgmt-watchdog.service
Unit=felhom-mgmt-watchdog.service NextElapseUSecRealtime= LastTriggerUSec=Wed 2026-11-11 11:03:28 CET 
--- fstrim.timer [enabled/active]
OnCalendar=weekly
AccuracySec=1h
Persistent=true
RandomizedDelaySec=100min
Unit=fstrim.service NextElapseUSecRealtime=Mon 2026-11-16 00:02:01 CET LastTriggerUSec=Mon 2026-11-09 01:25:39 CET 
--- logrotate.timer [enabled/active]
OnCalendar=daily
RandomizedDelaySec=1h
Persistent=true
Unit=logrotate.service NextElapseUSecRealtime=Thu 2026-11-12 00:11:48 CET LastTriggerUSec=Wed 2026-11-11 00:16:19 CET 
--- man-db.timer [enabled/active]
OnCalendar=daily
RandomizedDelaySec=12h
Persistent=true
Unit=man-db.service NextElapseUSecRealtime=Thu 2026-11-12 07:37:24 CET LastTriggerUSec=Wed 2026-11-11 02:10:19 CET 
--- proxmox-firewall.timer [disabled/inactive]
OnBootSec=1s
OnUnitInactiveSec=5s
Unit=proxmox-firewall.service
Unit=proxmox-firewall.service NextElapseUSecRealtime= LastTriggerUSec= 
--- pve-daily-update.timer [enabled/active]
OnCalendar=*-*-* 1:00
RandomizedDelaySec=5h
Persistent=true
Unit=pve-daily-update.service NextElapseUSecRealtime=Thu 2026-11-12 01:46:13 CET LastTriggerUSec=Wed 2026-11-11 02:22:58 CET 
--- systemd-tmpfiles-clean.timer [static/active]
OnBootSec=15min
OnUnitActiveSec=1d
Unit=systemd-tmpfiles-clean.service NextElapseUSecRealtime= LastTriggerUSec=Tue 2026-11-10 15:57:49 CET 
--- xfs_scrub_all.timer [enabled/active]
OnCalendar=Sun *-*-* 03:10:00
RandomizedDelaySec=60
Persistent=true
Unit=xfs_scrub_all.service NextElapseUSecRealtime=Sun 2026-11-15 03:10:25 CET LastTriggerUSec=Sun 2026-11-08 03:10:49 CET 
--- zfs-scrub-monthly@.timer [disabled/]
OnCalendar=monthly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-scrub@%i.service

--- zfs-scrub-weekly@.timer [disabled/]
OnCalendar=weekly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-scrub@%i.service

--- zfs-trim-monthly@.timer [disabled/]
OnCalendar=monthly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-trim@%i.service

--- zfs-trim-weekly@.timer [disabled/]
OnCalendar=weekly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-trim@%i.service


=== service limits of felhom + backup timers ===
--- apt-daily-upgrade.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 06:44:19 CET
ExecMainExitTimestamp=Wed 2026-11-11 06:44:19 CET
ExecMainStatus=0
ExecStart={ path=/usr/lib/apt/apt.systemd.daily ; argv[]=/usr/lib/apt/apt.systemd.daily install ; ignore_errors=no ; start_time=[Wed 2026-11-11 06:44:19 CET] ; stop_time=[Wed 2026-11-11 06:44:19 CET] ; pid=3061802 ; code=exited ; status=0 }
--- apt-daily.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Tue 2026-11-10 23:19:19 CET
ExecMainExitTimestamp=Tue 2026-11-10 23:19:19 CET
ExecMainStatus=0
ExecStart={ path=/usr/lib/apt/apt.systemd.daily ; argv[]=/usr/lib/apt/apt.systemd.daily update ; ignore_errors=no ; start_time=[Tue 2026-11-10 23:19:19 CET] ; stop_time=[Tue 2026-11-10 23:19:19 CET] ; pid=1543951 ; code=exited ; status=0 }
--- apt-listchanges.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=
ExecMainExitTimestamp=
ExecMainStatus=0
ExecStart={ path=python3 ; argv[]=python3 -m apt_listchanges.populate_database --profile apt ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
--- dpkg-db-backup.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 00:00:19 CET
ExecMainExitTimestamp=Wed 2026-11-11 00:00:19 CET
ExecMainStatus=0
ExecStart={ path=/usr/libexec/dpkg/dpkg-db-backup ; argv[]=/usr/libexec/dpkg/dpkg-db-backup ; ignore_errors=no ; start_time=[Wed 2026-11-11 00:00:19 CET] ; stop_time=[Wed 2026-11-11 00:00:19 CET] ; pid=1679989 ; code=exited ; status=0 }
--- e2scrub_all.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=
ExecMainExitTimestamp=
ExecMainStatus=0
ExecStart={ path=/sbin/e2scrub_all ; argv[]=/sbin/e2scrub_all ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
--- felhom-crash-guard-check.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 10:59:19 CET
ExecMainExitTimestamp=Wed 2026-11-11 10:59:19 CET
ExecMainStatus=0
ExecStart={ path=/usr/local/sbin/felhom-crash-guard ; argv[]=/usr/local/sbin/felhom-crash-guard check ; ignore_errors=no ; start_time=[Wed 2026-11-11 10:59:19 CET] ; stop_time=[Wed 2026-11-11 10:59:19 CET] ; pid=3911370 ; code=exited ; status=0 }
--- felhom-mgmt-watchdog.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 11:03:28 CET
ExecMainExitTimestamp=Wed 2026-11-11 11:03:28 CET
ExecMainStatus=0
ExecStart={ path=/usr/local/sbin/felhom-mgmt-watchdog ; argv[]=/usr/local/sbin/felhom-mgmt-watchdog ; ignore_errors=no ; start_time=[Wed 2026-11-11 11:03:28 CET] ; stop_time=[Wed 2026-11-11 11:03:28 CET] ; pid=3925600 ; code=exited ; status=0 }
--- fstrim.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=
ExecMainExitTimestamp=
ExecMainStatus=0
ExecStart={ path=/sbin/fstrim ; argv[]=/sbin/fstrim --listed-in /etc/fstab:/proc/self/mountinfo --verbose --quiet-unsupported ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
--- logrotate.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 00:16:19 CET
ExecMainExitTimestamp=Wed 2026-11-11 00:16:21 CET
ExecMainStatus=0
ExecStart={ path=/usr/sbin/logrotate ; argv[]=/usr/sbin/logrotate /etc/logrotate.conf ; ignore_errors=no ; start_time=[Wed 2026-11-11 00:16:19 CET] ; stop_time=[Wed 2026-11-11 00:16:21 CET] ; pid=1733122 ; code=exited ; status=0 }
--- man-db.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 02:10:19 CET
ExecMainExitTimestamp=Wed 2026-11-11 02:10:19 CET
ExecMainStatus=0
ExecStart={ path=/usr/bin/install ; argv[]=/usr/bin/install -d -o man -g man -m 0755 /var/cache/man ; ignore_errors=no ; start_time=[Wed 2026-11-11 02:10:19 CET] ; stop_time=[Wed 2026-11-11 02:10:19 CET] ; pid=2113150 ; code=exited ; status=0 }
ExecStart={ path=/usr/bin/mandb ; argv[]=/usr/bin/mandb --quiet ; ignore_errors=no ; start_time=[Wed 2026-11-11 02:10:19 CET] ; stop_time=[Wed 2026-11-11 02:10:19 CET] ; pid=2113157 ; code=exited ; status=0 }
--- pve-daily-update.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 02:22:58 CET
ExecMainExitTimestamp=Wed 2026-11-11 02:23:04 CET
ExecMainStatus=0
ExecStart={ path=/usr/bin/pveupdate ; argv[]=/usr/bin/pveupdate ; ignore_errors=no ; start_time=[Wed 2026-11-11 02:22:58 CET] ; stop_time=[Wed 2026-11-11 02:23:04 CET] ; pid=2155738 ; code=exited ; status=0 }

=== felhom units that are not timers ===
felhom-agent-rollback.service loaded inactive dead
felhom-agent.service loaded active running
felhom-crash-guard-check.service loaded inactive dead
felhom-crash-guard.service loaded active exited
felhom-mgmt-watchdog.service loaded inactive dead
felhom-oob-nft.service loaded active exited
felhom-shared-parent.service loaded active exited
felhom-sshd.service loaded active running
felhom-crash-guard-check.timer loaded active waiting
felhom-mgmt-watchdog.timer loaded active waiting
--- felhom-agent-rollback.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=infinity NRestarts=0 ActiveEnterTimestamp= 
--- felhom-agent.service
Restart=on-failure RestartUSec=5s TimeoutStartUSec=1min 30s RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Tue 2026-11-10 15:58:17 CET 
--- felhom-bootstrap.service
Restart=on-failure RestartUSec=30s TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=infinity NRestarts=0 ActiveEnterTimestamp= 
--- felhom-crash-guard-check.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp= 
--- felhom-crash-guard.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Tue 2026-11-10 15:42:59 CET 
--- felhom-mgmt-watchdog.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp= 
--- felhom-oob-nft.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Tue 2026-11-10 15:42:59 CET 
--- felhom-shared-parent.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Tue 2026-11-10 15:42:59 CET 
--- felhom-sshd.service
Restart=on-failure RestartUSec=100ms TimeoutStartUSec=1min 30s RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Tue 2026-11-10 15:43:00 CET 

=== cron ===
SHELL=/bin/sh
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
17 *	* * *	root	cd / && run-parts --report /etc/cron.hourly
25 6	* * *	root	test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.daily; }
47 6	* * 7	root	test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.weekly; }
52 6	1 * *	root	test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.monthly; }
--- /etc/cron.d/e2scrub_all
30 3 * * 0 root test -e /run/systemd/system || SERVICE_MODE=1 /usr/libexec/e2fsprogs/e2scrub_all_cron
10 3 * * * root test -e /run/systemd/system || SERVICE_MODE=1 /sbin/e2scrub_all -A -r
--- /etc/cron.d/vzdump
PATH="/usr/sbin:/usr/bin:/sbin:/bin"
--- /etc/cron.d/zfsutils-linux
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
24 0 1-7 * * root if [ $(date +\%w) -eq 0 ] && [ -x /usr/lib/zfs-linux/trim ]; then /usr/lib/zfs-linux/trim; fi
24 0 8-14 * * root if [ $(date +\%w) -eq 0 ] && [ -x /usr/lib/zfs-linux/scrub ]; then /usr/lib/zfs-linux/scrub; fi
--- cron.hourly: 
--- cron.daily: apt-compat dpkg logrotate man-db 
--- cron.weekly: man-db 
--- cron.monthly: 
--- user crontabs: 

=== at ===
no at

=== pve jobs ===
--- vzdump.cron
PATH="/usr/sbin:/usr/bin:/sbin:/bin"
--- vzdump.conf

=== pve tasks (start end type id status), last 14 days ===
awk: line 2: function strtonum never defined
awk: line 2: function strtonum never defined

=== runs of timer services, last 10 days (start/finish lines) ===
--- apt-daily-upgrade.service
2026-11-09T06:46:01+01:00 demo-hp systemd[1]: Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities...
2026-11-09T06:46:01+01:00 demo-hp systemd[1]: apt-daily-upgrade.service: Deactivated successfully.
2026-11-09T06:46:01+01:00 demo-hp systemd[1]: Finished apt-daily-upgrade.service - Daily apt upgrade and clean activities.
2026-11-10T06:55:09+01:00 demo-hp systemd[1]: Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities...
2026-11-10T06:55:10+01:00 demo-hp systemd[1]: apt-daily-upgrade.service: Deactivated successfully.
2026-11-10T06:55:10+01:00 demo-hp systemd[1]: Finished apt-daily-upgrade.service - Daily apt upgrade and clean activities.
2026-11-11T06:44:19+01:00 demo-hp systemd[1]: Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities...
2026-11-11T06:44:19+01:00 demo-hp systemd[1]: apt-daily-upgrade.service: Deactivated successfully.
2026-11-11T06:44:19+01:00 demo-hp systemd[1]: Finished apt-daily-upgrade.service - Daily apt upgrade and clean activities.
--- apt-daily.service
2026-11-09T07:55:02+01:00 demo-hp systemd[1]: Starting apt-daily.service - Daily apt download activities...
2026-11-09T07:55:03+01:00 demo-hp systemd[1]: apt-daily.service: Deactivated successfully.
2026-11-09T07:55:03+01:00 demo-hp systemd[1]: Finished apt-daily.service - Daily apt download activities.
2026-11-10T04:06:22+01:00 demo-hp systemd[1]: Starting apt-daily.service - Daily apt download activities...
2026-11-10T04:06:23+01:00 demo-hp systemd[1]: apt-daily.service: Deactivated successfully.
2026-11-10T04:06:23+01:00 demo-hp systemd[1]: Finished apt-daily.service - Daily apt download activities.
2026-11-10T23:19:19+01:00 demo-hp systemd[1]: Starting apt-daily.service - Daily apt download activities...
2026-11-10T23:19:19+01:00 demo-hp systemd[1]: apt-daily.service: Deactivated successfully.
2026-11-10T23:19:19+01:00 demo-hp systemd[1]: Finished apt-daily.service - Daily apt download activities.
--- felhom-crash-guard-check.service
2026-11-11T08:59:19+01:00 demo-hp systemd[1]: Starting felhom-crash-guard-check.service - Felhom crash guard re-arm check...
2026-11-11T08:59:19+01:00 demo-hp systemd[1]: felhom-crash-guard-check.service: Deactivated successfully.
2026-11-11T08:59:19+01:00 demo-hp systemd[1]: Finished felhom-crash-guard-check.service - Felhom crash guard re-arm check.
2026-11-11T09:59:19+01:00 demo-hp systemd[1]: Starting felhom-crash-guard-check.service - Felhom crash guard re-arm check...
2026-11-11T09:59:19+01:00 demo-hp systemd[1]: felhom-crash-guard-check.service: Deactivated successfully.
2026-11-11T09:59:19+01:00 demo-hp systemd[1]: Finished felhom-crash-guard-check.service - Felhom crash guard re-arm check.
2026-11-11T10:59:19+01:00 demo-hp systemd[1]: Starting felhom-crash-guard-check.service - Felhom crash guard re-arm check...
2026-11-11T10:59:19+01:00 demo-hp systemd[1]: felhom-crash-guard-check.service: Deactivated successfully.
2026-11-11T10:59:19+01:00 demo-hp systemd[1]: Finished felhom-crash-guard-check.service - Felhom crash guard re-arm check.
--- felhom-mgmt-watchdog.service
2026-11-11T11:01:20+01:00 demo-hp systemd[1]: Starting felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent)...
2026-11-11T11:01:20+01:00 demo-hp systemd[1]: felhom-mgmt-watchdog.service: Deactivated successfully.
2026-11-11T11:01:20+01:00 demo-hp systemd[1]: Finished felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent).
2026-11-11T11:02:24+01:00 demo-hp systemd[1]: Starting felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent)...
2026-11-11T11:02:24+01:00 demo-hp systemd[1]: felhom-mgmt-watchdog.service: Deactivated successfully.
2026-11-11T11:02:24+01:00 demo-hp systemd[1]: Finished felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent).
2026-11-11T11:03:28+01:00 demo-hp systemd[1]: Starting felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent)...
2026-11-11T11:03:28+01:00 demo-hp systemd[1]: felhom-mgmt-watchdog.service: Deactivated successfully.
2026-11-11T11:03:28+01:00 demo-hp systemd[1]: Finished felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent).
--- pve-daily-update.service
2026-11-09T03:29:48+01:00 demo-hp systemd[1]: pve-daily-update.service: Consumed 5.005s CPU time, 235.1M memory peak.
2026-11-10T03:05:09+01:00 demo-hp systemd[1]: Starting pve-daily-update.service - Daily PVE download activities...
2026-11-10T03:05:15+01:00 demo-hp systemd[1]: pve-daily-update.service: Deactivated successfully.
2026-11-10T03:05:15+01:00 demo-hp systemd[1]: Finished pve-daily-update.service - Daily PVE download activities.
2026-11-10T03:05:15+01:00 demo-hp systemd[1]: pve-daily-update.service: Consumed 5.281s CPU time, 295.5M memory peak.
2026-11-11T02:22:58+01:00 demo-hp systemd[1]: Starting pve-daily-update.service - Daily PVE download activities...
2026-11-11T02:23:04+01:00 demo-hp systemd[1]: pve-daily-update.service: Deactivated successfully.
2026-11-11T02:23:04+01:00 demo-hp systemd[1]: Finished pve-daily-update.service - Daily PVE download activities.
2026-11-11T02:23:04+01:00 demo-hp systemd[1]: pve-daily-update.service: Consumed 5.171s CPU time, 293.5M memory peak.

=== agent log: schedule words, last 3 days (tail 260) ===
2026-11-10T03:24:11+01:00 demo-hp sudo[112883]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T03:39:11+01:00 demo-hp sudo[165130]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T03:54:12+01:00 demo-hp sudo[215104]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:09:11+01:00 demo-hp sudo[265287]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:24:11+01:00 demo-hp sudo[326129]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:39:11+01:00 demo-hp sudo[376165]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:54:11+01:00 demo-hp sudo[426145]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:09:11+01:00 demo-hp sudo[476293]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:24:11+01:00 demo-hp sudo[526258]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:39:11+01:00 demo-hp sudo[576428]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:54:11+01:00 demo-hp sudo[626334]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:09:11+01:00 demo-hp sudo[676490]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:24:11+01:00 demo-hp sudo[726421]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:39:12+01:00 demo-hp sudo[776549]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:54:11+01:00 demo-hp sudo[826483]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:09:11+01:00 demo-hp sudo[876732]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:24:11+01:00 demo-hp sudo[926734]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:39:11+01:00 demo-hp sudo[976930]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:54:11+01:00 demo-hp sudo[1027027]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:09:11+01:00 demo-hp sudo[1077199]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:24:11+01:00 demo-hp sudo[1127154]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:39:11+01:00 demo-hp sudo[1180619]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:54:12+01:00 demo-hp sudo[1231276]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:55:21+01:00 demo-hp sudo[1236551]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:56:33+01:00 demo-hp felhom-agent[1264]: time=2026-11-10T08:56:33.425+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T09:09:11+01:00 demo-hp sudo[1281634]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:24:10+01:00 demo-hp felhom-agent[1264]: time=2026-11-10T09:24:10.329+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-05T20:50:35Z) is already proven; local: no set
2026-11-10T09:24:11+01:00 demo-hp sudo[1331688]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:39:11+01:00 demo-hp sudo[1381939]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:54:11+01:00 demo-hp sudo[1431884]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:09:11+01:00 demo-hp sudo[1481961]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:24:11+01:00 demo-hp sudo[1532001]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:39:11+01:00 demo-hp sudo[1582028]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:54:11+01:00 demo-hp sudo[1632919]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:09:11+01:00 demo-hp sudo[1683016]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:24:11+01:00 demo-hp sudo[1733023]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:39:11+01:00 demo-hp sudo[1783077]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:54:12+01:00 demo-hp sudo[1833125]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:09:11+01:00 demo-hp sudo[1883187]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:24:12+01:00 demo-hp sudo[1933288]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:39:11+01:00 demo-hp sudo[1983322]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:54:11+01:00 demo-hp sudo[2033570]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:09:12+01:00 demo-hp sudo[2095848]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:24:11+01:00 demo-hp sudo[2159490]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:39:11+01:00 demo-hp sudo[2216453]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:54:11+01:00 demo-hp sudo[2275938]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:54:26+01:00 demo-hp systemd[1]: Stopping felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog)...
2026-11-10T13:54:26+01:00 demo-hp felhom-agent[1264]: time=2026-11-10T13:54:26.844+01:00 level=INFO msg="backup: restore-test scheduler shutting down" reason="context canceled"
2026-11-10T13:54:26+01:00 demo-hp systemd[1]: Stopped felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T13:57:14+01:00 demo-hp systemd[1]: Started felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T13:57:15+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:15.046+01:00 level=INFO msg="backup tier armed" target=local cadence=24h0m0s keep_last=1 prune="keep-daily=1" wait_timeout=30m0s prune_pbs_allowed=false primary=true
2026-11-10T13:57:15+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:15.046+01:00 level=INFO msg="backup tier armed" target=felhom-pbs cadence=168h0m0s keep_last=0 prune="" wait_timeout=12h0m0s prune_pbs_allowed=false primary=false
2026-11-10T13:57:15+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:15.047+01:00 level=INFO msg="pbsdr: bridge enabled (hub-driven; no-op until a pbs_dr descriptor arrives)"
2026-11-10T13:57:15+01:00 demo-hp sudo[1275]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-os-apply --plan /var/lib/felhom-agent/os/plan-boot-20261110T125715Z-kernel-kernel-boot.json
2026-11-10T13:57:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:16.045+01:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
2026-11-10T13:57:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:16.045+01:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
2026-11-10T13:57:16+01:00 demo-hp sudo[1446]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:57:16+01:00 demo-hp sudo[1507]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:57:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:16.911+01:00 level=INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0m0s gue
2026-11-10T13:57:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:16.911+01:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
2026-11-10T13:57:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:16.912+01:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or rest
2026-11-10T13:57:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:57:16.912+01:00 level=INFO msg="linetest: weekly upload line test starting" schedule="weekly, due Tuesday from 10:00 host-local time; starts 10:00-15:59 after 10 quiet minutes; never besi
2026-11-10T13:58:28+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T13:58:28.317+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T14:12:19+01:00 demo-hp sudo[62389]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:27:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T14:27:16.046+01:00 level=INFO msg="backup: restore-test first evaluation after start (R-874)" after=30m0s
2026-11-10T14:27:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T14:27:16.383+01:00 level=INFO msg="backup: restore-test skips an entry that is not a backup of a guest" target=local volid=local:backup/felhom-golden-0.236.0.tar.zst size_bytes=654115664 rea
2026-11-10T14:27:16+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T14:27:16.735+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-05T20:50:35Z) is already proven; local: no set
2026-11-10T14:27:19+01:00 demo-hp sudo[112482]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:42:19+01:00 demo-hp sudo[162646]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:57:19+01:00 demo-hp sudo[212644]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:12:19+01:00 demo-hp sudo[262858]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:27:19+01:00 demo-hp sudo[312873]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:30:24+01:00 demo-hp systemd[1]: Stopping felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog)...
2026-11-10T15:30:24+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T15:30:24.913+01:00 level=INFO msg="backup: restore-test scheduler shutting down" reason="context canceled"
2026-11-10T15:30:24+01:00 demo-hp felhom-agent[1262]: time=2026-11-10T15:30:24.913+01:00 level=INFO msg="pbs: verify loop shutting down" reason="context canceled"
2026-11-10T15:30:25+01:00 demo-hp systemd[1]: Stopped felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:33:09+01:00 demo-hp systemd[1]: Started felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:33:09+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:09.997+01:00 level=INFO msg="backup tier armed" target=local cadence=24h0m0s keep_last=1 prune="keep-daily=1" wait_timeout=30m0s prune_pbs_allowed=false primary=true
2026-11-10T15:33:09+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:09.997+01:00 level=INFO msg="backup tier armed" target=felhom-pbs cadence=168h0m0s keep_last=0 prune="" wait_timeout=12h0m0s prune_pbs_allowed=false primary=false
2026-11-10T15:33:09+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:09.997+01:00 level=INFO msg="pbsdr: bridge enabled (hub-driven; no-op until a pbs_dr descriptor arrives)"
2026-11-10T15:33:10+01:00 demo-hp sudo[1318]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-os-apply --plan /var/lib/felhom-agent/os/plan-boot-20261110T143309Z-kernel-kernel-boot.json
2026-11-10T15:33:10+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:10.983+01:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
2026-11-10T15:33:10+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:10.983+01:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
2026-11-10T15:33:11+01:00 demo-hp sudo[1496]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:33:11+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:11.889+01:00 level=INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0m0s gue
2026-11-10T15:33:11+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:11.889+01:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
2026-11-10T15:33:11+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:11.889+01:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or rest
2026-11-10T15:33:11+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:33:11.890+01:00 level=INFO msg="linetest: weekly upload line test starting" schedule="weekly, due Tuesday from 10:00 host-local time; starts 10:00-15:59 after 10 quiet minutes; never besi
2026-11-10T15:33:12+01:00 demo-hp sudo[1660]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:34:21+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:34:21.282+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T15:40:09+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:40:09.290+01:00 level=INFO msg="backup: restore-test scheduler shutting down" reason="context canceled"
2026-11-10T15:40:09+01:00 demo-hp felhom-agent[1302]: time=2026-11-10T15:40:09.290+01:00 level=INFO msg="pbs: verify loop shutting down" reason="context canceled"
2026-11-10T15:40:09+01:00 demo-hp systemd[1]: Stopping felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog)...
2026-11-10T15:40:09+01:00 demo-hp systemd[1]: Stopped felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:43:04+01:00 demo-hp systemd[1]: Started felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:43:05+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:05.011+01:00 level=INFO msg="backup tier armed" target=local cadence=24h0m0s keep_last=1 prune="keep-daily=1" wait_timeout=30m0s prune_pbs_allowed=false primary=true
2026-11-10T15:43:05+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:05.011+01:00 level=INFO msg="backup tier armed" target=felhom-pbs cadence=168h0m0s keep_last=0 prune="" wait_timeout=12h0m0s prune_pbs_allowed=false primary=false
2026-11-10T15:43:05+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:05.011+01:00 level=INFO msg="pbsdr: bridge enabled (hub-driven; no-op until a pbs_dr descriptor arrives)"
2026-11-10T15:43:05+01:00 demo-hp sudo[1323]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-os-apply --plan /var/lib/felhom-agent/os/plan-boot-20261110T144304Z-kernel-kernel-boot.json
2026-11-10T15:43:06+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:06.000+01:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
2026-11-10T15:43:06+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:06.000+01:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
2026-11-10T15:43:06+01:00 demo-hp sudo[1499]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:43:06+01:00 demo-hp sudo[1563]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:43:06+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:06.858+01:00 level=INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0m0s gue
2026-11-10T15:43:06+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:06.858+01:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
2026-11-10T15:43:06+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:06.859+01:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or rest
2026-11-10T15:43:06+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:43:06.859+01:00 level=INFO msg="linetest: weekly upload line test starting" schedule="weekly, due Tuesday from 10:00 host-local time; starts 10:00-15:59 after 10 quiet minutes; never besi
2026-11-10T15:44:16+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:44:16.241+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T15:58:09+01:00 demo-hp sudo[65997]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:58:15+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:58:15.231+01:00 level=WARN msg="agent_update: signed update verified as root and handed off; restart scheduled" version=0.173.0 report="{\"agent_update\": {\"sha256\": \"752b2727fb6043417
2026-11-10T15:58:17+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:58:17.289+01:00 level=INFO msg="pbs: verify loop shutting down" reason="context canceled"
2026-11-10T15:58:17+01:00 demo-hp felhom-agent[1306]: time=2026-11-10T15:58:17.289+01:00 level=INFO msg="backup: restore-test scheduler shutting down" reason="context canceled"
2026-11-10T15:58:17+01:00 demo-hp systemd[1]: Stopping felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog)...
2026-11-10T15:58:17+01:00 demo-hp systemd[1]: Stopped felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:58:17+01:00 demo-hp systemd[1]: Started felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:58:17+01:00 demo-hp sudo[66874]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-os-apply --plan /var/lib/felhom-agent/os/plan-boot-20261110T145817Z-kernel-kernel-boot.json
2026-11-10T15:58:17+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:17.356+01:00 level=INFO msg="backup tier armed" target=local cadence=24h0m0s keep_last=1 prune="keep-daily=1" wait_timeout=30m0s prune_pbs_allowed=false primary=true
2026-11-10T15:58:17+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:17.356+01:00 level=INFO msg="backup tier armed" target=felhom-pbs cadence=168h0m0s keep_last=0 prune="" wait_timeout=12h0m0s prune_pbs_allowed=false primary=false
2026-11-10T15:58:17+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:17.356+01:00 level=INFO msg="pbsdr: bridge enabled (hub-driven; no-op until a pbs_dr descriptor arrives)"
2026-11-10T15:58:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:18.424+01:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
2026-11-10T15:58:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:18.424+01:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
2026-11-10T15:58:18+01:00 demo-hp sudo[67051]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:58:19+01:00 demo-hp sudo[67167]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:58:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:19.388+01:00 level=INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0m0s gu
2026-11-10T15:58:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:19.388+01:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
2026-11-10T15:58:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:19.389+01:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or res
2026-11-10T15:58:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:58:19.389+01:00 level=INFO msg="linetest: weekly upload line test starting" schedule="weekly, due Tuesday from 10:00 host-local time; starts 10:00-15:59 after 10 quiet minutes; never bes
2026-11-10T15:59:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:59:19.427+01:00 level=INFO msg="osupdate: running the bundle policy pass after the self-update commit (R-1285)" agent_version=0.173.0
2026-11-10T15:59:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:59:19.589+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: BUNDLE POLICY DONE install_mode=appliance removed=0"
2026-11-10T15:59:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:59:19.589+01:00 level=INFO msg="osupdate: bundle policy pass done" bundle_policy="{\"install_mode\": \"appliance\", \"removed\": []}"
2026-11-10T15:59:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:59:19.592+01:00 level=INFO msg="selfupdate prune: the self-update folder holds what it needs" kept=felhom-agent-0.173.0 removed=49
2026-11-10T15:59:26+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T15:59:26.622+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T16:13:24+01:00 demo-hp sudo[120555]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:28:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T16:28:18.425+01:00 level=INFO msg="backup: restore-test first evaluation after start (R-874)" after=30m0s
2026-11-10T16:28:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T16:28:18.768+01:00 level=INFO msg="backup: restore-test skips an entry that is not a backup of a guest" target=local volid=local:backup/felhom-golden-0.236.0.tar.zst size_bytes=654115664 re
2026-11-10T16:28:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T16:28:19.097+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-05T20:50:35Z) is already proven; local: no se
2026-11-10T16:28:24+01:00 demo-hp sudo[172820]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:29:17+01:00 demo-hp sudo[176191]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:43:24+01:00 demo-hp sudo[224892]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:58:24+01:00 demo-hp sudo[274799]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:13:24+01:00 demo-hp sudo[325353]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:28:24+01:00 demo-hp sudo[375316]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:43:24+01:00 demo-hp sudo[425306]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:58:24+01:00 demo-hp sudo[475151]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:13:24+01:00 demo-hp sudo[525197]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:28:24+01:00 demo-hp sudo[575041]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:43:24+01:00 demo-hp sudo[625011]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:58:24+01:00 demo-hp sudo[674867]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:13:24+01:00 demo-hp sudo[724869]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:28:24+01:00 demo-hp sudo[774788]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:43:24+01:00 demo-hp sudo[824794]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:58:24+01:00 demo-hp sudo[874679]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:13:24+01:00 demo-hp sudo[924671]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:28:24+01:00 demo-hp sudo[974638]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:43:24+01:00 demo-hp sudo[1024545]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:58:24+01:00 demo-hp sudo[1074504]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:13:24+01:00 demo-hp sudo[1124372]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:28:24+01:00 demo-hp sudo[1174370]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:43:24+01:00 demo-hp sudo[1224315]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:58:24+01:00 demo-hp sudo[1274176]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:59:26+01:00 demo-hp sudo[1277687]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:00:40+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T22:00:40.811+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T22:13:24+01:00 demo-hp sudo[1324125]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:28:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-10T22:28:19.944+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-05T20:50:35Z) is already proven; local: no se
2026-11-10T22:28:24+01:00 demo-hp sudo[1374071]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:43:24+01:00 demo-hp sudo[1424003]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:58:24+01:00 demo-hp sudo[1474011]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:13:24+01:00 demo-hp sudo[1523951]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:28:24+01:00 demo-hp sudo[1574019]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:43:24+01:00 demo-hp sudo[1623864]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:58:24+01:00 demo-hp sudo[1673826]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:13:24+01:00 demo-hp sudo[1723921]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:28:24+01:00 demo-hp sudo[1773909]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:43:24+01:00 demo-hp sudo[1823847]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:58:24+01:00 demo-hp sudo[1873734]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:13:24+01:00 demo-hp sudo[1923814]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:28:24+01:00 demo-hp sudo[1973839]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:43:24+01:00 demo-hp sudo[2023859]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:58:24+01:00 demo-hp sudo[2073734]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:13:24+01:00 demo-hp sudo[2123673]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:28:24+01:00 demo-hp sudo[2173583]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:43:24+01:00 demo-hp sudo[2235197]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:58:24+01:00 demo-hp sudo[2285057]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:13:24+01:00 demo-hp sudo[2335092]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:28:24+01:00 demo-hp sudo[2385056]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:43:24+01:00 demo-hp sudo[2437365]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:58:24+01:00 demo-hp sudo[2487208]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:59:26+01:00 demo-hp sudo[2490710]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:00:40+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:00:40.820+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-11T04:13:24+01:00 demo-hp sudo[2537305]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:28:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:28:19.579+01:00 level=INFO msg="backup: restore-test tier is DUE (per-archive; oldest-proven first among due tiers)" target=local archive=local:backup/vzdump-lxc-9201-2026_11_10-02_35_34
2026-11-11T04:28:20+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:28:20.131+01:00 level=INFO msg="restore-test: space preflight passed" storage=nvme-scratch required_bytes=41914830848 avail_bytes=633007927296
2026-11-11T04:28:20+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:28:20.232+01:00 level=INFO msg="restore-test: full-fidelity restore params derived from the archive config" scratch=990000 params=4
2026-11-11T04:28:24+01:00 demo-hp sudo[2598186]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:31:39+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:31:39.144+01:00 level=INFO msg="restore-test: scratch guest torn down" vmid=990000
2026-11-11T04:31:39+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:31:39.145+01:00 level=INFO msg="backup: scheduled restore-test passed" archive=local:backup/vzdump-lxc-9201-2026_11_10-02_35_34.tar.zst duration_s=199.562184354
2026-11-11T04:33:02+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:33:02.092+01:00 level=INFO msg="backup: space preflight passed" vmid=9201 target=local last_archive_bytes=9095951125 need_bytes=12443680730 avail_bytes=22617755648
2026-11-11T04:33:03+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:33:03.153+01:00 level=INFO msg="local-api: backup reached snapshotted (app may resume)" vmid=9201 target=local job=backup-9201-1794367981574952245
2026-11-11T04:38:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:38:19.390+01:00 level=INFO msg="janitor: stale-lock sweep deferred — a heavy operation is in flight" busy=backup:local
2026-11-11T04:43:24+01:00 demo-hp sudo[2655608]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:44:09+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:44:09.948+01:00 level=INFO msg="backup: completed" vmid=9201 target=local archive=local:backup/vzdump-lxc-9201-2026_11_11-04_33_02.tar.zst size_bytes=9096384826 uncovered_volumes=2
2026-11-11T04:44:09+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:44:09.949+01:00 level=INFO msg="local-api: backup job complete" vmid=9201 target=local job=backup-9201-1794367981574952245 archive=local:backup/vzdump-lxc-9201-2026_11_11-04_33_02.tar.zs
2026-11-11T04:45:39+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:39.956+01:00 level=INFO msg="osupdate: START" run=20261111T034539Z layer=guest vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T034539Z
2026-11-11T04:45:58+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:58.939+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T034539Z layer=guest:9201 lane=fast mode=apply select=pending-fast packages=0"
2026-11-11T04:45:58+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:58.939+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T04:45:58+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:58.939+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T04:45:58+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:58.939+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T04:45:58+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:58.940+01:00 level=INFO msg="osupdate: DONE" run=20261111T034539Z layer=guest vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=0 not_covered=0 
2026-11-11T04:45:58+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:45:58.982+01:00 level=INFO msg="osupdate: START" run=20261111T034539Z layer=host vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T034539Z
2026-11-11T04:46:15+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:15.451+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T034539Z layer=host lane=fast mode=apply select=pending-fast packages=0"
2026-11-11T04:46:15+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:15.451+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T04:46:15+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:15.451+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T04:46:15+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:15.451+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T04:46:16+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:16.538+01:00 level=INFO msg="osupdate: DONE" run=20261111T034539Z layer=host vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=16 not_covered=16
2026-11-11T04:46:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:18.657+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: LIVE-RESTORE already on"
2026-11-11T04:46:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:18.657+01:00 level=INFO msg="osupdate: live-restore" vmid=9201 result="{\"result\": \"already on\"}"
2026-11-11T04:46:18+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:18.657+01:00 level=INFO msg="osupdate: START" run=20261111T034539Z layer=docker vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T034539Z
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T034539Z layer=docker:9201 lane=slow mode=apply select=pending-docker packages=0 authority=
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: OOM-CHECK result=pass oom_killed=True oom_event=True exit=137 image=gitea.dooplex.hu/admin/felhom-controller:0.352.0 
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.869+01:00 level=INFO msg="osupdate: DONE" run=20261111T034539Z layer=docker vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=0 not_covered=0
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.883+01:00 level=INFO msg="osupdate: pve step holds the /etc/pve write gate — the agent's own writes wait until it ends" run=20261111T034539Z layer=pve vmid=9201 trigger=night
2026-11-11T04:46:48+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:46:48.883+01:00 level=INFO msg="osupdate: START" run=20261111T034539Z layer=pve vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T034539Z
2026-11-11T04:47:06+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:06.472+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T034539Z layer=pve:9201 lane=slow mode=apply select=pending-pve packages=0 authority=ring0"
2026-11-11T04:47:06+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:06.472+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T04:47:06+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:06.472+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T04:47:06+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:06.472+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T04:47:07+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:07.887+01:00 level=INFO msg="osupdate: DONE" run=20261111T034539Z layer=pve vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=2 not_covered=0 re
2026-11-11T04:47:07+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:07.892+01:00 level=INFO msg="osupdate: pve step released the /etc/pve write gate" run=20261111T034539Z layer=pve vmid=9201 trigger=night
2026-11-11T04:47:07+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T04:47:07.892+01:00 level=INFO msg="osupdate: kernel step skipped — the hub names no kernel step for this box" run=20261111T034539Z layer=kernel vmid=9201 trigger=night ring=0
2026-11-11T04:58:24+01:00 demo-hp sudo[2708953]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:13:24+01:00 demo-hp sudo[2758966]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:28:24+01:00 demo-hp sudo[2808864]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:43:24+01:00 demo-hp sudo[2858958]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:58:24+01:00 demo-hp sudo[2908875]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:13:24+01:00 demo-hp sudo[2958776]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:28:24+01:00 demo-hp sudo[3008761]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:43:24+01:00 demo-hp sudo[3058666]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:58:24+01:00 demo-hp sudo[3108643]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:13:24+01:00 demo-hp sudo[3158591]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:28:24+01:00 demo-hp sudo[3208701]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:43:24+01:00 demo-hp sudo[3258653]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:58:24+01:00 demo-hp sudo[3308680]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:13:24+01:00 demo-hp sudo[3358593]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:28:24+01:00 demo-hp sudo[3408639]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:43:24+01:00 demo-hp sudo[3458520]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:58:24+01:00 demo-hp sudo[3508327]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:13:24+01:00 demo-hp sudo[3558359]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:28:24+01:00 demo-hp sudo[3608281]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:43:24+01:00 demo-hp sudo[3658187]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:58:24+01:00 demo-hp sudo[3708187]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:59:26+01:00 demo-hp sudo[3711739]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:00:40+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T10:00:40.832+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-11T10:13:24+01:00 demo-hp sudo[3758186]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:28:19+01:00 demo-hp felhom-agent[66863]: time=2026-11-11T10:28:19.885+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-05T20:50:35Z) is already proven; local: no se
2026-11-11T10:28:24+01:00 demo-hp sudo[3808072]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:43:24+01:00 demo-hp sudo[3858055]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:58:24+01:00 demo-hp sudo[3908221]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage

=== agent log: line count per hour, last 26 h ===
  12339 2026-11-10T09   13253 2026-11-10T10   13266 2026-11-10T11   13262 2026-11-10T12   12658 2026-11-10T13   13271 2026-11-10T14   12173 2026-11-10T15   13301 2026-11-10T16   13278 2026-11-10T17   13268 2026-11-10T18   13244 2026-11-10T19   13256 2026-11-10T20   13270 2026-11-10T21   13266 2026-11-10T22   13246 2026-11-10T23   13249 2026-11-11T00   13261 2026-11-11T01   13267 2026-11-11T02   13507 2026-11-11T03   13345 2026-11-11T04   13267 2026-11-11T05   13264 2026-11-11T06   13261 2026-11-11T07   13261 2026-11-11T08   13252 2026-11-11T09   13262 2026-11-11T10     996 2026-11-11T11 
=== agent version ===
felhom-agent 0.173.0
RC=0
