# host-clock demo-felhom taken 2026-11-11T10:03:57Z from DooPlex

=== in-flight ===
checked

=== clock ===
utc 2026-11-11T10:03:24.716263814Z
local 2026-11-11T11:03:24 CET +0100
/usr/share/zoneinfo/Europe/Budapest
Timezone=Europe/Budapest
LocalRTC=no
CanNTP=yes
NTP=no
NTPSynchronized=no
TimeUSec=Wed 2026-11-11 11:03:24 CET
RTCTimeUSec=Wed 2026-11-11 11:03:21 CET
               Local time: Wed 2026-11-11 11:03:24 CET
           Universal time: Wed 2026-11-11 10:03:24 UTC
                 RTC time: Wed 2026-11-11 10:03:21
                Time zone: Europe/Budapest (CET, +0100)
System clock synchronized: no
              NTP service: inactive
          RTC in local TZ: no

=== who keeps the time ===
chrony: failed
   enabled: enabled
chronyd: failed
   enabled: alias
systemd-timesyncd: inactive
   enabled: not-found
ntp: inactive
   enabled: not-found
ntpsec: inactive
   enabled: not-found
openntpd: inactive
   enabled: not-found
506 Cannot talk to daemon
506 Cannot talk to daemon
Failed to query server: The name org.freedesktop.timesync1 was not provided by any .service files
pool 2.debian.pool.ntp.org iburst
sourcedir /run/chrony-dhcp
sourcedir /etc/chrony/sources.d
keyfile /etc/chrony/chrony.keys
driftfile /var/lib/chrony/chrony.drift
ntsdumpdir /var/lib/chrony
logdir /var/log/chrony
maxupdateskew 100.0
rtcsync
makestep 1 3
leapseclist /usr/share/zoneinfo/leap-seconds.list
confdir /etc/chrony/conf.d
/etc/chrony/conf.d:
README

/etc/chrony/sources.d:
README

=== start with no time ===
ls: cannot access '/var/lib/systemd/timesync/clock': No such file or directory
/var/lib/chrony/:
total 4
-rw-r--r-- 1 _chrony _chrony 42 2026-10-08 04:39:08.514818246 +0200 chrony.drift
2026-11-11 11:03:21.936805+01:00
1794391402
1794391404

=== boots ===
2026-11-08 05:35:18
 -5 46081f567f384ab88591d4e604555a48 Sun 2026-10-04 21:43:33 CEST Sun 2026-10-04 21:43:46 CEST
 -4 e82176ae7cf644518507468fc609eaa9 Wed 2026-10-14 15:43:07 CEST Fri 2026-10-16 05:09:06 CEST
 -3 ddd3d7305e244b2a9eafb5cf229476f1 Fri 2026-10-16 05:09:23 CEST Wed 2026-10-21 05:23:34 CEST
 -2 56db71938b304a57bdedf30f89860e1f Wed 2026-10-21 05:23:48 CEST Thu 2026-10-29 04:47:58 CET
 -1 4f6d8b388e224b8ca8ed45e06a2f96b9 Thu 2026-10-29 04:48:11 CET  Sun 2026-11-08 05:35:13 CET
  0 72899d2625244e069e8e8099775d1e51 Sun 2026-11-08 05:35:21 CET  Wed 2026-11-11 11:03:24 CET

=== timers ===
NEXT                          LEFT LAST                              PASSED UNIT                           ACTIVATES
Wed 2026-11-11 11:03:50 CET    25s Wed 2026-11-11 11:02:50 CET      34s ago felhom-mgmt-watchdog.timer     felhom-mgmt-watchdog.service
Wed 2026-11-11 11:56:50 CET  53min Wed 2026-11-11 10:56:50 CET     6min ago felhom-crash-guard-check.timer felhom-crash-guard-check.service
Thu 2026-11-12 00:00:00 CET    12h Wed 2026-11-11 00:00:30 CET      11h ago dpkg-db-backup.timer           dpkg-db-backup.service
Thu 2026-11-12 00:36:19 CET    13h Wed 2026-11-11 00:40:45 CET      10h ago logrotate.timer                logrotate.service
Thu 2026-11-12 00:37:37 CET    13h Wed 2026-11-11 10:46:55 CET    16min ago apt-daily.timer                apt-daily.service
Thu 2026-11-12 05:41:31 CET    18h Wed 2026-11-11 01:11:21 CET       9h ago pve-daily-update.timer         pve-daily-update.service
Thu 2026-11-12 05:50:49 CET    18h Wed 2026-11-11 05:50:49 CET 5h 12min ago systemd-tmpfiles-clean.timer   systemd-tmpfiles-clean.service
Thu 2026-11-12 06:54:07 CET    19h Wed 2026-11-11 06:40:15 CET 4h 23min ago apt-daily-upgrade.timer        apt-daily-upgrade.service
Thu 2026-11-12 07:50:39 CET    20h Wed 2026-11-11 10:09:10 CET    54min ago man-db.timer                   man-db.service
Sun 2026-11-15 03:10:21 CET 3 days Sun 2026-11-08 03:10:44 CET            - xfs_scrub_all.timer            xfs_scrub_all.service
Sun 2026-11-15 03:10:52 CET 3 days Sun 2026-11-08 03:10:44 CET            - e2scrub_all.timer              e2scrub_all.service
Mon 2026-11-16 01:20:47 CET 4 days Mon 2026-11-09 01:32:30 CET   2 days ago fstrim.timer                   fstrim.service

12 timers listed.

=== timer units (all) ===
--- apt-daily-upgrade.timer [enabled/active]
OnCalendar=*-*-* 6:00
RandomizedDelaySec=60m
Persistent=true
Unit=apt-daily-upgrade.service NextElapseUSecRealtime=Thu 2026-11-12 06:54:07 CET LastTriggerUSec=Wed 2026-11-11 06:40:15 CET 
--- apt-daily.timer [enabled/active]
OnCalendar=*-*-* 6,18:00
RandomizedDelaySec=12h
Persistent=true
Unit=apt-daily.service NextElapseUSecRealtime=Thu 2026-11-12 00:37:37 CET LastTriggerUSec=Wed 2026-11-11 10:46:55 CET 
--- apt-listchanges.timer [disabled/inactive]
OnCalendar=hourly
Unit=apt-listchanges.service NextElapseUSecRealtime= LastTriggerUSec= 
--- chrony-dnssrv@.timer [disabled/]
OnActiveSec=0
OnUnitInactiveSec=1h

--- dpkg-db-backup.timer [enabled/active]
OnCalendar=daily
Persistent=true
Unit=dpkg-db-backup.service NextElapseUSecRealtime=Thu 2026-11-12 00:00:00 CET LastTriggerUSec=Wed 2026-11-11 00:00:30 CET 
--- e2scrub_all.timer [enabled/active]
OnCalendar=Sun *-*-* 03:10:00
RandomizedDelaySec=60
Persistent=true
Unit=e2scrub_all.service NextElapseUSecRealtime=Sun 2026-11-15 03:10:52 CET LastTriggerUSec=Sun 2026-11-08 03:10:44 CET 
--- felhom-crash-guard-check.timer [enabled/active]
OnBootSec=15min
OnUnitActiveSec=1h
Unit=felhom-crash-guard-check.service NextElapseUSecRealtime= LastTriggerUSec=Wed 2026-11-11 10:56:50 CET 
--- felhom-mgmt-watchdog.timer [enabled/active]
OnBootSec=30s
OnUnitActiveSec=60s
AccuracySec=5s
Persistent=true
Unit=felhom-mgmt-watchdog.service
Unit=felhom-mgmt-watchdog.service NextElapseUSecRealtime= LastTriggerUSec=Wed 2026-11-11 11:02:50 CET 
--- fstrim.timer [enabled/active]
OnCalendar=weekly
AccuracySec=1h
Persistent=true
RandomizedDelaySec=100min
Unit=fstrim.service NextElapseUSecRealtime=Mon 2026-11-16 01:20:47 CET LastTriggerUSec=Mon 2026-11-09 01:32:30 CET 
--- logrotate.timer [enabled/active]
OnCalendar=daily
RandomizedDelaySec=1h
Persistent=true
Unit=logrotate.service NextElapseUSecRealtime=Thu 2026-11-12 00:36:19 CET LastTriggerUSec=Wed 2026-11-11 00:40:45 CET 
--- man-db.timer [enabled/active]
OnCalendar=daily
RandomizedDelaySec=12h
Persistent=true
Unit=man-db.service NextElapseUSecRealtime=Thu 2026-11-12 07:50:39 CET LastTriggerUSec=Wed 2026-11-11 10:09:10 CET 
--- proxmox-firewall.timer [disabled/inactive]
OnBootSec=1s
OnUnitInactiveSec=5s
Unit=proxmox-firewall.service
Unit=proxmox-firewall.service NextElapseUSecRealtime= LastTriggerUSec= 
--- pve-daily-update.timer [enabled/active]
OnCalendar=*-*-* 1:00
RandomizedDelaySec=5h
Persistent=true
Unit=pve-daily-update.service NextElapseUSecRealtime=Thu 2026-11-12 05:41:31 CET LastTriggerUSec=Wed 2026-11-11 01:11:21 CET 
--- systemd-tmpfiles-clean.timer [static/active]
OnBootSec=15min
OnUnitActiveSec=1d
Unit=systemd-tmpfiles-clean.service NextElapseUSecRealtime= LastTriggerUSec=Wed 2026-11-11 05:50:49 CET 
--- xfs_scrub_all.timer [enabled/active]
OnCalendar=Sun *-*-* 03:10:00
RandomizedDelaySec=60
Persistent=true
Unit=xfs_scrub_all.service NextElapseUSecRealtime=Sun 2026-11-15 03:10:21 CET LastTriggerUSec=Sun 2026-11-08 03:10:44 CET 
--- zfs-scrub-monthly@.timer [disabled/]
OnCalendar=monthly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-scrub@%i.service

--- zfs-scrub-weekly@.timer [disabled/]
OnCalendar=weekly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-scrub@%i.service

--- zfs-trim-monthly@.timer [disabled/]
OnCalendar=monthly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-trim@%i.service

--- zfs-trim-weekly@.timer [disabled/]
OnCalendar=weekly
Persistent=true
RandomizedDelaySec=1h
Unit=zfs-trim@%i.service


=== service limits of felhom + backup timers ===
--- apt-daily-upgrade.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 06:40:15 CET
ExecMainExitTimestamp=Wed 2026-11-11 06:40:15 CET
ExecMainStatus=0
ExecStart={ path=/usr/lib/apt/apt.systemd.daily ; argv[]=/usr/lib/apt/apt.systemd.daily install ; ignore_errors=no ; start_time=[Wed 2026-11-11 06:40:15 CET] ; stop_time=[Wed 2026-11-11 06:40:15 CET] ; pid=809079 ; code=exited ; status=0 }
--- apt-daily.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 10:46:55 CET
ExecMainExitTimestamp=Wed 2026-11-11 10:46:55 CET
ExecMainStatus=0
ExecStart={ path=/usr/lib/apt/apt.systemd.daily ; argv[]=/usr/lib/apt/apt.systemd.daily update ; ignore_errors=no ; start_time=[Wed 2026-11-11 10:46:55 CET] ; stop_time=[Wed 2026-11-11 10:46:55 CET] ; pid=1088520 ; code=exited ; status=0 }
--- apt-listchanges.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=
ExecMainExitTimestamp=
ExecMainStatus=0
ExecStart={ path=python3 ; argv[]=python3 -m apt_listchanges.populate_database --profile apt ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
--- dpkg-db-backup.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 00:00:30 CET
ExecMainExitTimestamp=Wed 2026-11-11 00:00:30 CET
ExecMainStatus=0
ExecStart={ path=/usr/libexec/dpkg/dpkg-db-backup ; argv[]=/usr/libexec/dpkg/dpkg-db-backup ; ignore_errors=no ; start_time=[Wed 2026-11-11 00:00:30 CET] ; stop_time=[Wed 2026-11-11 00:00:30 CET] ; pid=345759 ; code=exited ; status=0 }
--- e2scrub_all.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=
ExecMainExitTimestamp=
ExecMainStatus=0
ExecStart={ path=/sbin/e2scrub_all ; argv[]=/sbin/e2scrub_all ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
--- felhom-crash-guard-check.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 10:56:50 CET
ExecMainExitTimestamp=Wed 2026-11-11 10:56:50 CET
ExecMainStatus=0
ExecStart={ path=/usr/local/sbin/felhom-crash-guard ; argv[]=/usr/local/sbin/felhom-crash-guard check ; ignore_errors=no ; start_time=[Wed 2026-11-11 10:56:50 CET] ; stop_time=[Wed 2026-11-11 10:56:50 CET] ; pid=1099750 ; code=exited ; status=0 }
--- felhom-mgmt-watchdog.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 11:02:50 CET
ExecMainExitTimestamp=Wed 2026-11-11 11:02:50 CET
ExecMainStatus=0
ExecStart={ path=/usr/local/sbin/felhom-mgmt-watchdog ; argv[]=/usr/local/sbin/felhom-mgmt-watchdog ; ignore_errors=no ; start_time=[Wed 2026-11-11 11:02:50 CET] ; stop_time=[Wed 2026-11-11 11:02:50 CET] ; pid=1106395 ; code=exited ; status=0 }
--- fstrim.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Mon 2026-11-09 01:32:30 CET
ExecMainExitTimestamp=Mon 2026-11-09 01:32:46 CET
ExecMainStatus=0
ExecStart={ path=/sbin/fstrim ; argv[]=/sbin/fstrim --listed-in /etc/fstab:/proc/self/mountinfo --verbose --quiet-unsupported ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
--- logrotate.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 00:40:45 CET
ExecMainExitTimestamp=Wed 2026-11-11 00:40:47 CET
ExecMainStatus=0
ExecStart={ path=/usr/sbin/logrotate ; argv[]=/usr/sbin/logrotate /etc/logrotate.conf ; ignore_errors=no ; start_time=[Wed 2026-11-11 00:40:45 CET] ; stop_time=[Wed 2026-11-11 00:40:47 CET] ; pid=391150 ; code=exited ; status=0 }
--- man-db.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 10:09:10 CET
ExecMainExitTimestamp=Wed 2026-11-11 10:09:10 CET
ExecMainStatus=0
ExecStart={ path=/usr/bin/install ; argv[]=/usr/bin/install -d -o man -g man -m 0755 /var/cache/man ; ignore_errors=no ; start_time=[Wed 2026-11-11 10:09:10 CET] ; stop_time=[Wed 2026-11-11 10:09:10 CET] ; pid=1044483 ; code=exited ; status=0 }
ExecStart={ path=/usr/bin/mandb ; argv[]=/usr/bin/mandb --quiet ; ignore_errors=no ; start_time=[Wed 2026-11-11 10:09:10 CET] ; stop_time=[Wed 2026-11-11 10:09:10 CET] ; pid=1044490 ; code=exited ; status=0 }
--- pve-daily-update.service
Type=oneshot
TimeoutStartUSec=infinity
RuntimeMaxUSec=infinity
ExecMainStartTimestamp=Wed 2026-11-11 01:11:21 CET
ExecMainExitTimestamp=Wed 2026-11-11 01:11:25 CET
ExecMainStatus=0
ExecStart={ path=/usr/bin/pveupdate ; argv[]=/usr/bin/pveupdate ; ignore_errors=no ; start_time=[Wed 2026-11-11 01:11:21 CET] ; stop_time=[Wed 2026-11-11 01:11:25 CET] ; pid=425598 ; code=exited ; status=0 }

=== felhom units that are not timers ===
felhom-agent-rollback.service loaded inactive dead
felhom-agent.service loaded active running
felhom-crash-guard-check.service loaded inactive dead
felhom-crash-guard.service loaded active exited
felhom-mgmt-watchdog.service loaded inactive dead
felhom-oob-nft.service loaded active exited
felhom-shared-parent.service loaded active exited
felhom-sshd.service loaded active running
felhom-crash-guard-check.timer loaded active waiting
felhom-mgmt-watchdog.timer loaded active waiting
--- felhom-agent-rollback.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=infinity NRestarts=0 ActiveEnterTimestamp= 
--- felhom-agent.service
Restart=on-failure RestartUSec=5s TimeoutStartUSec=1min 30s RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Tue 2026-11-10 15:50:48 CET 
--- felhom-bootstrap.service
Restart=on-failure RestartUSec=30s TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=infinity NRestarts=0 ActiveEnterTimestamp= 
--- felhom-crash-guard-check.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp= 
--- felhom-crash-guard.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Sun 2026-11-08 05:35:23 CET 
--- felhom-mgmt-watchdog.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp= 
--- felhom-oob-nft.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Sun 2026-11-08 05:35:23 CET 
--- felhom-shared-parent.service
Restart=no RestartUSec=100ms TimeoutStartUSec=infinity RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Sun 2026-11-08 05:35:23 CET 
--- felhom-sshd.service
Restart=on-failure RestartUSec=100ms TimeoutStartUSec=1min 30s RuntimeMaxUSec=infinity WatchdogUSec=0 NRestarts=0 ActiveEnterTimestamp=Sun 2026-11-08 05:35:24 CET 

=== cron ===
SHELL=/bin/sh
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
17 *	* * *	root	cd / && run-parts --report /etc/cron.hourly
25 6	* * *	root	test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.daily; }
47 6	* * 7	root	test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.weekly; }
52 6	1 * *	root	test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.monthly; }
--- /etc/cron.d/e2scrub_all
30 3 * * 0 root test -e /run/systemd/system || SERVICE_MODE=1 /usr/libexec/e2fsprogs/e2scrub_all_cron
10 3 * * * root test -e /run/systemd/system || SERVICE_MODE=1 /sbin/e2scrub_all -A -r
--- /etc/cron.d/vzdump
PATH="/usr/sbin:/usr/bin:/sbin:/bin"
--- /etc/cron.d/zfsutils-linux
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
24 0 1-7 * * root if [ $(date +\%w) -eq 0 ] && [ -x /usr/lib/zfs-linux/trim ]; then /usr/lib/zfs-linux/trim; fi
24 0 8-14 * * root if [ $(date +\%w) -eq 0 ] && [ -x /usr/lib/zfs-linux/scrub ]; then /usr/lib/zfs-linux/scrub; fi
--- cron.hourly: 
--- cron.daily: apt-compat dpkg logrotate man-db 
--- cron.weekly: man-db 
--- cron.monthly: 
--- user crontabs: 

=== at ===
no at

=== pve jobs ===
--- vzdump.cron
PATH="/usr/sbin:/usr/bin:/sbin:/bin"
--- vzdump.conf

=== pve tasks (start end type id status), last 14 days ===
awk: line 2: function strtonum never defined
awk: line 2: function strtonum never defined

=== runs of timer services, last 10 days (start/finish lines) ===
--- apt-daily-upgrade.service
2026-11-09T06:30:32+01:00 demo-felhom systemd[1]: Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities...
2026-11-09T06:30:32+01:00 demo-felhom systemd[1]: apt-daily-upgrade.service: Deactivated successfully.
2026-11-09T06:30:32+01:00 demo-felhom systemd[1]: Finished apt-daily-upgrade.service - Daily apt upgrade and clean activities.
2026-11-10T06:03:00+01:00 demo-felhom systemd[1]: Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities...
2026-11-10T06:03:00+01:00 demo-felhom systemd[1]: apt-daily-upgrade.service: Deactivated successfully.
2026-11-10T06:03:00+01:00 demo-felhom systemd[1]: Finished apt-daily-upgrade.service - Daily apt upgrade and clean activities.
2026-11-11T06:40:15+01:00 demo-felhom systemd[1]: Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities...
2026-11-11T06:40:15+01:00 demo-felhom systemd[1]: apt-daily-upgrade.service: Deactivated successfully.
2026-11-11T06:40:15+01:00 demo-felhom systemd[1]: Finished apt-daily-upgrade.service - Daily apt upgrade and clean activities.
--- apt-daily.service
2026-11-10T13:12:32+01:00 demo-felhom systemd[1]: Starting apt-daily.service - Daily apt download activities...
2026-11-10T13:12:32+01:00 demo-felhom systemd[1]: apt-daily.service: Deactivated successfully.
2026-11-10T13:12:32+01:00 demo-felhom systemd[1]: Finished apt-daily.service - Daily apt download activities.
2026-11-11T01:34:49+01:00 demo-felhom systemd[1]: Starting apt-daily.service - Daily apt download activities...
2026-11-11T01:34:50+01:00 demo-felhom systemd[1]: apt-daily.service: Deactivated successfully.
2026-11-11T01:34:50+01:00 demo-felhom systemd[1]: Finished apt-daily.service - Daily apt download activities.
2026-11-11T10:46:55+01:00 demo-felhom systemd[1]: Starting apt-daily.service - Daily apt download activities...
2026-11-11T10:46:55+01:00 demo-felhom systemd[1]: apt-daily.service: Deactivated successfully.
2026-11-11T10:46:55+01:00 demo-felhom systemd[1]: Finished apt-daily.service - Daily apt download activities.
--- felhom-crash-guard-check.service
2026-11-11T08:56:50+01:00 demo-felhom systemd[1]: Starting felhom-crash-guard-check.service - Felhom crash guard re-arm check...
2026-11-11T08:56:50+01:00 demo-felhom systemd[1]: felhom-crash-guard-check.service: Deactivated successfully.
2026-11-11T08:56:50+01:00 demo-felhom systemd[1]: Finished felhom-crash-guard-check.service - Felhom crash guard re-arm check.
2026-11-11T09:56:50+01:00 demo-felhom systemd[1]: Starting felhom-crash-guard-check.service - Felhom crash guard re-arm check...
2026-11-11T09:56:50+01:00 demo-felhom systemd[1]: felhom-crash-guard-check.service: Deactivated successfully.
2026-11-11T09:56:50+01:00 demo-felhom systemd[1]: Finished felhom-crash-guard-check.service - Felhom crash guard re-arm check.
2026-11-11T10:56:50+01:00 demo-felhom systemd[1]: Starting felhom-crash-guard-check.service - Felhom crash guard re-arm check...
2026-11-11T10:56:50+01:00 demo-felhom systemd[1]: felhom-crash-guard-check.service: Deactivated successfully.
2026-11-11T10:56:50+01:00 demo-felhom systemd[1]: Finished felhom-crash-guard-check.service - Felhom crash guard re-arm check.
--- felhom-mgmt-watchdog.service
2026-11-11T11:00:49+01:00 demo-felhom systemd[1]: Starting felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent)...
2026-11-11T11:00:49+01:00 demo-felhom systemd[1]: felhom-mgmt-watchdog.service: Deactivated successfully.
2026-11-11T11:00:49+01:00 demo-felhom systemd[1]: Finished felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent).
2026-11-11T11:01:50+01:00 demo-felhom systemd[1]: Starting felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent)...
2026-11-11T11:01:50+01:00 demo-felhom systemd[1]: felhom-mgmt-watchdog.service: Deactivated successfully.
2026-11-11T11:01:50+01:00 demo-felhom systemd[1]: Finished felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent).
2026-11-11T11:02:50+01:00 demo-felhom systemd[1]: Starting felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent)...
2026-11-11T11:02:50+01:00 demo-felhom systemd[1]: felhom-mgmt-watchdog.service: Deactivated successfully.
2026-11-11T11:02:50+01:00 demo-felhom systemd[1]: Finished felhom-mgmt-watchdog.service - Felhom management-plane watchdog (privsep-dir auto-heal; agent-independent).
--- pve-daily-update.service
2026-11-09T02:07:09+01:00 demo-felhom systemd[1]: pve-daily-update.service: Consumed 3.774s CPU time, 234.8M memory peak.
2026-11-10T01:23:25+01:00 demo-felhom systemd[1]: Starting pve-daily-update.service - Daily PVE download activities...
2026-11-10T01:23:29+01:00 demo-felhom systemd[1]: pve-daily-update.service: Deactivated successfully.
2026-11-10T01:23:29+01:00 demo-felhom systemd[1]: Finished pve-daily-update.service - Daily PVE download activities.
2026-11-10T01:23:29+01:00 demo-felhom systemd[1]: pve-daily-update.service: Consumed 3.725s CPU time, 234.2M memory peak.
2026-11-11T01:11:21+01:00 demo-felhom systemd[1]: Starting pve-daily-update.service - Daily PVE download activities...
2026-11-11T01:11:25+01:00 demo-felhom systemd[1]: pve-daily-update.service: Deactivated successfully.
2026-11-11T01:11:25+01:00 demo-felhom systemd[1]: Finished pve-daily-update.service - Daily PVE download activities.
2026-11-11T01:11:25+01:00 demo-felhom systemd[1]: pve-daily-update.service: Consumed 3.757s CPU time, 234.8M memory peak.

=== agent log: schedule words, last 3 days (tail 260) ===
2026-11-10T00:20:42+01:00 demo-felhom sudo[2915765]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T00:35:42+01:00 demo-felhom sudo[2932690]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T00:50:42+01:00 demo-felhom sudo[2949587]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T01:05:42+01:00 demo-felhom sudo[2966528]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T01:20:42+01:00 demo-felhom sudo[2983412]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T01:35:42+01:00 demo-felhom sudo[3000347]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T01:50:42+01:00 demo-felhom sudo[3017217]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T02:05:42+01:00 demo-felhom sudo[3034102]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T02:20:42+01:00 demo-felhom sudo[3051036]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T02:35:42+01:00 demo-felhom sudo[3070754]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T02:50:42+01:00 demo-felhom sudo[3087822]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T03:05:42+01:00 demo-felhom sudo[3104852]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T03:20:42+01:00 demo-felhom sudo[3121847]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T03:35:42+01:00 demo-felhom sudo[3139471]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T03:50:42+01:00 demo-felhom sudo[3156417]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:05:42+01:00 demo-felhom sudo[3173412]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:20:42+01:00 demo-felhom sudo[3193437]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:35:42+01:00 demo-felhom sudo[3210510]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T04:50:42+01:00 demo-felhom sudo[3227558]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:05:42+01:00 demo-felhom sudo[3244549]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:20:42+01:00 demo-felhom sudo[3261530]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:34:26+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:34:26.031+01:00 level=INFO msg="backup: space preflight passed" vmid=9201 target=felhom-backup last_archive_bytes=1528966739 need_bytes=2984950247 avail_bytes=924950589440
2026-11-10T05:34:27+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:34:27.065+01:00 level=INFO msg="local-api: backup reached snapshotted (app may resume)" vmid=9201 target=felhom-backup job=backup-9201-1794285265667942744
2026-11-10T05:35:12+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:35:12.208+01:00 level=INFO msg="backup: completed" vmid=9201 target=felhom-backup archive=felhom-backup:backup/vzdump-lxc-9201-2026_11_10-05_34_26.tar.zst size_bytes=1299653068 uncove
2026-11-10T05:35:12+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:35:12.208+01:00 level=INFO msg="local-api: backup job complete" vmid=9201 target=felhom-backup job=backup-9201-1794285265667942744 archive=felhom-backup:backup/vzdump-lxc-9201-2026_11
2026-11-10T05:35:33+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:35:33.864+01:00 level=INFO msg="janitor: stale-lock sweep deferred — a heavy operation is in flight" busy=backup:felhom-backup
2026-11-10T05:35:40+01:00 demo-felhom sudo[3280846]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:35:42+01:00 demo-felhom sudo[3281005]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T05:35:52+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:35:52.839+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-10T05:36:42+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:42.210+01:00 level=INFO msg="osupdate: START" run=20261110T043642Z layer=guest vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261110T043642Z
2026-11-10T05:36:56+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:56.012+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261110T043642Z layer=guest:9201 lane=fast mode=apply select=pending-fast packages=0"
2026-11-10T05:36:56+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:56.012+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-10T05:36:56+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:56.012+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-10T05:36:56+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:56.012+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-10T05:36:56+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:56.013+01:00 level=INFO msg="osupdate: DONE" run=20261110T043642Z layer=guest vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=0 not_covered
2026-11-10T05:36:56+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:36:56.023+01:00 level=INFO msg="osupdate: START" run=20261110T043642Z layer=host vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261110T043642Z
2026-11-10T05:37:06+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:06.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261110T043642Z layer=host lane=fast mode=apply select=pending-fast packages=0"
2026-11-10T05:37:06+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:06.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-10T05:37:06+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:06.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-10T05:37:06+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:06.868+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-10T05:37:07+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:07.688+01:00 level=INFO msg="osupdate: DONE" run=20261110T043642Z layer=host vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=14 not_covered
2026-11-10T05:37:09+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:09.362+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: LIVE-RESTORE already on"
2026-11-10T05:37:09+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:09.362+01:00 level=INFO msg="osupdate: live-restore" vmid=9201 result="{\"result\": \"already on\"}"
2026-11-10T05:37:09+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:09.362+01:00 level=INFO msg="osupdate: START" run=20261110T043642Z layer=docker vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261110T043642Z
2026-11-10T05:37:31+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:31.993+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261110T043642Z layer=docker:9201 lane=slow mode=apply select=pending-docker packages=0 authori
2026-11-10T05:37:31+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:31.993+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-10T05:37:31+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:31.993+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-10T05:37:31+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:31.993+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-10T05:37:31+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:31.993+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: OOM-CHECK result=pass oom_killed=True oom_event=True exit=137 image=gitea.dooplex.hu/admin/felhom-controller:0.351.0
2026-11-10T05:37:31+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:31.993+01:00 level=INFO msg="osupdate: DONE" run=20261110T043642Z layer=docker vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=0 not_covere
2026-11-10T05:37:32+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:32.001+01:00 level=INFO msg="osupdate: pve step holds the /etc/pve write gate — the agent's own writes wait until it ends" run=20261110T043642Z layer=pve vmid=9201 trigger=night
2026-11-10T05:37:32+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:32.001+01:00 level=INFO msg="osupdate: START" run=20261110T043642Z layer=pve vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261110T043642Z
2026-11-10T05:37:43+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:43.960+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261110T043642Z layer=pve:9201 lane=slow mode=apply select=pending-pve packages=0 authority=rin
2026-11-10T05:37:43+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:43.960+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-10T05:37:43+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:43.960+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-10T05:37:43+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:43.960+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-10T05:37:44+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:44.758+01:00 level=INFO msg="osupdate: DONE" run=20261110T043642Z layer=pve vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=1 not_covered=0
2026-11-10T05:37:44+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:44.779+01:00 level=INFO msg="osupdate: pve step released the /etc/pve write gate" run=20261110T043642Z layer=pve vmid=9201 trigger=night
2026-11-10T05:37:44+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:37:44.779+01:00 level=INFO msg="osupdate: kernel step skipped — the hub names no kernel step for this box" run=20261110T043642Z layer=kernel vmid=9201 trigger=night ring=0
2026-11-10T05:39:27+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:39:27.093+01:00 level=INFO msg="local-api: backup reached snapshotted (app may resume)" vmid=9201 target=felhom-pbs job=backup-9201-felhom-pbs-1794285565692471312
2026-11-10T05:40:12+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:40:12.531+01:00 level=INFO msg="backup: completed" vmid=9201 target=felhom-pbs archive=felhom-pbs:backup/ct/9201/2026-11-10T04:39:26Z size_bytes=3502516951 uncovered_volumes=2
2026-11-10T05:40:12+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T05:40:12.531+01:00 level=INFO msg="local-api: backup job complete" vmid=9201 target=felhom-pbs job=backup-9201-felhom-pbs-1794285565692471312 archive=felhom-pbs:backup/ct/9201/2026-11-10
2026-11-10T05:50:42+01:00 demo-felhom sudo[3302512]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:05:42+01:00 demo-felhom sudo[3319580]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:06:34+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T06:06:34.950+01:00 level=INFO msg="backup: restore-test tier is DUE (per-archive; oldest-proven first among due tiers)" target=felhom-backup archive=felhom-backup:backup/vzdump-lxc-9201-
2026-11-10T06:06:35+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T06:06:35.818+01:00 level=INFO msg="restore-test: space preflight passed" storage=local-lvm required_bytes=10566459392 avail_bytes=363190239731
2026-11-10T06:06:35+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T06:06:35.841+01:00 level=INFO msg="restore-test: full-fidelity restore params derived from the archive config" scratch=990000 params=4
2026-11-10T06:07:34+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T06:07:34.438+01:00 level=INFO msg="restore-test: scratch guest torn down" vmid=990000
2026-11-10T06:07:34+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T06:07:34.439+01:00 level=INFO msg="backup: scheduled restore-test passed" archive=felhom-backup:backup/vzdump-lxc-9201-2026_11_09-05_31_03.tar.zst duration_s=59.485928852
2026-11-10T06:20:42+01:00 demo-felhom sudo[3337978]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:35:42+01:00 demo-felhom sudo[3354915]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T06:50:42+01:00 demo-felhom sudo[3371871]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:05:42+01:00 demo-felhom sudo[3388825]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:20:42+01:00 demo-felhom sudo[3405797]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:35:42+01:00 demo-felhom sudo[3422762]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T07:50:42+01:00 demo-felhom sudo[3439766]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:05:42+01:00 demo-felhom sudo[3456667]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:20:42+01:00 demo-felhom sudo[3473575]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:35:42+01:00 demo-felhom sudo[3491405]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T08:50:42+01:00 demo-felhom sudo[3509858]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:05:42+01:00 demo-felhom sudo[3526966]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:20:42+01:00 demo-felhom sudo[3543898]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:35:42+01:00 demo-felhom sudo[3560731]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T09:50:42+01:00 demo-felhom sudo[3577606]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:05:42+01:00 demo-felhom sudo[3594532]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:20:42+01:00 demo-felhom sudo[3611505]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:35:42+01:00 demo-felhom sudo[3628405]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T10:50:42+01:00 demo-felhom sudo[3645823]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:05:42+01:00 demo-felhom sudo[3662674]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:20:42+01:00 demo-felhom sudo[3679581]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:35:40+01:00 demo-felhom sudo[3696377]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:35:42+01:00 demo-felhom sudo[3696468]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T11:35:54+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T11:35:54.826+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=3
2026-11-10T11:50:42+01:00 demo-felhom sudo[3713367]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:05:42+01:00 demo-felhom sudo[3730217]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:06:35+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T12:06:35.294+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-03T04:35:12Z) is already proven; felhom-ba
2026-11-10T12:20:42+01:00 demo-felhom sudo[3747183]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:35:42+01:00 demo-felhom sudo[3764104]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T12:50:42+01:00 demo-felhom sudo[3781025]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:05:42+01:00 demo-felhom sudo[3797895]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:20:42+01:00 demo-felhom sudo[3814879]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:35:42+01:00 demo-felhom sudo[3831759]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T13:50:42+01:00 demo-felhom sudo[3848706]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:05:42+01:00 demo-felhom sudo[3865605]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:20:42+01:00 demo-felhom sudo[3882602]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:35:42+01:00 demo-felhom sudo[3899445]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T14:50:42+01:00 demo-felhom sudo[3916354]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:05:42+01:00 demo-felhom sudo[3933239]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:20:42+01:00 demo-felhom sudo[3950147]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:35:42+01:00 demo-felhom sudo[3967102]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:50:42+01:00 demo-felhom sudo[3984749]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:50:46+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T15:50:46.327+01:00 level=WARN msg="agent_update: signed update verified as root and handed off; restart scheduled" version=0.173.0 report="{\"agent_update\": {\"sha256\": \"752b2727fb604
2026-11-10T15:50:48+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T15:50:48.430+01:00 level=INFO msg="pbs: verify loop shutting down" reason="context canceled"
2026-11-10T15:50:48+01:00 demo-felhom felhom-agent[1206]: time=2026-11-10T15:50:48.430+01:00 level=INFO msg="backup: restore-test scheduler shutting down" reason="context canceled"
2026-11-10T15:50:48+01:00 demo-felhom systemd[1]: Stopping felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog)...
2026-11-10T15:50:48+01:00 demo-felhom systemd[1]: Stopped felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:50:48+01:00 demo-felhom systemd[1]: Started felhom-agent.service - Felhom host agent (Proxmox host tier; hub control loop + PBS verify + storage watchdog).
2026-11-10T15:50:48+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:48.463+01:00 level=INFO msg="backup tier armed" target=felhom-backup cadence=24h0m0s keep_last=3 prune="keep-daily=3" wait_timeout=30m0s prune_pbs_allowed=false primary=true
2026-11-10T15:50:48+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:48.463+01:00 level=INFO msg="backup tier armed" target=felhom-pbs cadence=168h0m0s keep_last=0 prune="" wait_timeout=12h0m0s prune_pbs_allowed=false primary=false
2026-11-10T15:50:48+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:48.464+01:00 level=INFO msg="pbsdr: bridge enabled (hub-driven; no-op until a pbs_dr descriptor arrives)"
2026-11-10T15:50:48+01:00 demo-felhom sudo[3985075]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-os-apply --plan /var/lib/felhom-agent/os/plan-boot-20261110T145048Z-kernel-kernel-boot.json
2026-11-10T15:50:49+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:49.046+01:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
2026-11-10T15:50:49+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:49.046+01:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
2026-11-10T15:50:49+01:00 demo-felhom sudo[3985235]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:50:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:50.001+01:00 level=INFO msg="controller-supervisor: started" interval=30s confirm_sweeps=2 crashloop_max=3 crashloop_window=15m0s slow_crashloop_max=5 slow_crashloop_window=24h0
2026-11-10T15:50:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:50.001+01:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
2026-11-10T15:50:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:50.001+01:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup 
2026-11-10T15:50:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:50:50.001+01:00 level=INFO msg="linetest: weekly upload line test starting" schedule="weekly, due Tuesday from 10:00 host-local time; starts 10:00-15:59 after 10 quiet minutes; nev
2026-11-10T15:50:50+01:00 demo-felhom sudo[3985377]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T15:51:01+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:51:01.241+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=3
2026-11-10T15:51:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:51:50.032+01:00 level=INFO msg="osupdate: running the bundle policy pass after the self-update commit (R-1285)" agent_version=0.173.0
2026-11-10T15:51:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:51:50.121+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: BUNDLE POLICY DONE install_mode=appliance removed=0"
2026-11-10T15:51:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:51:50.122+01:00 level=INFO msg="osupdate: bundle policy pass done" bundle_policy="{\"install_mode\": \"appliance\", \"removed\": []}"
2026-11-10T15:51:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T15:51:50.128+01:00 level=INFO msg="selfupdate prune: the self-update folder holds what it needs" kept=felhom-agent-0.173.0 removed=48
2026-11-10T16:05:54+01:00 demo-felhom sudo[4002880]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:20:49+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T16:20:49.047+01:00 level=INFO msg="backup: restore-test first evaluation after start (R-874)" after=30m0s
2026-11-10T16:20:49+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T16:20:49.736+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-03T04:35:12Z) is already proven; felhom
2026-11-10T16:20:54+01:00 demo-felhom sudo[4020715]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:28:44+01:00 demo-felhom sudo[4029648]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:35:54+01:00 demo-felhom sudo[4038486]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T16:50:54+01:00 demo-felhom sudo[4055454]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:05:54+01:00 demo-felhom sudo[4072670]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:20:54+01:00 demo-felhom sudo[4089639]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:35:54+01:00 demo-felhom sudo[4106493]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T17:50:54+01:00 demo-felhom sudo[4123369]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:05:54+01:00 demo-felhom sudo[4140267]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:20:54+01:00 demo-felhom sudo[4157202]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:35:54+01:00 demo-felhom sudo[4174095]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T18:50:54+01:00 demo-felhom sudo[4190953]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:05:54+01:00 demo-felhom sudo[14085]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:20:54+01:00 demo-felhom sudo[30996]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:35:54+01:00 demo-felhom sudo[47836]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T19:50:54+01:00 demo-felhom sudo[64771]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:05:54+01:00 demo-felhom sudo[81620]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:20:54+01:00 demo-felhom sudo[98549]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:35:54+01:00 demo-felhom sudo[115453]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T20:50:54+01:00 demo-felhom sudo[132275]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:05:54+01:00 demo-felhom sudo[149156]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:20:54+01:00 demo-felhom sudo[166106]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:35:54+01:00 demo-felhom sudo[183009]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:50:54+01:00 demo-felhom sudo[199912]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:51:01+01:00 demo-felhom sudo[200244]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T21:51:15+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T21:51:15.415+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=3
2026-11-10T22:05:54+01:00 demo-felhom sudo[216811]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:20:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-10T22:20:50.434+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-03T04:35:12Z) is already proven; felhom
2026-11-10T22:20:54+01:00 demo-felhom sudo[233785]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:35:54+01:00 demo-felhom sudo[250624]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T22:50:54+01:00 demo-felhom sudo[267511]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:05:54+01:00 demo-felhom sudo[284411]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:20:54+01:00 demo-felhom sudo[301342]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:35:54+01:00 demo-felhom sudo[318204]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-10T23:50:54+01:00 demo-felhom sudo[335082]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:05:54+01:00 demo-felhom sudo[351965]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:20:54+01:00 demo-felhom sudo[368862]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:35:54+01:00 demo-felhom sudo[385722]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T00:50:54+01:00 demo-felhom sudo[402645]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:05:54+01:00 demo-felhom sudo[419499]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:20:54+01:00 demo-felhom sudo[436416]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:35:54+01:00 demo-felhom sudo[453352]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T01:50:54+01:00 demo-felhom sudo[470292]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:05:54+01:00 demo-felhom sudo[487150]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:20:54+01:00 demo-felhom sudo[504080]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:35:54+01:00 demo-felhom sudo[524004]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T02:50:54+01:00 demo-felhom sudo[541023]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:05:54+01:00 demo-felhom sudo[558023]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:20:54+01:00 demo-felhom sudo[575005]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:35:54+01:00 demo-felhom sudo[592593]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:50:54+01:00 demo-felhom sudo[609616]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:51:01+01:00 demo-felhom sudo[610005]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T03:51:15+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T03:51:15.426+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=3
2026-11-11T04:05:54+01:00 demo-felhom sudo[626547]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:20:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T04:20:50.416+01:00 level=INFO msg="backup: restore-test evaluated — nothing due" verdicts="felhom-pbs: newest settled archive (landed 2026-11-03T04:35:12Z) is already proven; felhom
2026-11-11T04:20:54+01:00 demo-felhom sudo[646613]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:35:54+01:00 demo-felhom sudo[663687]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T04:50:54+01:00 demo-felhom sudo[680674]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:05:54+01:00 demo-felhom sudo[697658]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:20:54+01:00 demo-felhom sudo[714656]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:35:54+01:00 demo-felhom sudo[731604]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T05:36:51+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:36:51.383+01:00 level=INFO msg="backup: space preflight passed" vmid=9201 target=felhom-backup last_archive_bytes=1299653068 need_bytes=2698308159 avail_bytes=925178314752
2026-11-11T05:36:52+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:36:52.425+01:00 level=INFO msg="local-api: backup reached snapshotted (app may resume)" vmid=9201 target=felhom-backup job=backup-9201-1794371810991152516
2026-11-11T05:37:37+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:37:37.562+01:00 level=INFO msg="backup: completed" vmid=9201 target=felhom-backup archive=felhom-backup:backup/vzdump-lxc-9201-2026_11_11-05_36_51.tar.zst size_bytes=1300036887 unc
2026-11-11T05:37:37+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:37:37.562+01:00 level=INFO msg="local-api: backup job complete" vmid=9201 target=felhom-backup job=backup-9201-1794371810991152516 archive=felhom-backup:backup/vzdump-lxc-9201-2026
2026-11-11T05:39:07+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:07.567+01:00 level=INFO msg="osupdate: START" run=20261111T043907Z layer=guest vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T043907Z
2026-11-11T05:39:21+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:21.549+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T043907Z layer=guest:9201 lane=fast mode=apply select=pending-fast packages=0"
2026-11-11T05:39:21+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:21.549+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T05:39:21+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:21.549+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T05:39:21+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:21.549+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T05:39:21+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:21.549+01:00 level=INFO msg="osupdate: DONE" run=20261111T043907Z layer=guest vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=0 not_cove
2026-11-11T05:39:21+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:21.617+01:00 level=INFO msg="osupdate: START" run=20261111T043907Z layer=host vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T043907Z
2026-11-11T05:39:32+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:32.620+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T043907Z layer=host lane=fast mode=apply select=pending-fast packages=0"
2026-11-11T05:39:32+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:32.620+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T05:39:32+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:32.620+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T05:39:32+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:32.620+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T05:39:33+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:33.444+01:00 level=INFO msg="osupdate: DONE" run=20261111T043907Z layer=host vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=15 not_cove
2026-11-11T05:39:35+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:35.096+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: LIVE-RESTORE already on"
2026-11-11T05:39:35+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:35.096+01:00 level=INFO msg="osupdate: live-restore" vmid=9201 result="{\"result\": \"already on\"}"
2026-11-11T05:39:35+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:35.096+01:00 level=INFO msg="osupdate: START" run=20261111T043907Z layer=docker vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T043907Z
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.910+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T043907Z layer=docker:9201 lane=slow mode=apply select=pending-docker packages=0 auth
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.910+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.910+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.910+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.910+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: OOM-CHECK result=fail oom_killed=False oom_event=False exit=137 image=gitea.dooplex.hu/admin/felhom-controller:0.
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.910+01:00 level=INFO msg="osupdate: DONE" run=20261111T043907Z layer=docker vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=0 not_cov
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.917+01:00 level=INFO msg="osupdate: pve step holds the /etc/pve write gate — the agent's own writes wait until it ends" run=20261111T043907Z layer=pve vmid=9201 trigger=nig
2026-11-11T05:39:57+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:39:57.917+01:00 level=INFO msg="osupdate: START" run=20261111T043907Z layer=pve vmid=9201 ring=0 trigger=night enabled=true release=ring0-20261111T043907Z
2026-11-11T05:40:09+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:09.469+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: START release=ring0-20261111T043907Z layer=pve:9201 lane=slow mode=apply select=pending-pve packages=0 authority=
2026-11-11T05:40:09+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:09.469+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: REPAIR configured=0 journal=0 fixed=0"
2026-11-11T05:40:09+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:09.469+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: PLAN upgrade=0 already=0 not-installed=0 from-snapshot=0"
2026-11-11T05:40:09+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:09.469+01:00 level=INFO msg="osupdate: wrapper" line="os-apply: DONE rc=0 seconds=0 upgraded=0 (nothing to do)"
2026-11-11T05:40:10+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:10.295+01:00 level=INFO msg="osupdate: DONE" run=20261111T043907Z layer=pve vmid=9201 ring=0 trigger=night outcome=nothing healthy=true reason="" upgraded=0 pending=1 not_covere
2026-11-11T05:40:10+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:10.301+01:00 level=INFO msg="osupdate: pve step released the /etc/pve write gate" run=20261111T043907Z layer=pve vmid=9201 trigger=night
2026-11-11T05:40:10+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T05:40:10.301+01:00 level=INFO msg="osupdate: kernel step skipped — the hub names no kernel step for this box" run=20261111T043907Z layer=kernel vmid=9201 trigger=night ring=0
2026-11-11T05:50:55+01:00 demo-felhom sudo[753077]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:05:54+01:00 demo-felhom sudo[770116]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:20:54+01:00 demo-felhom sudo[787124]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:35:54+01:00 demo-felhom sudo[804022]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T06:50:54+01:00 demo-felhom sudo[821020]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:05:54+01:00 demo-felhom sudo[837952]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:20:54+01:00 demo-felhom sudo[854940]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:35:54+01:00 demo-felhom sudo[871826]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T07:50:54+01:00 demo-felhom sudo[888788]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:05:54+01:00 demo-felhom sudo[905669]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:20:54+01:00 demo-felhom sudo[922546]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:35:54+01:00 demo-felhom sudo[939426]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T08:50:54+01:00 demo-felhom sudo[956204]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:05:54+01:00 demo-felhom sudo[973033]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:20:54+01:00 demo-felhom sudo[989961]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:35:54+01:00 demo-felhom sudo[1006771]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:50:54+01:00 demo-felhom sudo[1023597]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:51:01+01:00 demo-felhom sudo[1024025]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T09:51:11+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T09:51:11.409+01:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
2026-11-11T10:05:54+01:00 demo-felhom sudo[1040510]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:20:50+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T10:20:50.077+01:00 level=INFO msg="backup: restore-test tier is DUE (per-archive; oldest-proven first among due tiers)" target=felhom-pbs archive=felhom-pbs:backup/ct/9201/2026-11-10T
2026-11-11T10:20:51+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T10:20:51.359+01:00 level=INFO msg="restore-test: space preflight passed" storage=local-lvm required_bytes=9571729458 avail_bytes=363152785854
2026-11-11T10:20:51+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T10:20:51.385+01:00 level=INFO msg="restore-test: full-fidelity restore params derived from the archive config" scratch=990000 params=4
2026-11-11T10:20:54+01:00 demo-felhom sudo[1057518]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:22:20+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T10:22:20.013+01:00 level=INFO msg="restore-test: scratch guest torn down" vmid=990000
2026-11-11T10:22:20+01:00 demo-felhom felhom-agent[3985063]: time=2026-11-11T10:22:20.014+01:00 level=INFO msg="backup: scheduled restore-test passed" archive=felhom-pbs:backup/ct/9201/2026-11-10T04:39:26Z duration_s=89.933700579
2026-11-11T10:35:54+01:00 demo-felhom sudo[1075697]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage
2026-11-11T10:50:54+01:00 demo-felhom sudo[1092663]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-pbs-apply read felhom-pbs /etc/pve/priv/storage

=== agent log: line count per hour, last 26 h ===
  12376 2026-11-10T09   13173 2026-11-10T10   13176 2026-11-10T11   13191 2026-11-10T12   13181 2026-11-10T13   13166 2026-11-10T14   13300 2026-11-10T15   13246 2026-11-10T16   13200 2026-11-10T17   13190 2026-11-10T18   13190 2026-11-10T19   13181 2026-11-10T20   13196 2026-11-10T21   13184 2026-11-10T22   13156 2026-11-10T23   13189 2026-11-11T00   13192 2026-11-11T01   13168 2026-11-11T02   13284 2026-11-11T03   13175 2026-11-11T04   13292 2026-11-11T05   13183 2026-11-11T06   13186 2026-11-11T07   13195 2026-11-11T08   13199 2026-11-11T09   13207 2026-11-11T10     826 2026-11-11T11 
=== agent version ===
felhom-agent 0.173.0
RC=0
