Sep 24 10:29:29 demo-hp felhom-agent[1195783]: time=2026-09-24T10:29:29.327+02:00 level=INFO msg="backup: restore-test tier is DUE (per-archive; oldest-proven first among due tiers)" target=local archive=local:backup/vzdump-lxc-9201-2026_09_23-06_55_25.tar.zst landed=2026-09-23T04:55:25Z reason="newest settled archive (landed 2026-09-23T04:55:25Z) has not been proven (last proven archive was a dif
Sep 24 10:29:29 demo-hp felhom-agent[1195783]: time=2026-09-24T10:29:29.525+02:00 level=INFO msg="restore-test: full-fidelity restore params derived from the archive config" scratch=990000 params=4
Sep 24 10:29:29 demo-hp felhom-agent[1195783]: time=2026-09-24T10:29:29.971+02:00 level=INFO msg="guest-power: watchdog alive" sweeps_since_boot=10080 guests_evaluated=1 currently_stopped=0
Sep 24 10:29:31 demo-hp felhom-agent[1195783]: time=2026-09-24T10:29:31.070+02:00 level=INFO msg="controller-supervisor: alive" sweeps_since_boot=20160 guests_evaluated=1 controllers_not_running=0
Sep 24 10:30:29 demo-hp felhom-agent[1195783]: time=2026-09-24T10:30:29.383+02:00 level=INFO msg="pbs: verify cycle complete" datastore=felhom-offsite snapshots=2
Sep 24 10:33:10 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:10.974+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.858999999990042
Sep 24 10:33:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:24.908+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.876699999982906
Sep 24 10:33:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:26.605+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.878899999996376
Sep 24 10:33:27 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:27.899+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.879699999993417
Sep 24 10:33:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:30.409+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.881699999994661
Sep 24 10:33:50 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:50.628+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.907699999993555
Sep 24 10:33:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:56.628+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.916999999991563
Sep 24 10:33:57 demo-hp felhom-agent[1195783]: time=2026-09-24T10:33:57.440+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.917099999997676
Sep 24 10:34:10 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:10.700+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.932999999984233
Sep 24 10:34:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:24.654+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.944199999994661
Sep 24 10:34:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:26.225+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.945099999997815
Sep 24 10:34:27 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:27.723+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.947399999982823
Sep 24 10:34:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:30.294+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.950199999998396
Sep 24 10:34:50 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:50.502+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.980399999994717
Sep 24 10:34:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:56.464+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.987099999989378
Sep 24 10:34:57 demo-hp felhom-agent[1195783]: time=2026-09-24T10:34:57.258+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.987199999995491
Sep 24 10:35:10 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:10.359+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=0.998499999994744
Sep 24 10:35:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:24.658+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:35:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:26.161+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:35:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:26.913+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:35:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:30.317+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:35:50 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:50.259+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:35:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:56.170+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:35:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:35:56.889+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:10 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:10.275+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:24.693+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:26.184+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:27 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:27.382+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:28 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:28.266+02:00 level=INFO msg="audit: gate decision" class=guest_destroy host=demo-hp-bb76ea guest=990000 source=one_shot_job disposition=benign allowed=true reason=benign key_id="" nonce="" durable_id=""
Sep 24 10:36:28 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:28.266+02:00 level=INFO msg="gate decision" class=guest_destroy guest=990000 source=one_shot_job disposition=benign allowed=true reason=benign
Sep 24 10:36:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:30.302+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:30.330+02:00 level=ERROR msg="restore-test: scratch teardown task failed; left for Recover" vmid=990000 err="proxmox: task UPID:demo-hp:00278B87:115B3CEB:6AB4E10C:vzdestroy:990000:felhom-agent@pve!agent: failed: exitstatus \"lvremove 'pve/vm-990000-disk-0' error:   Logical volume pve/vm-990000-disk-0 contains a filesystem in use.
Sep 24 10:36:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:30.331+02:00 level=ERROR msg="backup: scheduled restore-test FAILED" archive=local:backup/vzdump-lxc-9201-2026_09_23-06_55_25.tar.zst err="reconcile: restore-test start task: proxmox: task UPID:demo-hp:002789C4:115B3A8C:6AB4E106:vzstart:990000:felhom-agent@pve!agent: failed: exitstatus \"startup for container '990000' failed\""
Sep 24 10:36:50 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:50.263+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:56.161+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:36:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:36:56.876+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:10 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:10.318+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:24.498+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:24.682+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:25 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:25.123+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:25 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:25.852+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:26.224+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:26.604+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:27 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:27.036+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:30.315+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:50 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:50.292+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:56.164+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:37:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:37:56.955+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:10 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:10.316+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:24 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:24.666+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:26.198+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:26 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:26.951+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:30 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:30.283+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:50 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:50.302+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1
Sep 24 10:38:56 demo-hp felhom-agent[1195783]: time=2026-09-24T10:38:56.175+02:00 level=WARN msg="storage: lvmthin pool data fill is high (a full pool corrupts every guest on it)" storage=local-lvm data_used_fraction=1

== UPID:demo-hp:00273369:115A998B:6AB4DF6A:vzrestore:990000:felhom-agent@pve!agent:
Filesystem UUID: c934b758-ba9f-4713-a1a5-2d1232043953
Superblock backups stored on blocks: 
	32768, 98304, 163840, 229376
restoring 'local:backup/vzdump-lxc-9201-2026_09_23-06_55_25.tar.zst' now..
extracting archive '/var/lib/vz/dump/vzdump-lxc-9201-2026_09_23-06_55_25.tar.zst'
Total bytes read: 22607360000 (22GiB, 67MiB/s)
merging backed-up and given configuration..
TASK OK
== UPID:demo-hp:002789C4:115B3A8C:6AB4E106:vzstart:990000:felhom-agent@pve!agent:
run_buffer: 569 Script exited with status 32
lxc_init: 1037 Failed to run lxc.hook.pre-start for container "990000"
__lxc_start: 2208 Failed to initialize container "990000"
TASK ERROR: startup for container '990000' failed
== UPID:demo-hp:00278B87:115B3CEB:6AB4E10C:vzdestroy:990000:felhom-agent@pve!agent:
TASK ERROR: lvremove 'pve/vm-990000-disk-0' error:   Logical volume pve/vm-990000-disk-0 contains a filesystem in use.
== dmsetup open counts
Name                    Maj Min Stat Open Targ Event  UUID                                                                      
pve-vm--990000--disk--0 252   8 L--w    0    1      0 LVM-zVqGDaV6jsHB26RyZrd0ftfUB3blL75R3RYWI304wBL9CEdu1E10ZdglPW0HuVJh      
pve-vm--990000--disk--1 252   9 L--w    0    1      0 LVM-zVqGDaV6jsHB26RyZrd0ftfUB3blL75RXHMjzdCWlzJJB21MBWeU8M2L9365Wh3i      
pve-vm--990000--disk--2 252  10 L--w    0    1      0 LVM-zVqGDaV6jsHB26RyZrd0ftfUB3blL75R4vCRapMR1JPlXcbl9PAQnNETfYQEVTrQ      
pve-vm--990000--disk--3 252  11 L--w    0    1      0 LVM-zVqGDaV6jsHB26RyZrd0ftfUB3blL75RjyxMj93W5cBuZZDWPKZVS7RDOHYlk1B9      
== mountinfo holders
== fuser
