admin
65493fc481
gates / gates (push) Successful in 6m45s
demo-hp 12:06:52 UTC, 1.53 GB written: at boot the dead task was judged dead, the partial and its .tmp removed by the root helper, the next backup finished (5.65 GB), host root back below its pre-cut use. Orphan thin device 4 repaired first (operator B2 - A); R-1012 P2 -> P3, detection stays open. Delivered by signed jobs to Tester 1 and the N100 (probe 71/71, real sudo checked). Controller 0.310.0 everywhere after the operator cleared the per-customer floors. Register 134 -> 134 (opened 4, closed 4). Report: REPORT-power-cut-fixes-2026-10-14.md. Both plugs ON. Claude-Session: https://claude.ai/code/session_012qRErfCoiTkvDK9N5XHbzb
24 lines
3.9 KiB
Plaintext
24 lines
3.9 KiB
Plaintext
Wed Oct 14 12:07:58 UTC 2026
|
|
Oct 14 14:07:42 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:42.197+02:00 level=INFO msg="felhom-agent daemon starting" version=0.156.1 host_id=demo-hp-bb76ea hub_url=https://hub.felhom.eu interval_s=900
|
|
Oct 14 14:07:43 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:43.150+02:00 level=INFO msg="storage: watchdog starting" interval=5s debounce=15s
|
|
Oct 14 14:07:43 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:43.150+02:00 level=INFO msg="backup: restore-test scheduler starting (per-archive due-check)" eval_interval=6h0m0s settle=24h0m0s
|
|
Oct 14 14:07:43 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:43.150+02:00 level=INFO msg="pbs: verify loop starting" cadence=6h0m0s
|
|
Oct 14 14:07:43 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:43.975+02:00 level=INFO msg="selfheal: node watchdog starting" mode=appliance interval_s=60
|
|
Oct 14 14:07:43 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:43.975+02:00 level=INFO msg="guestnet: watchdog starting" interval=1m0s min_heal_interval=10m0s max_heals_per_hour=3 settle=3m0s
|
|
Oct 14 14:07:43 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:43.998+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
|
|
Oct 14 14:07:44 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:44.008+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
|
|
Oct 14 14:07:44 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:44.017+02:00 level=WARN msg="backup-in-flight: a vzdump task is listed as active but its worker process is gone — it is dead, not running" vmid=9201 upid=UPID:demo-hp:000939B2:00125EED:6ACF7001:vzdump:9201:felhom-agent@pve!agent:
|
|
Oct 14 14:07:44 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:44.017+02:00 level=WARN msg="stale-lock: clearing a stale backup lock left by an interrupted backup" vmid=9201 lock=backup onboot=true status=stopped
|
|
Oct 14 14:07:44 demo-hp sudo[1522]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/sbin/pct unlock 9201
|
|
Oct 14 14:07:45 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:45.003+02:00 level=ERROR msg="stale-lock: pct unlock failed" vmid=9201 err="pct unlock: exit status 255: no lock found trying to remove any lock\n"
|
|
Oct 14 14:07:45 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:45.025+02:00 level=INFO msg="stale-lock: scanning pool guests" pool=felhom listed=1 scanned=1
|
|
Oct 14 14:07:45 demo-hp sudo[1704]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-vzdump-partial-clean local 9201 vzdump-lxc-9201-2026_10_14-14_05_21.tar.dat
|
|
Oct 14 14:07:48 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:48.565+02:00 level=WARN msg="vzdump-partial: removed a dead half-written backup" storage=local vmid=9201 name=vzdump-lxc-9201-2026_10_14-14_05_21.tar.dat bytes=964239360 why="written before this boot" helper="removed vzdump-lxc-9201-2026_10_14-14_05_21.tar.dat 964239360 B (written before this boot)"
|
|
Oct 14 14:07:48 demo-hp sudo[5221]: felhom-agent : PWD=/ ; USER=root ; COMMAND=/usr/local/sbin/felhom-vzdump-partial-clean local 9201 vzdump-lxc-9201-2026_10_14-14_05_21.tmp
|
|
Oct 14 14:07:52 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:52.457+02:00 level=WARN msg="vzdump-partial: removed a dead half-written backup" storage=local vmid=9201 name=vzdump-lxc-9201-2026_10_14-14_05_21.tmp bytes=4096 why="written before this boot" helper="removed vzdump-lxc-9201-2026_10_14-14_05_21.tmp 571 B (written before this boot)"
|
|
Oct 14 14:07:52 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:52.464+02:00 level=INFO msg="janitor: starting (restore-test scratch retry + stale-lock sweep)" interval=10m0s
|
|
Oct 14 14:07:52 demo-hp felhom-agent[1273]: time=2026-10-14T14:07:52.465+02:00 level=INFO msg="fstrim: weekly guest disk trim starting" schedule="weekly, due Wednesday from 10:00 host-local time; starts only 10:00-20:59; never beside a backup or restore-test"
|
|
---
|
|
/dev/mapper/pve-root 41424257024 24689217536 14597832704 63% /
|
|
status: running
|