0b63574293
gates / gates (push) Successful in 20s
Three more kills 20 minutes apart: recovered in 61 s / 41 s / 61 s, and none of them accumulated, because the window is 15 minutes. Four restarts, zero pauses. So the brake catches a FAST crash loop and is blind to a SLOW one — a controller dying every 20 minutes is restarted forever, and the only trace is an info event that mails nobody. Measured, not changed: the options are written into R-531 for the operator to rule on. Machine layer torn down: VM 334 purged with its disks, demo-hp's own containers 9201 and 9202 untouched. Evidence copied off the box first, token-leak control 0. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
92 lines
7.9 KiB
Plaintext
92 lines
7.9 KiB
Plaintext
2026/09/16 11:56:08 [INFO] local-api: channel up (agent 169.254.253.1:8443) — guest 9201, 3 mount(s) visible
|
|
2026/09/16 11:56:08 [INFO] local-api: mount mp8 → /mnt/felhom-drives (storage=/mnt/felhom-drives, class=, backup=false)
|
|
2026/09/16 11:56:08 [INFO] local-api: mount mp9 → /etc/felhom-bootstrap (storage=/var/lib/felhom-agent/guests/9201/bootstrap, class=, backup=false)
|
|
2026/09/16 11:56:08 [INFO] local-api: mount mp0 → /var/lib/felhom (storage=local-lvm, class=, backup=true)
|
|
2026/09/16 11:56:08 [INFO] felhom-controller 0.243.0 starting (customer: tester-1, domain: enkicsifelhom.hu)
|
|
2026/09/16 11:56:08 [INFO] [settings] Loaded settings from /opt/docker/felhom-controller/data/settings.json
|
|
2026/09/16 11:56:08 [INFO] Encryption key loaded from /opt/docker/felhom-controller/data/encryption.key
|
|
2026/09/16 11:56:08 [INFO] [stacks] Using compose command: docker compose
|
|
2026/09/16 11:56:08 [INFO] [stacks] ScanStacks complete: 56 stacks found (4 deployed, 52 available)
|
|
2026/09/16 11:56:08 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:08 [INFO] [stacks] InjectMissingFields: processed 4 stacks
|
|
2026/09/16 11:56:08 [INFO] [stacks] Encryption migration: no stacks needed migration
|
|
2026/09/16 11:56:08 [INFO] [stacks] desired-state backfill: 0 app(s) recorded as running, 0 left unrecorded (state ambiguous — legacy boot behaviour retained)
|
|
2026/09/16 11:56:08 [INFO] [quiesce] loop started (poll 5m0s, max-quiesce 30m0s)
|
|
2026/09/16 11:56:08 [INFO] [stacks] installed-images backfill: 0 app(s) recorded, 4 already had a record, 0 left unrecorded (could not be observed completely — unknown, which renders nothing)
|
|
2026/09/16 11:56:08 [INFO] [stacks] pin adoption: 0 pinned, 4 already pinned, 0 left unpinned (0 not completely observed, 0 running something the template no longer offers)
|
|
2026/09/16 11:56:08 [INFO] [sync] Starting catalog sync (repo: https://gitea.dooplex.hu/admin/app-catalog-felhom.eu.git, interval: 15m0s)
|
|
2026/09/16 11:56:08 [INFO] [sync] Starting catalog sync
|
|
2026/09/16 11:56:08 [INFO] [sync] Pulling latest from https://gitea.dooplex.hu/admin/app-catalog-felhom.eu.git (branch: main)
|
|
2026/09/16 11:56:08 [INFO] Metrics store opened at /opt/docker/felhom-controller/data/metrics.db
|
|
2026/09/16 11:56:08 [INFO] Metrics collector started (60s interval)
|
|
2026/09/16 11:56:08 [INFO] Notifier enabled (hub: https://hub.felhom.eu)
|
|
2026/09/16 11:56:08 [INFO] Self-update enabled (check every 6h, auto-update: false, auto-update time: 04:30)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: status-refresh (every 10s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: stack-scan (every 2m0s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: health-probes (every 10s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: system-health (every 5m0s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: deadapp-check (every 30s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: ring-spill (every 30s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job db-dump scheduled for 2026-09-17 02:30 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: offsite-credential-retry (every 5m0s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: backup-cache (every 5m0s)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job tier2-backup scheduled for 2026-09-17 03:30 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job offbox-backup scheduled for 2026-09-17 04:15 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job offsite-abandon-sweep scheduled for 2026-09-17 05:10 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job offsite-integrity scheduled for 2026-09-17 06:00 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job offsite-proof scheduled for 2026-09-17 05:30 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job metrics-prune scheduled for 2026-09-17 04:00 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Daily job fill-watch scheduled for 2026-09-17 03:30 CEST
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: hub-report (every 15m0s)
|
|
2026/09/16 11:56:08 [INFO] Hub reporting enabled (every 15m0s to https://hub.felhom.eu)
|
|
2026/09/16 11:56:08 [INFO] [scheduler] Registered periodic job: selfupdate-check (every 6h0m0s)
|
|
2026/09/16 11:56:08 [INFO] ========== Startup Self-Test ==========
|
|
2026/09/16 11:56:08 [INFO] [PASS] Docker socket: reachable (v29.8.1)
|
|
2026/09/16 11:56:08 [INFO] [PASS] Stacks directory: /opt/docker/stacks
|
|
2026/09/16 11:56:08 [INFO] [PASS] Data directory: /opt/docker/felhom-controller/data (writable)
|
|
2026/09/16 11:56:08 [INFO] [PASS] System data path: /mnt/sys_drive
|
|
2026/09/16 11:56:08 [INFO] [PASS] Storage paths: 1 connected, 0 disconnected
|
|
2026/09/16 11:56:08 [INFO] [PASS] Git catalog: 53 app definitions found
|
|
2026/09/16 11:56:09 [INFO] [PASS] Hub connectivity: https://hub.felhom.eu reachable (HTTP 200)
|
|
2026/09/16 11:56:09 [INFO] [PASS] Metrics DB: 0.0 MB
|
|
2026/09/16 11:56:09 [INFO] ========================================
|
|
2026/09/16 11:56:09 [INFO] Self-test complete: 8 passed, 0 warnings, 0 failed
|
|
2026/09/16 11:56:09 [INFO] [scheduler] Starting scheduler with 18 jobs
|
|
2026/09/16 11:56:09 [INFO] [scheduler] Registered periodic job: geo-verify (every 6h0m0s)
|
|
2026/09/16 11:56:09 [INFO] Geo-restriction support enabled (CF API token configured)
|
|
2026/09/16 11:56:09 [INFO] [report] hub wait channel active (hold ≤240s)
|
|
2026/09/16 11:56:09 [INFO] [backup] Found 2 DB dump files across drives
|
|
2026/09/16 11:56:09 [INFO] [web] Auth: using password from settings.json
|
|
2026/09/16 11:56:09 [INFO] [scheduler] Registered periodic job: disk-health-check (every 1h0m0s)
|
|
2026/09/16 11:56:09 [INFO] [scheduler] Registered periodic job: agent-channel-health (every 1m0s)
|
|
2026/09/16 11:56:09 [INFO] Web UI listening on :8080
|
|
2026/09/16 11:56:09 [INFO] [infra] connected felhom-controller to traefik-public
|
|
2026/09/16 11:56:09 [INFO] [sync] Catalog sync complete
|
|
2026/09/16 11:56:09 [INFO] [sync] Initial sync: Sablonok naprakészek — nincs változás
|
|
2026/09/16 11:56:09 [INFO] [backup] Discovered 2 databases
|
|
2026/09/16 11:56:09 [INFO] [backup] Backup status cache refreshed
|
|
2026/09/16 11:56:09 [INFO] [web] FileBrowser sync — no config/compose change, ensured running without recreate (1 storage path(s))
|
|
2026/09/16 11:56:09 [INFO] [monitor] Health check: status=ok
|
|
2026/09/16 11:56:13 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:14 [INFO] [report] Building system report
|
|
2026/09/16 11:56:14 [INFO] Event pushed: controller_started (info) — Controller elindult (0.243.0)
|
|
2026/09/16 11:56:14 [INFO] [monitor] Health check: status=ok
|
|
2026/09/16 11:56:14 [INFO] [report] Hub report pushed successfully (4703 bytes)
|
|
2026/09/16 11:56:14 [INFO] [settings] Settings saved
|
|
2026/09/16 11:56:14 [INFO] Startup hub report sent
|
|
2026/09/16 11:56:18 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:19 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:19 [INFO] Health probes: 3 ok (of 3 probed)
|
|
2026/09/16 11:56:23 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:23 [INFO] [bootrecon] boot window: fleet settled after 10s (3 identical samples 5s apart) — sweeping
|
|
2026/09/16 11:56:23 [INFO] [bootrecon] Boot reconciliation: no boot-orphaned apps (nothing to start)
|
|
2026/09/16 11:56:29 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:39 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:39 [INFO] [selfupdate] Current version 0.243.0 is up to date
|
|
2026/09/16 11:56:49 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:56:59 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:57:09 [INFO] [scheduler] Running job: agent-channel-health
|
|
2026/09/16 11:57:09 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|
|
2026/09/16 11:57:09 [INFO] [scheduler] Job agent-channel-health completed (took 192ms)
|
|
2026/09/16 11:57:19 [INFO] [stacks] Status refresh: 11 containers across 56 stacks
|