162 lines
17 KiB
Plaintext
162 lines
17 KiB
Plaintext
2026/10/25 17:16:37 [INFO] local-api: channel up (agent 169.254.253.1:8443) — guest 9201, 3 mount(s) visible
|
|
2026/10/25 17:16:37 [INFO] local-api: mount mp0 → /var/lib/felhom (storage=local-lvm, class=, backup=true)
|
|
2026/10/25 17:16:37 [INFO] local-api: mount mp8 → /mnt/felhom-drives (storage=/mnt/felhom-drives, class=, backup=false)
|
|
2026/10/25 17:16:37 [INFO] local-api: mount mp9 → /etc/felhom-bootstrap (storage=/var/lib/felhom-agent/guests/9201/bootstrap, class=, backup=false)
|
|
2026/10/25 17:16:37 [INFO] felhom-controller 0.343.0 starting (customer: demo-felhom, domain: demo-felhom.eu)
|
|
2026/10/25 17:16:37 [INFO] [settings] Loaded settings from /opt/docker/felhom-controller/data/settings.json
|
|
2026/10/25 17:16:37 [INFO] Encryption key loaded from /opt/docker/felhom-controller/data/encryption.key
|
|
2026/10/25 17:16:37 [INFO] [stacks] Using compose command: docker compose
|
|
2026/10/25 17:16:37 [INFO] [stacks] ScanStacks complete: 68 stacks found (5 deployed, 63 available)
|
|
2026/10/25 17:16:37 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:16:37 [INFO] [stacks] InjectMissingFields: processed 5 stacks
|
|
2026/10/25 17:16:37 [INFO] [stacks] Encryption migration: no stacks needed migration
|
|
2026/10/25 17:16:37 [INFO] [quiesce] loop started (poll 5m0s, max-quiesce 30m0s)
|
|
2026/10/25 17:16:37 [INFO] [stacks] desired-state backfill: 0 app(s) recorded as running, 0 left unrecorded (state ambiguous — legacy boot behaviour retained)
|
|
2026/10/25 17:16:37 [INFO] [stacks] installed-images backfill: 0 app(s) recorded, 5 already had a record, 0 left unrecorded (could not be observed completely — unknown, which renders nothing)
|
|
2026/10/25 17:16:37 [INFO] [stacks] pin adoption: 0 pinned, 5 already pinned, 0 left unpinned (0 not completely observed, 0 running something the template no longer offers)
|
|
2026/10/25 17:16:37 [INFO] [stacks] applied-meta backfill (R-646): recorded 0 []; skipped 0 [] — not current with the catalog, their pinned version's .felhom.yml is no longer on the box
|
|
2026/10/25 17:16:37 [INFO] [sync] Starting catalog sync (repo: https://gitea.dooplex.hu/admin/app-catalog-felhom.eu.git, interval: 15m0s)
|
|
2026/10/25 17:16:37 [INFO] [sync] Starting catalog sync
|
|
2026/10/25 17:16:37 [INFO] Metrics store opened at /opt/docker/felhom-controller/data/metrics.db
|
|
2026/10/25 17:16:37 [INFO] Metrics collector started (60s interval)
|
|
2026/10/25 17:16:37 [INFO] [sync] Pulling latest from https://gitea.dooplex.hu/admin/app-catalog-felhom.eu.git (branch: main)
|
|
2026/10/25 17:16:37 [INFO] [tier2] start-up: no leftover second-drive copy container
|
|
2026/10/25 17:16:37 [INFO] [backup] restore record wired: /opt/docker/felhom-controller/data/restore-status.json (interrupted at startup: false)
|
|
2026/10/25 17:16:37 [INFO] [backup] app-data run record wired: /opt/docker/felhom-controller/data/appdata-run.json (an earlier cut still shown: false)
|
|
2026/10/25 17:16:37 [INFO] Notifier enabled (hub: https://hub.felhom.eu)
|
|
2026/10/25 17:16:37 [INFO] [upwatch] the host's weekly line test: 92.6 Mbit/s (measured 2026-10-24T08:02:45Z)
|
|
2026/10/25 17:16:37 [INFO] [upwatch] upload and CPU watch started (line 93 Mbit/s, qBittorrent share 50 %)
|
|
2026/10/25 17:16:37 [INFO] [selfupdate] Post-update startup: update successful (0.342.0 → 0.343.0)
|
|
2026/10/25 17:16:37 [INFO] Self-update enabled (check every 6h, auto-update: false, auto-update time: 04:30)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: status-refresh (every 10s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: stack-scan (every 2m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: docker-socket-watch (every 15s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: docker-socket-users (every 5m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: health-probes (every 10s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: system-health (every 5m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: after-unclean-boot (every 30s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: deadapp-check (every 30s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: ring-spill (every 30s)
|
|
2026/10/25 17:16:37 [INFO] [offsite-apply] settle-gate: awaiting floor knowledge (first report ACK) before offsite apply
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job db-dump scheduled for 2026-10-26 02:30 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: offsite-credential-retry (every 5m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: backup-cache (every 5m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: conversion-copy-release (every 1h0m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job tier2-backup scheduled for 2026-10-26 03:30 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job offbox-backup scheduled for 2026-10-26 04:15 CET
|
|
2026/10/25 17:16:37 [INFO] [catch-up] controller start: no backup leg missed its last scheduled time — nothing to make up
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job offsite-abandon-sweep scheduled for 2026-10-26 05:10 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job offsite-integrity scheduled for 2026-10-26 06:00 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job offsite-proof scheduled for 2026-10-26 05:30 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job metrics-prune scheduled for 2026-10-26 04:00 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Daily job fill-watch scheduled for 2026-10-26 03:30 CET
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: fill-watch-interval (every 10m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: hub-report (every 15m0s)
|
|
2026/10/25 17:16:37 [INFO] Hub reporting enabled (every 15m0s to https://hub.felhom.eu)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: selfupdate-check (every 6h0m0s)
|
|
2026/10/25 17:16:37 [INFO] ========== Startup Self-Test ==========
|
|
2026/10/25 17:16:37 [INFO] Event pushed: controller_updated (info) [hu-only] — Controller frissítve: 0.342.0 → 0.343.0
|
|
2026/10/25 17:16:37 [INFO] [PASS] Docker socket: reachable (v29.9.2)
|
|
2026/10/25 17:16:37 [INFO] [PASS] Stacks directory: /opt/docker/stacks
|
|
2026/10/25 17:16:37 [INFO] [PASS] Data directory: /opt/docker/felhom-controller/data (writable)
|
|
2026/10/25 17:16:37 [INFO] [PASS] System data path: /mnt/sys_drive
|
|
2026/10/25 17:16:37 [INFO] [PASS] Storage paths: 1 connected, 0 disconnected
|
|
2026/10/25 17:16:37 [INFO] [PASS] Git catalog: 65 app definitions found
|
|
2026/10/25 17:16:37 [INFO] [PASS] Hub connectivity: https://hub.felhom.eu reachable (HTTP 200)
|
|
2026/10/25 17:16:37 [INFO] [PASS] Metrics DB: 30.3 MB
|
|
2026/10/25 17:16:37 [INFO] ========================================
|
|
2026/10/25 17:16:37 [INFO] Self-test complete: 8 passed, 0 warnings, 0 failed
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Starting scheduler with 23 jobs
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: geo-verify (every 6h0m0s)
|
|
2026/10/25 17:16:37 [INFO] Geo-restriction support enabled (CF API token configured)
|
|
2026/10/25 17:16:37 [INFO] [report] hub wait channel active (hold ≤240s)
|
|
2026/10/25 17:16:37 [INFO] Notification preferences synced to hub: source=household status=ok email=doodoo21@freemail.hu, events=[app_stopped_unhealthy app_update_held app_update_undone backup_failed db_dump_failed disk_critical disk_warning expected_backup_missed expected_dbdump_missed health_critical node_down offbox_enlarge_blocked storage_disconnected], cooldown=6h, email_cleared=false
|
|
2026/10/25 17:16:37 [INFO] [backup] Found 0 DB dump files across drives
|
|
2026/10/25 17:16:37 [INFO] [infra] connected felhom-controller to traefik-public
|
|
2026/10/25 17:16:37 [INFO] [backup] Discovered 0 databases
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/opengist/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/prowlarr/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/radarr/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/sonarr/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/qbittorrent/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [backup] Discovered app data: 5 apps
|
|
2026/10/25 17:16:37 [INFO] [web] sessions: restored 1 dashboard session(s) from disk (dropped 0 expired, 0 malformed)
|
|
2026/10/25 17:16:37 [INFO] [web] Auth: using password from settings.json
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: disk-health-check (every 1h0m0s)
|
|
2026/10/25 17:16:37 [INFO] [scheduler] Registered periodic job: agent-channel-health (every 1m0s)
|
|
2026/10/25 17:16:37 [INFO] Web UI listening on :8080
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/radarr/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/sonarr/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/qbittorrent/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/grimmory/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/immich/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/nextcloud/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 2 HDD mounts for /opt/docker/stacks/paperless-ngx/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/romm/docker-compose.yml
|
|
2026/10/25 17:16:37 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/opengist — 2 env vars, 0 encrypted, 0 sensitive fields
|
|
2026/10/25 17:16:37 [INFO] [stacks] SaveAppConfig: saved config for opengist
|
|
2026/10/25 17:16:37 [INFO] [stacks] opengist: install id 75d74fb92a0d5fcd recorded (an app installed before D47)
|
|
2026/10/25 17:16:37 [INFO] [backup] Recovery unit captured for opengist → /mnt/sys_drive/felhom-data/backups/primary/opengist (images=1, secrets-referenced=0, data_keys=0, portable-carried=0/0, withheld=0)
|
|
2026/10/25 17:16:37 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/prowlarr — 2 env vars, 0 encrypted, 0 sensitive fields
|
|
2026/10/25 17:16:37 [INFO] [stacks] SaveAppConfig: saved config for prowlarr
|
|
2026/10/25 17:16:37 [INFO] [stacks] prowlarr: install id 4a473060b914b0e2 recorded (an app installed before D47)
|
|
2026/10/25 17:16:37 [INFO] [backup] Recovery unit captured for prowlarr → /mnt/sys_drive/felhom-data/backups/primary/prowlarr (images=1, secrets-referenced=0, data_keys=0, portable-carried=0/0, withheld=0)
|
|
2026/10/25 17:16:37 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/radarr — 3 env vars, 0 encrypted, 0 sensitive fields
|
|
2026/10/25 17:16:37 [INFO] [stacks] SaveAppConfig: saved config for radarr
|
|
2026/10/25 17:16:37 [INFO] [stacks] radarr: install id 55bfad619c700564 recorded (an app installed before D47)
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/grimmory/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/immich/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/nextcloud/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 2 HDD mounts for /opt/docker/stacks/paperless-ngx/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/romm/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/grimmory/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/immich/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/nextcloud/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 2 HDD mounts for /opt/docker/stacks/paperless-ngx/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/romm/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/grimmory/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/immich/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/nextcloud/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 2 HDD mounts for /opt/docker/stacks/paperless-ngx/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/romm/docker-compose.yml
|
|
2026/10/25 17:16:37 [INFO] [backup] Recovery unit captured for radarr → /mnt/felhom-drives/hdd_1/backups/primary/radarr (images=1, secrets-referenced=0, data_keys=0, portable-carried=0/0, withheld=0)
|
|
2026/10/25 17:16:37 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/sonarr — 3 env vars, 0 encrypted, 0 sensitive fields
|
|
2026/10/25 17:16:37 [INFO] [stacks] SaveAppConfig: saved config for sonarr
|
|
2026/10/25 17:16:37 [INFO] [stacks] sonarr: install id c0df4f095aa926d7 recorded (an app installed before D47)
|
|
2026/10/25 17:16:37 [INFO] [backup] Recovery unit captured for sonarr → /mnt/felhom-drives/hdd_1/backups/primary/sonarr (images=1, secrets-referenced=0, data_keys=0, portable-carried=0/0, withheld=0)
|
|
2026/10/25 17:16:37 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/qbittorrent — 4 env vars, 0 encrypted, 1 sensitive fields
|
|
2026/10/25 17:16:37 [INFO] [stacks] SaveAppConfig: saved config for qbittorrent
|
|
2026/10/25 17:16:37 [INFO] [stacks] qbittorrent: install id f82c26e291976a7f recorded (an app installed before D47)
|
|
2026/10/25 17:16:37 [INFO] [sync] Catalog sync complete
|
|
2026/10/25 17:16:37 [INFO] [sync] Initial sync: Sablonok naprakészek — nincs változás
|
|
2026/10/25 17:16:37 [INFO] [infra] connected felhom-controller to felhom-filebrowser (the FileBrowser default-login check, R-1126)
|
|
2026/10/25 17:16:37 [INFO] [backup] Recovery unit captured for qbittorrent → /mnt/felhom-drives/hdd_1/backups/primary/qbittorrent (images=1, secrets-referenced=1, data_keys=0, portable-carried=0/0, withheld=1)
|
|
2026/10/25 17:16:37 [INFO] [backup] Backup status cache refreshed
|
|
2026/10/25 17:16:37 [INFO] [web] FileBrowser sync — no config/compose change, ensured running without recreate (1 storage path(s))
|
|
2026/10/25 17:16:37 [INFO] [monitor] Health check: status=ok
|
|
2026/10/25 17:16:42 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:16:42 [INFO] [report] Building system report
|
|
2026/10/25 17:16:42 [INFO] Event pushed: controller_started (info) [hu-only] — Controller elindult (0.343.0)
|
|
2026/10/25 17:16:43 [INFO] [monitor] Health check: status=ok
|
|
2026/10/25 17:16:43 [INFO] [report] Hub report pushed successfully (5496 bytes)
|
|
2026/10/25 17:16:43 [INFO] [settings] Settings saved
|
|
2026/10/25 17:16:43 [INFO] Startup hub report sent
|
|
2026/10/25 17:16:47 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:16:47 [INFO] [offsite-apply] settle-gate: GO — at/above floor 0.343.0 (we are 0.343.0), no managed update running
|
|
2026/10/25 17:16:47 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:16:47 [INFO] Health probes: 5 ok (of 5 probed)
|
|
2026/10/25 17:16:52 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:16:52 [INFO] [bootrecon] boot window: fleet settled after 10s (3 identical samples 5s apart) — sweeping
|
|
2026/10/25 17:16:52 [INFO] [bootrecon] Boot reconciliation: no boot-orphaned apps (nothing to start)
|
|
2026/10/25 17:16:57 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:17:07 [INFO] [deadapp] boot grace 1m30s: the host's last boot was clean (R-856)
|
|
2026/10/25 17:17:07 [INFO] [aftercrash] a normal (or unknown) boot — no app repair after an unclean boot (R-1007)
|
|
2026/10/25 17:17:07 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:17:08 [INFO] [selfupdate] Current version 0.343.0 is up to date
|
|
2026/10/25 17:17:17 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:17:27 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:17:37 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|
|
2026/10/25 17:17:37 [INFO] [scheduler] Running job: agent-channel-health
|
|
2026/10/25 17:17:38 [INFO] [scheduler] Job agent-channel-health completed (took 859ms)
|
|
2026/10/25 17:17:47 [INFO] [stacks] Status refresh: 8 containers across 68 stacks
|