Files
felhom.eu/documentation/audits/evidence-bignight-2026-09-14/phase5/F2/controller.log
T

290 lines
26 KiB
Plaintext

2026/09/14 19:42:48 [INFO] local-api: channel up (agent 169.254.253.1:8443) — guest 9201, 3 mount(s) visible
2026/09/14 19:42:48 [INFO] local-api: mount mp8 → /mnt/felhom-drives (storage=/mnt/felhom-drives, class=, backup=false)
2026/09/14 19:42:48 [INFO] local-api: mount mp9 → /etc/felhom-bootstrap (storage=/var/lib/felhom-agent/guests/9201/bootstrap, class=, backup=false)
2026/09/14 19:42:48 [INFO] local-api: mount mp0 → /var/lib/felhom (storage=local-lvm, class=, backup=true)
2026/09/14 19:42:48 [INFO] felhom-controller 0.242.0 starting (customer: tester-1, domain: enkicsifelhom.hu)
2026/09/14 19:42:48 [INFO] [settings] Loaded settings from /opt/docker/felhom-controller/data/settings.json
2026/09/14 19:42:48 [INFO] Encryption key loaded from /opt/docker/felhom-controller/data/encryption.key
2026/09/14 19:42:48 [INFO] [stacks] Using compose command: docker compose
2026/09/14 19:42:48 [INFO] [stacks] ScanStacks complete: 57 stacks found (12 deployed, 45 available)
2026/09/14 19:42:48 [INFO] [stacks] Status refresh: 27 containers across 57 stacks
2026/09/14 19:42:48 [INFO] [stacks] InjectMissingFields: processed 12 stacks
2026/09/14 19:42:48 [INFO] [stacks] Encryption migration: no stacks needed migration
2026/09/14 19:42:48 [WARN] [appstop] crash recovery: an app-data backup (volume dump) (op "volume-dump:adventurelog") was interrupted and left 1 app(s) stopped — restarting them: [adventurelog]
2026/09/14 19:42:48 [INFO] [stacks] Starting stack: adventurelog
2026/09/14 19:42:48 [INFO] [quiesce] loop started (poll 5m0s, max-quiesce 30m0s)
2026/09/14 19:42:49 [INFO] [infra] connected felhom-controller to traefik-public
2026/09/14 19:42:52 [INFO] [stacks] Stack adventurelog started successfully (took 3.3s)
2026/09/14 19:42:52 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:42:52 [INFO] [appstop] crash recovery: restarted adventurelog after the interrupted an app-data backup (volume dump)
2026/09/14 19:42:52 [INFO] [stacks] desired-state backfill: 0 app(s) recorded as running, 0 left unrecorded (state ambiguous — legacy boot behaviour retained)
2026/09/14 19:42:52 [INFO] [stacks] installed-images backfill: 0 app(s) recorded, 12 already had a record, 0 left unrecorded (could not be observed completely — unknown, which renders nothing)
2026/09/14 19:42:52 [INFO] [stacks] pin adoption: 0 pinned, 12 already pinned, 0 left unpinned (0 not completely observed, 0 running something the template no longer offers)
2026/09/14 19:42:52 [INFO] [sync] Starting catalog sync (repo: https://gitea.dooplex.hu/admin/app-catalog-felhom.eu.git, interval: 15m0s)
2026/09/14 19:42:52 [INFO] [sync] Starting catalog sync
2026/09/14 19:42:52 [INFO] [sync] Pulling latest from https://gitea.dooplex.hu/admin/app-catalog-felhom.eu.git (branch: main)
2026/09/14 19:42:52 [INFO] Metrics store opened at /opt/docker/felhom-controller/data/metrics.db
2026/09/14 19:42:52 [INFO] Metrics collector started (60s interval)
2026/09/14 19:42:52 [INFO] Notifier enabled (hub: https://hub.felhom.eu)
2026/09/14 19:42:52 [INFO] Self-update enabled (check every 6h, auto-update: false, auto-update time: 04:30)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: status-refresh (every 10s)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: stack-scan (every 2m0s)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: health-probes (every 10s)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: system-health (every 5m0s)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: deadapp-check (every 30s)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: ring-spill (every 30s)
2026/09/14 19:42:52 [INFO] [scheduler] Daily job db-dump scheduled for 2026-09-15 02:30 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: offsite-credential-retry (every 5m0s)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: backup-cache (every 5m0s)
2026/09/14 19:42:52 [INFO] [scheduler] Daily job tier2-backup scheduled for 2026-09-15 03:30 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Daily job offbox-backup scheduled for 2026-09-15 04:15 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Daily job offsite-abandon-sweep scheduled for 2026-09-15 05:10 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Daily job offsite-integrity scheduled for 2026-09-15 06:00 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Daily job offsite-proof scheduled for 2026-09-15 05:30 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Daily job metrics-prune scheduled for 2026-09-15 04:00 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Daily job fill-watch scheduled for 2026-09-15 03:30 CEST
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: hub-report (every 15m0s)
2026/09/14 19:42:52 [INFO] Hub reporting enabled (every 15m0s to https://hub.felhom.eu)
2026/09/14 19:42:52 [INFO] [scheduler] Registered periodic job: selfupdate-check (every 6h0m0s)
2026/09/14 19:42:52 [INFO] ========== Startup Self-Test ==========
2026/09/14 19:42:53 [INFO] [PASS] Docker socket: reachable (v29.8.0)
2026/09/14 19:42:53 [INFO] [PASS] Stacks directory: /opt/docker/stacks
2026/09/14 19:42:53 [INFO] [PASS] Data directory: /opt/docker/felhom-controller/data (writable)
2026/09/14 19:42:53 [INFO] [PASS] System data path: /mnt/sys_drive
2026/09/14 19:42:53 [INFO] [PASS] Storage paths: 1 connected, 0 disconnected
2026/09/14 19:42:53 [INFO] [PASS] Git catalog: 53 app definitions found
2026/09/14 19:42:53 [INFO] [PASS] Hub connectivity: https://hub.felhom.eu reachable (HTTP 200)
2026/09/14 19:42:53 [INFO] [PASS] Metrics DB: 0.2 MB
2026/09/14 19:42:53 [INFO] ========================================
2026/09/14 19:42:53 [INFO] Self-test complete: 8 passed, 0 warnings, 0 failed
2026/09/14 19:42:53 [INFO] [scheduler] Starting scheduler with 18 jobs
2026/09/14 19:42:53 [INFO] [scheduler] Registered periodic job: geo-verify (every 6h0m0s)
2026/09/14 19:42:53 [INFO] Geo-restriction support enabled (CF API token configured)
2026/09/14 19:42:53 [INFO] Event pushed: backup_failed (error) — an app-data backup (volume dump) was interrupted by a controller restart — 1 app(s) were left stopped and have been restarted
2026/09/14 19:42:53 [INFO] [report] hub wait channel active (hold ≤240s)
2026/09/14 19:42:53 [INFO] [web] Auth: using password from settings.json
2026/09/14 19:42:53 [INFO] [scheduler] Registered periodic job: disk-health-check (every 1h0m0s)
2026/09/14 19:42:53 [INFO] [scheduler] Registered periodic job: agent-channel-health (every 1m0s)
2026/09/14 19:42:53 [INFO] Web UI listening on :8080
2026/09/14 19:42:54 [INFO] [gate] boot 1789414856-10033: waiting (≤2m0s) for live drive bind(s) [/mnt/felhom-drives/hdd_1] before recreating drive-backed apps
2026/09/14 19:42:54 [INFO] [gate] boot 1789414856-10033: live bind confirmed — recreating drive-backed app immich (state=starting) onto /mnt/felhom-drives/hdd_1
2026/09/14 19:42:54 [INFO] [stacks] Stopping stack: immich
2026/09/14 19:42:55 [INFO] [web] FileBrowser sync — no config/compose change, ensured running without recreate (1 storage path(s))
2026/09/14 19:42:55 [WARN] [api] Unauthorized request to /api/stacks/bookstack from 172.18.0.11:46646
2026/09/14 19:42:56 [INFO] [sync] Catalog sync complete
2026/09/14 19:42:56 [INFO] [sync] Initial sync: Sablonok naprakészek — nincs változás
2026/09/14 19:42:56 [INFO] [monitor] Health check: status=ok
2026/09/14 19:42:57 [INFO] [web] Login from 172.18.0.11:46646
2026/09/14 19:42:57 [INFO] [stacks] Stack adventurelog post-start status:
2026/09/14 19:42:57 [INFO] [stacks] adventurelog ghcr.io/seanmorley15/adventurelog-backend:v0.12.1 running Up 5 seconds (health: starting)
2026/09/14 19:42:57 [INFO] [stacks] adventurelog-frontend ghcr.io/seanmorley15/adventurelog-frontend:v0.12.1 running Up 7 seconds (healthy)
2026/09/14 19:42:57 [INFO] [stacks] adventurelog-postgres postgis/postgis:16-3.5-alpine running Up 13 seconds (healthy)
2026/09/14 19:42:57 [INFO] [stacks] Stack immich stopped successfully (took 3.3s)
2026/09/14 19:42:57 [INFO] [stacks] Status refresh: 24 containers across 57 stacks
2026/09/14 19:42:57 [INFO] [stacks] Starting stack: immich
2026/09/14 19:42:57 [INFO] [stacks] Status refresh: 24 containers across 57 stacks
2026/09/14 19:42:57 [INFO] [settings] Settings saved
2026/09/14 19:42:57 [INFO] [backup] Found 6 DB dump files across drives
2026/09/14 19:42:58 [INFO] [backup] Discovered 5 databases
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/adventurelog/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/bookstack/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/docmost/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/gokapi/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/immich/docker-compose.yml
2026/09/14 19:42:58 [INFO] [report] Building system report
2026/09/14 19:42:58 [INFO] Event pushed: controller_started (info) — Controller elindult (0.242.0)
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/jellyfin/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/mealie/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/nextcloud/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 2 HDD mounts for /opt/docker/stacks/paperless-ngx/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/privatebin/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/uptime-kuma/docker-compose.yml
2026/09/14 19:42:58 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/vaultwarden/docker-compose.yml
2026/09/14 19:42:58 [INFO] [backup] Discovered app data: 12 apps
2026/09/14 19:42:59 [INFO] [backup] Backup status cache refreshed
2026/09/14 19:42:59 [INFO] [monitor] Health check: status=ok
2026/09/14 19:43:00 [INFO] [report] Hub report pushed successfully (26604 bytes)
2026/09/14 19:43:00 [INFO] [settings] Settings saved
2026/09/14 19:43:00 [INFO] Startup hub report sent
2026/09/14 19:43:02 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:03 [WARN] Health probe jellyfin: API GET :8096/health → Get "http://jellyfin:8096/health": dial tcp 172.18.0.13:8096: connect: connection refused
2026/09/14 19:43:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:03 [WARN] Health probes: 4 ok, 1 unhealthy (of 5 probed)
2026/09/14 19:43:08 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:10 [INFO] [stacks] Stack immich started successfully (took 12.6s)
2026/09/14 19:43:10 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:10 [INFO] [gate] boot 1789414856-10033: live bind confirmed — recreating drive-backed app jellyfin (state=running) onto /mnt/felhom-drives/hdd_1
2026/09/14 19:43:10 [INFO] [stacks] Stopping stack: jellyfin
2026/09/14 19:43:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:14 [INFO] Health probes: 2 ok (of 2 probed)
2026/09/14 19:43:16 [INFO] [stacks] Stack immich post-start status:
2026/09/14 19:43:16 [INFO] [stacks] immich-machine-learning ghcr.io/immich-app/immich-machine-learning:v3.0.3 running Up 17 seconds (health: starting)
2026/09/14 19:43:16 [INFO] [stacks] immich-postgres ghcr.io/immich-app/postgres:16-vectorchord0.4.3-pgvectors0.2.0 running Up 17 seconds (healthy)
2026/09/14 19:43:16 [INFO] [stacks] immich-redis redis:7-alpine running Up 17 seconds (healthy)
2026/09/14 19:43:16 [INFO] [stacks] immich-server ghcr.io/immich-app/immich-server:v3.0.3 running Up 7 seconds (health: starting)
2026/09/14 19:43:18 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:21 [INFO] [stacks] Stack jellyfin stopped successfully (took 10.7s)
2026/09/14 19:43:21 [INFO] [stacks] Status refresh: 27 containers across 57 stacks
2026/09/14 19:43:21 [INFO] [stacks] Starting stack: jellyfin
2026/09/14 19:43:22 [INFO] [stacks] Stack jellyfin started successfully (took 0.7s)
2026/09/14 19:43:22 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:22 [INFO] [gate] boot 1789414856-10033: live bind confirmed — recreating drive-backed app nextcloud (state=starting) onto /mnt/felhom-drives/hdd_1
2026/09/14 19:43:22 [INFO] [stacks] Stopping stack: nextcloud
2026/09/14 19:43:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:25 [INFO] [selfupdate] Current version 0.242.0 is up to date
2026/09/14 19:43:25 [INFO] [stacks] Stack jellyfin post-start status:
2026/09/14 19:43:25 [INFO] [stacks] jellyfin jellyfin/jellyfin:10.11.11 running Up 3 seconds (health: starting)
2026/09/14 19:43:26 [INFO] [stacks] Stack nextcloud stopped successfully (took 4.2s)
2026/09/14 19:43:26 [INFO] [stacks] Status refresh: 25 containers across 57 stacks
2026/09/14 19:43:26 [INFO] [stacks] Starting stack: nextcloud
2026/09/14 19:43:28 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:33 [WARN] Health probe jellyfin: API GET :8096/health → Get "http://jellyfin:8096/health": dial tcp 172.18.0.13:8096: connect: connection refused
2026/09/14 19:43:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:33 [WARN] Health probes: 0 ok, 1 unhealthy (of 1 probed)
2026/09/14 19:43:38 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:38 [INFO] [stacks] Stack nextcloud started successfully (took 12.0s)
2026/09/14 19:43:39 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:39 [INFO] [gate] boot 1789414856-10033: live bind confirmed — recreating drive-backed app paperless-ngx (state=starting) onto /mnt/felhom-drives/hdd_1
2026/09/14 19:43:39 [INFO] [stacks] Stopping stack: paperless-ngx
2026/09/14 19:43:43 [INFO] [stacks] Stack nextcloud post-start status:
2026/09/14 19:43:43 [INFO] [stacks] nextcloud nextcloud:34.0.1-apache running Up 4 seconds (health: starting)
2026/09/14 19:43:43 [INFO] [stacks] nextcloud-db mariadb:11.6 running Up 15 seconds (healthy)
2026/09/14 19:43:43 [INFO] [stacks] nextcloud-redis redis:7-alpine running Up 15 seconds (healthy)
2026/09/14 19:43:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:44 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:45 [WARN] Health probe jellyfin: API GET :8096/health → expected status 200, got 503
2026/09/14 19:43:45 [WARN] Health probes: 1 ok, 1 unhealthy (of 2 probed)
2026/09/14 19:43:48 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:48 [INFO] [bootrecon] boot window: budget 50s exhausted while the fleet was still changing — sweeping anyway
2026/09/14 19:43:48 [INFO] [bootrecon] Boot reconciliation: no boot-orphaned apps (nothing to start)
2026/09/14 19:43:51 [INFO] [stacks] Stack paperless-ngx stopped successfully (took 12.5s)
2026/09/14 19:43:51 [INFO] [stacks] Status refresh: 25 containers across 57 stacks
2026/09/14 19:43:51 [INFO] [stacks] Starting stack: paperless-ngx
2026/09/14 19:43:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:43:53 [INFO] Health probes: 2 ok (of 2 probed)
2026/09/14 19:43:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:43:53 [INFO] [scheduler] Job agent-channel-health completed (took 185ms)
2026/09/14 19:44:03 [INFO] [stacks] Stack paperless-ngx started successfully (took 11.2s)
2026/09/14 19:44:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:03 [INFO] [gate] boot 1789414856-10033: re-syncing FileBrowser mounts against the live binds
2026/09/14 19:44:03 [INFO] [settings] Settings saved
2026/09/14 19:44:03 [INFO] [web] FileBrowser sync — no config/compose change, ensured running without recreate (1 storage path(s))
2026/09/14 19:44:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:03 [INFO] Health probes: 3 ok (of 3 probed)
2026/09/14 19:44:06 [INFO] [stacks] Stack paperless-ngx post-start status:
2026/09/14 19:44:06 [INFO] [stacks] paperless-postgres postgres:16-alpine running Up 14 seconds (healthy)
2026/09/14 19:44:06 [INFO] [stacks] paperless-redis redis:7-alpine running Up 14 seconds (healthy)
2026/09/14 19:44:06 [INFO] [stacks] paperless-webserver ghcr.io/paperless-ngx/paperless-ngx:2.20.15 running Up 3 seconds (health: starting)
2026/09/14 19:44:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:22 [INFO] [fillwatch] checked 3 filesystem(s), 0 unreadable/skipped, 0 notification(s); bands: all ok
2026/09/14 19:44:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:53 [INFO] [scheduler] Running job: stack-scan
2026/09/14 19:44:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:53 [INFO] [stacks] ScanStacks complete: 57 stacks found (12 deployed, 45 available)
2026/09/14 19:44:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:44:53 [INFO] [scheduler] Job stack-scan completed (took 82ms)
2026/09/14 19:44:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:44:53 [INFO] [scheduler] Job agent-channel-health completed (took 195ms)
2026/09/14 19:45:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:45:09 [INFO] [web] Login from 172.18.0.11:46646
2026/09/14 19:45:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:45:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:45:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:45:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:45:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:45:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:45:53 [INFO] [scheduler] Job agent-channel-health completed (took 179ms)
2026/09/14 19:46:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:53 [INFO] [scheduler] Running job: stack-scan
2026/09/14 19:46:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:53 [INFO] [stacks] ScanStacks complete: 57 stacks found (12 deployed, 45 available)
2026/09/14 19:46:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:46:53 [INFO] [scheduler] Job stack-scan completed (took 75ms)
2026/09/14 19:46:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:46:53 [INFO] [scheduler] Job agent-channel-health completed (took 186ms)
2026/09/14 19:47:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:47:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:47:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:47:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:47:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:47:53 [INFO] [scheduler] Running job: backup-cache
2026/09/14 19:47:53 [INFO] [scheduler] Running job: system-health
2026/09/14 19:47:53 [INFO] [scheduler] Running job: offsite-credential-retry
2026/09/14 19:47:53 [INFO] [scheduler] Job offsite-credential-retry completed (took 0s)
2026/09/14 19:47:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:47:53 [INFO] [backup] Found 6 DB dump files across drives
2026/09/14 19:47:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:47:53 [INFO] [backup] Discovered 6 databases
2026/09/14 19:47:53 [INFO] [monitor] Health check: status=ok
2026/09/14 19:47:53 [INFO] [scheduler] Job system-health completed (took 233ms)
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/adventurelog/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/bookstack/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/docmost/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/gokapi/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/immich/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/jellyfin/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/mealie/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 1 HDD mounts for /opt/docker/stacks/nextcloud/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 2 HDD mounts for /opt/docker/stacks/paperless-ngx/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/privatebin/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/uptime-kuma/docker-compose.yml
2026/09/14 19:47:53 [INFO] [stacks] ParseComposeHDDMounts: found 0 HDD mounts for /opt/docker/stacks/vaultwarden/docker-compose.yml
2026/09/14 19:47:53 [INFO] [backup] Discovered app data: 12 apps
2026/09/14 19:47:53 [INFO] [backup] Backup status cache refreshed
2026/09/14 19:47:53 [INFO] [scheduler] Job backup-cache completed (took 288ms)
2026/09/14 19:47:53 [INFO] [scheduler] Job agent-channel-health completed (took 178ms)
2026/09/14 19:48:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:03 [INFO] Health probes: 2 ok (of 2 probed)
2026/09/14 19:48:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:13 [INFO] Health probes: 3 ok (of 3 probed)
2026/09/14 19:48:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:53 [INFO] [scheduler] Running job: stack-scan
2026/09/14 19:48:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:53 [INFO] [stacks] ScanStacks complete: 57 stacks found (12 deployed, 45 available)
2026/09/14 19:48:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:48:53 [INFO] [scheduler] Job stack-scan completed (took 100ms)
2026/09/14 19:48:53 [INFO] Health probes: 3 ok (of 3 probed)
2026/09/14 19:48:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:48:53 [INFO] [scheduler] Job agent-channel-health completed (took 190ms)
2026/09/14 19:49:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:49:03 [INFO] Health probes: 1 ok (of 1 probed)
2026/09/14 19:49:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:49:13 [INFO] Health probes: 2 ok (of 2 probed)
2026/09/14 19:49:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:49:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:49:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:49:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:49:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:49:53 [INFO] [scheduler] Job agent-channel-health completed (took 183ms)
2026/09/14 19:50:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:53 [INFO] [scheduler] Running job: stack-scan
2026/09/14 19:50:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:53 [INFO] [stacks] ScanStacks complete: 57 stacks found (12 deployed, 45 available)
2026/09/14 19:50:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:50:53 [INFO] [scheduler] Job stack-scan completed (took 80ms)
2026/09/14 19:50:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:50:53 [INFO] [scheduler] Job agent-channel-health completed (took 189ms)
2026/09/14 19:51:03 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:51:13 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:51:23 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:51:33 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:51:43 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:51:53 [INFO] [stacks] Status refresh: 28 containers across 57 stacks
2026/09/14 19:51:53 [INFO] [scheduler] Running job: agent-channel-health
2026/09/14 19:51:53 [INFO] [scheduler] Job agent-channel-health completed (took 191ms)