Files
felhom.eu/documentation/audits/night-2026-10-19/P3/09-controller-log-window.txt
T

177 lines
22 KiB
Plaintext

2026/10/19 18:55:42 auth.go:160: [DEBUG] [web] login attempt: visitor 192.168.0.180 (peer 172.18.0.3:41876, X-Forwarded-For "192.168.0.180", CF-Connecting-IP "")
2026/10/19 18:55:42 auth.go:192: [DEBUG] [web] login successful from 192.168.0.180, creating session
2026/10/19 18:55:42 session_store.go:140: [DEBUG] [web] sessions: saved 142 session(s) to dashboard-sessions.json
2026/10/19 18:55:42 auth.go:316: [DEBUG] [web] session created, expires=2026-10-26T18:55:42Z, active_sessions=146
2026/10/19 18:55:42 auth.go:212: [INFO] [web] Login from 192.168.0.180
2026/10/19 18:55:42 auth.go:144: [DEBUG] [web] auth: valid session for GET /
2026/10/19 18:55:42 server.go:637: [DEBUG] [web] ServeHTTP: GET / from 172.18.0.3:41876
2026/10/19 18:55:42 auth.go:144: [DEBUG] [web] auth: valid session for GET /launcher
2026/10/19 18:55:42 server.go:637: [DEBUG] [web] ServeHTTP: GET /launcher from 172.18.0.3:41876
2026/10/19 18:55:42 auth.go:144: [DEBUG] [web] auth: valid session for POST /backup/offbox/reconstitute
2026/10/19 18:55:42 server.go:637: [DEBUG] [web] ServeHTTP: POST /backup/offbox/reconstitute from 172.18.0.3:41876
2026/10/19 18:55:43 [WARN] [backup] ValidateDump: /mnt/felhom-drives/scratch_hdd/backups/offsite-restore/rallly/mnt/sys_drive/felhom-data/backups/primary/rallly/db-dumps/rallly-postgres.sql is structurally valid (36 tables) but its accounts table has NO rows — the dump may predate the customer's data
2026/10/19 18:55:43 offbox_reconstitute.go:1206: [WARN] [offbox] rallly: the snapshot dump rallly-postgres.sql has no account rows — it may predate the customer's data
2026/10/19 18:55:43 restore_dbcreds.go:114: [INFO] [backup] Restore rallly: database password(s) [DB_PASSWORD] come from the backup, [] stay as installed (older than the data) — values not logged (R-1106)
2026/10/19 18:55:43 dbdump.go:130: [DEBUG] DiscoverDatabases: running docker ps to find database containers
2026/10/19 18:55:43 dbdump.go:149: [DEBUG] DiscoverDatabases: docker ps output: 5e59e7bdadc1 rallly rallly lukevella/rallly:4.15.3
8ad4e7b50692 rallly-postgres rallly postgres:18-alpine
197253b4df3a paperless-webserver paperless-ngx ghcr.io/paperless-ngx/paperless-ngx:2.20.15
f7b4c0e21fd3 paperless-redis paperless-ngx redis:7-alpine
8c1fda4f57c7 paperless-postgres paperless-ngx postgres:18-alpine
011c9b739e1a immich-server immich ghcr.io/immich-app/immich-server:v3.2.4
224ee4af256c immich-machine-learning immich ghcr.io/immich-app/immich-machine-learning:v3.2.4
c030b51054cb...
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container rallly (image=lukevella/rallly:4.15.3, not a database)
2026/10/19 18:55:43 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: rallly-postgres (id=8ad4e7b50692)
2026/10/19 18:55:43 dbdump.go:198: [DEBUG] DiscoverDatabases: rallly-postgres → stack=rallly, dbUser=rallly, dbName=rallly
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container paperless-webserver (image=ghcr.io/paperless-ngx/paperless-ngx:2.20.15, not a database)
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container paperless-redis (image=redis:7-alpine, not a database)
2026/10/19 18:55:43 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: paperless-postgres (id=8c1fda4f57c7)
2026/10/19 18:55:43 dbdump.go:915: [DEBUG] DiscoverDatabases: paperless-postgres → stack "paperless-ngx" from the compose project label (the container name would have given "paperless")
2026/10/19 18:55:43 dbdump.go:198: [DEBUG] DiscoverDatabases: paperless-postgres → stack=paperless-ngx, dbUser=paperless, dbName=paperless
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-server (image=ghcr.io/immich-app/immich-server:v3.2.4, not a database)
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-machine-learning (image=ghcr.io/immich-app/immich-machine-learning:v3.2.4, not a database)
2026/10/19 18:55:43 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: immich-postgres (id=c030b51054cb)
2026/10/19 18:55:43 dbdump.go:198: [DEBUG] DiscoverDatabases: immich-postgres → stack=immich, dbUser=immich, dbName=immich
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-redis (image=redis:7-alpine, not a database)
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container r893-sftp (image=atmoz/sftp:alpine, not a database)
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container filebrowser (image=gtstef/filebrowser:1.5.6-stable, not a database)
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container felhom-controller (image=gitea.dooplex.hu/admin/felhom-controller:0.335.0, not a database)
2026/10/19 18:55:43 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container traefik (image=traefik:v3.7.13, not a database)
2026/10/19 18:55:43 dbdump.go:205: [DEBUG] DiscoverDatabases: found 3 database(s), skipped 10 non-DB container(s)
2026/10/19 18:55:43 dbdump.go:208: [INFO] [backup] Discovered 3 databases
2026/10/19 18:55:43 dbdump.go:277: [DEBUG] DumpOne: starting dump for container=rallly-postgres, stack=rallly, dbType=postgres, dest=/mnt/sys_drive/felhom-data/backups/primary/rallly/db-dumps/pre-restore-20261019T185543Z-rallly-postgres.sql
2026/10/19 18:55:43 dbdump.go:314: [DEBUG] DumpOne: pg_dump command: docker exec 8ad4e7b50692 pg_dump -U rallly -d rallly --clean --if-exists --no-owner --no-privileges
2026/10/19 18:55:43 [WARN] [backup] ValidateDump: /mnt/sys_drive/felhom-data/backups/primary/rallly/db-dumps/pre-restore-20261019T185543Z-rallly-postgres.sql is structurally valid (36 tables) but its accounts table has NO rows — the dump may predate the customer's data
2026/10/19 18:55:43 dbdump.go:424: [DEBUG] DumpOne: completed rallly-postgres → pre-restore-20261019T185543Z-rallly-postgres.sql (size=110.0 KB, valid=true, tables=36, duration=325ms)
2026/10/19 18:55:43 dbdump.go:429: [INFO] [backup] DB dump: rallly-postgres → pre-restore-20261019T185543Z-rallly-postgres.sql (110.0 KB, 325ms, 36 tables)
2026/10/19 18:55:43 offbox_reconstitute.go:262: [INFO] [offbox] rallly: pre-restore safety dump written → pre-restore-20261019T185543Z-rallly-postgres.sql (110.0 KB)
2026/10/19 18:55:43 manager.go:1437: [DEBUG] [stacks] StopStack rallly: current state=running deployed=true containers=2
2026/10/19 18:55:43 manager.go:1440: [INFO] [stacks] Stopping stack: rallly
2026/10/19 18:55:43 manager.go:1686: [DEBUG] Env vars for compose: [PATH, HOSTNAME, FELHOM_BOOTSTRAP_PATH, HOME, DOMAIN, SUBDOMAIN, DB_PASSWORD, DOMAIN, SECRET_PASSWORD, IMPORT_PATH] (10 app + 0 system)
2026/10/19 18:55:43 manager.go:1695: [DEBUG] Running: docker compose down (in /opt/docker/stacks/rallly)
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] GetInfo starting (hddPath="/mnt/felhom-drives/scratch_hdd", hasCPUCollector=true)
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readMemInfo: guest cap=25898MB (host total was 30714348KB) → used≈12771MB avail≈13127MB
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readMemInfo: totalKB=30714348 availKB=15567204 → total=25898MB avail=13127MB used=12771MB (49.3%)
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readDiskUsage: path="/" bsize=4096 total=68.4GB used=12.0GB avail=52.8GB (18.5%)
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readDiskUsage: path="/mnt/felhom-drives/scratch_hdd" bsize=4096 total=937.8GB used=175.4GB avail=714.7GB (19.7%)
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readLoadAvg: raw="2.25 2.62 2.11 8/1611 4393" → 1m=2.25 5m=2.62 15m=2.11
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readThermalZones: /sys — found 1 zones
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] readTemperature: found via hwmon at /sys — 57.6°C (hwmon2)
2026/10/19 18:55:44 info.go:13: [DEBUG] [system] GetInfo done in 59ms — mem=12771MB/25898MB (49.3%), rootDisk=12.0GB/68.4GB (18.5%), load=2.25/2.62/2.11, temp=57.6°C (hwmon2), cpu=13.9%
2026/10/19 18:55:44 scheduler.go:85: [DEBUG] [scheduler] job deadapp-check: execution starting
2026/10/19 18:55:44 scheduler.go:85: [DEBUG] [scheduler] job ring-spill: execution starting
2026/10/19 18:55:44 scheduler.go:85: [DEBUG] [scheduler] job docker-socket-watch: execution starting
2026/10/19 18:55:44 scheduler.go:85: [DEBUG] [scheduler] job health-probes: execution starting
2026/10/19 18:55:44 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping immich — last check 1m40s ago, effective interval 5m0s, healthy=true
2026/10/19 18:55:44 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping paperless-ngx — last check 1m0s ago, effective interval 5m0s, healthy=true
2026/10/19 18:55:44 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping rallly — last check 1m0s ago, effective interval 5m0s, healthy=true
2026/10/19 18:55:44 healthprobe.go:110: [DEBUG] [stacks] RunHealthProbes: collected 0 targets (3 skipped not due, 0 skipped no container)
2026/10/19 18:55:44 scheduler.go:85: [DEBUG] [scheduler] job after-unclean-boot: execution starting
2026/10/19 18:55:44 scheduler.go:85: [DEBUG] [scheduler] job status-refresh: execution starting
2026/10/19 18:55:44 manager.go:838: [INFO] [stacks] Status refresh: 11 containers across 70 stacks
2026/10/19 18:55:54 scheduler.go:85: [DEBUG] [scheduler] job status-refresh: execution starting
2026/10/19 18:55:54 scheduler.go:85: [DEBUG] [scheduler] job health-probes: execution starting
2026/10/19 18:55:54 manager.go:838: [INFO] [stacks] Status refresh: 10 containers across 70 stacks
2026/10/19 18:55:54 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping immich — last check 1m50s ago, effective interval 5m0s, healthy=true
2026/10/19 18:55:54 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping paperless-ngx — last check 1m10s ago, effective interval 5m0s, healthy=true
2026/10/19 18:55:54 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping rallly — last check 1m10s ago, effective interval 5m0s, healthy=true
2026/10/19 18:55:54 healthprobe.go:110: [DEBUG] [stacks] RunHealthProbes: collected 0 targets (3 skipped not due, 0 skipped no container)
2026/10/19 18:55:54 manager.go:1717: [DEBUG] Command completed: docker compose down (took 10.7s)
2026/10/19 18:55:54 manager.go:1449: [INFO] [stacks] Stack rallly stopped successfully (took 10.7s)
2026/10/19 18:55:54 manager.go:838: [INFO] [stacks] Status refresh: 9 containers across 70 stacks
2026/10/19 18:55:54 restore.go:215: [INFO] [backup] Restoring Docker volume rallly_rallly_postgres_data for rallly
2026/10/19 18:55:55 restore.go:253: [DEBUG] [backup] Volume rallly_rallly_postgres_data restored successfully
2026/10/19 18:55:55 restore.go:258: [INFO] [backup] Restored 1 Docker volume(s) for rallly
2026/10/19 18:55:55 manager.go:1404: [INFO] [stacks] Starting stack rallly services only: [rallly-postgres]
2026/10/19 18:55:55 manager.go:1686: [DEBUG] Env vars for compose: [PATH, HOSTNAME, FELHOM_BOOTSTRAP_PATH, HOME, DOMAIN, DOMAIN, SECRET_PASSWORD, SUBDOMAIN, DB_PASSWORD, IMPORT_PATH] (10 app + 0 system)
2026/10/19 18:55:55 manager.go:1695: [DEBUG] Running: docker compose up -d rallly-postgres (in /opt/docker/stacks/rallly)
2026/10/19 18:55:56 manager.go:1717: [DEBUG] Command completed: docker compose up -d rallly-postgres (took 0.4s)
2026/10/19 18:55:56 manager.go:1415: [INFO] [stacks] Stack rallly services [rallly-postgres] started (took 0.4s)
2026/10/19 18:55:56 manager.go:838: [INFO] [stacks] Status refresh: 10 containers across 70 stacks
2026/10/19 18:55:56 dbdump.go:130: [DEBUG] DiscoverDatabases: running docker ps to find database containers
2026/10/19 18:55:56 dbdump.go:149: [DEBUG] DiscoverDatabases: docker ps output: b55136567813 rallly-postgres rallly postgres:18-alpine
197253b4df3a paperless-webserver paperless-ngx ghcr.io/paperless-ngx/paperless-ngx:2.20.15
f7b4c0e21fd3 paperless-redis paperless-ngx redis:7-alpine
8c1fda4f57c7 paperless-postgres paperless-ngx postgres:18-alpine
011c9b739e1a immich-server immich ghcr.io/immich-app/immich-server:v3.2.4
224ee4af256c immich-machine-learning immich ghcr.io/immich-app/immich-machine-learning:v3.2.4
c030b51054cb immich-postgres immich ghcr.io/immich-app/postgres...
2026/10/19 18:55:56 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: rallly-postgres (id=b55136567813)
2026/10/19 18:55:56 dbdump.go:198: [DEBUG] DiscoverDatabases: rallly-postgres → stack=rallly, dbUser=rallly, dbName=rallly
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container paperless-webserver (image=ghcr.io/paperless-ngx/paperless-ngx:2.20.15, not a database)
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container paperless-redis (image=redis:7-alpine, not a database)
2026/10/19 18:55:56 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: paperless-postgres (id=8c1fda4f57c7)
2026/10/19 18:55:56 dbdump.go:915: [DEBUG] DiscoverDatabases: paperless-postgres → stack "paperless-ngx" from the compose project label (the container name would have given "paperless")
2026/10/19 18:55:56 dbdump.go:198: [DEBUG] DiscoverDatabases: paperless-postgres → stack=paperless-ngx, dbUser=paperless, dbName=paperless
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-server (image=ghcr.io/immich-app/immich-server:v3.2.4, not a database)
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-machine-learning (image=ghcr.io/immich-app/immich-machine-learning:v3.2.4, not a database)
2026/10/19 18:55:56 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: immich-postgres (id=c030b51054cb)
2026/10/19 18:55:56 dbdump.go:198: [DEBUG] DiscoverDatabases: immich-postgres → stack=immich, dbUser=immich, dbName=immich
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-redis (image=redis:7-alpine, not a database)
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container r893-sftp (image=atmoz/sftp:alpine, not a database)
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container filebrowser (image=gtstef/filebrowser:1.5.6-stable, not a database)
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container felhom-controller (image=gitea.dooplex.hu/admin/felhom-controller:0.335.0, not a database)
2026/10/19 18:55:56 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container traefik (image=traefik:v3.7.13, not a database)
2026/10/19 18:55:56 dbdump.go:205: [DEBUG] DiscoverDatabases: found 3 database(s), skipped 9 non-DB container(s)
2026/10/19 18:55:56 dbdump.go:208: [INFO] [backup] Discovered 3 databases
2026/10/19 18:55:56 restore_db.go:87: [INFO] [backup] Restore rallly: replaying DB dump into rallly-postgres (postgres)
2026/10/19 18:55:56 dbdump.go:800: [DEBUG] [backup] ImportDump: importing /mnt/felhom-drives/scratch_hdd/backups/offsite-restore/rallly/mnt/sys_drive/felhom-data/backups/primary/rallly/db-dumps/rallly-postgres.sql into rallly-postgres (postgres)
2026/10/19 18:55:57 dbdump.go:814: [ERROR] [backup] postgres import into rallly-postgres FAILED: exit status 3 — engine output follows:
ERROR: function r893_forced_replay_failure() does not exist
LINE 1: SELECT r893_forced_replay_failure();
^
HINT: No function matches the given name and argument types. You might need to add explicit type casts.
2026/10/19 18:55:57 offbox_reconstitute.go:1062: [ERROR] [offbox] rallly: database replay failed, rolling back to the pre-restore state: importing postgres dump for rallly: postgres import into rallly-postgres failed: exit status 3
2026/10/19 18:55:57 dbdump.go:130: [DEBUG] DiscoverDatabases: running docker ps to find database containers
2026/10/19 18:55:57 dbdump.go:149: [DEBUG] DiscoverDatabases: docker ps output: b55136567813 rallly-postgres rallly postgres:18-alpine
197253b4df3a paperless-webserver paperless-ngx ghcr.io/paperless-ngx/paperless-ngx:2.20.15
f7b4c0e21fd3 paperless-redis paperless-ngx redis:7-alpine
8c1fda4f57c7 paperless-postgres paperless-ngx postgres:18-alpine
011c9b739e1a immich-server immich ghcr.io/immich-app/immich-server:v3.2.4
224ee4af256c immich-machine-learning immich ghcr.io/immich-app/immich-machine-learning:v3.2.4
c030b51054cb immich-postgres immich ghcr.io/immich-app/postgres...
2026/10/19 18:55:57 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: rallly-postgres (id=b55136567813)
2026/10/19 18:55:57 dbdump.go:198: [DEBUG] DiscoverDatabases: rallly-postgres → stack=rallly, dbUser=rallly, dbName=rallly
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container paperless-webserver (image=ghcr.io/paperless-ngx/paperless-ngx:2.20.15, not a database)
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container paperless-redis (image=redis:7-alpine, not a database)
2026/10/19 18:55:57 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: paperless-postgres (id=8c1fda4f57c7)
2026/10/19 18:55:57 dbdump.go:915: [DEBUG] DiscoverDatabases: paperless-postgres → stack "paperless-ngx" from the compose project label (the container name would have given "paperless")
2026/10/19 18:55:57 dbdump.go:198: [DEBUG] DiscoverDatabases: paperless-postgres → stack=paperless-ngx, dbUser=paperless, dbName=paperless
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-server (image=ghcr.io/immich-app/immich-server:v3.2.4, not a database)
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-machine-learning (image=ghcr.io/immich-app/immich-machine-learning:v3.2.4, not a database)
2026/10/19 18:55:57 dbdump.go:178: [DEBUG] DiscoverDatabases: found postgres container: immich-postgres (id=c030b51054cb)
2026/10/19 18:55:57 dbdump.go:198: [DEBUG] DiscoverDatabases: immich-postgres → stack=immich, dbUser=immich, dbName=immich
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container immich-redis (image=redis:7-alpine, not a database)
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container r893-sftp (image=atmoz/sftp:alpine, not a database)
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container filebrowser (image=gtstef/filebrowser:1.5.6-stable, not a database)
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container felhom-controller (image=gitea.dooplex.hu/admin/felhom-controller:0.335.0, not a database)
2026/10/19 18:55:57 dbdump.go:171: [DEBUG] DiscoverDatabases: skipping container traefik (image=traefik:v3.7.13, not a database)
2026/10/19 18:55:57 dbdump.go:205: [DEBUG] DiscoverDatabases: found 3 database(s), skipped 9 non-DB container(s)
2026/10/19 18:55:57 dbdump.go:208: [INFO] [backup] Discovered 3 databases
2026/10/19 18:55:57 offbox_reconstitute.go:603: [DEBUG] [offbox] rallly: rallly-postgres was re-created during the restore (8ad4e7b50692 → b55136567813) — rolling back into the live container
2026/10/19 18:55:57 offbox_reconstitute.go:606: [INFO] [offbox] rallly: rolling back to the pre-restore state from pre-restore-20261019T185543Z-rallly-postgres.sql
2026/10/19 18:55:57 dbdump.go:800: [DEBUG] [backup] ImportDump: importing /mnt/sys_drive/felhom-data/backups/primary/rallly/db-dumps/pre-restore-20261019T185543Z-rallly-postgres.sql into rallly-postgres (postgres)
2026/10/19 18:55:58 dbdump.go:820: [INFO] [backup] Imported DB dump pre-restore-20261019T185543Z-rallly-postgres.sql into rallly-postgres (postgres)
2026/10/19 18:55:58 offbox_reconstitute.go:611: [INFO] [offbox] rallly: rollback complete — 1 database(s) returned to the pre-restore state
2026/10/19 18:55:58 settings.go:1951: [WARN] [settings] restore hold SET for rallly — the app stays stopped until it is cleared
2026/10/19 18:55:58 settings.go:922: [DEBUG] [settings] saved to /opt/docker/felhom-controller/data/settings.json (27892 bytes)
2026/10/19 18:55:58 settings.go:925: [INFO] [settings] Settings saved
2026/10/19 18:55:58 manager.go:1437: [DEBUG] [stacks] StopStack rallly: current state=starting deployed=true containers=1
2026/10/19 18:55:58 manager.go:1440: [INFO] [stacks] Stopping stack: rallly
2026/10/19 18:55:58 manager.go:1686: [DEBUG] Env vars for compose: [PATH, HOSTNAME, FELHOM_BOOTSTRAP_PATH, HOME, DOMAIN, SUBDOMAIN, DB_PASSWORD, DOMAIN, SECRET_PASSWORD, IMPORT_PATH] (10 app + 0 system)
2026/10/19 18:55:58 manager.go:1695: [DEBUG] Running: docker compose down (in /opt/docker/stacks/rallly)
2026/10/19 18:55:59 manager.go:1717: [DEBUG] Command completed: docker compose down (took 0.9s)
2026/10/19 18:55:59 manager.go:1449: [INFO] [stacks] Stack rallly stopped successfully (took 0.9s)
2026/10/19 18:55:59 manager.go:838: [INFO] [stacks] Status refresh: 9 containers across 70 stacks
2026/10/19 18:55:59 offbox_reconstitute.go:531: [ERROR] [offbox] rallly: the restore stopped half-way after files/volumes/version had moved — HOLDING the app stopped for support (R-893); error was: importing postgres dump for rallly: postgres import into rallly-postgres failed: exit status 3
2026/10/19 18:55:59 notifier.go:1373: [WARN] notifier disabled (no hub configured): DROPPED event backup_run_failures (severity error) — further backup_run_failures events are logged at DEBUG only
2026/10/19 18:55:59 offbox_handlers.go:547: [ERROR] [web] off-box reconstitute rallly (async): a(z) rallly adatbázisának visszaállítása sikertelen. Az adatbázis a visszaállítás előtti állapotban van, de az alkalmazás fájljai és többi adata már a mentésből származnak, ezért nem illenek össze. Az alkalmazást biztonsági okból LEÁLLÍTVA hagytuk. Ehhez segítség kell: vedd fel velünk a kapcsolatot
2026/10/19 18:55:59 scheduler.go:85: [DEBUG] [scheduler] job docker-socket-watch: execution starting
2026/10/19 18:56:04 scheduler.go:85: [DEBUG] [scheduler] job health-probes: execution starting
2026/10/19 18:56:04 scheduler.go:85: [DEBUG] [scheduler] job status-refresh: execution starting
2026/10/19 18:56:04 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping immich — last check 2m0s ago, effective interval 5m0s, healthy=true
2026/10/19 18:56:04 healthprobe.go:64: [DEBUG] [stacks] RunHealthProbes: skipping paperless-ngx — last check 1m20s ago, effective interval 5m0s, healthy=true
2026/10/19 18:56:04 healthprobe.go:110: [DEBUG] [stacks] RunHealthProbes: collected 0 targets (2 skipped not due, 0 skipped no container)
2026/10/19 18:56:04 manager.go:838: [INFO] [stacks] Status refresh: 9 containers across 70 stacks