admin/felhom.eu
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
e78726314ea43aecaea37a2fc081edef922ea607
felhom.eu/documentation/audits/more-night-apps-2026-09-30/D/D-immich.log
T
admin 42bf40bd2c
gates / gates (push) Successful in 29s
Details
More apps update themselves at night (30+2 -> 35+3); the same-name security-fix gap measured (R-740, decision for the operator) 
- Twelve steps published on both venues (catalog): first ladders for calibre-web, gitea, wger,
  crafty-controller, uptime-kuma, zipline (two steps); within-major emby, ghost, home-assistant,
  outline, rallly. immich's step v3.0.3 -> v3.2.2 re-proven at 768M (Part D).
- Part C: the night leg skips a digest-only change AND the catalog never records a same-tag re-test,
  so a same-name upstream fix reaches no box. Row R-740; the decision in STATUS; `09` decision 30
  carries a dated note (the decision itself unchanged).
- Rows: 369 -> 377. Opened R-735..R-742; closed R-735, R-738, R-742; narrowed R-462, R-624, R-446,
  R-440, R-734, R-732. The currency audit gains §1b (and corrects its 31+1 to 30+2).

Evidence: documentation/audits/more-night-apps-2026-09-30/. Report: REPORT-more-night-apps-2026-09-30.md.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
2026-09-30 20:27:28 +02:00

170 lines
16 KiB
Plaintext
Raw Blame History

[17:17:59] scratch drive folders cleared before FROM (R-656): none existed
[17:17:59] D-immich-0b82-768: deploying immich at FROM {'immich-server': 'ghcr.io/immich-app/immich-server:v3.0.3', 'immich-machine-learning': 'ghcr.io/immich-app/immich-machine-learning:v3.0.3', 'immich-postgres': 'ghcr.io/immich-app/postgres:16-vectorchord0.4.3-pgvectors0.2.0', 'immich-redis': 'redis:7-alpine'}
[17:19:34] FROM settled=True in 31.4s :: {"immich-machine-learning": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}, "immich-postgres": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}, "immich-redis": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}, "immich-server": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}}
[17:19:34] fixture: the BOX walk's own (Immich), through upgrade_boxport
[17:19:34] immich: seeded album drillalbumcb179b80
[17:19:35] immich: readback found=True (http 200, control passed)
[17:19:35] C1 (seed reads back BEFORE): True
[17:19:35] D-immich-0b82-768: swapping to TO {'immich-server': 'ghcr.io/immich-app/immich-server:v3.2.2', 'immich-machine-learning': 'ghcr.io/immich-app/immich-machine-learning:v3.0.3', 'immich-postgres': 'ghcr.io/immich-app/postgres:16-vectorchord0.4.3-pgvectors0.2.0', 'immich-redis': 'redis:7-alpine'}
[17:19:36] TO up -d rc=0
[17:20:08] TO settled=True in 31.5s :: {"immich-machine-learning": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}, "immich-postgres": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}, "immich-redis": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}, "immich-server": {"status": "running", "health": "healthy", "restarts": 0, "exit": 0}}
[17:20:08] engine state immich-postgres: 16
[17:20:08] migration lines observed: 6
[17:20:08] immich: readback found=True (http 200, control passed)
[17:20:08] RESULT (seed reads back AFTER): True
[17:20:09] files_may_change — the files: ['/srv/felhom-gate/hdd/appdata/immich/backups/.immich (changed)', '/srv/felhom-gate/hdd/appdata/immich/encoded-video/.immich (changed)', '/srv/felhom-gate/hdd/appdata/immich/library/.immich (changed)', '/srv/felhom-gate/hdd/appdata/immich/profile/.immich (changed)', '/srv/felhom-gate/hdd/appdata/immich/thumbs/.immich (changed)', '/srv/felhom-gate/hdd/appdata/immich/upload/.immich (changed)']
[17:20:09] files_may_change: the bind-mounted tree changed under ['/srv/felhom-gate/hdd/appdata/immich']
[17:20:09] memory watch: 600s, 4 callers on 1 path(s) at 172.18.0.2:2283
[17:20:24] + 15s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=723M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1460M/2048M peak=1631M kills=0 rs=0 reqs=304
[17:20:39] + 30s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=707M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1471M/2048M peak=1631M kills=0 rs=0 reqs=604
[17:20:55] + 46s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=703M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1467M/2048M peak=1631M kills=0 rs=0 reqs=904
[17:21:10] + 61s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=701M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1494M/2048M peak=1631M kills=0 rs=0 reqs=1204
[17:21:25] + 76s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=701M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1494M/2048M peak=1631M kills=0 rs=0 reqs=1507
[17:21:40] + 91s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=701M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1357M/2048M peak=1631M kills=0 rs=0 reqs=1808
[17:21:55] + 106s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=701M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1111M/2048M peak=1631M kills=0 rs=0 reqs=2108
[17:22:11] + 122s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1113M/2048M peak=1631M kills=0 rs=0 reqs=2408
[17:22:26] + 137s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1116M/2048M peak=1631M kills=0 rs=0 reqs=2708
[17:22:41] + 152s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1083M/2048M peak=1631M kills=0 rs=0 reqs=3008
[17:22:56] + 167s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1083M/2048M peak=1631M kills=0 rs=0 reqs=3308
[17:23:11] + 182s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1084M/2048M peak=1631M kills=0 rs=0 reqs=3608
[17:23:26] + 197s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1075M/2048M peak=1631M kills=0 rs=0 reqs=3912
[17:23:42] + 213s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=702M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1074M/2048M peak=1631M kills=0 rs=0 reqs=4212
[17:23:57] + 228s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=705M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1071M/2048M peak=1631M kills=0 rs=0 reqs=4512
[17:24:12] + 243s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=715M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1068M/2048M peak=1631M kills=0 rs=0 reqs=4812
[17:24:27] + 258s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=731M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1074M/2048M peak=1631M kills=0 rs=0 reqs=5112
[17:24:42] + 273s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=741M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1078M/2048M peak=1631M kills=0 rs=0 reqs=5412
[17:24:58] + 288s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=748M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1074M/2048M peak=1631M kills=0 rs=0 reqs=5712
[17:25:13] + 304s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=754M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1072M/2048M peak=1631M kills=0 rs=0 reqs=6016
[17:25:28] + 319s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=754M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1073M/2048M peak=1631M kills=0 rs=0 reqs=6316
[17:25:43] + 334s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=764M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1075M/2048M peak=1631M kills=0 rs=0 reqs=6616
[17:25:58] + 349s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=767M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1072M/2048M peak=1631M kills=0 rs=0 reqs=6916
[17:26:14] + 364s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=763M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1072M/2048M peak=1631M kills=0 rs=0 reqs=7216
[17:26:29] + 380s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=767M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1075M/2048M peak=1631M kills=0 rs=0 reqs=7516
[17:26:44] + 395s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=763M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1076M/2048M peak=1631M kills=0 rs=0 reqs=7820
[17:26:59] + 410s immich-machine-learning=249M/1536M peak=265M kills=0 rs=0 immich-postgres=763M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1077M/2048M peak=1631M kills=0 rs=0 reqs=8120
[17:27:14] + 425s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1078M/2048M peak=1631M kills=0 rs=0 reqs=8420
[17:27:29] + 440s immich-machine-learning=249M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1079M/2048M peak=1631M kills=0 rs=0 reqs=8720
[17:27:45] + 456s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1079M/2048M peak=1631M kills=0 rs=0 reqs=9020
[17:28:00] + 471s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1081M/2048M peak=1631M kills=0 rs=0 reqs=9324
[17:28:15] + 486s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1080M/2048M peak=1631M kills=0 rs=0 reqs=9624
[17:28:30] + 501s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1081M/2048M peak=1631M kills=0 rs=0 reqs=9924
[17:28:45] + 516s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1081M/2048M peak=1631M kills=0 rs=0 reqs=10224
[17:29:01] + 532s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1082M/2048M peak=1631M kills=0 rs=0 reqs=10524
[17:29:16] + 547s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1082M/2048M peak=1631M kills=0 rs=0 reqs=10824
[17:29:31] + 562s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1082M/2048M peak=1631M kills=0 rs=0 reqs=11124
[17:29:46] + 577s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=762M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1082M/2048M peak=1631M kills=0 rs=0 reqs=11426
[17:30:01] + 592s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=761M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1083M/2048M peak=1631M kills=0 rs=0 reqs=11728
[17:30:17] + 607s immich-machine-learning=248M/1536M peak=265M kills=0 rs=0 immich-postgres=761M/768M peak=768M kills=0 rs=0 immich-redis=13M/128M peak=17M kills=0 rs=0 immich-server=1082M/2048M peak=1631M kills=0 rs=0 reqs=12028
[17:30:17] memory watch: killed=False tight=[] requests=12028 codes={'200': 12028}
[17:30:17] D-immich-0b82-768: ABORT — putting the FROM images back
[17:33:20] ABORT: the app did NOT come back (rc=0, 181.6s)
{
"harness_version": 4,
"edge": "D-immich-0b82-768",
"app": "immich",
"note": "Part D 2026-09-30: step 0b8272068aab36bf's own definition, immich-postgres 512M -> 768M (R-732)",
"from": {
"immich-server": "ghcr.io/immich-app/immich-server:v3.0.3",
"immich-machine-learning": "ghcr.io/immich-app/immich-machine-learning:v3.0.3",
"immich-postgres": "ghcr.io/immich-app/postgres:16-vectorchord0.4.3-pgvectors0.2.0",
"immich-redis": "redis:7-alpine"
},
"to": {
"immich-server": "ghcr.io/immich-app/immich-server:v3.2.2",
"immich-machine-learning": "ghcr.io/immich-app/immich-machine-learning:v3.0.3",
"immich-postgres": "ghcr.io/immich-app/postgres:16-vectorchord0.4.3-pgvectors0.2.0",
"immich-redis": "redis:7-alpine"
},
"verdict": "proven",
"seed_read_before": true,
"seed_read_after": true,
"healthy_after": true,
"migration_observed": "\u001b[2Kimmich-server | \u001b[32m[Nest] 7 - \u001b[39m09/30/2026, 7:19:45 PM \u001b[32m LOG\u001b[39m \u001b[33m[Microservices:DatabaseRepository]\u001b[39m \u001b[32mRunning migrations\u001b[39m",
"abort": "refuses",
"abort_detail": "18:54.244 CEST [72] LOG: database system was shut down at 2026-09-30 19:18:54 CEST\n\u001b[2Kimmich-postgres | 2026-09-30 19:18:54.259 CEST [1] LOG: database system is ready to accept connections\n\u001b[2Kimmich-postgres | 2026-09-30 19:19:07.602 CEST [95] ERROR: relation \"system_metadata\" does not exist at character 21\n\u001b[2Kimmich-postgres | 2026-09-30 19:19:07.602 CEST [95] STATEMENT: select \"value\" from \"system_metadata\" where \"key\" = $1\n\u001b[2Kimmich-postgres | 2026-09-30 19:23:54.345 CEST [70] LOG: checkpoint starting: time\n\u001b[2Kimmich-postgres | 2026-09-30 19:28:24.197 CEST [70] LOG: checkpoint complete: wrote 16951 buffers (25.9%); 0 WAL file(s) added, 0 removed, 16 recycled; write=269.713 s, sync=0.077 s, total=269.853 s; sync files=769, longest=0.007 s, average=0.001 s; distance=269095 kB, estimate=269095 kB; lsn=0/11F98B70, redo lsn=0/11F98B38",
"engine_state_after": {
"immich-postgres": {
"image": "ghcr.io/immich-app/postgres:16-vectorchord0.4.3-pgvectors0.2.0",
"probe": "datadir major version",
"answer": "16",
"probe_rc": 0
}
},
"memory": {
"soak_s": 607.7,
"requested_s": 600,
"requests": 12028,
"codes": {
"200": 12028
},
"first_kill": null,
"containers": {
"immich-machine-learning": {
"limit": 1610612736,
"peak": 278474752,
"peak_pct": 0.173,
"anon_peak_sampled": 246366208,
"anon_peak_pct": 0.153,
"oom_kills": 0,
"restarts": 0,
"oomkilled_flag": false,
"measured": true
},
"immich-postgres": {
"limit": 805306368,
"peak": 805638144,
"peak_pct": 1.0,
"anon_peak_sampled": 238280704,
"anon_peak_pct": 0.296,
"oom_kills": 0,
"restarts": 0,
"oomkilled_flag": false,
"measured": true
},
"immich-redis": {
"limit": 134217728,
"peak": 18083840,
"peak_pct": 0.135,
"anon_peak_sampled": 4100096,
"anon_peak_pct": 0.031,
"oom_kills": 0,
"restarts": 0,
"oomkilled_flag": false,
"measured": true
},
"immich-server": {
"limit": 2147483648,
"peak": 1711157248,
"peak_pct": 0.797,
"anon_peak_sampled": 1054654464,
"anon_peak_pct": 0.491,
"oom_kills": 0,
"restarts": 0,
"oomkilled_flag": false,
"measured": true
}
},
"unmeasured": [],
"load": "reached"
},
"marks": [
"files_may_change"
],
"duration_s": 31.5,
"measured_at": "2026-09-30T17:33:20Z",
"evidence": "evidence/D-immich-0b82-768",
"scratch_cleared": [],
"files_changed": [
"/srv/felhom-gate/hdd/appdata/immich"
],
"files_changed_detail": [
"/srv/felhom-gate/hdd/appdata/immich/backups/.immich (changed)",
"/srv/felhom-gate/hdd/appdata/immich/encoded-video/.immich (changed)",
"/srv/felhom-gate/hdd/appdata/immich/library/.immich (changed)",
"/srv/felhom-gate/hdd/appdata/immich/profile/.immich (changed)",
"/srv/felhom-gate/hdd/appdata/immich/thumbs/.immich (changed)",
"/srv/felhom-gate/hdd/appdata/immich/upload/.immich (changed)"
],
"total_s": 921.3
}
Reference in New Issue View Git Blame Copy Permalink