09:08:54 === phase h4 at 2026-10-29T08:08:54Z 09:08:58 controller image: gitea.dooplex.hu/admin/felhom-controller:0.347.0-rc.1-d63fault gitea.dooplex.hu/admin/felhom-controller:0.347.0-rc.1-d63fault Up 15 minutes (healthy) 09:09:02 [h4] compose → ghcr.io/kozea/radicale:3.8.1; Restart → 200 {'ok': True, 'data': {'state': 'starting'}, 'message': 'Stack radicale restart requested — state now: starting'} 09:09:08 app: state=starting hold=None deployed=True 09:09:11 compose image: image: ghcr.io/kozea/radicale:3.8.1@sha256:54d9406cd30f9e206a9dd6d61dfac48da26b9afc37200e14f23beb8fafa7d11c 09:09:14 container: ghcr.io/kozea/radicale:3.8.1 Up 11 seconds (healthy) 09:09:17 copies: (none) 09:09:28 radicale: MKCALENDAR /csalad/felhom-749ed888/ http=201 09:09:28 radicale: PUT event http=201 09:09:33 [h4] compose → ghcr.io/kozea/radicale:3.8.0; Restart → 200 {'ok': True, 'data': {'state': 'starting'}, 'message': 'Stack radicale restart requested — state now: starting'} 09:09:39 app: state=running hold=None deployed=True 09:09:42 compose image: image: ghcr.io/kozea/radicale:3.8.0@sha256:0d60d544710bda0fa83bfdea685db731b6cbf74e12d7f22b4997e9cff3a50468 09:09:45 container: ghcr.io/kozea/radicale:3.8.0 Up 11 seconds (healthy) 09:09:48 copies: (none) 09:10:03 app: state=running hold=None deployed=True 09:10:07 compose image: image: ghcr.io/kozea/radicale:3.8.0@sha256:0d60d544710bda0fa83bfdea685db731b6cbf74e12d7f22b4997e9cff3a50468 09:10:10 container: ghcr.io/kozea/radicale:3.8.0 Up 36 seconds (healthy) 09:10:13 copies: (none) 09:10:16 armed: defwrite-after-compose = 0 1 09:10:16 restore: ('HTTP/2 302', ['location: /backups/restore/app?name=radicale&flash=flash.offbox.full_restore_started']) 09:10:16 + 0s h4 restore: (True, 'offbox-reconstitute', None, '') 09:10:22 + 6s h4 restore: (False, 'offbox-reconstitute', None, '') 09:10:22 restore record: {"running": false, "op": "offbox-reconstitute", "stack": "radicale", "started_at": "2026-10-29T08:10:16.87791986Z", "last": {"op": "offbox-reconstitute", "stack": "radicale", "ok": false, "message": "A teljes vissza\u00e1ll\u00edt\u00e1s sikertelen: restoring radicale: writing the snapshot's definition failed: FAULT INJECTED at defwrite-after-compose (D63 test build)", "finished_at": "2026-10-29T08:10:20.32238992Z"}, "last_recent": true} 09:10:26 controller log: 2026/10/29 08:09:01 [INFO] [api] restart requested for stack: radicale 2026/10/29 08:09:01 [INFO] [stacks] Restarting stack: radicale 2026/10/29 08:09:02 [INFO] [stacks] Stack radicale: started again: radicale 2026-10-29T08:07:08.330110078Z → 2026-10-29T08:09:01.852817156Z 2026/10/29 08:09:02 [INFO] [stacks] Stack radicale restarted successfully (took 1.1s) 2026/10/29 08:09:05 [INFO] [stacks] Stack radicale post-start status: 2026/10/29 08:09:05 [INFO] [stacks] radicale ghcr.io/kozea/radicale:3.8.1@sha256:54d9406cd30f9e206a9dd6d61dfac48da26b9afc37200e14f23beb8fafa7d11c running Up 3 seconds (health: starting) 2026/10/29 08:09:32 [INFO] [api] restart requested for stack: radicale 2026/10/29 08:09:32 [INFO] [stacks] Restarting stack: radicale 2026/10/29 08:09:33 [INFO] [stacks] Stack radicale: started again: radicale 2026-10-29T08:09:01.852817156Z → 2026-10-29T08:09:32.950147579Z 2026/10/29 08:09:33 [INFO] [stacks] Stack radicale restarted successfully (took 0.8s) 2026/10/29 08:09:33 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/radicale — 4 env vars, 0 encrypted, 1 sensitive fields 2026/10/29 08:09:33 [INFO] [stacks] installed-images radicale: recorded 1 service(s) (radicale=ghcr.io/kozea/radicale:3.8.0 (sha256:0d60d544710b…)) 2026/10/29 08:09:33 [INFO] [stacks] SaveAppConfig: saved config for radicale 2026/10/29 08:09:36 [INFO] [stacks] Stack radicale post-start status: 2026/10/29 08:09:36 [INFO] [stacks] radicale ghcr.io/kozea/radicale:3.8.0@sha256:0d60d544710bda0fa83bfdea685db731b6cbf74e12d7f22b4997e9cff3a50468 running Up 3 seconds (health: starting) 2026/10/29 08:10:18 [INFO] [offbox] radicale: snapshot 78002a51 holds data of [ghcr.io/kozea/radicale:3.8.1@sha256:54d9406cd30f9e206a9dd6d61dfac48da26b9afc37200e14f23beb8fafa7d11c] (written 2026-10-29T08:03:01Z); the app runs [ghcr.io/kozea/radicale:3.8.0@sha256:0d60d544710bda0fa83bfdea685db731b6cbf74e12d7f22b4997e9cff3a50468] — it comes back at the snapshot's version 2026/10/29 08:10:19 [INFO] [stacks] Stopping stack: radicale 2026/10/29 08:10:19 [INFO] [stacks] Stack radicale stopped successfully (took 0.3s) 2026/10/29 08:10:19 [INFO] [offbox] radicale: the live volumes are copied before the restore (1 copied, 0 new from the snapshot) in 332ms — /mnt/sys_drive/felhom-data/backups/restore-undo/radicale/20261029T081019Z (R-893) 2026/10/29 08:10:19 [INFO] [backup] radicale: the restore copy is recorded — a power cut from here on puts the app back on start (R-1195) 2026/10/29 08:10:19 [ERROR] [faultinject] defwrite-after-compose: FAULT INJECTED (fail left 0) 2026/10/29 08:10:19 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/radicale — 4 env vars, 1 encrypted, 1 sensitive fields 2026/10/29 08:10:19 [INFO] [stacks] Redeploying radicale from recovery unit with 4 env vars 2026/10/29 08:10:19 [INFO] [stacks] SaveAppConfig: saved config for radicale 2026/10/29 08:10:19 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/radicale — 4 env vars, 0 encrypted, 1 sensitive fields 2026/10/29 08:10:19 [INFO] [stacks] SaveAppConfig: saved config for radicale 2026/10/29 08:10:19 [INFO] [stacks] pin radicale: radicale=ghcr.io/kozea/radicale:3.8.0 2026/10/29 08:10:19 [INFO] [offbox] radicale: the definition write failed (FAULT INJECTED at defwrite-after-compose (D63 test build)); the live definition is written back before the start 2026/10/29 08:10:19 [INFO] [stacks] Starting stack: radicale 2026/10/29 08:10:20 [INFO] [stacks] Stack radicale started successfully (took 0.3s) 2026/10/29 08:10:20 [DEBUG] [stacks] SaveAppConfig: saving /opt/docker/stacks/radicale — 4 env vars, 0 encrypted, 1 sensitive fields 2026/10/29 08:10:20 [INFO] [stacks] installed-images radicale: recorded 1 service(s) (radicale=ghcr.io/kozea/radicale:3.8.0 (sha256:0d60d544710b…)) 2026/10/29 08:10:20 [INFO] [stacks] SaveAppConfig: saved config for radicale 2026/10/29 08:10:20 [ERROR] [web] off-box reconstitute radicale (async): restoring radicale: writing the snapshot's definition failed: FAULT INJECTED at defwrite-after-compose (D63 test build) 2026/10/29 08:10:23 [INFO] [stacks] Stack radicale post-start status: 2026/10/29 08:10:23 [INFO] [stacks] radicale ghcr.io/kozea/radicale:3.8.0@sha256:0d60d544710bda0fa83bfdea685db731b6cbf74e12d7f22b4997e9cff3a50468 running Up 3 seconds (health: starting) 09:10:26 app: state=starting hold=None deployed=True 09:10:29 compose image: image: ghcr.io/kozea/radicale:3.8.0@sha256:0d60d544710bda0fa83bfdea685db731b6cbf74e12d7f22b4997e9cff3a50468 09:10:33 container: ghcr.io/kozea/radicale:3.8.0 Up 11 seconds (healthy) 09:10:36 copies: (none) 09:10:38 radicale: readback http=200 found=True (controls: no auth 401, wrong 401, absent 404) 09:10:38 T1 readback: True 09:10:42 radicale: readback http=200 found=True (controls: no auth 401, wrong 401, absent 404) 09:10:42 T2 readback: True 09:10:45 fault file left: (none)