## now: applied-meta and stack .felhom.yml probe port
2026-09-24 10:46:18.306558751 +0000 applied-meta/.felhom.yml
2026-09-24 10:48:16.019124190 +0000 .felhom.yml
applied-meta/.felhom.yml:106:      port: 8999
.felhom.yml:106:      port: 8999

## the controller log 10:38-10:49 (nextcloud: pin, applied, undo, hold, restore)
      1 2026/09/24 10:38:51 sync.go:409: [INFO] [sync] Updated nextcloud/.felhom.yml
      1 2026/09/24 10:39:21 undo.go:273: [INFO] [stacks] update nextcloud: the undo copy will hold 3 named volume(s), 928.8 MiB
      1 2026/09/24 10:39:21 pin.go:373: [INFO] [stacks] update nextcloud: pin advanced to /opt/docker/felhom-controller/data/catalog-cache/templates/nextcloud/docker-compose.yml (nextcloud=nextcloud:34.0.4-apache, nextcloud-db=mariadb:12.3, nextcloud-redis=redis:7.4-alpine)
      1 2026/09/24 10:39:25 undo.go:423: [INFO] [stacks] update nextcloud: copied nextcloud_nextcloud_db_data → nextcloud_nextcloud_db_data.pre-update-20260924T103924Z in 950ms
      1 2026/09/24 10:39:28 healthprobe.go:190: [WARN] Health probe nextcloud: API GET :8999/status.php → Get "http://nextcloud:8999/status.php": dial tcp: lookup nextcloud on 127.0.0.11:53: no such host
      1 2026/09/24 10:39:32 undo.go:423: [INFO] [stacks] update nextcloud: copied nextcloud_nextcloud_html → nextcloud_nextcloud_html.pre-update-20260924T103924Z in 6.779s
      1 2026/09/24 10:39:33 undo.go:423: [INFO] [stacks] update nextcloud: copied nextcloud_nextcloud_redis_data → nextcloud_nextcloud_redis_data.pre-update-20260924T103924Z in 435ms
     17 2026/09/24 10:39:49 healthprobe.go:190: [WARN] Health probe nextcloud: API GET :8999/status.php → Get "http://nextcloud:8999/status.php": dial tcp 172.18.0.5:8999: connect: connection refused
      1 2026/09/24 10:41:10 update.go:961: [INFO] [stacks] update nextcloud: kept 6855 bytes of the app's own log at /opt/docker/stacks/nextcloud/hold-logs/20260924T104110Z/compose-logs.txt before stopping it (R-621)
      1 2026/09/24 10:41:10 update.go:1260: [INFO] [stacks] update nextcloud: phase undoing
      1 2026/09/24 10:41:10 undo.go:501: [WARN] [stacks] update nextcloud: UNDO — putting back the previous version and its 3 volume copy(ies) (reason: not healthy: not healthy within 1m30s (last: health check failing))
      1 2026/09/24 10:41:12 undo.go:507: [ERROR] [stacks] update nextcloud: the undo copy nextcloud_nextcloud_db_data.pre-update-20260924T103924Z has no finished-marker — it is cut off or missing; NOTHING is put back
      1 2026/09/24 10:41:12 update.go:981: [ERROR] [stacks] update nextcloud: the UNDO failed too (untouched) — HOLDING the app; the undo copies are kept: [{nextcloud_nextcloud_db_data nextcloud_nextcloud_db_data.pre-update-20260924T103924Z} {nextcloud_nextcloud_html nextcloud_nextcloud_html.pre-update-20260924T103924Z} {nextcloud_nextcloud_redis_data nextcloud_nextcloud_redis_data.pre-update-20260924T103924Z}]
      1 2026/09/24 10:41:12 settings.go:1814: [WARN] [settings] restore hold SET for nextcloud — the app stays stopped until it is cleared
      1 2026/09/24 10:41:12 update_guard.go:560: [WARN] [backup] nextcloud is HELD STOPPED after a failed update (restore point: tier 2 "második meghajtó", 2026-09-24T10:39:14Z; holds: "a beállításokat, az adatbázist és a fájlokat tartalmazza"; undo: "untouched")
      1 2026/09/24 10:41:12 settings.go:1814: [WARN] [settings] restore hold SET for nextcloud — the app stays stopped until it is cleared
      1 2026/09/24 10:41:12 undo.go:619: [INFO] [stacks] update nextcloud: event app_update_held (hold recorded: true)
      1 2026/09/24 10:41:14 sync.go:409: [INFO] [sync] Updated nextcloud/.felhom.yml
      1 2026/09/24 10:41:28 pin.go:93: [INFO] [stacks] pin nextcloud: nextcloud=nextcloud:34.0.4-apache, nextcloud-db=mariadb:12.3, nextcloud-redis=redis:7-alpine
      1 2026/09/24 10:41:52 restore_unit.go:464: [INFO] [backup] Restore-from-unit completed: nextcloud — 3 volume(s) of 3 listed, 1 database(s) of 1 listed
      1 2026/09/24 10:41:52 settings.go:1848: [INFO] [settings] restore hold CLEARED for nextcloud
      1 2026/09/24 10:41:52 update_guard.go:609: [INFO] [backup] nextcloud: restore completed — the update hold (set 2026-09-24T10:41:12Z) is CLEARED
      9 2026/09/24 10:41:58 healthprobe.go:190: [WARN] Health probe nextcloud: API GET :8999/status.php → Get "http://nextcloud:8999/status.php": dial tcp 172.18.0.5:8999: connect: connection refused
      1 2026/09/24 10:44:13 offbox_reconstitute.go:319: [INFO] [backup] nextcloud: pruned old undo copy pre-restore-20260924T102048Z-nextcloud-mariadb.sql (keeping the newest 3)
      1 2026/09/24 10:44:18 undo.go:273: [INFO] [stacks] update nextcloud: the undo copy will hold 3 named volume(s), 928.8 MiB
      1 2026/09/24 10:44:18 pin.go:373: [INFO] [stacks] update nextcloud: pin advanced to /opt/docker/felhom-controller/data/catalog-cache/templates/nextcloud/docker-compose.yml (nextcloud=nextcloud:34.0.4-apache, nextcloud-db=mariadb:12.3, nextcloud-redis=redis:7.4.0-alpine)
      1 2026/09/24 10:44:24 undo.go:423: [INFO] [stacks] update nextcloud: copied nextcloud_nextcloud_db_data → nextcloud_nextcloud_db_data.pre-update-20260924T104423Z in 929ms
      1 2026/09/24 10:44:31 undo.go:423: [INFO] [stacks] update nextcloud: copied nextcloud_nextcloud_html → nextcloud_nextcloud_html.pre-update-20260924T104423Z in 7.147s
      1 2026/09/24 10:44:31 undo.go:423: [INFO] [stacks] update nextcloud: copied nextcloud_nextcloud_redis_data → nextcloud_nextcloud_redis_data.pre-update-20260924T104423Z in 577ms
     18 2026/09/24 10:44:48 healthprobe.go:190: [WARN] Health probe nextcloud: API GET :8999/status.php → Get "http://nextcloud:8999/status.php": dial tcp 172.18.0.5:8999: connect: connection refused
      1 2026/09/24 10:46:08 update.go:961: [INFO] [stacks] update nextcloud: kept 6773 bytes of the app's own log at /opt/docker/stacks/nextcloud/hold-logs/20260924T104608Z/compose-logs.txt before stopping it (R-621)
      1 2026/09/24 10:46:08 update.go:1260: [INFO] [stacks] update nextcloud: phase undoing
      1 2026/09/24 10:46:08 undo.go:501: [WARN] [stacks] update nextcloud: UNDO — putting back the previous version and its 3 volume copy(ies) (reason: not healthy: not healthy within 1m30s (last: health check failing))
      1 2026/09/24 10:46:18 pin.go:93: [INFO] [stacks] pin nextcloud: nextcloud=nextcloud:34.0.4-apache, nextcloud-db=mariadb:12.3, nextcloud-redis=redis:7-alpine
      1 2026/09/24 10:46:24 [ERROR] [stacks] .felhom.yml backup block rejected in /opt/docker/stacks/nextcloud/pre-update-meta: docker-compose.yml unreadable: stat /opt/docker/stacks/nextcloud/pre-update-meta/docker-compose.yml: no such file or directory
     17 2026/09/24 10:46:34 healthprobe.go:190: [WARN] Health probe nextcloud: API GET :8999/status.php → Get "http://nextcloud:8999/status.php": dial tcp 172.18.0.5:8999: connect: connection refused
      1 2026/09/24 10:47:55 undo.go:535: [ERROR] [stacks] update nextcloud: the previous version did not come up after the undo: not healthy within 1m30s (last: health check failing)
      1 2026/09/24 10:47:55 update.go:961: [INFO] [stacks] update nextcloud: kept 6798 bytes of the app's own log at /opt/docker/stacks/nextcloud/hold-logs/20260924T104755Z/compose-logs.txt before stopping it (R-621)
      1 2026/09/24 10:47:57 update.go:981: [ERROR] [stacks] update nextcloud: the UNDO failed too (not_started) — HOLDING the app; the undo copies are kept: [{nextcloud_nextcloud_db_data nextcloud_nextcloud_db_data.pre-update-20260924T104423Z} {nextcloud_nextcloud_html nextcloud_nextcloud_html.pre-update-20260924T104423Z} {nextcloud_nextcloud_redis_data nextcloud_nextcloud_redis_data.pre-update-20260924T104423Z}]
      1 2026/09/24 10:47:57 settings.go:1814: [WARN] [settings] restore hold SET for nextcloud — the app stays stopped until it is cleared
      1 2026/09/24 10:47:57 update_guard.go:715: [ERROR] [backup] nextcloud is HELD STOPPED after a failed update and NO copy on this box brings it back whole (seen: [tier 1 at 2026-09-24T10:44:17Z]; drive files declared: true; undo: "not_started") — support must act (R-659)
      1 2026/09/24 10:47:57 undo.go:619: [INFO] [stacks] update nextcloud: event app_update_held (hold recorded: true)
      1 2026/09/24 10:48:02 sync.go:409: [INFO] [sync] Updated nextcloud/.felhom.yml
      1 2026/09/24 10:48:16 pin.go:93: [INFO] [stacks] pin nextcloud: nextcloud=nextcloud:34.0.4-apache, nextcloud-db=mariadb:12.3, nextcloud-redis=redis:7-alpine
      1 2026/09/24 10:48:40 restore_unit.go:464: [INFO] [backup] Restore-from-unit completed: nextcloud — 3 volume(s) of 3 listed, 1 database(s) of 1 listed
      1 2026/09/24 10:48:40 settings.go:1848: [INFO] [settings] restore hold CLEARED for nextcloud
      1 2026/09/24 10:48:40 update_guard.go:609: [INFO] [backup] nextcloud: restore completed — the update hold (set 2026-09-24T10:47:57Z) is CLEARED

## undo-copy volumes left
nextcloud_nextcloud_db_data.pre-update-20260924T103924Z
nextcloud_nextcloud_db_data.pre-update-20260924T104423Z
nextcloud_nextcloud_html.pre-update-20260924T103924Z
nextcloud_nextcloud_html.pre-update-20260924T104423Z
nextcloud_nextcloud_redis_data.pre-update-20260924T103924Z
nextcloud_nextcloud_redis_data.pre-update-20260924T104423Z
