Files
felhom.eu/documentation/audits/night-2026-09-23/chaos/round-09.json
T
admin 3e58c184f6
gates / gates (push) Successful in 27s
night shift 2026-09-23: the record, the register, the morning note
DRILL-night-2026-09-23.md: Parts A-E. 09 §3 decisions 21 (operator word),
22 and 23 (CC unattended, operator may reverse); §6.4 parts 4 and 6
(catalog half) shipped; §6.1a residuals R-658/R-659. Register 330 -> 336:
R-651..R-660 opened (R-658 and R-659 P1), R-650/R-640/R-499/R-626 closed.
Capability map, nightly rotation (opengist), STATUS (one question: the
floor), CONTEXT, REPORT. The floor stays 0.266.0.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
2026-09-24 00:24:04 +02:00

189 lines
9.2 KiB
JSON

{
"round": 9,
"action": "fail_health",
"accident": "kill -9 of the controller's PID: killed 3308 at 23:04:11",
"delay_s": 58,
"app": "vikunja",
"started": "2026-09-23T21:03:08Z",
"before": {
"badges": {
"hu": [
{
"title": "Ez az alkalmazás a legfrissebb elérhető változatot futtatja.",
"text": "Naprakész"
}
],
"en": [
{
"title": "This app is running the newest version available.",
"text": "Up to date"
}
]
},
"lines": {
"hu": {
"undone_line": null,
"hold": null
},
"en": {
"undone_line": null,
"hold": null
}
},
"state": {
"deployed": true,
"state": "running",
"update_phase": null,
"hold_reason": null,
"update_error": null
}
},
"drill_commit": "16512923234a",
"badge_catchup_s": 4.4,
"armed_at": "23:03:13",
"phases": [
[
0.0,
"safety-dump",
"Adatbázis pillanatkép…"
],
[
0.6,
"pulling",
"Új verzió letöltése…"
],
[
3.7,
"copying",
"Az adatok másolása a frissítés előtt…"
],
[
4.2,
"verifying",
"Működés ellenőrzése…"
],
[
152.0,
"undoing",
"Visszaállítás az előző változatra…"
],
[
157.7,
"undone",
"Visszaállítva az előző változatra"
]
],
"controller_back_s": 0.2,
"time_to_steady_s": 163.4,
"after": {
"badges": {
"hu": [
{
"title": "Újabb változat érhető el ehhez az alkalmazáshoz. A frissítés indításához nyomd meg a Frissítés gombot.",
"text": "Frissítés elérhető — ma"
}
],
"en": [
{
"title": "A newer version of this app is available. Select the Update button to start it.",
"text": "Update available — today"
}
]
},
"lines": {
"hu": {
"undone_line": "A(z) vikunja frissítése 2026-09-23 23:05-kor nem sikerült. A doboz automatikusan visszaállította az előző változatot és az adatokat — semmi nem veszett el.",
"hold": null
},
"en": {
"undone_line": "The update of vikunja at 2026-09-23 23:05 did not succeed. The box put back the previous version and its data automatically — nothing was lost.",
"hold": null
}
},
"state": {
"deployed": true,
"state": "running",
"update_phase": "undone",
"hold_reason": null,
"update_error": null
}
},
"observables": {
"pinned_images": {
"vikunja": "vikunja/vikunja:2.5.0"
},
"installed_images": {
"vikunja": "vikunja/vikunja:2.5.0"
},
"catalog_images": {
"vikunja": "vikunja/vikunja:2.6.0"
},
"live_compose_image_lines": [
"image: vikunja/vikunja:2.5.0"
],
"docker_inspect": [
"vikunja vikunja/vikunja:2.5.0 running=true restarts=0"
]
},
"readback": {
"A": true,
"B": true
},
"events": [
"2026-09-23T21:05:51Z app_update_undone (warning)"
],
"box_log": [
"2026-09-23T21:03:09Z INFO [sync] Updated vikunja/.felhom.yml",
"2026-09-23T21:03:09Z INFO [stacks] ScanStacks complete: 55 stacks found (11 deployed, 44 available)",
"2026-09-23T21:03:09Z INFO [api] Catalog sync completed: Sablonok frissítve — frissítve: vikunja",
"2026-09-23T21:03:11Z INFO [stacks] ScanStacks complete: 55 stacks found (11 deployed, 44 available)",
"2026-09-23T21:03:13Z INFO [api] update requested for stack: vikunja",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: accepted — guarded update started",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: phase checking",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: precondition met — Tier 1 (own recovery unit) copy from 2026-09-23T20:56:25Z (7m0s old, limit 24h0m0s)",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: phase safety-dump",
"2026-09-23T21:03:13Z INFO [backup] Discovered 5 databases",
"2026-09-23T21:03:13Z INFO [backup] update safety dump for vikunja: the app has no database — nothing to copy (no-op)",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: safety dump done (0 file(s)) []",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: the undo copy will hold 0 named volume(s), 0.0 MiB",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: phase pinning",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: pin advanced to the catalog's current definition (vikunja=vikunja/vikunja:2.6.0)",
"2026-09-23T21:03:13Z INFO [stacks] update vikunja: phase pulling",
"2026-09-23T21:03:16Z INFO [stacks] update vikunja: phase copying",
"2026-09-23T21:03:17Z INFO [stacks] update vikunja: phase starting",
"2026-09-23T21:03:17Z INFO [stacks] update vikunja: phase verifying",
"2026-09-23T21:03:17Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:03:35Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:03:45Z INFO [scheduler] Running job: backup-cache",
"2026-09-23T21:04:14Z INFO [stacks] ScanStacks complete: 55 stacks found (11 deployed, 44 available)",
"2026-09-23T21:04:14Z WARN [stacks] update recovery: vikunja was interrupted in verifying (started 2026-09-23T21:03:13Z) — the new version may have run; marking it Updating and RESUMING the health wait",
"2026-09-23T21:04:14Z WARN [update] 1 interrupted update(s) will resume after the backup side is wired: [vikunja]",
"2026-09-23T21:04:14Z INFO [backup] restore record wired: /opt/docker/felhom-controller/data/restore-status.json (interrupted at startup: false)",
"2026-09-23T21:04:14Z INFO [scheduler] Registered periodic job: backup-cache (every 5m0s)",
"2026-09-23T21:04:14Z INFO [scheduler] Daily job tier2-backup scheduled for 2026-09-24 03:30 CEST",
"2026-09-23T21:04:14Z INFO [scheduler] Daily job offbox-backup scheduled for 2026-09-24 04:15 CEST",
"2026-09-23T21:04:14Z INFO [stacks] update vikunja: resuming after a controller restart — `up -d` then the health wait",
"2026-09-23T21:04:14Z INFO [backup] Found 8 DB dump files across drives",
"2026-09-23T21:04:14Z INFO [stacks] update vikunja: phase verifying",
"2026-09-23T21:04:14Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:04:14Z INFO [backup] Discovered 5 databases",
"2026-09-23T21:04:14Z INFO [backup] Backup status cache refreshed",
"2026-09-23T21:04:15Z WARN [api] Unauthorized request to /api/stacks/vikunja from 172.18.0.12:57278",
"2026-09-23T21:04:34Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:04:44Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:04:54Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:05:14Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:05:24Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:05:44Z WARN Health probe vikunja: API GET :8999/api/v1/info → Get \"http://vikunja:8999/api/v1/info\": dial tcp 172.18.0.2:8999: connect: connection refused",
"2026-09-23T21:05:45Z ERROR [stacks] update vikunja FAILED after the new version was started: not healthy: not healthy within 1m30s (last: state unhealthy)",
"2026-09-23T21:05:45Z INFO [stacks] update vikunja: kept 1299 bytes of the app's own log at /opt/docker/stacks/vikunja/hold-logs/20260923T210545Z/compose-logs.txt before stopping it (R-621)",
"2026-09-23T21:05:45Z INFO [stacks] update vikunja: phase undoing",
"2026-09-23T21:05:45Z WARN [stacks] update vikunja: UNDO — putting back the previous version and its 0 volume copy(ies) (reason: not healthy: not healthy within 1m30s (last: state unhealthy))",
"2026-09-23T21:05:45Z INFO [stacks] pin vikunja: vikunja=vikunja/vikunja:2.5.0",
"2026-09-23T21:05:46Z WARN Health probe vikunja: API GET :3456/api/v1/info → Get \"http://vikunja:3456/api/v1/info\": dial tcp 172.18.0.2:3456: connect: connection refused",
"2026-09-23T21:05:51Z INFO [stacks] update vikunja: event app_update_undone",
"2026-09-23T21:05:51Z WARN notifier disabled (no hub configured): DROPPED event app_update_undone (severity warning) — further app_update_undone events are logged at DEBUG only",
"2026-09-23T21:05:51Z INFO [stacks] update vikunja: UNDONE in 6s — the previous version is running on the data from before the update (the app's health check passed)"
],
"undo_copies_left": "0"
}