R-858 filed (P2): a Docker engine step leaves the controller and traefik on the old docker socket; demo-felhom repaired by restarting the two containers; incident evidence
gates / gates (push) Successful in 28s
gates / gates (push) Successful in 28s
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
This commit is contained in:
@@ -0,0 +1,20 @@
|
||||
== 2026-10-04T15:56:54Z demo-felhom guest 9201
|
||||
1506210 srw-rw---- 1 root docker 0 Oct 4 14:13 /var/run/docker.sock
|
||||
143 srw-rw---- 0 root 991 0 Aug 10 07:25 /var/run/docker.sock
|
||||
cloudflared mounts-socket=no
|
||||
felhom-controller mounts-socket=socket
|
||||
filebrowser mounts-socket=no
|
||||
traefik mounts-socket=socket
|
||||
opengist mounts-socket=no
|
||||
2026-10-04T14:13:33+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:33.518477721Z" level=info msg="Restoring containers: start."
|
||||
2026-10-04T14:13:33+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:33.566951360Z" level=info msg="Deleting nftables IPv4 rules" error="running nft: /dev/stdin:1:17-30: Error: Could not process rule: No such file or directory\ndelete table ip docker-bridges\n ^^^^^^^^^^^^^^\n exit status 1"
|
||||
2026-10-04T14:13:33+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:33.575940033Z" level=info msg="Deleting nftables IPv6 rules" error="running nft: /dev/stdin:1:18-31: Error: Could not process rule: No such file or directory\ndelete table ip6 docker-bridges\n ^^^^^^^^^^^^^^\n exit status 1"
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.060369627Z" level=info msg="there are running containers, updated network configuration will not take affect"
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.060647190Z" level=info msg="Loading containers: done."
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.074298789Z" level=info msg="Docker daemon" commit=8af9fe3 containerd-snapshotter=false storage-driver=overlay2 version=29.8.2
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.074346504Z" level=info msg="Initializing buildkit"
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.074487454Z" level=warning msg="failed check for fsverity support" error="enable fsverity failed: operation not supported" path=/var/lib/docker/buildkit/content
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.219975776Z" level=info msg="Completed buildkit initialization"
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.223588774Z" level=info msg="Daemon has completed initialization"
|
||||
2026-10-04T14:13:34+00:00 demo-felhom dockerd[3505106]: time="2026-10-04T14:13:34.223626300Z" level=info msg="API listen on /run/docker.sock"
|
||||
2026-10-04T14:13:34+00:00 demo-felhom systemd[1]: Started docker.service - Docker Application Container Engine.
|
||||
@@ -0,0 +1,40 @@
|
||||
2026/10/04 11:57:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 11:57:03 [INFO] [scheduler] Job agent-channel-health completed (took 837ms)
|
||||
2026/10/04 11:58:02 [INFO] [scheduler] Running job: system-health
|
||||
2026/10/04 11:58:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 11:58:02 [INFO] [monitor] Health check: status=ok
|
||||
2026/10/04 11:58:02 [INFO] [scheduler] Job system-health completed (took 194ms)
|
||||
2026/10/04 11:58:03 [INFO] [scheduler] Job agent-channel-health completed (took 958ms)
|
||||
2026/10/04 11:58:42 [INFO] Health probes: 1 ok (of 1 probed)
|
||||
2026/10/04 11:59:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 11:59:03 [INFO] [scheduler] Job agent-channel-health completed (took 838ms)
|
||||
2026/10/04 12:00:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:00:03 [INFO] [scheduler] Job agent-channel-health completed (took 833ms)
|
||||
2026/10/04 12:01:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:01:03 [INFO] [scheduler] Job agent-channel-health completed (took 825ms)
|
||||
2026/10/04 12:02:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:02:03 [INFO] [scheduler] Job agent-channel-health completed (took 828ms)
|
||||
2026/10/04 12:03:02 [INFO] [scheduler] Running job: system-health
|
||||
2026/10/04 12:03:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:03:02 [INFO] [monitor] Health check: status=ok
|
||||
2026/10/04 12:03:02 [INFO] [scheduler] Job system-health completed (took 239ms)
|
||||
2026/10/04 12:03:02 [INFO] [monitor] Health check: status=ok
|
||||
2026/10/04 12:03:03 [INFO] [scheduler] Job agent-channel-health completed (took 1.085s)
|
||||
2026/10/04 12:03:42 [INFO] Health probes: 1 ok (of 1 probed)
|
||||
2026/10/04 12:04:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:04:03 [INFO] [scheduler] Job agent-channel-health completed (took 831ms)
|
||||
2026/10/04 12:05:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:05:03 [INFO] [scheduler] Job agent-channel-health completed (took 838ms)
|
||||
2026/10/04 12:06:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:06:03 [INFO] [scheduler] Job agent-channel-health completed (took 860ms)
|
||||
2026/10/04 12:07:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:07:03 [INFO] [scheduler] Job agent-channel-health completed (took 846ms)
|
||||
2026/10/04 12:08:02 [INFO] [scheduler] Running job: system-health
|
||||
2026/10/04 12:08:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:08:02 [INFO] [monitor] Health check: status=ok
|
||||
2026/10/04 12:08:02 [INFO] [scheduler] Job system-health completed (took 188ms)
|
||||
2026/10/04 12:08:03 [INFO] [scheduler] Job agent-channel-health completed (took 968ms)
|
||||
2026/10/04 12:08:52 [INFO] Health probes: 1 ok (of 1 probed)
|
||||
2026/10/04 12:09:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/10/04 12:09:03 [INFO] [scheduler] Job agent-channel-health completed (took 836ms)
|
||||
2026/10/04 12:10:02 [INFO] [scheduler] Running job: agent-channel-health
|
||||
@@ -0,0 +1,14 @@
|
||||
repair 2026-10-04T15:57:13Z: docker restart traefik felhom-controller (containers only; the engine untouched)
|
||||
traefik
|
||||
felhom-controller
|
||||
controller health=healthy
|
||||
1506210 srw-rw---- 1 root 991 0 Oct 4 14:13 /var/run/docker.sock
|
||||
1506210 srw-rw---- 1 root 991 0 Oct 4 14:13 /var/run/docker.sock
|
||||
cloudflared | Up 5 hours (healthy)
|
||||
felhom-controller | Up 9 seconds (healthy)
|
||||
filebrowser | Up 7 hours (healthy)
|
||||
traefik | Up 9 seconds
|
||||
opengist | Up 10 hours (healthy)
|
||||
ActiveEnterTimestamp=Sun 2026-10-04 14:13:34 UTC
|
||||
2026/10/04 15:57:16 [INFO] [monitor] Health check: status=ok
|
||||
2026/10/04 15:57:21 [INFO] [monitor] Health check: status=ok
|
||||
Reference in New Issue
Block a user