Files
felhom.eu/documentation/audits/clock-list-2026-11-11/MATRIX.md
T
admin 978666dde3
gates / gates (push) Successful in 2m2s
lists: the Clock list (70 jobs) and the End-dates list (39 things), 9 register rows, 4 decisions
Read-only review of every job on a timer and of everything that ends on a date,
with measurements from the three test boxes. Nothing ends in the next 14 days.
Register 236 -> 245 (R-1379..R-1387), pointer lines on twelve rows, D76-D79 in
STATUS.md. Part C: felhom-agent's clone address holds no token now; the other
clones wait for the operator's yes. R-1035's 4-week check moved to 2026-11-18
(operator read needed).

Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
2026-11-11 11:54:42 +01:00

10 KiB

The Clock list — the matrix

Made by tools/make-matrix.py from TABLE.md. Do not edit it by hand.

A answered · D decided, not built · K known gap (has a row) · N nobody asked. Columns are the eight questions: 1 what runs, owner, what starts it · 2 when, how often, order · 3 how long, limit, 10x data · 4 if it does not run · 5 late, twice, meets another job · 6 clock wrong or jumps · 7 who is told, when · 8 how do we know.

Job Named 1 2 3 4 5 6 7 8 N
CA01 Whole-guest backup: due-check and run · CUSTOMER mentioned A A A A A K A K 0
CA02 OS-update night leg: guest, host, Docker, Proxmox · CUSTOMER mentioned A A A A A N A N 2
CA03 Kernel lane: night reboot, 20-minute boot judge, one self-revert · CUSTOMER mentioned A A A A A K A A 0
CA04 Crash guard: early-boot unit and the hourly re-arm timer · CUSTOMER mentioned A A A A N N A N 3
CA05 Scheduled restore-test evaluation · CUSTOMER mentioned A A A A A N A N 2
CA06 Controller supervisor: restarts a dead or silent controller · CUSTOMER mentioned A A N A A N A A 2
CA07 Guest-power watchdog: starts a guest that must run · CUSTOMER mentioned A A A A A N N N 3
CA08 Hub report and heartbeat loop · CUSTOMER mentioned A A A A A A A A 0
CA09 Signed jobs: the validity window against the host clock · OPERATOR mentioned A A A N A N N A 3
CA10 Storage watchdog and the 20-second mount re-assert · CUSTOMER mentioned A A N A A N A N 3
CA11 Weekly guest disk trim · CUSTOMER mentioned A A A A A N A N 2
CA12 Weekly upload line test · CUSTOMER mentioned A A A A A N A A 1
CA13 PBS datastore verify loop · CUSTOMER mentioned A A A A N A N N 3
CA14 Janitor: leftover scratch guests and stale backup locks · CUSTOMER mentioned A A A A A A A A 0
CA15 Guest network watchdog: DHCP client heal · CUSTOMER mentioned A A N A A A A A 1
CA16 Host networking self-heal · CUSTOMER mentioned A A A A A A A A 0
CA17 Management-plane watchdog timer: keeps SSH reachable · OPERATOR mentioned A A A A A A A A 0
CA18 Agent service: restart, start limit, rollback · CUSTOMER mentioned A A A A A N A N 2
CA19 Off-site tunnel loop and the clock-ahead re-key · CUSTOMER mentioned A A N A A A A A 1
CA20 Whole-guest backup cap: rolling windows · CUSTOMER mentioned A A A A A N A A 1
CA21 Unsent OS-update report sender · OPERATOR unnamed A A A A A A A A 0
CC01 Night dump leg: databases and volumes · CUSTOMER mentioned A A A A A A A A 0
CC02 Second-drive copy leg · CUSTOMER mentioned A A A A N A A A 1
CC03 Off-site push leg, with the clean-up of old snapshots · CUSTOMER mentioned A A A A K A A A 0
CC04 Missed-night catch-up and the resume watch · CUSTOMER mentioned A A A A A N A A 1
CC05 Missed-backup banner (26 hours) · CUSTOMER mentioned A A A A A N A A 1
CC06 Whole-guest backup driver: stop apps, ask the agent, start apps · CUSTOMER mentioned A A A A A K A A 0
CC07 Automatic app-update leg · CUSTOMER mentioned A A A A A K N A 1
CC08 Off-site integrity check · CUSTOMER mentioned A A K A A A A A 0
CC09 Off-site proof restore · CUSTOMER mentioned A A A A N A A A 1
CC10 Hub report: every 15 minutes, on change, and the hanging wait · CUSTOMER mentioned A A A A A A A A 0
CC11 Controller self-update: check, floor, nightly auto · CUSTOMER mentioned A A N A N A A A 2
CC12 Catalog sync: app templates from git · CUSTOMER mentioned A A N N A A A A 2
CC13 System health check and base-stack self-heal · CUSTOMER mentioned A A N A A A A A 1
CC14 Dead-app scan · CUSTOMER mentioned A A N A A N A A 2
CC15 Disk-fill watch · CUSTOMER mentioned A A N A A A A A 1
CC16 Drive health check, hourly · CUSTOMER mentioned A A N A A A A A 1
CC17 Agent channel health, every 60 seconds · CUSTOMER mentioned A A A A A A A A 0
CC18 Held-app report to the hub · CUSTOMER mentioned A A A A A N A A 1
CC19 Abandoned off-site store sweep · CUSTOMER mentioned A A A A N A N A 2
CC20 Restore-copy sweep and conversion-copy release · CUSTOMER mentioned A A N N A A A A 2
CC21 Upload and CPU watch, torrent limit rule, line-test hold · CUSTOMER mentioned A A A A N A A A 1
CC22 The scheduler itself: daily slots and interval jobs · CUSTOMER mentioned A A A A A K A A 0
CH01 Box liveness: 'your server cannot be reached' · CUSTOMER mentioned A A N A A A A A 1
CH02 Missed-backup deadline check (05:00) · CUSTOMER mentioned A A N N A N A N 4
CH03 Mail cooldowns and the weekly outage mail · CUSTOMER mentioned A A A A A N N A 2
CH04 Retry of a failed operator mail · OPERATOR mentioned A A A N A N N N 4
CH05 Kernel mail: 'your box restarts tonight' · CUSTOMER mentioned A A A A A A A N 1
CH06 OS-update approval tick and the hourly OS alarms · OPERATOR mentioned A A A A A N A N 2
CH07 Off-site copy too old, and escrow never finished · CUSTOMER mentioned A A A N A N A N 3
CH08 Restore-test proof too old · OPERATOR mentioned A A N A A N A N 3
CH09 Off-site clean-up window (20 minutes, weekly) · CUSTOMER mentioned A A A N A N A A 2
CH10 Delayed deletion of a set-aside off-site copy · CUSTOMER mentioned A A N A A A A A 1
CH11 Off-site key audit (07:10) · OPERATOR mentioned A A N N A A A N 3
CH12 Off-site credential stuck, and its self-heal · OPERATOR mentioned A A A A A A A A 0
CH13 PBS whole-box credential self-heal · OPERATOR mentioned A A A A A A A N 1
CH14 WireGuard peer list push to ep0 · OPERATOR mentioned A A A N A A A A 1
CH15 Box clock ran ahead: the tunnel alarm · OPERATOR mentioned A A A A A A A A 0
CH16 The daily scheduler and the hour change · OPERATOR mentioned A A A N A N A A 2
CH17 Hub database snapshot (four slots) · OPERATOR mentioned A A A A A N A A 1
CH18 Daily prune of old hub rows (04:30) · OPERATOR mentioned A A N A A N A A 2
CH19 The other checks on the 60-second sweep · OPERATOR mentioned A A N A A A A N 2
CH20 Reminder about a held app · CUSTOMER mentioned A A A A A N A A 1
CH21 'A golden is published but not vouched' · OPERATOR mentioned A A A A A A A A 0
CH22 Shared storage boxes: fill and reachability · OPERATOR mentioned A A A A A A A A 0
CH23 DooPlex: push of the hub database snapshot off-site · OPERATOR mentioned A A A A A K N A 1
CH24 DooPlex: Sunday restore tests · OPERATOR mentioned A A A A N N A A 2
CH25 DooPlex: nightly off-site push and the release copy · OPERATOR mentioned A A N A A A A A 1
CH26 DooPlex and ep0: PBS copy, prune, verify, clean-up · OPERATOR mentioned A A A A N N N A 3
CH27 Nightly CI: the gates and the security watch · OPERATOR mentioned A A A N A A A N 2

Totals

  • Jobs: 70 in the table · named 0 · mentioned only 69 · named by no architecture document 1.
  • Answers: 560 · A 457 · D 0 · K 9 · N 94.
  • Jobs with no N: 18 of 70.
Question A D K N
1 what runs, owner, what starts it 70 0 0 0
2 when, how often, order 70 0 0 0
3 how long, limit, 10x data 50 0 1 19
4 if it does not run 59 0 0 11
5 late, twice, meets another job 60 0 1 9
6 clock wrong or jumps 36 0 6 28
7 who is told, when 61 0 0 9
8 how do we know 51 0 1 18

The N answers, by class row

Class Row Count Members (id-question)
W1 R-1383 23 CA07-7, CA07-8, CA09-4, CA09-7, CA13-7, CC07-7, CC12-4, CC19-7, CC20-4, CH02-4, CH02-8, CH03-7, CH04-4, CH04-7, CH04-8, CH07-4, CH09-4, CH11-4, CH14-4, CH16-4, CH26-7, CH27-4, CH27-8
W2 R-1384 30 CA02-6, CA02-8, CA04-6, CA04-8, CA05-6, CA05-8, CA06-6, CA07-6, CA09-6, CA10-6, CA11-6, CA11-8, CA12-6, CA20-6, CC04-6, CC05-6, CC14-6, CC18-6, CH02-6, CH03-6, CH04-6, CH06-6, CH07-6, CH07-8, CH08-6, CH09-6, CH16-6, CH18-6, CH20-6, CH24-6
W3 R-1385 12 CA04-5, CA13-5, CC02-5, CC09-5, CC11-5, CC19-5, CC21-5, CH05-8, CH24-5, CH25-3, CH26-5, CH26-6
W4 R-1386 25 CA06-3, CA10-3, CA10-8, CA13-8, CA15-3, CA19-3, CC11-3, CC12-3, CC13-3, CC14-3, CC15-3, CC16-3, CC20-3, CH01-3, CH02-3, CH06-8, CH08-3, CH08-8, CH10-3, CH11-3, CH11-8, CH13-8, CH18-3, CH19-3, CH19-8
W5 R-1387 4 CA18-6, CA18-8, CH17-6, CH23-7

The K answers, by existing row

Row Count Members
R-401 1 CC08-3
R-1186 1 CC03-5
R-1189 2 CA01-6, CA01-8
R-1260 3 CC06-6, CC07-6, CC22-6
R-1293 1 CH23-6
R-1301 1 CA03-6