Files
felhom.eu/documentation/audits/clock-list-2026-11-11/MATRIX.md
T
admin 978666dde3
gates / gates (push) Successful in 2m2s
lists: the Clock list (70 jobs) and the End-dates list (39 things), 9 register rows, 4 decisions
Read-only review of every job on a timer and of everything that ends on a date,
with measurements from the three test boxes. Nothing ends in the next 14 days.
Register 236 -> 245 (R-1379..R-1387), pointer lines on twelve rows, D76-D79 in
STATUS.md. Part C: felhom-agent's clone address holds no token now; the other
clones wait for the operator's yes. R-1035's 4-week check moved to 2026-11-18
(operator read needed).

Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
2026-11-11 11:54:42 +01:00

118 lines
10 KiB
Markdown

# The Clock list — the matrix
Made by `tools/make-matrix.py` from `TABLE.md`. Do not edit it by hand.
`A` answered · `D` decided, not built · `K` known gap (has a row) · `N` nobody asked. Columns are the eight
questions: 1 what runs, owner, what starts it · 2 when, how often, order · 3 how long, limit, 10x data · 4 if it does not run · 5 late, twice, meets another job · 6 clock wrong or jumps · 7 who is told, when · 8 how do we know.
| Job | Named | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | N |
|---|---|---|---|---|---|---|---|---|---|---|
| CA01 Whole-guest backup: due-check and run · CUSTOMER | mentioned | A | A | A | A | A | K | A | K | 0 |
| CA02 OS-update night leg: guest, host, Docker, Proxmox · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
| CA03 Kernel lane: night reboot, 20-minute boot judge, one self-revert · CUSTOMER | mentioned | A | A | A | A | A | K | A | A | 0 |
| CA04 Crash guard: early-boot unit and the hourly re-arm timer · CUSTOMER | mentioned | A | A | A | A | **N** | **N** | A | **N** | 3 |
| CA05 Scheduled restore-test evaluation · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
| CA06 Controller supervisor: restarts a dead or silent controller · CUSTOMER | mentioned | A | A | **N** | A | A | **N** | A | A | 2 |
| CA07 Guest-power watchdog: starts a guest that must run · CUSTOMER | mentioned | A | A | A | A | A | **N** | **N** | **N** | 3 |
| CA08 Hub report and heartbeat loop · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
| CA09 Signed jobs: the validity window against the host clock · OPERATOR | mentioned | A | A | A | **N** | A | **N** | **N** | A | 3 |
| CA10 Storage watchdog and the 20-second mount re-assert · CUSTOMER | mentioned | A | A | **N** | A | A | **N** | A | **N** | 3 |
| CA11 Weekly guest disk trim · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
| CA12 Weekly upload line test · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CA13 PBS datastore verify loop · CUSTOMER | mentioned | A | A | A | A | **N** | A | **N** | **N** | 3 |
| CA14 Janitor: leftover scratch guests and stale backup locks · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
| CA15 Guest network watchdog: DHCP client heal · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CA16 Host networking self-heal · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
| CA17 Management-plane watchdog timer: keeps SSH reachable · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
| CA18 Agent service: restart, start limit, rollback · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
| CA19 Off-site tunnel loop and the clock-ahead re-key · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CA20 Whole-guest backup cap: rolling windows · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CA21 Unsent OS-update report sender · OPERATOR | unnamed | A | A | A | A | A | A | A | A | 0 |
| CC01 Night dump leg: databases and volumes · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
| CC02 Second-drive copy leg · CUSTOMER | mentioned | A | A | A | A | **N** | A | A | A | 1 |
| CC03 Off-site push leg, with the clean-up of old snapshots · CUSTOMER | mentioned | A | A | A | A | K | A | A | A | 0 |
| CC04 Missed-night catch-up and the resume watch · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CC05 Missed-backup banner (26 hours) · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CC06 Whole-guest backup driver: stop apps, ask the agent, start apps · CUSTOMER | mentioned | A | A | A | A | A | K | A | A | 0 |
| CC07 Automatic app-update leg · CUSTOMER | mentioned | A | A | A | A | A | K | **N** | A | 1 |
| CC08 Off-site integrity check · CUSTOMER | mentioned | A | A | K | A | A | A | A | A | 0 |
| CC09 Off-site proof restore · CUSTOMER | mentioned | A | A | A | A | **N** | A | A | A | 1 |
| CC10 Hub report: every 15 minutes, on change, and the hanging wait · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
| CC11 Controller self-update: check, floor, nightly auto · CUSTOMER | mentioned | A | A | **N** | A | **N** | A | A | A | 2 |
| CC12 Catalog sync: app templates from git · CUSTOMER | mentioned | A | A | **N** | **N** | A | A | A | A | 2 |
| CC13 System health check and base-stack self-heal · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CC14 Dead-app scan · CUSTOMER | mentioned | A | A | **N** | A | A | **N** | A | A | 2 |
| CC15 Disk-fill watch · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CC16 Drive health check, hourly · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CC17 Agent channel health, every 60 seconds · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
| CC18 Held-app report to the hub · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CC19 Abandoned off-site store sweep · CUSTOMER | mentioned | A | A | A | A | **N** | A | **N** | A | 2 |
| CC20 Restore-copy sweep and conversion-copy release · CUSTOMER | mentioned | A | A | **N** | **N** | A | A | A | A | 2 |
| CC21 Upload and CPU watch, torrent limit rule, line-test hold · CUSTOMER | mentioned | A | A | A | A | **N** | A | A | A | 1 |
| CC22 The scheduler itself: daily slots and interval jobs · CUSTOMER | mentioned | A | A | A | A | A | K | A | A | 0 |
| CH01 Box liveness: 'your server cannot be reached' · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CH02 Missed-backup deadline check (05:00) · CUSTOMER | mentioned | A | A | **N** | **N** | A | **N** | A | **N** | 4 |
| CH03 Mail cooldowns and the weekly outage mail · CUSTOMER | mentioned | A | A | A | A | A | **N** | **N** | A | 2 |
| CH04 Retry of a failed operator mail · OPERATOR | mentioned | A | A | A | **N** | A | **N** | **N** | **N** | 4 |
| CH05 Kernel mail: 'your box restarts tonight' · CUSTOMER | mentioned | A | A | A | A | A | A | A | **N** | 1 |
| CH06 OS-update approval tick and the hourly OS alarms · OPERATOR | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
| CH07 Off-site copy too old, and escrow never finished · CUSTOMER | mentioned | A | A | A | **N** | A | **N** | A | **N** | 3 |
| CH08 Restore-test proof too old · OPERATOR | mentioned | A | A | **N** | A | A | **N** | A | **N** | 3 |
| CH09 Off-site clean-up window (20 minutes, weekly) · CUSTOMER | mentioned | A | A | A | **N** | A | **N** | A | A | 2 |
| CH10 Delayed deletion of a set-aside off-site copy · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CH11 Off-site key audit (07:10) · OPERATOR | mentioned | A | A | **N** | **N** | A | A | A | **N** | 3 |
| CH12 Off-site credential stuck, and its self-heal · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
| CH13 PBS whole-box credential self-heal · OPERATOR | mentioned | A | A | A | A | A | A | A | **N** | 1 |
| CH14 WireGuard peer list push to ep0 · OPERATOR | mentioned | A | A | A | **N** | A | A | A | A | 1 |
| CH15 Box clock ran ahead: the tunnel alarm · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
| CH16 The daily scheduler and the hour change · OPERATOR | mentioned | A | A | A | **N** | A | **N** | A | A | 2 |
| CH17 Hub database snapshot (four slots) · OPERATOR | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CH18 Daily prune of old hub rows (04:30) · OPERATOR | mentioned | A | A | **N** | A | A | **N** | A | A | 2 |
| CH19 The other checks on the 60-second sweep · OPERATOR | mentioned | A | A | **N** | A | A | A | A | **N** | 2 |
| CH20 Reminder about a held app · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
| CH21 'A golden is published but not vouched' · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
| CH22 Shared storage boxes: fill and reachability · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
| CH23 DooPlex: push of the hub database snapshot off-site · OPERATOR | mentioned | A | A | A | A | A | K | **N** | A | 1 |
| CH24 DooPlex: Sunday restore tests · OPERATOR | mentioned | A | A | A | A | **N** | **N** | A | A | 2 |
| CH25 DooPlex: nightly off-site push and the release copy · OPERATOR | mentioned | A | A | **N** | A | A | A | A | A | 1 |
| CH26 DooPlex and ep0: PBS copy, prune, verify, clean-up · OPERATOR | mentioned | A | A | A | A | **N** | **N** | **N** | A | 3 |
| CH27 Nightly CI: the gates and the security watch · OPERATOR | mentioned | A | A | A | **N** | A | A | A | **N** | 2 |
## Totals
- Jobs: **70** in the table · named **0** · mentioned only **69** · named by no architecture document **1**.
- Answers: **560** · A **457** · D **0** · K **9** · N **94**.
- Jobs with no N: **18** of 70.
| Question | A | D | K | N |
|---|---|---|---|---|
| 1 what runs, owner, what starts it | 70 | 0 | 0 | 0 |
| 2 when, how often, order | 70 | 0 | 0 | 0 |
| 3 how long, limit, 10x data | 50 | 0 | 1 | 19 |
| 4 if it does not run | 59 | 0 | 0 | 11 |
| 5 late, twice, meets another job | 60 | 0 | 1 | 9 |
| 6 clock wrong or jumps | 36 | 0 | 6 | 28 |
| 7 who is told, when | 61 | 0 | 0 | 9 |
| 8 how do we know | 51 | 0 | 1 | 18 |
## The N answers, by class row
| Class | Row | Count | Members (id-question) |
|---|---|---|---|
| W1 | R-1383 | 23 | CA07-7, CA07-8, CA09-4, CA09-7, CA13-7, CC07-7, CC12-4, CC19-7, CC20-4, CH02-4, CH02-8, CH03-7, CH04-4, CH04-7, CH04-8, CH07-4, CH09-4, CH11-4, CH14-4, CH16-4, CH26-7, CH27-4, CH27-8 |
| W2 | R-1384 | 30 | CA02-6, CA02-8, CA04-6, CA04-8, CA05-6, CA05-8, CA06-6, CA07-6, CA09-6, CA10-6, CA11-6, CA11-8, CA12-6, CA20-6, CC04-6, CC05-6, CC14-6, CC18-6, CH02-6, CH03-6, CH04-6, CH06-6, CH07-6, CH07-8, CH08-6, CH09-6, CH16-6, CH18-6, CH20-6, CH24-6 |
| W3 | R-1385 | 12 | CA04-5, CA13-5, CC02-5, CC09-5, CC11-5, CC19-5, CC21-5, CH05-8, CH24-5, CH25-3, CH26-5, CH26-6 |
| W4 | R-1386 | 25 | CA06-3, CA10-3, CA10-8, CA13-8, CA15-3, CA19-3, CC11-3, CC12-3, CC13-3, CC14-3, CC15-3, CC16-3, CC20-3, CH01-3, CH02-3, CH06-8, CH08-3, CH08-8, CH10-3, CH11-3, CH11-8, CH13-8, CH18-3, CH19-3, CH19-8 |
| W5 | R-1387 | 4 | CA18-6, CA18-8, CH17-6, CH23-7 |
## The K answers, by existing row
| Row | Count | Members |
|---|---|---|
| R-401 | 1 | CC08-3 |
| R-1186 | 1 | CC03-5 |
| R-1189 | 2 | CA01-6, CA01-8 |
| R-1260 | 3 | CC06-6, CC07-6, CC22-6 |
| R-1293 | 1 | CH23-6 |
| R-1301 | 1 | CA03-6 |