gates / gates (push) Successful in 2m2s
Read-only review of every job on a timer and of everything that ends on a date, with measurements from the three test boxes. Nothing ends in the next 14 days. Register 236 -> 245 (R-1379..R-1387), pointer lines on twelve rows, D76-D79 in STATUS.md. Part C: felhom-agent's clone address holds no token now; the other clones wait for the operator's yes. R-1035's 4-week check moved to 2026-11-18 (operator read needed). Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
118 lines
10 KiB
Markdown
118 lines
10 KiB
Markdown
# The Clock list — the matrix
|
|
|
|
Made by `tools/make-matrix.py` from `TABLE.md`. Do not edit it by hand.
|
|
|
|
`A` answered · `D` decided, not built · `K` known gap (has a row) · `N` nobody asked. Columns are the eight
|
|
questions: 1 what runs, owner, what starts it · 2 when, how often, order · 3 how long, limit, 10x data · 4 if it does not run · 5 late, twice, meets another job · 6 clock wrong or jumps · 7 who is told, when · 8 how do we know.
|
|
|
|
| Job | Named | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | N |
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
|
| CA01 Whole-guest backup: due-check and run · CUSTOMER | mentioned | A | A | A | A | A | K | A | K | 0 |
|
|
| CA02 OS-update night leg: guest, host, Docker, Proxmox · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
|
|
| CA03 Kernel lane: night reboot, 20-minute boot judge, one self-revert · CUSTOMER | mentioned | A | A | A | A | A | K | A | A | 0 |
|
|
| CA04 Crash guard: early-boot unit and the hourly re-arm timer · CUSTOMER | mentioned | A | A | A | A | **N** | **N** | A | **N** | 3 |
|
|
| CA05 Scheduled restore-test evaluation · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
|
|
| CA06 Controller supervisor: restarts a dead or silent controller · CUSTOMER | mentioned | A | A | **N** | A | A | **N** | A | A | 2 |
|
|
| CA07 Guest-power watchdog: starts a guest that must run · CUSTOMER | mentioned | A | A | A | A | A | **N** | **N** | **N** | 3 |
|
|
| CA08 Hub report and heartbeat loop · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CA09 Signed jobs: the validity window against the host clock · OPERATOR | mentioned | A | A | A | **N** | A | **N** | **N** | A | 3 |
|
|
| CA10 Storage watchdog and the 20-second mount re-assert · CUSTOMER | mentioned | A | A | **N** | A | A | **N** | A | **N** | 3 |
|
|
| CA11 Weekly guest disk trim · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
|
|
| CA12 Weekly upload line test · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CA13 PBS datastore verify loop · CUSTOMER | mentioned | A | A | A | A | **N** | A | **N** | **N** | 3 |
|
|
| CA14 Janitor: leftover scratch guests and stale backup locks · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CA15 Guest network watchdog: DHCP client heal · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CA16 Host networking self-heal · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CA17 Management-plane watchdog timer: keeps SSH reachable · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CA18 Agent service: restart, start limit, rollback · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
|
|
| CA19 Off-site tunnel loop and the clock-ahead re-key · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CA20 Whole-guest backup cap: rolling windows · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CA21 Unsent OS-update report sender · OPERATOR | unnamed | A | A | A | A | A | A | A | A | 0 |
|
|
| CC01 Night dump leg: databases and volumes · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CC02 Second-drive copy leg · CUSTOMER | mentioned | A | A | A | A | **N** | A | A | A | 1 |
|
|
| CC03 Off-site push leg, with the clean-up of old snapshots · CUSTOMER | mentioned | A | A | A | A | K | A | A | A | 0 |
|
|
| CC04 Missed-night catch-up and the resume watch · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CC05 Missed-backup banner (26 hours) · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CC06 Whole-guest backup driver: stop apps, ask the agent, start apps · CUSTOMER | mentioned | A | A | A | A | A | K | A | A | 0 |
|
|
| CC07 Automatic app-update leg · CUSTOMER | mentioned | A | A | A | A | A | K | **N** | A | 1 |
|
|
| CC08 Off-site integrity check · CUSTOMER | mentioned | A | A | K | A | A | A | A | A | 0 |
|
|
| CC09 Off-site proof restore · CUSTOMER | mentioned | A | A | A | A | **N** | A | A | A | 1 |
|
|
| CC10 Hub report: every 15 minutes, on change, and the hanging wait · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CC11 Controller self-update: check, floor, nightly auto · CUSTOMER | mentioned | A | A | **N** | A | **N** | A | A | A | 2 |
|
|
| CC12 Catalog sync: app templates from git · CUSTOMER | mentioned | A | A | **N** | **N** | A | A | A | A | 2 |
|
|
| CC13 System health check and base-stack self-heal · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CC14 Dead-app scan · CUSTOMER | mentioned | A | A | **N** | A | A | **N** | A | A | 2 |
|
|
| CC15 Disk-fill watch · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CC16 Drive health check, hourly · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CC17 Agent channel health, every 60 seconds · CUSTOMER | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CC18 Held-app report to the hub · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CC19 Abandoned off-site store sweep · CUSTOMER | mentioned | A | A | A | A | **N** | A | **N** | A | 2 |
|
|
| CC20 Restore-copy sweep and conversion-copy release · CUSTOMER | mentioned | A | A | **N** | **N** | A | A | A | A | 2 |
|
|
| CC21 Upload and CPU watch, torrent limit rule, line-test hold · CUSTOMER | mentioned | A | A | A | A | **N** | A | A | A | 1 |
|
|
| CC22 The scheduler itself: daily slots and interval jobs · CUSTOMER | mentioned | A | A | A | A | A | K | A | A | 0 |
|
|
| CH01 Box liveness: 'your server cannot be reached' · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CH02 Missed-backup deadline check (05:00) · CUSTOMER | mentioned | A | A | **N** | **N** | A | **N** | A | **N** | 4 |
|
|
| CH03 Mail cooldowns and the weekly outage mail · CUSTOMER | mentioned | A | A | A | A | A | **N** | **N** | A | 2 |
|
|
| CH04 Retry of a failed operator mail · OPERATOR | mentioned | A | A | A | **N** | A | **N** | **N** | **N** | 4 |
|
|
| CH05 Kernel mail: 'your box restarts tonight' · CUSTOMER | mentioned | A | A | A | A | A | A | A | **N** | 1 |
|
|
| CH06 OS-update approval tick and the hourly OS alarms · OPERATOR | mentioned | A | A | A | A | A | **N** | A | **N** | 2 |
|
|
| CH07 Off-site copy too old, and escrow never finished · CUSTOMER | mentioned | A | A | A | **N** | A | **N** | A | **N** | 3 |
|
|
| CH08 Restore-test proof too old · OPERATOR | mentioned | A | A | **N** | A | A | **N** | A | **N** | 3 |
|
|
| CH09 Off-site clean-up window (20 minutes, weekly) · CUSTOMER | mentioned | A | A | A | **N** | A | **N** | A | A | 2 |
|
|
| CH10 Delayed deletion of a set-aside off-site copy · CUSTOMER | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CH11 Off-site key audit (07:10) · OPERATOR | mentioned | A | A | **N** | **N** | A | A | A | **N** | 3 |
|
|
| CH12 Off-site credential stuck, and its self-heal · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CH13 PBS whole-box credential self-heal · OPERATOR | mentioned | A | A | A | A | A | A | A | **N** | 1 |
|
|
| CH14 WireGuard peer list push to ep0 · OPERATOR | mentioned | A | A | A | **N** | A | A | A | A | 1 |
|
|
| CH15 Box clock ran ahead: the tunnel alarm · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CH16 The daily scheduler and the hour change · OPERATOR | mentioned | A | A | A | **N** | A | **N** | A | A | 2 |
|
|
| CH17 Hub database snapshot (four slots) · OPERATOR | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CH18 Daily prune of old hub rows (04:30) · OPERATOR | mentioned | A | A | **N** | A | A | **N** | A | A | 2 |
|
|
| CH19 The other checks on the 60-second sweep · OPERATOR | mentioned | A | A | **N** | A | A | A | A | **N** | 2 |
|
|
| CH20 Reminder about a held app · CUSTOMER | mentioned | A | A | A | A | A | **N** | A | A | 1 |
|
|
| CH21 'A golden is published but not vouched' · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CH22 Shared storage boxes: fill and reachability · OPERATOR | mentioned | A | A | A | A | A | A | A | A | 0 |
|
|
| CH23 DooPlex: push of the hub database snapshot off-site · OPERATOR | mentioned | A | A | A | A | A | K | **N** | A | 1 |
|
|
| CH24 DooPlex: Sunday restore tests · OPERATOR | mentioned | A | A | A | A | **N** | **N** | A | A | 2 |
|
|
| CH25 DooPlex: nightly off-site push and the release copy · OPERATOR | mentioned | A | A | **N** | A | A | A | A | A | 1 |
|
|
| CH26 DooPlex and ep0: PBS copy, prune, verify, clean-up · OPERATOR | mentioned | A | A | A | A | **N** | **N** | **N** | A | 3 |
|
|
| CH27 Nightly CI: the gates and the security watch · OPERATOR | mentioned | A | A | A | **N** | A | A | A | **N** | 2 |
|
|
|
|
## Totals
|
|
|
|
- Jobs: **70** in the table · named **0** · mentioned only **69** · named by no architecture document **1**.
|
|
- Answers: **560** · A **457** · D **0** · K **9** · N **94**.
|
|
- Jobs with no N: **18** of 70.
|
|
|
|
| Question | A | D | K | N |
|
|
|---|---|---|---|---|
|
|
| 1 what runs, owner, what starts it | 70 | 0 | 0 | 0 |
|
|
| 2 when, how often, order | 70 | 0 | 0 | 0 |
|
|
| 3 how long, limit, 10x data | 50 | 0 | 1 | 19 |
|
|
| 4 if it does not run | 59 | 0 | 0 | 11 |
|
|
| 5 late, twice, meets another job | 60 | 0 | 1 | 9 |
|
|
| 6 clock wrong or jumps | 36 | 0 | 6 | 28 |
|
|
| 7 who is told, when | 61 | 0 | 0 | 9 |
|
|
| 8 how do we know | 51 | 0 | 1 | 18 |
|
|
|
|
## The N answers, by class row
|
|
|
|
| Class | Row | Count | Members (id-question) |
|
|
|---|---|---|---|
|
|
| W1 | R-1383 | 23 | CA07-7, CA07-8, CA09-4, CA09-7, CA13-7, CC07-7, CC12-4, CC19-7, CC20-4, CH02-4, CH02-8, CH03-7, CH04-4, CH04-7, CH04-8, CH07-4, CH09-4, CH11-4, CH14-4, CH16-4, CH26-7, CH27-4, CH27-8 |
|
|
| W2 | R-1384 | 30 | CA02-6, CA02-8, CA04-6, CA04-8, CA05-6, CA05-8, CA06-6, CA07-6, CA09-6, CA10-6, CA11-6, CA11-8, CA12-6, CA20-6, CC04-6, CC05-6, CC14-6, CC18-6, CH02-6, CH03-6, CH04-6, CH06-6, CH07-6, CH07-8, CH08-6, CH09-6, CH16-6, CH18-6, CH20-6, CH24-6 |
|
|
| W3 | R-1385 | 12 | CA04-5, CA13-5, CC02-5, CC09-5, CC11-5, CC19-5, CC21-5, CH05-8, CH24-5, CH25-3, CH26-5, CH26-6 |
|
|
| W4 | R-1386 | 25 | CA06-3, CA10-3, CA10-8, CA13-8, CA15-3, CA19-3, CC11-3, CC12-3, CC13-3, CC14-3, CC15-3, CC16-3, CC20-3, CH01-3, CH02-3, CH06-8, CH08-3, CH08-8, CH10-3, CH11-3, CH11-8, CH13-8, CH18-3, CH19-3, CH19-8 |
|
|
| W5 | R-1387 | 4 | CA18-6, CA18-8, CH17-6, CH23-7 |
|
|
|
|
## The K answers, by existing row
|
|
|
|
| Row | Count | Members |
|
|
|---|---|---|
|
|
| R-401 | 1 | CC08-3 |
|
|
| R-1186 | 1 | CC03-5 |
|
|
| R-1189 | 2 | CA01-6, CA01-8 |
|
|
| R-1260 | 3 | CC06-6, CC07-6, CC22-6 |
|
|
| R-1293 | 1 | CH23-6 |
|
|
| R-1301 | 1 | CA03-6 |
|