Tester 2's RESET checked read only: every leg ok, the first live R-32 purge (folder held no repository; sub-account gone), ep0 namespace+copy+prune job+token gone, no other customer touched (Storage Box 303/62/43 and ep0 2/2/2/1/27 before = after); hand-over: tell the friend go; A20 third firing; R-32 result + dated check for Tester4
gates / gates (push) Successful in 16m3s

This commit is contained in:
admin committed 2026-10-22 15:04:07 +02:00
1 parent 82ce9d72d6
commit 1b442bcc2e
11 files changed
+169 -8

No files matched your search

@@ -0,0 +1,28 @@
# Tester-2 host delete + RESET — the hub's own record (customer_resets #25, events, the hub log 14:54–14:58 CEST = 12:54–12:58 UTC; log times are CEST)
customer_resets #25: started 2026-10-22 12:55:56 UTC, completed 12:56:04 UTC, escrow_acked 0, legs {claim: ok, db_purge: ok, descriptor: ok, hetzner: ok, pbs: ok}
host_deletions: Tester-2-be8404 deleted 2026-10-22 12:54:47 UTC, escrow_acked 0
events: 12:54:48 selfbind_link_sent (host delete) · 12:56:04 customer_reset (warning) · 12:56:05 selfbind_link_sent (RESET completion)
--- hub log
2026/10/22 14:54:47 [INFO] host deleted: Tester-2-be8404 (no key escrow held; WG peer removal push requested (asynchronous — the endpoint drops the peer on that push, check `wg show` before calling the box gone))
2026/10/22 14:54:48 [INFO] self-bind link emailed to the registered address of Tester-2
2026/10/22 14:54:48 [INFO] self-bind link (hash 25c9e7ff…, valid 7 days) emailed to the registered address of Tester-2
2026/10/22 14:54:48 [INFO] self-bind link auto-minted for Tester-2 on host delete (the console banner's promised email now exists)
2026/10/22 14:54:48 [INFO] wgsync: pushed 4 peers to 167.233.158.164:22
2026/10/22 14:55:10 [DEBUG] Offsite escrow pending: Tester-2 — no anchor (no successful run, no host report) — not judged
2026/10/22 14:55:18 [INFO] osupdates: guest candidate 654f62937e9293c8 (272 packages, first seen 2026-10-22T03:23:44Z): waiting — healthy for 9h32m0s of 24h0m0s
2026/10/22 14:55:18 [INFO] osupdates: host candidate 69c797991f7b72f5 (607 packages, first seen 2026-10-22T03:23:44Z): waiting — healthy for 9h32m0s of 24h0m0s
2026/10/22 14:55:20 [offsite] shared already provisioned for Tester-2 (subaccount 322460)
2026/10/22 14:55:21 [INFO] pbsdr: DR tier ON for Tester-2, no host enrolled yet — the descriptor applies once the cascade is ready (host → WG peer → apply)
2026/10/22 14:55:21 [INFO] Customer config updated: Tester-2
2026/10/22 14:55:56 [INFO] customer RESET started for Tester-2 (journal #25, escrow_ack=false)
2026/10/22 14:55:57 [WARN] offsitekeys: RESET purged Tester-2's off-site folder through its own login: 0 path(s) []
2026/10/22 14:56:04 [offsite] deprovisioned shared sub-account 322460 for Tester-2 (its folder was purged first)
2026/10/22 14:56:04 [INFO] reset Tester-2: offsite deprovisioned (repo data destroyed)
2026/10/22 14:56:04 [INFO] tenantsync: deprovision ok for Tester-2 (ns=Tester-2, existed=true)
2026/10/22 14:56:04 [INFO] reset Tester-2: PBS tenancy deprovisioned
2026/10/22 14:56:04 [INFO] [claim] reset to unclaimed for Tester-2 (customer RESET) — next onboarding mints a fresh code
2026/10/22 14:56:04 [INFO] customer RESET complete for Tester-2 (journal #25) — identity + basic config retained
2026/10/22 14:56:05 [INFO] self-bind link emailed to the registered address of Tester-2
2026/10/22 14:56:05 [INFO] self-bind link (hash cea0be7a…, valid 7 days) emailed to the registered address of Tester-2
2026/10/22 14:56:05 [INFO] self-bind link auto-minted for Tester-2 on RESET completion (the console banner's promised email now exists)
2026/10/22 14:56:10 [DEBUG] Offsite escrow pending: Tester-2 — no anchor (no successful run, no host report) — not judged
@@ -0,0 +1,11 @@
# the hub's own daily off-site listing per customer (hub_settings offsite_snapshot_listing:*) — before the reset (05:10 UTC today) and yesterday; Tester-2 has none in either
2026-10-21 (00:00Z snapshot) Tester4 listed_at 2026-10-21T05:10:01.734603053Z entries 44
2026-10-21 (00:00Z snapshot) demo-felhom listed_at 2026-10-21T05:10:03.612595011Z entries 38
2026-10-21 (00:00Z snapshot) demo-hp listed_at 2026-10-21T05:10:06.382113986Z entries 289
2026-10-21 (00:00Z snapshot) tester-1 listed_at 2026-10-21T05:10:08.570986682Z entries 58
2026-10-21 (00:00Z snapshot) Tester-2 listing rows: 0
2026-10-22 05:10 UTC (live) Tester4 listed_at 2026-10-22T05:10:01.733186835Z entries 72
2026-10-22 05:10 UTC (live) demo-felhom listed_at 2026-10-22T05:10:05.213622074Z entries 43
2026-10-22 05:10 UTC (live) demo-hp listed_at 2026-10-22T05:10:08.606069689Z entries 303
2026-10-22 05:10 UTC (live) tester-1 listed_at 2026-10-22T05:10:10.755277879Z entries 62
2026-10-22 05:10 UTC (live) Tester-2 listing rows: 0
@@ -0,0 +1,11 @@
# Storage Box AFTER Tester-2's RESET (12:56:04 UTC), listed 2026-10-22 13:00 UTC — read only: each box's own
# append-only key, `restic snapshots --json --no-lock` from inside its controller container (the controller's own
# rclone-pinned transport); only counts printed. Compared with the hub's own 05:10 UTC listing (02-...).
demo-hp user=u629488-sub3 repo=/home/felhom-repo snapshots 303 newest 2026-10-22T02:18:13 hub 05:10 listing 303 SAME
tester-1 user=u629488-sub4 repo=/home/felhom-repo snapshots 62 newest 2026-10-22T02:15:58 hub 05:10 listing 62 SAME
demo-felhom user=u629488-sub1 repo=/home/felhom-repo snapshots 43 newest 2026-10-22T02:15:29 hub 05:10 listing 43 SAME
Tester4 no box (its VM was destroyed 2026-10-22 night) — not re-listable read-only by CC; hub 05:10 listing 72.
The hub's own 05:10 UTC listing on 2026-10-23 compares it with today's and raises
offsite_snapshots_vanished if any file is gone (R-895) — CC reads it then.
# Structure: each customer is a separate sub-account whose login sees only its own home; the purge ran through
# Tester-2's own login (sub-account 322460) and removed 0 paths (the hub log, 01-...). It could not reach the others.
@@ -0,0 +1,69 @@
# ep0 (felhom-hetzner), read only (list commands), 2026-10-22 13:01 UTC
2026-10-22T13:01:05Z
== namespaces
Tester4
demo-felhom
demo-hp
operator
tester-1
== snapshot dirs
ns/Tester4/ct/9201/2026-10-20T12:17:26Z
ns/demo-felhom/ct/9201/2026-10-13T04:22:51Z
ns/demo-felhom/ct/9201/2026-10-20T04:27:45Z
ns/demo-hp/ct/9201/2026-10-08T20:34:27Z
ns/demo-hp/ct/9201/2026-10-15T20:38:47Z
ns/tester-1/ct/9201/2026-10-11T20:02:13Z
ns/tester-1/ct/9201/2026-10-18T20:04:51Z
== prune jobs
prune-demo-felhom demo-felhom 03:30 {'keep-weekly': 2}
prune-demo-hp demo-hp 03:30 {'keep-weekly': 2}
prune-Tester4 Tester4 03:30 {'keep-weekly': 2}
prune-tester-1 tester-1 03:30 {'keep-weekly': 2}
prune-operator-hubdb operator 03:45 {'keep-daily': 14, 'keep-weekly': 8}
== users
dooplex-hub@pbs None []
felhom@pbs None []
root@pam None []
== tokens
felhom@pbs ['felhom@pbs!Tester4', 'felhom@pbs!demo-felhom', 'felhom@pbs!demo-hp', 'felhom@pbs!tester-1']
dooplex-hub@pbs ['dooplex-hub@pbs!push', 'dooplex-hub@pbs!restore']
== acl for Tester-2
acl entries: 14 mentioning Tester-2: []
== today prune tasks
UPID:felhom-hetzner:00086AE7:07B20B30:00000573:6AD986BC:prunejob:felhom\x2doffsite\x3aoperator:root@pam: OK
UPID:felhom-hetzner:00086AE7:07B20B30:00000572:6AD98338:prunejob:felhom\x2doffsite\x3atester\x2d1:root@pam: OK
UPID:felhom-hetzner:00086AE7:07B20B30:00000571:6AD98338:prunejob:felhom\x2doffsite\x3ademo\x2dhp:root@pam: OK
UPID:felhom-hetzner:00086AE7:07B20B30:00000570:6AD98338:prunejob:felhom\x2doffsite\x3aTester\x2d2:root@pam: OK
UPID:felhom-hetzner:00086AE7:07B20B30:0000056F:6AD98338:prunejob:felhom\x2doffsite\x3ademo\x2dfelhom:root@pam: OK
UPID:felhom-hetzner:00086AE7:07B20B30:0000056E:6AD98338:prunejob:felhom\x2doffsite\x3aTester4:root@pam: OK
operator kept at 03:45: 27
operator now: 27
Oct 22 12:56:04 felhom-hetzner sudo[2948694]: felhom-peersync : PWD=/home/felhom-peersync ; USER=root ; COMMAND=/usr/local/bin/felhom-tenantsync
Oct 22 12:56:04 felhom-hetzner proxmox-backup-proxy[551655]: removing whole namespace recursively below felhom-offsite:/Tester-2
Oct 22 12:56:04 felhom-hetzner proxmox-backup-proxy[551655]: removing groups in namespace felhom-offsite:/Tester-2
Oct 22 12:56:04 felhom-hetzner proxmox-backup-proxy[551655]: removing all groups in namespace felhom-offsite:/Tester-2
Oct 22 12:56:04 felhom-hetzner proxmox-backup-proxy[551655]: removing backup group "/mnt/pbs-datastore/ns/Tester-2/ct/9201"
Oct 22 12:56:04 felhom-hetzner proxmox-backup-proxy[551655]: removing backup snapshot "/mnt/pbs-datastore/ns/Tester-2/ct/9201/2026-10-04T16:31:13Z"
(ns/operator: 27 snapshot folders now = 27 kept by today's 03:45 prune)
# BEFORE: today's 03:30 UTC prune tasks (one per household namespace) — their keep lists
Starting datastore prune on datastore 'felhom-offsite', namespace 'tester-1', non-recursive
keep ct/9201/2026-10-11T20:02:13Z
keep ct/9201/2026-10-18T20:04:51Z
TASK OK
Starting datastore prune on datastore 'felhom-offsite', namespace 'demo-hp', non-recursive
keep ct/9201/2026-10-08T20:34:27Z
keep ct/9201/2026-10-15T20:38:47Z
TASK OK
Starting datastore prune on datastore 'felhom-offsite', namespace 'Tester-2', non-recursive
keep ct/9201/2026-10-04T16:31:13Z
TASK OK
Starting datastore prune on datastore 'felhom-offsite', namespace 'demo-felhom', non-recursive
keep ct/9201/2026-10-13T04:22:51Z
keep ct/9201/2026-10-20T04:27:45Z
TASK OK
Starting datastore prune on datastore 'felhom-offsite', namespace 'Tester4', non-recursive
keep ct/9201/2026-10-20T12:17:26Z
TASK OK
# comparison: tester-1 2 -> 2, demo-hp 2 -> 2, demo-felhom 2 -> 2, Tester4 1 -> 1 (same names); operator 27 -> 27; Tester-2 1 -> namespace gone
@@ -0,0 +1,14 @@
# the hub after the RESET (live, with WAL), read 2026-10-22 13:02:10 UTC — SELECT on named non-secret columns
customer: Tester-2 | name set: True | domain: sajatfelhom.hu | address set: True | language: hu | status: active | dr_tier: 1
offsite: enabled True type shared | provisioned fields still set: ['quota_gb']
hosts: 0
claim rows: 0
escrow (live/retained via deletions): 0 0
dr_recipe rows: 0 | one_time_secrets: 0
mail list: [(1, 0)]
offsite listing row: 0
# events since 12:50 UTC, every customer, warning or worse
('2026-10-22 12:56:04', 'Tester-2', 'customer_reset', 'warning', 'Ügyfél-visszaállítás (RESET): minden működési állapot törölve (offsite tároló, PBS névtér, DR-recept, azonosítási állapot). Az azonosság és ')
# any event of the R-1165 / key-audit kinds since 12:50: 0
felhom.sajatfelhom.hu 530 server=server: cloudflare
files.sajatfelhom.hu 530 server=server: cloudflare