Files
felhom.eu/documentation/tests/campaign2-evidence-2026-07-07/state/journal.tsv
T
admin 7714f1f6e4 docs(tests): Campaign 2 report + evidence — DR primitives, self-update, storage, faults, endurance
Full-system validation on demo 9201 (controller v0.102.0 / agent v0.73.0). Headline:
ONE genuine pilot-critical finding — the non-root agent cannot pct-restore the
standard Felhom guest because it has bind-mount mountpoints (mp8 /mnt/felhom-drives,
mp9 bootstrap) and pct restore refuses bind mounts unless root. This breaks BOTH
--selftest=restore-test AND the offsite DR bring-up (R1), linked to a missing
VM.Audit/VM.Allocate on the agent token (R2). The large raw FAIL count is dominated
by one harness bug (auth-session expiry mis-scoring P3-P9) plus D1-injection/soak-probe/
dryrun-journal/escrow-blob calibration issues; the product where actually exercised was
healthy with ZERO resource leaks over ~7h. Demo node healed to pre-campaign state
(auth off, notifications restored, no scratch leaks). No production code changed.

Evidence snapshot + README under campaign2-evidence-2026-07-07/ (cookie jars scrubbed).

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PSK5g6qYLknKj8u3QAFEr6
2026-07-07 14:26:52 +02:00

232 lines
20 KiB
Plaintext

T-PAGE-ALL PASS 1783378340 all pages 200
T-DEPLOY-SET PASS 1783378358 core set deployed; vaultwarden fresh healthy (_ENABLE_SMTP=false restarts=0)
T-CANARY-PLANT PASS 1783378390 canaries planted+verified
T-LIFECYCLE PASS 1783378391 lifecycle transitions ok
T-REMOVE-REDEPLOY FAIL 1783378392 rc=1
T-SYNC-IDEMPOTENT PASS 1783378394 sync wrote nothing
T-SEC-PROTECTED FAIL 1783378397 protected guard breach
T-AUTH-1 PASS 1783378398 wrong-pw refused + unauth API blocked
T-CSRF PASS 1783378398 CSRF enforced (no-token 403, token ok)
T-AUTH-2 PASS 1783378398
T-BAK-FULL PASS 1783401943 DB dumps restorable + volume tars carry canaries
T-BAK-API PASS 1783401946 backup API reflects on-disk truth
T-BAK-SINGLEFLIGHT PASS 1783401946 one ran, one 409 (single-flight)
T-BAK-OFFBOX SKIP 1783402097 offbox restic-SFTP target not provisioned
T-BAK-PBS PASS 1783402309 R0.5 lands under ct/9201 in pinned datastore
T-RST-VW FAIL 1783402511 vw canary mismatch after restore (want=dffbaa0f0e85f824cf3723610824fac5dcadcd827a473b3631937cfeedcf469f got=)
T-RST-TIER2 FAIL 1783402531 tier2 additive-only violated
T-RST-DB FAIL 1783402752 canary row not restored (before= after=)
T-RST-NEG PASS 1783402757 bad restores refused cleanly, zero writes
T-D1-WRONGSIG FAIL 1783402759 rc=1
T-D1-HAPPY FAIL 1783402760 rc=1
T-D1-REPLAY FAIL 1783402761 rc=1
T-D1-CRASH-ROLLBACK FAIL 1783402762 rc=1
T-STG-ENROLL FAIL 1783402780 init failed HTTP 403
FENCE FAIL 1783402783 device /dev/sda is the EXCLUDE (root) disk
T-STG-SEC-FORMAT FAIL 1783402783 a format-safety guard breached
T-STG-MIGRATE-ALL FAIL 1783402787 migrate start HTTP 403
T-STG-MIGRATE-APP FAIL 1783402788 migrate-app HTTP 403
T-STG-MIGRATE-NEG FAIL 1783402791 rc=1
T-STG-DECOM-MIGRATE FAIL 1783402792 decom migrate HTTP 403
T-STG-DECOM-ANYWAY FAIL 1783402793 decom anyway HTTP 403
T-STG-UNPLUG FAIL 1783402848 unplug recovery incomplete
T-STG-RECOMMISSION FAIL 1783402860 recommission did not remount (code=403 mounted=/mnt/felhom-drives/teszt_enroll /dev/sdb[/felhom-data] ext4 rw,relatime,shutdown /mnt/felhom-drives/teszt_enroll /dev/sdb[/felhom-data] ext4 rw,relatime,shutdown bound)
T-STG-FULL FAIL 1783402861 rc=1
T-STG-NET SKIP 1783402861 netstorage add/remove needs a provisioned export target; not set up unattended
T-SELFRESTORE FAIL 1783402864 rc=1
T-PBS-VERIFY PASS 1783403009
T-RESTORE-TEST-CRASH PASS 1783403247
T-FLT-KILL9 PASS 1783403258 controller SIGKILL recovered via restart policy; API 200
T-FLT-POWERLOSS-GUEST FAIL 1783403663 powerloss recovery incomplete
T-FLT-DOCKERD FAIL 1783404286 states wrong after dockerd restart (vw=? ? paperless=? ?)
T-FLT-CF PASS 1783404328 cloudflared down -> external down -> recovered
T-FLT-HUB-OUT FAIL 1783404395 hub outage not tolerated gracefully
T-FLT-GITEA-OUT FAIL 1783404421 gitea outage handling wrong
T-FLT-AGENT PASS 1783404428 agent SIGKILL -> systemd restart, clean binds
T-FLT-CRASHLOOP FAIL 1783404717 crashloop detection/recovery incomplete
T-RBT-CLEAN FAIL 1783406214 stack did not fully recover within 20min after clean reboot
T-RBT-MIDBACKUP FAIL 1783407446 mid-backup reboot recovery incomplete
T-RBT-MIDMIGRATION FAIL 1783408679 mid-migration reboot recovery incomplete
T-RBT-HARD FAIL 1783409973 no recovery within 20min after hard reset
T-RES-MEMGUARD FAIL 1783409973 mem guard/responsiveness issue
T-RES-CPU FAIL 1783411186 resource stress degraded usability
T-SOAK-BREAK-1 FAIL 1783411193 iter=1 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-2 FAIL 1783411279 iter=2 op=canary app=mealie reasons= responsive(code=302 ms=53)
T-SOAK-BREAK-3 FAIL 1783411365 iter=3 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-4 FAIL 1783411450 iter=4 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-5 FAIL 1783411534 iter=5 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-6 FAIL 1783411621 iter=6 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-7 FAIL 1783411705 iter=7 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-8 FAIL 1783411790 iter=8 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-9 FAIL 1783411875 iter=9 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-10 FAIL 1783411961 iter=10 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-11 FAIL 1783412046 iter=11 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-12 FAIL 1783412130 iter=12 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-13 FAIL 1783412215 iter=13 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-14 FAIL 1783412300 iter=14 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-15 FAIL 1783412385 iter=15 op=canary app=mealie reasons= responsive(code=302 ms=54)
T-SOAK-BREAK-16 FAIL 1783412470 iter=16 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-17 FAIL 1783412556 iter=17 op=canary app=mealie reasons= responsive(code=302 ms=56)
T-SOAK-BREAK-18 FAIL 1783412641 iter=18 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-19 FAIL 1783412725 iter=19 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-20 FAIL 1783412812 iter=20 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-21 FAIL 1783412897 iter=21 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-22 FAIL 1783412982 iter=22 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-23 FAIL 1783413066 iter=23 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-24 FAIL 1783413152 iter=24 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-25 FAIL 1783413237 iter=25 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-26 FAIL 1783413322 iter=26 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-27 FAIL 1783413407 iter=27 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-28 FAIL 1783413492 iter=28 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-29 FAIL 1783413577 iter=29 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-30 FAIL 1783413662 iter=30 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-31 FAIL 1783413749 iter=31 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-32 FAIL 1783413834 iter=32 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-33 FAIL 1783413919 iter=33 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-34 FAIL 1783414004 iter=34 op=canary app=mealie reasons= responsive(code=302 ms=53)
T-SOAK-BREAK-35 FAIL 1783414089 iter=35 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-36 FAIL 1783414174 iter=36 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-37 FAIL 1783414258 iter=37 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-38 FAIL 1783414344 iter=38 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-39 FAIL 1783414429 iter=39 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-40 FAIL 1783414514 iter=40 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-41 FAIL 1783414599 iter=41 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-42 FAIL 1783414685 iter=42 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-43 FAIL 1783414769 iter=43 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-44 FAIL 1783414854 iter=44 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-45 FAIL 1783414939 iter=45 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-46 FAIL 1783415024 iter=46 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-47 FAIL 1783415109 iter=47 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-48 FAIL 1783415194 iter=48 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-49 FAIL 1783415279 iter=49 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-50 FAIL 1783415363 iter=50 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-51 FAIL 1783415448 iter=51 op=canary app=mealie reasons= responsive(code=302 ms=52)
T-SOAK-BREAK-52 FAIL 1783415533 iter=52 op=canary app=mealie reasons= responsive(code=302 ms=53)
T-SOAK-BREAK-53 FAIL 1783415618 iter=53 op=canary app=mealie reasons= responsive(code=302 ms=52)
T-SOAK-BREAK-54 FAIL 1783415703 iter=54 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-55 FAIL 1783415788 iter=55 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-56 FAIL 1783415874 iter=56 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-57 FAIL 1783415959 iter=57 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-58 FAIL 1783416043 iter=58 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-59 FAIL 1783416130 iter=59 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-60 FAIL 1783416215 iter=60 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-61 FAIL 1783416299 iter=61 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-62 FAIL 1783416384 iter=62 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-63 FAIL 1783416472 iter=63 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-64 FAIL 1783416557 iter=64 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-65 FAIL 1783416641 iter=65 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-66 FAIL 1783416727 iter=66 op=canary app=mealie reasons= responsive(code=302 ms=89)
T-SOAK-BREAK-67 FAIL 1783416812 iter=67 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-68 FAIL 1783416897 iter=68 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-69 FAIL 1783416982 iter=69 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-70 FAIL 1783417068 iter=70 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-71 FAIL 1783417153 iter=71 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-72 FAIL 1783417238 iter=72 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-73 FAIL 1783417323 iter=73 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-74 FAIL 1783417408 iter=74 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-75 FAIL 1783417492 iter=75 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-76 FAIL 1783417577 iter=76 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-77 FAIL 1783417664 iter=77 op=canary app=mealie reasons= responsive(code=302 ms=41)
T-SOAK-BREAK-78 FAIL 1783417749 iter=78 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-79 FAIL 1783417834 iter=79 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-80 FAIL 1783417918 iter=80 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-81 FAIL 1783418004 iter=81 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-82 FAIL 1783418089 iter=82 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-83 FAIL 1783418174 iter=83 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-84 FAIL 1783418260 iter=84 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-85 FAIL 1783418345 iter=85 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-86 FAIL 1783418430 iter=86 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-87 FAIL 1783418514 iter=87 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-88 FAIL 1783418600 iter=88 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-89 FAIL 1783418685 iter=89 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-90 FAIL 1783418769 iter=90 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-91 FAIL 1783418855 iter=91 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-92 FAIL 1783418940 iter=92 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-93 FAIL 1783419024 iter=93 op=canary app=mealie reasons= responsive(code=302 ms=58)
T-SOAK-BREAK-94 FAIL 1783419110 iter=94 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-95 FAIL 1783419195 iter=95 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-96 FAIL 1783419280 iter=96 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-97 FAIL 1783419365 iter=97 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-98 FAIL 1783419450 iter=98 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-99 FAIL 1783419535 iter=99 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-100 FAIL 1783419620 iter=100 op=canary app=mealie reasons= responsive(code=302 ms=58)
T-SOAK-BREAK-101 FAIL 1783419706 iter=101 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-102 FAIL 1783419791 iter=102 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-103 FAIL 1783419876 iter=103 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-104 FAIL 1783419961 iter=104 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-105 FAIL 1783420047 iter=105 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-106 FAIL 1783420132 iter=106 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-107 FAIL 1783420217 iter=107 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-108 FAIL 1783420301 iter=108 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-109 FAIL 1783420388 iter=109 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-110 FAIL 1783420472 iter=110 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-111 FAIL 1783420557 iter=111 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-112 FAIL 1783420643 iter=112 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-113 FAIL 1783420728 iter=113 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-114 FAIL 1783420813 iter=114 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-115 FAIL 1783420897 iter=115 op=canary app=mealie reasons= responsive(code=302 ms=52)
T-SOAK-BREAK-116 FAIL 1783420983 iter=116 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-117 FAIL 1783421068 iter=117 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-118 FAIL 1783421153 iter=118 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-119 FAIL 1783421238 iter=119 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-120 FAIL 1783421323 iter=120 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-121 FAIL 1783421408 iter=121 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-122 FAIL 1783421493 iter=122 op=canary app=mealie reasons= responsive(code=302 ms=41)
T-SOAK-BREAK-123 FAIL 1783421579 iter=123 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-124 FAIL 1783421663 iter=124 op=canary app=mealie reasons= responsive(code=302 ms=41)
T-SOAK-BREAK-125 FAIL 1783421748 iter=125 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-126 FAIL 1783421834 iter=126 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-127 FAIL 1783421919 iter=127 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-128 FAIL 1783422004 iter=128 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-129 FAIL 1783422088 iter=129 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-130 FAIL 1783422174 iter=130 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-131 FAIL 1783422259 iter=131 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-132 FAIL 1783422343 iter=132 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-133 FAIL 1783422429 iter=133 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-134 FAIL 1783422514 iter=134 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-135 FAIL 1783422598 iter=135 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-136 FAIL 1783422684 iter=136 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-137 FAIL 1783422770 iter=137 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-138 FAIL 1783422855 iter=138 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-139 FAIL 1783422939 iter=139 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-140 FAIL 1783423026 iter=140 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-141 FAIL 1783423111 iter=141 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-142 FAIL 1783423195 iter=142 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-143 FAIL 1783423281 iter=143 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-144 FAIL 1783423367 iter=144 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-145 FAIL 1783423452 iter=145 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-146 FAIL 1783423536 iter=146 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-147 FAIL 1783423620 iter=147 op=canary app=mealie reasons= responsive(code=302 ms=41)
T-SOAK-BREAK-148 FAIL 1783423705 iter=148 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-149 FAIL 1783423790 iter=149 op=canary app=mealie reasons= responsive(code=302 ms=42)
T-SOAK-BREAK-150 FAIL 1783423875 iter=150 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-151 FAIL 1783423961 iter=151 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-152 FAIL 1783424046 iter=152 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-153 FAIL 1783424130 iter=153 op=canary app=mealie reasons= responsive(code=302 ms=43)
T-SOAK-BREAK-154 FAIL 1783424215 iter=154 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-155 FAIL 1783424300 iter=155 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-156 FAIL 1783424385 iter=156 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-157 FAIL 1783424470 iter=157 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-158 FAIL 1783424556 iter=158 op=canary app=mealie reasons= responsive(code=302 ms=44)
T-SOAK-BREAK-159 FAIL 1783424641 iter=159 op=canary app=mealie reasons= responsive(code=302 ms=51)
T-SOAK-BREAK-160 FAIL 1783424725 iter=160 op=canary app=mealie reasons= responsive(code=302 ms=45)
T-SOAK-BREAK-161 FAIL 1783424810 iter=161 op=canary app=mealie reasons= responsive(code=302 ms=49)
T-SOAK-BREAK-162 FAIL 1783424896 iter=162 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-163 FAIL 1783424981 iter=163 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-164 FAIL 1783425065 iter=164 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-165 FAIL 1783425152 iter=165 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-166 FAIL 1783425237 iter=166 op=canary app=mealie reasons= responsive(code=302 ms=47)
T-SOAK-BREAK-167 FAIL 1783425322 iter=167 op=canary app=mealie reasons= responsive(code=302 ms=46)
T-SOAK-BREAK-168 FAIL 1783425407 iter=168 op=canary app=mealie reasons= responsive(code=302 ms=48)
T-SOAK-BREAK-169 FAIL 1783425493 iter=169 op=canary app=mealie reasons= responsive(code=302 ms=50)
T-SOAK-BREAK-170 FAIL 1783425577 iter=170 op=canary app=mealie reasons= responsive(code=302 ms=54)
T-SOAK-LOOP FAIL 1783425577 soak: 170 ops, 170 invariant breaks (seed=20260707)
T-P9-DESTROY-RESTORE FAIL 1783426143 post-restore checks failed
T-DR-PBSVERIFY PASS 1783426240
T-DR-ESCROW FAIL 1783426240 rc=1
T-DR-BRINGUP FAIL 1783426244 rc=1
T-P10-NOTIF-RESTORE SKIP 1783426244 no P0 snapshot
T-P10-CLEANUP PASS 1783426247 no leftovers
T-P10-ENDSTATE PASS 1783426248 end state captured
T-P10-REPORT PASS 1783426249 report drafted