From 4a557f54a5bed4e7cf6dc5ab8859593b2128d37a Mon Sep 17 00:00:00 2001 From: kisfenyo Date: Tue, 20 Oct 2026 22:13:50 +0200 Subject: [PATCH] =?UTF-8?q?rehearsal=202026-10-20:=20B6=20#1=20power=20cut?= =?UTF-8?q?=20mid=20install,=20#6=20off-site=20blocked,=20#14=20kept=20dat?= =?UTF-8?q?a=20=E2=80=94=20evidence?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- .../B4-use/health-log.txt | 22 +++++++++ .../rehearsal-2026-10-20/B4-use/memwatch.txt | 46 ++++++++++++++++++- .../s1-power-cut-mid-install/00-expected.txt | 1 + .../01-install-and-cut.txt | 10 ++++ .../02-after-power-on.txt | 4 ++ .../03-reinstall-and-remove.txt | 4 ++ .../B6-failures/s14-kept-data/00-expected.txt | 5 ++ .../B6-failures/s14-kept-data/01-before.txt | 7 +++ .../s14-kept-data/02-remove-keep-and-use.txt | 7 +++ .../B6-failures/s14-kept-data/03-after.txt | 6 +++ .../B6-failures/s14-kept-data/README.md | 20 ++++++++ .../s6-offsite-blocked/00-expected.txt | 1 + .../s6-offsite-blocked/01-block.txt | 11 +++++ .../s6-offsite-blocked/02-run-blocked.txt | 7 +++ .../03-page-while-blocked.txt | 1 + .../s6-offsite-blocked/04-catch-up.txt | 2 + .../B6-failures/s6-offsite-blocked/README.md | 12 +++++ 17 files changed, 165 insertions(+), 1 deletion(-) create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/00-expected.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/01-install-and-cut.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/02-after-power-on.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/03-reinstall-and-remove.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/00-expected.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/01-before.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/02-remove-keep-and-use.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/03-after.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/README.md create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/00-expected.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/01-block.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/02-run-blocked.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/03-page-while-blocked.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/04-catch-up.txt create mode 100644 documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/README.md diff --git a/documentation/audits/rehearsal-2026-10-20/B4-use/health-log.txt b/documentation/audits/rehearsal-2026-10-20/B4-use/health-log.txt index ea2ef542..d1e441be 100644 --- a/documentation/audits/rehearsal-2026-10-20/B4-use/health-log.txt +++ b/documentation/audits/rehearsal-2026-10-20/B4-use/health-log.txt @@ -217,3 +217,25 @@ 2026-10-20T19:48:06 health=200 0.010029 diskread=36GB 2026-10-20T19:49:08 health=200 0.009547 diskread=36GB 2026-10-20T19:50:09 health=200 0.011250 diskread=36GB +2026-10-20T19:51:11 health=200 0.010575 diskread=36GB +2026-10-20T19:52:13 health=200 0.014121 diskread=36GB +2026-10-20T19:53:14 health=200 0.010484 diskread=36GB +2026-10-20T19:54:16 health=200 0.010155 diskread=36GB +2026-10-20T19:55:17 health=200 0.012236 diskread=38GB +2026-10-20T19:56:19 health=200 0.011075 diskread=41GB +2026-10-20T19:57:21 health=200 0.011407 diskread=41GB +2026-10-20T19:58:23 health=200 0.009433 diskread=44GB +2026-10-20T19:59:25 health=200 0.011234 diskread=46GB +2026-10-20T20:00:27 health=200 0.011270 diskread=49GB +2026-10-20T20:01:48 health=000 20.001708 diskread=0GB +2026-10-20T20:02:53 health=000 2.794430 diskread=0GB +2026-10-20T20:03:54 health=200 0.015602 diskread=3GB +2026-10-20T20:04:56 health=200 0.009545 diskread=4GB +2026-10-20T20:05:58 health=200 0.010738 diskread=4GB +2026-10-20T20:06:59 health=200 0.010381 diskread=4GB +2026-10-20T20:08:01 health=200 0.009909 diskread=4GB +2026-10-20T20:09:02 health=200 0.010086 diskread=4GB +2026-10-20T20:10:04 health=200 0.010429 diskread=4GB +2026-10-20T20:11:06 health=200 0.014048 diskread=4GB +2026-10-20T20:12:07 health=200 0.011040 diskread=4GB +2026-10-20T20:13:08 health=200 0.010723 diskread=5GB diff --git a/documentation/audits/rehearsal-2026-10-20/B4-use/memwatch.txt b/documentation/audits/rehearsal-2026-10-20/B4-use/memwatch.txt index b0bf0694..573e6b63 100644 --- a/documentation/audits/rehearsal-2026-10-20/B4-use/memwatch.txt +++ b/documentation/audits/rehearsal-2026-10-20/B4-use/memwatch.txt @@ -420,4 +420,48 @@ 19:49:15Z used=3638MB avail=458MB load1=1.09 cpu=4% immich-server:718/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 6% | felhom-controller:108/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% 19:49:45Z used=3638MB avail=458MB load1=1.02 cpu=4% immich-server:718/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 6% | felhom-controller:108/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% 19:50:16Z used=3638MB avail=458MB load1=0.62 cpu=3% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 6% | felhom-controller:107/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 8% -19:50:46Z used=3638MB avail=458MB load1=0.63 cpu=3% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 6% | felhom-controller:107/4096MB 1% | booksta \ No newline at end of file +19:50:46Z used=3638MB avail=458MB load1=0.63 cpu=3% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 6% | felhom-controller:107/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 8% +19:51:16Z used=3638MB avail=458MB load1=0.51 cpu=6% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:113/4096MB 68% | bookstack-db:85/256MB 0% | immich-postgres:78/768MB 7% +19:51:46Z used=3638MB avail=458MB load1=0.42 cpu=8% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:113/4096MB 68% | bookstack-db:85/256MB 0% | immich-postgres:78/768MB 7% +19:52:16Z used=3638MB avail=458MB load1=0.38 cpu=8% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:108/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% +19:52:46Z used=3638MB avail=458MB load1=0.56 cpu=7% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:108/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% +19:53:16Z used=3638MB avail=458MB load1=0.57 cpu=7% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:107/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% +19:53:46Z used=3638MB avail=458MB load1=0.4 cpu=7% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:107/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% +19:54:16Z used=3638MB avail=458MB load1=0.31 cpu=7% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:108/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% +19:54:47Z used=3438MB avail=658MB load1=1.36 cpu=17% immich-server:717/3072MB 0% | paperless-webserver:550/1280MB 0% | mealie:200/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud-db:117/512MB 0% | felhom-controller:108/4096MB 1% | bookstack-db:85/256MB 0% | immich-postgres:77/768MB 0% +19:55:17Z used=3638MB avail=458MB load1=2.22 cpu=14% paperless-webserver:463/1280MB 0% | immich-machine-learning:443/2048MB 45% | mealie:174/1000MB 0% | felhom-controller:132/4096MB 1% | bookstack:131/512MB 0% | nextcloud-db:124/512MB 0% | immich-postgres:124/768MB 0% | bookstack-db:97/256MB 0% +19:55:47Z used=3288MB avail=808MB load1=3.2 cpu=32% paperless-webserver:463/1280MB 0% | immich-machine-learning:443/2048MB 45% | mealie:174/1000MB 0% | felhom-controller:132/4096MB 1% | bookstack:131/512MB 0% | nextcloud-db:124/512MB 0% | immich-postgres:124/768MB 0% | bookstack-db:97/256MB 0% +19:56:20Z used=3038MB avail=1058MB load1=2.16 cpu=29% immich-server:916/3072MB 0% | mealie:254/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud:155/1024MB 0% | nextcloud-db:141/512MB 0% | felhom-controller:102/4096MB 30% | bookstack-db:91/256MB 0% | immich-postgres:87/768MB 0% +19:56:50Z used=3638MB avail=458MB load1=2.56 cpu=33% immich-server:916/3072MB 0% | mealie:254/1000MB 0% | immich-machine-learning:167/2048MB 0% | nextcloud:155/1024MB 0% | nextcloud-db:141/512MB 0% | felhom-controller:102/4096MB 30% | bookstack-db:91/256MB 0% | immich-postgres:87/768MB 0% +19:57:20Z used=3638MB avail=458MB load1=2.26 cpu=11% immich-server:984/3072MB 0% | paperless-webserver:544/1280MB 0% | mealie:257/1000MB 0% | immich-machine-learning:167/2048MB 0% | felhom-controller:144/4096MB 1% | nextcloud-db:112/512MB 5% | traefik:110/4096MB 0% | actualbudget:106/256MB 0% +19:57:50Z used=1590MB avail=2506MB load1=2.52 cpu=33% immich-server:984/3072MB 0% | paperless-webserver:544/1280MB 0% | mealie:257/1000MB 0% | immich-machine-learning:167/2048MB 0% | felhom-controller:144/4096MB 1% | nextcloud-db:112/512MB 5% | traefik:110/4096MB 0% | actualbudget:106/256MB 0% +19:58:20Z used=3338MB avail=758MB load1=3.1 cpu=10% paperless-webserver:476/1280MB 0% | immich-machine-learning:431/2048MB 33% | felhom-controller:206/4096MB 1% | mealie:196/1000MB 0% | nextcloud-db:137/512MB 0% | bookstack:131/512MB 0% | immich-postgres:129/768MB 11% | bookstack-db:99/256MB 0% +19:58:50Z used=3288MB avail=808MB load1=3.89 cpu=27% paperless-webserver:476/1280MB 0% | immich-machine-learning:431/2048MB 33% | felhom-controller:206/4096MB 1% | mealie:196/1000MB 0% | nextcloud-db:137/512MB 0% | bookstack:131/512MB 0% | immich-postgres:129/768MB 11% | bookstack-db:99/256MB 0% +19:59:21Z used=3038MB avail=1058MB load1=2.93 cpu=15% immich-server:936/3072MB 0% | mealie:236/1000MB 0% | nextcloud:162/1024MB 0% | immich-machine-learning:147/2048MB 13% | nextcloud-db:134/512MB 0% | felhom-controller:100/4096MB 20% | bookstack-db:96/256MB 0% | immich-postgres:74/768MB 0% +19:59:51Z used=3638MB avail=458MB load1=2.55 cpu=55% immich-server:936/3072MB 0% | mealie:236/1000MB 0% | nextcloud:162/1024MB 0% | immich-machine-learning:147/2048MB 13% | nextcloud-db:134/512MB 0% | felhom-controller:100/4096MB 20% | bookstack-db:96/256MB 0% | immich-postgres:74/768MB 0% +20:00:21Z used=3638MB avail=458MB load1=2.37 cpu=17% immich-server:926/3072MB 0% | paperless-webserver:561/1280MB 0% | mealie:202/1000MB 0% | immich-machine-learning:136/2048MB 0% | felhom-controller:122/4096MB 0% | nextcloud-db:93/512MB 0% | immich-postgres:87/768MB 0% | actualbudget:80/256MB 0% +20:00:51Z used=3638MB avail=458MB load1=1.97 cpu=9% immich-server:926/3072MB 0% | paperless-webserver:561/1280MB 0% | mealie:202/1000MB 0% | immich-machine-learning:136/2048MB 0% | felhom-controller:122/4096MB 0% | nextcloud-db:93/512MB 0% | immich-postgres:87/768MB 0% | actualbudget:80/256MB 0% +20:01:21Z NO ANSWER TimeoutExpired +20:02:16Z used=NoneMB avail=NoneMB load1=None cpu=0% +20:02:50Z used=NoneMB avail=NoneMB load1=None cpu=0% +20:03:24Z used=NoneMB avail=NoneMB load1=None cpu=0% +20:03:54Z used=3638MB avail=458MB load1=4.34 cpu=65% immich-server:211/3072MB 18% | traefik:186/4096MB 15% | nextcloud:156/1024MB 18% | nextcloud-db:148/512MB 21% | filebrowser:145/256MB 0% | immich-postgres:132/768MB 0% | actualbudget:130/256MB 30% | immich-machine-learning:122/2048MB 30% +20:04:24Z used=3638MB avail=458MB load1=3.04 cpu=44% immich-server:211/3072MB 18% | traefik:186/4096MB 15% | nextcloud:156/1024MB 18% | nextcloud-db:148/512MB 21% | filebrowser:145/256MB 0% | immich-postgres:132/768MB 0% | actualbudget:130/256MB 30% | immich-machine-learning:122/2048MB 30% +20:04:54Z used=3678MB avail=418MB load1=2.88 cpu=19% immich-server:1080/3072MB 0% | mealie:214/1000MB 0% | paperless-webserver:202/1280MB 100% | immich-machine-learning:174/2048MB 0% | nextcloud-db:127/512MB 0% | bookstack-db:108/256MB 0% | immich-postgres:75/768MB 0% | nextcloud:55/1024MB 0% +20:05:25Z used=3638MB avail=458MB load1=1.8 cpu=8% immich-server:1080/3072MB 0% | mealie:214/1000MB 0% | paperless-webserver:202/1280MB 100% | immich-machine-learning:174/2048MB 0% | nextcloud-db:127/512MB 0% | bookstack-db:108/256MB 0% | immich-postgres:75/768MB 0% | nextcloud:55/1024MB 0% +20:05:55Z used=3638MB avail=458MB load1=1.28 cpu=11% immich-server:1025/3072MB 0% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:102/512MB 0% | immich-postgres:88/768MB 0% | bookstack-db:82/256MB 0% | felhom-controller:72/4096MB 32% +20:06:25Z used=3638MB avail=458MB load1=0.78 cpu=6% immich-server:1025/3072MB 0% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:102/512MB 0% | immich-postgres:88/768MB 0% | bookstack-db:82/256MB 0% | felhom-controller:72/4096MB 32% +20:06:55Z used=3638MB avail=458MB load1=0.62 cpu=3% immich-server:757/3072MB 0% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:71/4096MB 23% +20:07:25Z used=3638MB avail=458MB load1=0.43 cpu=7% immich-server:757/3072MB 0% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:71/4096MB 23% +20:07:55Z used=3638MB avail=458MB load1=0.39 cpu=4% immich-server:760/3072MB 2% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:81/4096MB 25% +20:08:25Z used=3638MB avail=458MB load1=0.52 cpu=6% immich-server:762/3072MB 1% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:72/4096MB 97% +20:08:55Z used=3638MB avail=458MB load1=0.53 cpu=4% immich-server:762/3072MB 1% | paperless-webserver:541/1280MB 0% | mealie:217/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:72/4096MB 97% +20:09:25Z used=3638MB avail=458MB load1=0.32 cpu=6% immich-server:763/3072MB 0% | paperless-webserver:541/1280MB 0% | mealie:251/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:71/4096MB 20% +20:09:56Z used=3638MB avail=458MB load1=0.45 cpu=5% immich-server:763/3072MB 0% | paperless-webserver:541/1280MB 0% | mealie:251/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:71/4096MB 20% +20:10:26Z used=3038MB avail=1058MB load1=0.61 cpu=7% immich-server:765/3072MB 0% | mealie:251/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:71/4096MB 11% | traefik:63/4096MB 0% +20:10:56Z used=3038MB avail=1058MB load1=0.81 cpu=16% immich-server:765/3072MB 0% | mealie:251/1000MB 0% | immich-machine-learning:133/2048MB 0% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:81/256MB 0% | felhom-controller:71/4096MB 11% | traefik:63/4096MB 0% +20:11:26Z used=3638MB avail=458MB load1=1.76 cpu=35% immich-server:766/3072MB 0% | mealie:251/1000MB 0% | immich-machine-learning:134/2048MB 0% | felhom-controller:124/4096MB 22% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:82/256MB 0% | traefik:65/4096MB 0% +20:11:56Z used=3638MB avail=458MB load1=2.5 cpu=36% immich-server:766/3072MB 0% | mealie:251/1000MB 0% | immich-machine-learning:134/2048MB 0% | felhom-controller:124/4096MB 22% | nextcloud-db:104/512MB 0% | immich-postgres:89/768MB 0% | bookstack-db:82/256MB 0% | traefik:65/4096MB 0% +20:12:26Z used=3638MB avail=458MB load1=2.34 cpu=5% immich-server:668/3072MB 0% | mealie:214/1000MB 0% | felhom-controller:124/4096MB 9% | immich-postgres:99/768MB 0% | immich-machine-learning:96/2048MB 0% | nextcloud-db:85/512MB 0% | paperless-webserver:83/1280MB 204% | filebrowser:69/256MB 0% +20:12:56Z used=3638MB avail=458MB load1=2.77 cpu=76% immich-server:668/3072MB 0% | mealie:214/1000MB 0% | felhom-controller:124/4096MB 9% | immich-postgres:99/768MB 0% | immich-machine-learning:96/2048MB 0% | nextcloud-db:85/512MB 0% | paperless-webserver:83/1280MB 204% | filebrowser:69/256MB 0% +20:13:27Z used=3638MB avail=458MB load1=2.77 cpu=32% immich-server:662/3072MB 0% | paperless-webserver:529/1280MB 86% | mealie:192/1000MB 0% | traefik:113/4096MB 4% | immich-postgres:98/768MB 0% | nextcloud-db:76/512MB 0% | immich-machine- \ No newline at end of file diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/00-expected.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/00-expected.txt new file mode 100644 index 00000000..9b74f155 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/00-expected.txt @@ -0,0 +1 @@ +Expected (before): after power returns the app is either not installed (clean, can be installed again) or installed and working — never a half-state the household cannot clear; the page says which. diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/01-install-and-cut.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/01-install-and-cut.txt new file mode 100644 index 00000000..73a2a58b --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/01-install-and-cut.txt @@ -0,0 +1,10 @@ +20:00:53Z deploy ('202', {'ok': True, 'data': {'warning': 'Az alkalmazások csúcsterhelése meghaladhatja a rendelkezésre álló memóriát. Normál használat mellett ez nem okoz problémát.'}, 'message': 'Telepítés elindítva – az állapot a kártyán követhető'}) +0.2 state not_deployed deployed True +0.9 state not_deployed deployed True +1.6 state not_deployed deployed True +2.3 state not_deployed deployed True +3.1 state not_deployed deployed True +3.8 state not_deployed deployed True +20:00:57Z PLUG PULLED +on 20:01:17 +health 200 20:03:30 diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/02-after-power-on.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/02-after-power-on.txt new file mode 100644 index 00000000..16250fd6 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/02-after-power-on.txt @@ -0,0 +1,4 @@ +privatebin: not_deployed deployed False pins None [] +page: PrivateBin — Felhom.eu document.documentElement.className=document.documentElement.className.replace('no-js','js'); function csrfHeaders(){var el=document.querySelector('meta[name="csrf-token"]');return el?{'X-CSRF-Token':el.content}:{};} var fhEN=document.documentElement.lang==='en'; function fhNum(v,prec){var s=Number(v).toFixed(prec);return fhEN?s:s.replace('.',',');} function fhIsoDate(iso){re +20:03:25 WARN [stacks] install privatebin was INTERRUPTED by a controller restart — removing what it started (volumes kept) and reporting it (R-681) +20:03:27 INFO Event pushed: app_deploy_failed (warning) [hu-only] — Alkalmazás telepítése nem sikerült: PrivateBin — interrupted by a controller restart before it finished — install it again diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/03-reinstall-and-remove.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/03-reinstall-and-remove.txt new file mode 100644 index 00000000..7cfef430 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s1-power-cut-mid-install/03-reinstall-and-remove.txt @@ -0,0 +1,4 @@ +deploy 202 +installed again: running 15 s +stop 200 +remove 200 privatebin True diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/00-expected.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/00-expected.txt new file mode 100644 index 00000000..54cfe2c1 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/00-expected.txt @@ -0,0 +1,5 @@ +Expected (written 20:15Z, before the run): Paperless-ngx holds 47 documents (8 failed imports) before. +1. Stop + Remove with "keep my data" (remove_hdd_data=false, remove_backups=false) -> app gone, data folder kept, listed under "Megőrzött adatok". +2. Install again with no choice -> the install refuses 409 kept_data_choice and offers "use" with a named copy and its date. Nothing installed. +3. Install again with "use" -> 202, a load from the newest copy, then the app runs and shows 47 documents. +Risk to watch: a document added after the newest copy would have files on the drive but no row in the database. diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/01-before.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/01-before.txt new file mode 100644 index 00000000..f6db2ba4 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/01-before.txt @@ -0,0 +1,7 @@ +keys ['deployed', 'deployed_at', 'desired_state', 'env', 'installed_images', 'locked_fields', 'pinned_images'] +DOMAIN tester4.test +SUBDOMAIN paperless +HDD_PATH /mnt/felhom-drives/hdd_1 +PAPERLESS_ADMIN_USER irisz +PAPERLESS_OCR_LANGUAGE hun +units 404 {"ok": false, "error": "endpoint not found"} diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/02-remove-keep-and-use.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/02-remove-keep-and-use.txt new file mode 100644 index 00000000..83a08202 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/02-remove-keep-and-use.txt @@ -0,0 +1,7 @@ +20:10:06Z stop 200 +20:10:45Z remove 200 {"ok": true, "data": {"removed": "paperless-ngx", "volumes_removed": ["paperless-ngx_paperless_data", "paperless-ngx_paperless_postgres_data", "paperless-ngx_paperless_redis_data"], "hdd_paths_removed": [], "hdd_paths_preserved": ["/mnt/felhom-drives/hdd_1/appdata/paperless/media (2.4M)", "/mnt/felhom-drives/hdd_1/appdata/paperless/export (4.0K)"], "userdata_kept": [], "verified": true}, "message": "Stack paperless-ngx removed"} +20:10:52Z kept page: adatok Az eltávolított alkalmazások lemezen maradt adatai. Megnézheted őket, betöltheted egy új telepítésbe, vagy törölheted. Magától a szerver soha nem töröl közülük semmit. Erről nem készül mentés. Paperless-ngx 2026. 10. 20. 14:49 · 2,2 MB Visszatölthető innen: saját mentés, 2026. 10. 20. 21:57 Betöltés Megnézem Törlés A(z) Paperless-ngx megőrzött adatai (2,2 MB) véglegesen törlődnek. Ezt nem lehet visszacsinálni. A törléshez írd be: Paperless-ngx Végleges törlés (function(){ var burger=document.querySelector('.nav-burger'); var sidebar=document.getElementById('sidebar'); var backdrop=document.querySelector('.nav-backdrop'); if(!burger||!sidebar||!backdrop)return; function setOpen(open){ 16153 +20:10:54Z deploy no choice 409 {"ok": false, "data": {"code": "kept_data_choice", "title": "Ennek az alkalmazásnak megvannak a régi adatai", "body": "A(z) Paperless-ngx korábbi adatai (2.2 MB, 2026-10-20) még a lemezen vannak. Mit csináljunk velük?", "use_label": "A megőrzött adataimat használom", "use_desc": "Az adatbázist innen töltjük vissza: saját mentés, 2026-10-20 21:57. A régi fájlokkal indítjuk az alkalmazást. Ami ezután változott, hiányozhat.", "use_off": "", "use_offered": true, "fresh_label": "Tiszta lappal kezdem", "fresh_desc": "A régi adatok egy mai dátummal jelölt mappába kerülnek. Nem törlünk semmit.", "not_backed_up": "Erről nem készül mentés."}, "error": "Ennek az alkalmazásnak megvannak a régi adatai"} +20:10:56Z deploy use 202 {"ok": true, "message": "A(z) Paperless-ngx megőrzött adatainak betöltése elindult."} +20:11:06Z 10 state stopped deployed True +20:11:26Z 30 state running deployed True diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/03-after.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/03-after.txt new file mode 100644 index 00000000..ffb633a4 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/03-after.txt @@ -0,0 +1,6 @@ +20:11:34 paperless documents: b'404 page not found\n' | failed tasks: b'404 page not found\n' +20:11:56 paperless documents: b'404 page not found\n' | failed tasks: b'404 page not found\n' +20:12:18 paperless documents: b'404 page not found\n' | failed tasks: b'404 page not found\n' +20:12:39 paperless documents: b'404 page not found\n' | failed tasks: b'404 page not found\n' +20:13:02 paperless documents: 47 | failed tasks: ['kezikonyv_100_oldal.pdf', 'jelszavas_kivonat.pdf', 'szkennelt_nyilatkozat.pdf', 'szamla_2025_049.pdf', 'szamla_2024_048.pdf', 'szamla_2026_047.pdf', 'szamla_2025_046.pdf', 'szamla_2026_044.pdf'] +downloads ok 47 of 47 | newest added 2026-10-20T16:00:14.728211+02:00 szamla_2024_048.pdf diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/README.md b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/README.md new file mode 100644 index 00000000..5ff3f4d7 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s14-kept-data/README.md @@ -0,0 +1,20 @@ +# B6 #14 — app removed keeping its data, installed again with „use my kept data" (Paperless-ngx) + +Run 2026-10-20 20:10–20:14 UTC on Tester4 (VM 9320, controller 0.336.0). Method: endpoint-level — the same +requests the dashboard sends (`/api/stacks/paperless-ngx/stop`, `/remove`, `/deploy`), the „Megőrzött adatok" +page read as HTML, the documents counted and downloaded through Paperless's own API by the user `irisz`. + +| step | result | +|---|---| +| before | 47 documents, 8 failed imports | +| Remove, keep data | 200 in 39 s; three Docker volumes removed; drive folders `media` (2.4 MB) and `export` kept; `verified: true` | +| „Megőrzött adatok" page | lists „Paperless-ngx 2026. 10. 20. 14:49 · 2,2 MB", „Visszatölthető innen: saját mentés, 2026. 10. 20. 21:57", buttons Betöltés / Megnézem / Törlés; says „Erről nem készül mentés." | +| install, no choice | 409 `kept_data_choice`: „Ennek az alkalmazásnak megvannak a régi adatai" + the two choices; the „use" text names the copy and warns „Ami ezután változott, hiányozhat." Nothing installed | +| install, „use" | 202, load started; app running after 30 s; Paperless answered after ~2 min | +| after | **47 documents, the same 8 failed imports; 47 of 47 originals download** | + +**Verdict: PASS.** No data lost. The page tells the household which copy it uses and that later changes can be +missing. Times on the page are local (CEST); the copy is the 19:57 UTC unit from B8. + +Not tested here: a document added AFTER the newest copy (its file would stay on the drive with no database row) — +the page warns about it in words; not reproduced. diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/00-expected.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/00-expected.txt new file mode 100644 index 00000000..4c19d93d --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/00-expected.txt @@ -0,0 +1 @@ +Expected (before): the off-site run fails within a bounded time with a clear household message and an operator alarm; nothing else breaks; the next run after the path returns catches up fully. diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/01-block.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/01-block.txt new file mode 100644 index 00000000..8b194000 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/01-block.txt @@ -0,0 +1,11 @@ +table bridge rh1020off { + chain c1 { + type filter hook forward priority 0; policy accept; + iifname "tap9320i0" ip daddr { 91.98.242.176, 167.233.158.164 } counter packets 0 bytes 0 drop + iifname "tap9320i0" ip6 daddr 2a01:4f8:bacc:2:200::d30 counter packets 0 bytes 0 drop + } +} +19:54:29 +packets 252 +packets 0 +unblocked 19:57:26 diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/02-run-blocked.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/02-run-blocked.txt new file mode 100644 index 00000000..d7de6967 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/02-run-blocked.txt @@ -0,0 +1,7 @@ +19:54:29Z press 302 +19:54:59Z running dump err= +19:55:29Z running dump err= +19:56:00Z running dump err= +19:56:30Z running dump err= +19:57:00Z error err= offbox repo unreachable: exit status 1: rclone: ssh: connect to host u629488-sub5.your-storagebox.de port 23: Network is unreachable +Fatal: unable to open repository at rclone:/home/felhom-repo: error diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/03-page-while-blocked.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/03-page-while-blocked.txt new file mode 100644 index 00000000..8852d969 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/03-page-while-blocked.txt @@ -0,0 +1 @@ +page while blocked: Távoli mentés (3. mentés) — titkosított, offsite Az alkalmazás-mentések titkosított másolata egy távoli tárolóra — saját NAS vagy Felhom offsite tárhely — restic + SFTP kapcsolaton. A tároló csak titkosított adatot lát. Ez a 3-2-1 szabály „1 off-site" lába — független a helyi másodpéldánytól és a teljes rendszermentéstől. ✗ Hiba Utolsó távoli mentés most 1,1 GB Tároló méret · 26 pillanatkép u629488-sub5@u629488-sub5.your-storagebox.de /home/felhom-repo Utolsó hiba: offbox repo unreachable: exit status 1: rclone: ssh: connect to host u629488-sub5.your-storagebox.de port 23: Network is unreachable Fatal: unable to open repository at rclone:/home/felhom-repo: error talking HTTP to rclone diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/04-catch-up.txt b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/04-catch-up.txt new file mode 100644 index 00000000..4f7bbde8 --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/04-catch-up.txt @@ -0,0 +1,2 @@ +19:57:26Z press 302 +20:00:26Z ok snaps= 35 dur= 2m37s err= diff --git a/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/README.md b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/README.md new file mode 100644 index 00000000..f0b8d57e --- /dev/null +++ b/documentation/audits/rehearsal-2026-10-20/B6-failures/s6-offsite-blocked/README.md @@ -0,0 +1,12 @@ +# B6 #6 — the off-site path blocked (shortened: one manual run, then the catch-up) — 2026-10-20 19:54–20:00 UTC + +The one real night belongs to B5 (plan amendment). Blocked at the VM's own cable on demo-hp: the Storage Box +(91.98.242.176, 2a01:4f8:bacc:2:200::d30) and ep0 (167.233.158.164); 252 packets dropped (positive control). + +| UTC | act | observed | +|---|---|---| +| 19:54:59 | „Távoli mentés most" | running (dump phase — local, fine) | +| 19:57:00 | | **error after ~2.5 min**; the page: „✗ Hiba … Utolsó hiba: offbox repo unreachable: exit status 1: rclone: ssh: connect to host u629488-sub5.your-storagebox.de port 23: Network is unreachable Fatal: unable to open repository…" — honest and fast, but raw English (W25 class) | +| 19:57:26 | unblocked; „Távoli mentés most" again | **ok in 2 min 37 s, 35 snapshots** — the catch-up is complete | + +Not measured: a whole night blocked (the hub's 48 h `offsite_stale`), and whether the NIGHT's run retries by itself.