night watch: demo-hp converted docmost by itself; R-696 filed; teardown recorded
gates / gates (push) Successful in 26s
gates / gates (push) Successful in 26s
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0159rPz1ZhFKsS53msqPYxtS
This commit is contained in:
@@ -25,6 +25,8 @@
|
||||
- **Decisions taken by CC unattended, operator may reverse (`09` §3):** 37 (target 18, not 17), 38 (`pg_dumpall` from
|
||||
the old engine, zero tolerated load errors), 39 (docmost 384M → 512M).
|
||||
- **Hub v0.125.0:** the customer delete lists the Cloudflare items to remove by hand (R-688 half).
|
||||
- **Night 26:** demo-hp's automatic leg converted docmost 16 → 18 (54 s, content equal). Found R-696: Tier 1's time is the
|
||||
unit manifest's refresh, not its dump — the kept 16 copy was released on a 16 dump.
|
||||
- Record: `documentation/audits/DRILL-night-2026-09-26.md`.
|
||||
|
||||
## Rulings 2026-09-25 (evening, operator)
|
||||
|
||||
@@ -9,6 +9,6 @@ This repo carried:
|
||||
code commit) success; manifest synced by ArgoCD, image `0.125.0` confirmed on the deployment.
|
||||
- **`09`:** decisions 35–36 (operator), 37–39 (CC unattended); §6.4 part 10 as built for docmost.
|
||||
- **`07`:** §6.5 kept data (where it lives, that it is not backed up, who deletes it — D3 open).
|
||||
- **Register:** before 334 rows; opened R-689, R-691, R-693, R-694, R-695; opened and closed R-690, R-692; closed R-657;
|
||||
narrowed R-450, R-463, R-469, R-687, R-688, R-691; R-655 measured. After: 338.
|
||||
- **Register:** before 334 rows; opened R-689, R-691, R-693, R-694, R-695, R-696; opened and closed R-690, R-692; closed R-657;
|
||||
narrowed R-450, R-463, R-469, R-687, R-688, R-691; R-655 measured. After: 339.
|
||||
- **STATUS** with D3 in the decision section; **CONTEXT**.
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# STATUS — what works, what's broken, what's next
|
||||
|
||||
**Updated 2026-09-25 (evening). Both demo boxes run controller 0.274.0 and host agent 0.134.0. Hub 0.125.0.**
|
||||
**Updated 2026-09-26 (early morning). Both demo boxes run controller 0.274.0 and host agent 0.134.0. Hub 0.125.0.**
|
||||
|
||||
**Decisions I took on my own** (you may reverse each):
|
||||
1. **docmost's database goes to PostgreSQL 18, not 17.** Its own makers already use 18. One move instead of two.
|
||||
@@ -10,7 +10,7 @@
|
||||
**What I did, and it worked.**
|
||||
- **The box now converts a PostgreSQL database to a new main version.** Only for an app whose step was tested. docmost is the first. On the scratch box: the conversion took 42 seconds in total. The data came back.
|
||||
- **When it goes wrong, the box puts the old version back.** I tested three failures: a load error, an app that does not start, and a controller killed in the middle. Each time the old version came back with its data.
|
||||
- **docmost moved in the catalog.** Tonight the HP box's automatic update should convert its docmost by itself. I watch it.
|
||||
- **The HP box converted its docmost by itself in the night.** It took 54 seconds. Its users, spaces and pages are all still there.
|
||||
- **Kept data is never a dead end now.** When an app is installed over old files, the page asks: "Use my kept data" or "Start fresh". A new "Kept data" page shows every leftover folder. The household can look at it (read only), load it, or delete it (they must type the app's name). I tested all of it on the scratch box, in both languages.
|
||||
- **The hub's customer delete stops promising to clean Cloudflare.** It now lists what you remove by hand.
|
||||
|
||||
@@ -21,10 +21,11 @@
|
||||
- **The file browser cannot open nextcloud's kept folder.** The files are there and can be loaded or deleted.
|
||||
- **The HP box's restore test tries to test the golden template file and fails every 6 hours.** Not fixed (agent side).
|
||||
- **The memory check always calls docmost "tight".** Its memory grows with its limit. Filed.
|
||||
- **The box threw away docmost's old database copy too early on the HP box.** It trusted the wrong time for "a backup exists". The data is safe: the check proved every row came across, and tonight's backup is on the new version. Filed.
|
||||
- **Two quick deletes on the Kept data page can leave an empty folder that keeps coming back.** Seen once on the scratch box; no data involved. Cleared by hand. Filed.
|
||||
- **adventurelog stays on its old version.** I found how to skip its internet download. The move needs a choice.
|
||||
|
||||
**Rows.** 7 opened, 3 closed. The list went from 334 to 338.
|
||||
**Rows.** 8 opened, 3 closed. The list went from 334 to 339.
|
||||
|
||||
**Decision for you — D3: may the box ever delete kept data by itself?**
|
||||
- **A — never; only the household deletes it (I recommend this).** Cost: kept data can fill a drive. The drive-full warning names the kept folders and their sizes, so the household sees what to delete.
|
||||
|
||||
@@ -24,8 +24,8 @@ Architecture read before any claim: `09-update-architecture.md` §3 decisions 13
|
||||
- **My own tool error in Part A4:** a bare `docker compose up -d` in docmost's stack dir (no `.env` there — the controller
|
||||
passes the env) started docmost without its secrets; it crash-looped and **the box stopped it after 7 restarts
|
||||
(decision 28 working)**. Started again with the product's Start; the seed read back.
|
||||
- **The kept pre-conversion copy's release on 9202** needs the hourly job after a proven backup; its first run is after
|
||||
this record was written — result in Part G.
|
||||
- **The kept pre-conversion copy was released too early on demo-hp (R-696, found in Part G):** the release trusted the
|
||||
unit's refresh time, and the unit's dump was from PostgreSQL 16. Low harm tonight; not fixed (a third release).
|
||||
|
||||
## Claims in the brief, judged
|
||||
|
||||
@@ -101,13 +101,29 @@ Cloudflare items to remove by hand; live preview read for demo-hp. F3 (R-655): m
|
||||
|
||||
## Part G — the night watch
|
||||
|
||||
*(filled in during the night)*
|
||||
Read-only on both demo boxes (`G/`). **demo-hp converted docmost BY ITSELF in the automatic leg:** off-site copy
|
||||
04:14–04:18 → leg 04:18:25–04:19:20 CEST → `CONVERTED 16 → 18 in 9.898s — the check is equal (2 database(s), 50
|
||||
table(s), 73 row(s)), PG_VERSION 18` → `DONE in 54s`; hub summary `done=1`, `steps: [docmost 55.1 s]`. Content read back
|
||||
(read-only SELECTs, before 12:41Z / after 02:40Z): users 1 = 1, workspaces 1 = 1, spaces 1 = 1, pages 4 = 4;
|
||||
`PG_VERSION` 16 → 18; front door 200; all three containers healthy. **The whole-box backup** was due since the
|
||||
evening and held for its window [04:30, 08:30); it started at 04:30:45, eleven minutes after the leg ended — nothing had
|
||||
to wait (R-687 item 4 still unobserved). demo-felhom: db-dump 02:30, Tier 2 03:30, off-site 04:15, leg nothing to do —
|
||||
hub reads `"steps": []` (**R-687's fix, live**). **9202's release (B5) worked:** 13:30:39Z, one hour after a backup whose
|
||||
dump (11:57) came after the conversion (11:13). **demo-hp's release was premature (R-696):** at 02:30:16Z it removed the
|
||||
16 copy citing "Tier 1 at 02:20:16Z" — the unit's manifest refresh; its `docmost-postgres.sql` is 02:15:01Z and says
|
||||
`Dumped from database version 16.15`.
|
||||
|
||||
## Teardown
|
||||
|
||||
*(filled in at the end)*
|
||||
- **Machine:** 9202 — docmost and nextcloud removed through the product; this session's kept folders deleted through
|
||||
the Kept-data page (the older romm/paperless leftovers stay as found); back on the LIVE catalog (`controller.yaml`
|
||||
from the saved copy), controller 0.274.0; one empty folder recreated by the file browser's stale bind removed by hand
|
||||
after the loop was understood (R-695). The drill repo reset to live `main`. demo boxes: nothing touched but the two
|
||||
floors (read-only otherwise); docmost on demo-hp now runs PostgreSQL 18 — the intended outcome.
|
||||
- **Host:** bench LXC 9401 destroyed (name checked), its template removed; demo-hp `pct list` 9201 + 9202 only.
|
||||
- **Hub:** global floor 0.274.0 (MinAgent 0.131.0); hub 0.125.0; no customer or appliance created.
|
||||
|
||||
## Register
|
||||
|
||||
Before: **334 rows / 674,532 B**. Opened R-689, R-691 (helper), R-693, R-694; opened and closed R-690, R-692; closed
|
||||
R-657; opened R-695 (teardown finding); narrowed R-450, R-463, R-469, R-687, R-688, R-691; R-655 measured. After: **338 rows**.
|
||||
R-657; opened R-695 (teardown finding) and R-696 (the night watch); narrowed R-450, R-463, R-469, R-687, R-688, R-691; R-655 measured. After: **339 rows / 682,159 B**.
|
||||
|
||||
@@ -0,0 +1,10 @@
|
||||
== felhom-pve
|
||||
gitea.dooplex.hu/admin/felhom-controller:0.274.0 healthy up-since 2026-09-25T12:30:15.114414232Z
|
||||
== demo-hp
|
||||
gitea.dooplex.hu/admin/felhom-controller:0.274.0 healthy up-since 2026-09-25T12:30:14.95052835Z
|
||||
docmost docmost/docmost:0.96.0
|
||||
docmost-redis redis:7-alpine
|
||||
docmost-postgres postgres:16-alpine
|
||||
2026/09/26 00:10:18 quiesce.go:248: [DEBUG] [quiesce] scheduled backup due but outside the backup window [04:30–08:30) — deferring to the next poll inside it
|
||||
2026/09/26 00:15:19 quiesce.go:248: [DEBUG] [quiesce] scheduled backup due but outside the backup window [04:30–08:30) — deferring to the next poll inside it
|
||||
2026/09/26 00:20:18 quiesce.go:248: [DEBUG] [quiesce] scheduled backup due but outside the backup window [04:30–08:30) — deferring to the next poll inside it
|
||||
@@ -0,0 +1,647 @@
|
||||
# demo-hp night 2026-09-26, controller log 00:25Z–now (INFO/WARN/ERROR)
|
||||
2026/09/26 00:25:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:25:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:25:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:25:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 223ms)
|
||||
2026/09/26 00:25:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 230ms)
|
||||
2026/09/26 00:25:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 668ms)
|
||||
2026/09/26 00:26:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:26:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:26:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 98ms)
|
||||
2026/09/26 00:26:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 646ms)
|
||||
2026/09/26 00:27:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:27:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 660ms)
|
||||
2026/09/26 00:28:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:28:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:28:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 100ms)
|
||||
2026/09/26 00:28:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 626ms)
|
||||
2026/09/26 00:29:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:29:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 650ms)
|
||||
2026/09/26 00:30:00 scheduler.go:346: [INFO] [scheduler] Running job: db-dump
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: selfupdate-check
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: geo-verify
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job geo-verify completed (took 0s)
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job selfupdate-check completed (took 42ms)
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:30:16 scheduler.go:346: [INFO] [scheduler] Running job: disk-health-check
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 172ms)
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job conversion-copy-release completed (took 172ms)
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 304ms)
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 471ms)
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 681ms)
|
||||
2026/09/26 00:30:16 scheduler.go:363: [INFO] [scheduler] Job disk-health-check completed (took 807ms)
|
||||
2026/09/26 00:30:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 1.328s)
|
||||
2026/09/26 00:31:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:31:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 689ms)
|
||||
2026/09/26 00:31:53 backup.go:639: [INFO] [backup] App-data backup completed: 6 databases (8.7 MB total), 9 volume dump(s) (1m53.831s)
|
||||
2026/09/26 00:31:53 scheduler.go:363: [INFO] [scheduler] Job db-dump completed (took 1m53.851s)
|
||||
2026/09/26 00:31:53 notifier.go:346: [INFO] Event pushed: db_dump_completed (info) [hu-only] — Adatbázis mentés elkészült
|
||||
2026/09/26 00:32:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:32:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:32:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 85ms)
|
||||
2026/09/26 00:32:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 710ms)
|
||||
2026/09/26 00:33:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:33:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 640ms)
|
||||
2026/09/26 00:34:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:34:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 66ms)
|
||||
2026/09/26 00:34:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:34:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 663ms)
|
||||
2026/09/26 00:35:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:35:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:35:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:35:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 229ms)
|
||||
2026/09/26 00:35:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 236ms)
|
||||
2026/09/26 00:35:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 662ms)
|
||||
2026/09/26 00:36:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:36:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:36:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 81ms)
|
||||
2026/09/26 00:36:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 652ms)
|
||||
2026/09/26 00:37:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:37:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 666ms)
|
||||
2026/09/26 00:38:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:38:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 71ms)
|
||||
2026/09/26 00:38:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:38:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 627ms)
|
||||
2026/09/26 00:39:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:39:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 666ms)
|
||||
2026/09/26 00:40:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:40:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:40:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:40:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:40:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 106ms)
|
||||
2026/09/26 00:40:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 238ms)
|
||||
2026/09/26 00:40:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 310ms)
|
||||
2026/09/26 00:40:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 645ms)
|
||||
2026/09/26 00:41:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:41:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 657ms)
|
||||
2026/09/26 00:42:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:42:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:42:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 77ms)
|
||||
2026/09/26 00:42:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 670ms)
|
||||
2026/09/26 00:43:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:43:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 656ms)
|
||||
2026/09/26 00:44:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:44:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 75ms)
|
||||
2026/09/26 00:44:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:44:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 698ms)
|
||||
2026/09/26 00:45:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:45:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:45:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 00:45:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:45:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 239ms)
|
||||
2026/09/26 00:45:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 269ms)
|
||||
2026/09/26 00:45:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 653ms)
|
||||
2026/09/26 00:45:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 1.224s)
|
||||
2026/09/26 00:46:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:46:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:46:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 94ms)
|
||||
2026/09/26 00:46:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 777ms)
|
||||
2026/09/26 00:47:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:47:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 656ms)
|
||||
2026/09/26 00:48:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:48:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:48:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 100ms)
|
||||
2026/09/26 00:48:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 693ms)
|
||||
2026/09/26 00:49:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:49:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 693ms)
|
||||
2026/09/26 00:50:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:50:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:50:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:50:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:50:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 108ms)
|
||||
2026/09/26 00:50:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 219ms)
|
||||
2026/09/26 00:50:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 305ms)
|
||||
2026/09/26 00:50:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 655ms)
|
||||
2026/09/26 00:51:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:51:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 684ms)
|
||||
2026/09/26 00:52:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:52:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 75ms)
|
||||
2026/09/26 00:52:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:52:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 713ms)
|
||||
2026/09/26 00:53:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:53:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 658ms)
|
||||
2026/09/26 00:54:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:54:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:54:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 103ms)
|
||||
2026/09/26 00:54:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 686ms)
|
||||
2026/09/26 00:55:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:55:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:55:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:55:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 222ms)
|
||||
2026/09/26 00:55:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 232ms)
|
||||
2026/09/26 00:55:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 697ms)
|
||||
2026/09/26 00:56:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:56:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:56:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 110ms)
|
||||
2026/09/26 00:56:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 649ms)
|
||||
2026/09/26 00:57:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:57:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 702ms)
|
||||
2026/09/26 00:58:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:58:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:58:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 114ms)
|
||||
2026/09/26 00:58:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 648ms)
|
||||
2026/09/26 00:59:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:59:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 665ms)
|
||||
2026/09/26 01:00:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:00:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:00:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:00:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:00:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:00:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 100ms)
|
||||
2026/09/26 01:00:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 265ms)
|
||||
2026/09/26 01:00:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 400ms)
|
||||
2026/09/26 01:00:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 765ms)
|
||||
2026/09/26 01:00:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 1.101s)
|
||||
2026/09/26 01:01:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:01:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 667ms)
|
||||
2026/09/26 01:02:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:02:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:02:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 95ms)
|
||||
2026/09/26 01:02:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 639ms)
|
||||
2026/09/26 01:03:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:03:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 652ms)
|
||||
2026/09/26 01:04:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:04:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 64ms)
|
||||
2026/09/26 01:04:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:04:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 665ms)
|
||||
2026/09/26 01:05:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:05:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:05:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:05:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 245ms)
|
||||
2026/09/26 01:05:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 259ms)
|
||||
2026/09/26 01:05:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 661ms)
|
||||
2026/09/26 01:06:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:06:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 72ms)
|
||||
2026/09/26 01:06:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:06:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 640ms)
|
||||
2026/09/26 01:07:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:07:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 684ms)
|
||||
2026/09/26 01:08:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:08:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:08:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 100ms)
|
||||
2026/09/26 01:08:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 644ms)
|
||||
2026/09/26 01:09:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:09:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 655ms)
|
||||
2026/09/26 01:10:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:10:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:10:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:10:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:10:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 118ms)
|
||||
2026/09/26 01:10:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 222ms)
|
||||
2026/09/26 01:10:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 309ms)
|
||||
2026/09/26 01:10:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 711ms)
|
||||
2026/09/26 01:11:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:11:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 678ms)
|
||||
2026/09/26 01:12:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:12:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:12:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 113ms)
|
||||
2026/09/26 01:12:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 632ms)
|
||||
2026/09/26 01:13:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:13:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 647ms)
|
||||
2026/09/26 01:14:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:14:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:14:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 103ms)
|
||||
2026/09/26 01:14:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 669ms)
|
||||
2026/09/26 01:15:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:15:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:15:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:15:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:15:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 258ms)
|
||||
2026/09/26 01:15:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 261ms)
|
||||
2026/09/26 01:15:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 654ms)
|
||||
2026/09/26 01:15:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 983ms)
|
||||
2026/09/26 01:16:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:16:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:16:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 107ms)
|
||||
2026/09/26 01:16:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 674ms)
|
||||
2026/09/26 01:17:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:17:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 684ms)
|
||||
2026/09/26 01:18:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:18:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:18:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 105ms)
|
||||
2026/09/26 01:18:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 680ms)
|
||||
2026/09/26 01:19:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:19:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 662ms)
|
||||
2026/09/26 01:20:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:20:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:20:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:20:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:20:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 123ms)
|
||||
2026/09/26 01:20:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 238ms)
|
||||
2026/09/26 01:20:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 321ms)
|
||||
2026/09/26 01:20:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 657ms)
|
||||
2026/09/26 01:21:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:21:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 672ms)
|
||||
2026/09/26 01:22:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:22:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:22:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 111ms)
|
||||
2026/09/26 01:22:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 656ms)
|
||||
2026/09/26 01:23:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:23:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 625ms)
|
||||
2026/09/26 01:24:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:24:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 68ms)
|
||||
2026/09/26 01:24:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:24:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 647ms)
|
||||
2026/09/26 01:25:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:25:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:25:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:25:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 219ms)
|
||||
2026/09/26 01:25:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 224ms)
|
||||
2026/09/26 01:25:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 695ms)
|
||||
2026/09/26 01:26:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:26:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 72ms)
|
||||
2026/09/26 01:26:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:26:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 665ms)
|
||||
2026/09/26 01:27:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:27:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 665ms)
|
||||
2026/09/26 01:28:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:28:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 68ms)
|
||||
2026/09/26 01:28:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:28:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 661ms)
|
||||
2026/09/26 01:29:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:29:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 649ms)
|
||||
2026/09/26 01:30:00 scheduler.go:346: [INFO] [scheduler] Running job: tier2-backup
|
||||
2026/09/26 01:30:00 scheduler.go:346: [INFO] [scheduler] Running job: fill-watch
|
||||
2026/09/26 01:30:00 scheduler.go:363: [INFO] [scheduler] Job fill-watch completed (took 1ms)
|
||||
2026/09/26 01:30:00 tier2.go:425: [INFO] [backup] Tier 2 copied adventurelog → /mnt/felhom-drives/hdd_1/backups/secondary/adventurelog (259.3 MB, 0 leg(s), 1s)
|
||||
2026/09/26 01:30:00 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: adventurelog
|
||||
2026/09/26 01:30:00 tier2.go:425: [INFO] [backup] Tier 2 copied bentopdf → /mnt/felhom-drives/hdd_1/backups/secondary/bentopdf (13.3 KB, 0 leg(s), 0s)
|
||||
2026/09/26 01:30:00 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: bentopdf
|
||||
2026/09/26 01:30:01 tier2.go:425: [INFO] [backup] Tier 2 copied bookstack → /mnt/felhom-drives/hdd_1/backups/secondary/bookstack (160.4 MB, 0 leg(s), 0s)
|
||||
2026/09/26 01:30:01 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: bookstack
|
||||
2026/09/26 01:30:01 tier2.go:425: [INFO] [backup] Tier 2 copied calibre-web → /mnt/sys_drive/felhom-data/backups/secondary/calibre-web (5.6 MB, 1 leg(s), 0s) [SSD: state-only]
|
||||
2026/09/26 01:30:01 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: calibre-web
|
||||
2026/09/26 01:30:01 tier2.go:425: [INFO] [backup] Tier 2 copied docmost → /mnt/felhom-drives/hdd_1/backups/secondary/docmost (96.5 MB, 0 leg(s), 0s)
|
||||
2026/09/26 01:30:01 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: docmost
|
||||
2026/09/26 01:30:02 tier2.go:425: [INFO] [backup] Tier 2 copied kimai → /mnt/felhom-drives/hdd_1/backups/secondary/kimai (205.0 MB, 0 leg(s), 1s)
|
||||
2026/09/26 01:30:02 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: kimai
|
||||
2026/09/26 01:30:02 tier2.go:425: [INFO] [backup] Tier 2 copied opengist → /mnt/felhom-drives/hdd_1/backups/secondary/opengist (199.6 KB, 0 leg(s), 0s)
|
||||
2026/09/26 01:30:02 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: opengist
|
||||
2026/09/26 01:30:05 tier2.go:425: [INFO] [backup] Tier 2 copied paperless-ngx → /mnt/sys_drive/felhom-data/backups/secondary/paperless-ngx (397.7 MB, 1 leg(s), 3s) [SSD: state-only]
|
||||
2026/09/26 01:30:05 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: paperless-ngx
|
||||
2026/09/26 01:30:05 tier2.go:425: [INFO] [backup] Tier 2 copied privatebin → /mnt/felhom-drives/hdd_1/backups/secondary/privatebin (2.0 MB, 0 leg(s), 0s)
|
||||
2026/09/26 01:30:05 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: privatebin
|
||||
2026/09/26 01:30:08 tier2.go:425: [INFO] [backup] Tier 2 copied romm → /mnt/sys_drive/felhom-data/backups/secondary/romm (191.5 MB, 0 leg(s), 3s) [SSD: state-only]
|
||||
2026/09/26 01:30:08 tier2.go:476: [INFO] [backup] Tier 2 run complete: 10 app(s) processed (incl. volume-only — F6)
|
||||
2026/09/26 01:30:08 scheduler.go:363: [INFO] [scheduler] Job tier2-backup completed (took 8.76s)
|
||||
2026/09/26 01:30:08 notifier.go:346: [INFO] Event pushed: crossdrive_completed (info) [hu-only] — Másodlagos mentés elkészült: romm
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:30:16 scheduler.go:363: [INFO] [scheduler] Job conversion-copy-release completed (took 0s)
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: disk-health-check
|
||||
2026/09/26 01:30:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:30:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 103ms)
|
||||
2026/09/26 01:30:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 262ms)
|
||||
2026/09/26 01:30:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 374ms)
|
||||
2026/09/26 01:30:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 664ms)
|
||||
2026/09/26 01:30:16 scheduler.go:363: [INFO] [scheduler] Job disk-health-check completed (took 726ms)
|
||||
2026/09/26 01:30:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 989ms)
|
||||
2026/09/26 01:31:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:31:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 644ms)
|
||||
2026/09/26 01:32:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:32:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 73ms)
|
||||
2026/09/26 01:32:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:32:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 677ms)
|
||||
2026/09/26 01:33:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:33:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 645ms)
|
||||
2026/09/26 01:34:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:34:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:34:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 78ms)
|
||||
2026/09/26 01:34:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 647ms)
|
||||
2026/09/26 01:35:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:35:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:35:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:35:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 227ms)
|
||||
2026/09/26 01:35:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 229ms)
|
||||
2026/09/26 01:35:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 658ms)
|
||||
2026/09/26 01:36:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:36:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:36:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 92ms)
|
||||
2026/09/26 01:36:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 634ms)
|
||||
2026/09/26 01:37:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:37:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 646ms)
|
||||
2026/09/26 01:38:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:38:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:38:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 97ms)
|
||||
2026/09/26 01:38:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 691ms)
|
||||
2026/09/26 01:39:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:39:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 708ms)
|
||||
2026/09/26 01:40:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:40:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:40:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:40:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:40:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 80ms)
|
||||
2026/09/26 01:40:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 215ms)
|
||||
2026/09/26 01:40:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 302ms)
|
||||
2026/09/26 01:40:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 670ms)
|
||||
2026/09/26 01:41:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:41:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 691ms)
|
||||
2026/09/26 01:42:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:42:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 71ms)
|
||||
2026/09/26 01:42:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:42:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 679ms)
|
||||
2026/09/26 01:43:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:43:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 671ms)
|
||||
2026/09/26 01:44:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:44:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:44:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 78ms)
|
||||
2026/09/26 01:44:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 662ms)
|
||||
2026/09/26 01:45:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:45:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:45:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:45:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:45:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 245ms)
|
||||
2026/09/26 01:45:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 267ms)
|
||||
2026/09/26 01:45:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 662ms)
|
||||
2026/09/26 01:45:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 978ms)
|
||||
2026/09/26 01:46:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:46:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 71ms)
|
||||
2026/09/26 01:46:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:46:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 655ms)
|
||||
2026/09/26 01:47:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:47:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 653ms)
|
||||
2026/09/26 01:48:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:48:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 72ms)
|
||||
2026/09/26 01:48:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:48:17 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 985ms)
|
||||
2026/09/26 01:49:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:49:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 660ms)
|
||||
2026/09/26 01:50:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:50:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:50:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:50:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:50:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 84ms)
|
||||
2026/09/26 01:50:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 219ms)
|
||||
2026/09/26 01:50:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 308ms)
|
||||
2026/09/26 01:50:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 700ms)
|
||||
2026/09/26 01:51:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:51:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 663ms)
|
||||
2026/09/26 01:52:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:52:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:52:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 111ms)
|
||||
2026/09/26 01:52:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 650ms)
|
||||
2026/09/26 01:53:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:53:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 673ms)
|
||||
2026/09/26 01:54:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:54:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:54:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 107ms)
|
||||
2026/09/26 01:54:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 676ms)
|
||||
2026/09/26 01:55:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:55:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:55:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:55:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 229ms)
|
||||
2026/09/26 01:55:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 237ms)
|
||||
2026/09/26 01:55:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 701ms)
|
||||
2026/09/26 01:56:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:56:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 67ms)
|
||||
2026/09/26 01:56:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:56:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 641ms)
|
||||
2026/09/26 01:57:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:57:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 684ms)
|
||||
2026/09/26 01:58:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:58:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:58:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 95ms)
|
||||
2026/09/26 01:58:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 668ms)
|
||||
2026/09/26 01:59:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:59:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 663ms)
|
||||
2026/09/26 02:00:00 scheduler.go:346: [INFO] [scheduler] Running job: metrics-prune
|
||||
2026/09/26 02:00:00 scheduler.go:363: [INFO] [scheduler] Job metrics-prune completed (took 169ms)
|
||||
2026/09/26 02:00:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:00:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:00:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:00:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 02:00:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:00:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 134ms)
|
||||
2026/09/26 02:00:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 280ms)
|
||||
2026/09/26 02:00:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 437ms)
|
||||
2026/09/26 02:00:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 654ms)
|
||||
2026/09/26 02:00:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 1.288s)
|
||||
2026/09/26 02:01:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:01:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 671ms)
|
||||
2026/09/26 02:02:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:02:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:02:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 107ms)
|
||||
2026/09/26 02:02:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 640ms)
|
||||
2026/09/26 02:03:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:03:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 661ms)
|
||||
2026/09/26 02:04:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:04:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:04:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 102ms)
|
||||
2026/09/26 02:04:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 669ms)
|
||||
2026/09/26 02:05:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:05:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:05:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:05:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 234ms)
|
||||
2026/09/26 02:05:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 243ms)
|
||||
2026/09/26 02:05:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 685ms)
|
||||
2026/09/26 02:06:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:06:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:06:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 102ms)
|
||||
2026/09/26 02:06:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 696ms)
|
||||
2026/09/26 02:07:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:07:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 657ms)
|
||||
2026/09/26 02:08:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:08:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:08:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 76ms)
|
||||
2026/09/26 02:08:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 687ms)
|
||||
2026/09/26 02:09:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:09:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 675ms)
|
||||
2026/09/26 02:10:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:10:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:10:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:10:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:10:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 80ms)
|
||||
2026/09/26 02:10:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 230ms)
|
||||
2026/09/26 02:10:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 323ms)
|
||||
2026/09/26 02:10:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 693ms)
|
||||
2026/09/26 02:11:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:11:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 656ms)
|
||||
2026/09/26 02:12:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:12:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:12:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 102ms)
|
||||
2026/09/26 02:12:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 635ms)
|
||||
2026/09/26 02:13:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:13:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 653ms)
|
||||
2026/09/26 02:14:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:14:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:14:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 96ms)
|
||||
2026/09/26 02:14:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 671ms)
|
||||
2026/09/26 02:15:00 scheduler.go:346: [INFO] [scheduler] Running job: offbox-backup
|
||||
2026/09/26 02:15:00 offbox.go:922: [INFO] [offbox] backup run started (9 app(s) toggled)
|
||||
2026/09/26 02:15:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:15:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:15:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 02:15:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:15:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 279ms)
|
||||
2026/09/26 02:15:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 320ms)
|
||||
2026/09/26 02:15:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 663ms)
|
||||
2026/09/26 02:15:17 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 1.045s)
|
||||
2026/09/26 02:16:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:16:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:16:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 97ms)
|
||||
2026/09/26 02:16:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 658ms)
|
||||
2026/09/26 02:16:44 backup.go:639: [INFO] [backup] App-data backup completed: 6 databases (8.7 MB total), 9 volume dump(s) (1m44.349s)
|
||||
2026/09/26 02:16:44 offbox.go:969: [INFO] [offbox] pre-push dump leg completed in 1m44.393s — snapshot pair is coherent
|
||||
2026/09/26 02:16:55 offbox.go:1385: [WARN] [offbox] backed up bentopdf (/mnt/sys_drive/felhom-data/backups/primary/bentopdf, 0 mandatory path(s)) — but the recovery unit carried NO database dump and NO volume tar, so this snapshot holds none of the app's data; the next run with a dump leg will replace it
|
||||
2026/09/26 02:16:59 offbox.go:1388: [INFO] [offbox] backed up bookstack (/mnt/sys_drive/felhom-data/backups/primary/bookstack, 0 mandatory path(s))
|
||||
2026/09/26 02:17:03 offbox.go:1388: [INFO] [offbox] backed up calibre-web (/mnt/felhom-drives/hdd_1/backups/primary/calibre-web, 1 mandatory path(s))
|
||||
2026/09/26 02:17:09 offbox.go:1388: [INFO] [offbox] backed up docmost (/mnt/sys_drive/felhom-data/backups/primary/docmost, 0 mandatory path(s))
|
||||
2026/09/26 02:17:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:17:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 683ms)
|
||||
2026/09/26 02:17:19 offbox.go:1388: [INFO] [offbox] backed up kimai (/mnt/sys_drive/felhom-data/backups/primary/kimai, 0 mandatory path(s))
|
||||
2026/09/26 02:17:26 offbox.go:1388: [INFO] [offbox] backed up paperless-ngx (/mnt/felhom-drives/hdd_1/backups/primary/paperless-ngx, 1 mandatory path(s))
|
||||
2026/09/26 02:17:30 offbox.go:1388: [INFO] [offbox] backed up opengist (/mnt/sys_drive/felhom-data/backups/primary/opengist, 0 mandatory path(s))
|
||||
2026/09/26 02:17:33 offbox.go:1388: [INFO] [offbox] backed up privatebin (/mnt/sys_drive/felhom-data/backups/primary/privatebin, 0 mandatory path(s))
|
||||
2026/09/26 02:17:42 offbox.go:1388: [INFO] [offbox] backed up romm (/mnt/felhom-drives/hdd_1/backups/primary/romm, 0 mandatory path(s))
|
||||
2026/09/26 02:18:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:18:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:18:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 98ms)
|
||||
2026/09/26 02:18:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 679ms)
|
||||
2026/09/26 02:18:25 offbox.go:1158: [INFO] [offbox] backup OK: 9 app(s) backed up, 90 snapshot(s), 3m20s
|
||||
2026/09/26 02:18:25 unattended.go:254: [INFO] [update-leg] started (after-offsite): window 02:30, no step starts at or after 07:30
|
||||
2026/09/26 02:18:25 update.go:536: [INFO] [stacks] update docmost: accepted — guarded update started
|
||||
2026/09/26 02:18:25 unattended.go:320: [INFO] [update-leg] docmost: step pressed docmost=docmost/docmost:0.96.0, docmost-postgres=postgres:16-alpine, docmost-redis=redis:7-alpine → docmost=docmost/docmost:0.96.0, docmost-postgres=postgres:18-alpine, docmost-redis=redis:7-alpine
|
||||
2026/09/26 02:18:25 update.go:1365: [INFO] [stacks] update docmost: phase checking
|
||||
2026/09/26 02:18:25 update.go:786: [INFO] [stacks] update docmost: ladder — the last step (2 of 2) — the catalog's current definition
|
||||
2026/09/26 02:18:25 update.go:800: [INFO] [stacks] update docmost: this step CONVERTS docmost-postgres PostgreSQL 16 → 18 (the ladder entry's mark); database volume docmost_docmost_postgres_data
|
||||
2026/09/26 02:18:25 update.go:814: [INFO] [stacks] update docmost: precondition met — Tier 2 (second drive) copy from 2026-09-26T01:30:01Z (48m0s old, limit 24h0m0s)
|
||||
2026/09/26 02:18:25 update.go:1365: [INFO] [stacks] update docmost: phase safety-dump
|
||||
2026/09/26 02:18:26 offbox_reconstitute.go:255: [INFO] [offbox] docmost: pre-restore safety dump written → pre-restore-20260926T021825Z-docmost-postgres.sql (157.6 KB)
|
||||
2026/09/26 02:18:26 update_guard.go:478: [INFO] [backup] update safety dump for docmost: 1 file(s) [/mnt/sys_drive/felhom-data/backups/primary/docmost/db-dumps/pre-restore-20260926T021825Z-docmost-postgres.sql]
|
||||
2026/09/26 02:18:26 update.go:846: [INFO] [stacks] update docmost: safety dump done (1 file(s)) [/mnt/sys_drive/felhom-data/backups/primary/docmost/db-dumps/pre-restore-20260926T021825Z-docmost-postgres.sql]
|
||||
2026/09/26 02:18:26 undo.go:401: [WARN] [stacks] update docmost: volume(s) [docmost_docmost_postgres_data docmost_docmost_redis_data docmost_docmost_storage] carry no compose label (recreated by a restore before v0.268.0 — R-658) — copied by name
|
||||
2026/09/26 02:18:27 undo.go:287: [INFO] [stacks] update docmost: the undo copy will hold 3 named volume(s), 97.7 MiB
|
||||
2026/09/26 02:18:27 pgconvert.go:286: [INFO] [stacks] update docmost: conversion space — database volume docmost_docmost_postgres_data is 67 MB; the dump needs up to 83 MB + the 2 GB floor; 28.6 GB free beside the stack dir
|
||||
2026/09/26 02:18:27 update.go:1365: [INFO] [stacks] update docmost: phase pinning
|
||||
2026/09/26 02:18:27 pin.go:373: [INFO] [stacks] update docmost: pin advanced to /opt/docker/felhom-controller/data/catalog-cache/templates/docmost/docker-compose.yml (docmost=docmost/docmost:0.96.0, docmost-postgres=postgres:18-alpine, docmost-redis=redis:7-alpine)
|
||||
2026/09/26 02:18:27 update.go:1365: [INFO] [stacks] update docmost: phase pulling
|
||||
2026/09/26 02:18:32 update.go:1365: [INFO] [stacks] update docmost: phase copying
|
||||
2026/09/26 02:18:38 update.go:1365: [INFO] [stacks] update docmost: phase copying
|
||||
2026/09/26 02:18:41 undo.go:437: [INFO] [stacks] update docmost: copied docmost_docmost_postgres_data → docmost_docmost_postgres_data.pre-update-20260926T021838Z in 2.429s
|
||||
2026/09/26 02:18:41 update.go:1365: [INFO] [stacks] update docmost: phase copying
|
||||
2026/09/26 02:18:42 undo.go:437: [INFO] [stacks] update docmost: copied docmost_docmost_redis_data → docmost_docmost_redis_data.pre-update-20260926T021838Z in 873ms
|
||||
2026/09/26 02:18:42 update.go:1365: [INFO] [stacks] update docmost: phase copying
|
||||
2026/09/26 02:18:42 undo.go:437: [INFO] [stacks] update docmost: copied docmost_docmost_storage → docmost_docmost_storage.pre-update-20260926T021838Z in 384ms
|
||||
2026/09/26 02:18:42 update.go:1365: [INFO] [stacks] update docmost: phase converting
|
||||
2026/09/26 02:18:42 pgconvert.go:369: [INFO] [stacks] update docmost: CONVERTING docmost-postgres PostgreSQL 16 → 18 (volume docmost_docmost_postgres_data, kept copy docmost_docmost_postgres_data.pre-update-20260926T021838Z)
|
||||
2026/09/26 02:18:43 pgconvert.go:414: [INFO] [stacks] update docmost: pg_dumpall from 16 done in 536ms — 136 kB, completion line present; before: 2 database(s), 50 table(s), 73 row(s)
|
||||
2026/09/26 02:18:44 update.go:1365: [INFO] [stacks] update docmost: phase converting
|
||||
2026/09/26 02:18:44 pgconvert.go:430: [INFO] [stacks] update docmost: database volume docmost_docmost_postgres_data emptied (its copy docmost_docmost_postgres_data.pre-update-20260926T021838Z holds the old datadir, marker checked twice)
|
||||
2026/09/26 02:18:45 manager.go:1521: [ERROR] [stacks] execCommand failed: exit status 2
|
||||
2026/09/26 02:18:47 manager.go:1521: [ERROR] [stacks] execCommand failed: exit status 2
|
||||
2026/09/26 02:18:51 pgconvert.go:459: [INFO] [stacks] update docmost: loaded into 18 in 1.899s (dropped the entrypoint's empty database(s) [docmost]; skipped CREATE ROLE for [docmost])
|
||||
2026/09/26 02:18:52 pgconvert.go:475: [INFO] [stacks] update docmost: CONVERTED 16 → 18 in 9.898s — the check is equal (2 database(s), 50 table(s), 73 row(s)), PG_VERSION 18
|
||||
2026/09/26 02:18:52 update.go:1365: [INFO] [stacks] update docmost: phase starting
|
||||
2026/09/26 02:19:03 update.go:1365: [INFO] [stacks] update docmost: phase verifying
|
||||
2026/09/26 02:19:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:19:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 748ms)
|
||||
2026/09/26 02:19:18 update.go:997: [INFO] [stacks] update docmost: healthy after 15s (the app's health check passed)
|
||||
2026/09/26 02:19:19 update.go:1015: [INFO] [stacks] update docmost: KEEPING the pre-conversion datadir copy docmost_docmost_postgres_data.pre-update-20260926T021838Z (PostgreSQL 16) until a backup of the converted app is proven
|
||||
2026/09/26 02:19:19 update.go:1033: [INFO] [stacks] update docmost: DONE in 54s
|
||||
2026/09/26 02:19:20 unattended.go:327: [INFO] [update-leg] docmost: step ended done after 55.1 s
|
||||
2026/09/26 02:19:20 unattended.go:235: [INFO] [update-leg] update leg (after-offsite): done=1 undone=0 held=0 failed=0 skipped=0 in 55s [skipped: ]
|
||||
2026/09/26 02:19:20 scheduler.go:363: [INFO] [scheduler] Job offbox-backup completed (took 4m20.57s)
|
||||
2026/09/26 02:20:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:20:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:20:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:20:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:20:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 83ms)
|
||||
2026/09/26 02:20:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 227ms)
|
||||
2026/09/26 02:20:16 offbox_reconstitute.go:319: [INFO] [backup] docmost: pruned old undo copy pre-restore-20260822T162708Z-docmost-postgres.sql (keeping the newest 3)
|
||||
2026/09/26 02:20:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 314ms)
|
||||
2026/09/26 02:20:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 658ms)
|
||||
2026/09/26 02:21:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:21:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 626ms)
|
||||
2026/09/26 02:22:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:22:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 73ms)
|
||||
2026/09/26 02:22:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:22:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 691ms)
|
||||
2026/09/26 02:23:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:23:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 661ms)
|
||||
2026/09/26 02:24:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:24:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 67ms)
|
||||
2026/09/26 02:24:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:24:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 632ms)
|
||||
2026/09/26 02:25:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:25:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:25:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:25:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 219ms)
|
||||
2026/09/26 02:25:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 237ms)
|
||||
2026/09/26 02:25:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 722ms)
|
||||
2026/09/26 02:26:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:26:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 70ms)
|
||||
2026/09/26 02:26:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:26:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 656ms)
|
||||
2026/09/26 02:27:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:27:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 664ms)
|
||||
2026/09/26 02:28:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:28:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:28:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 98ms)
|
||||
2026/09/26 02:28:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 683ms)
|
||||
2026/09/26 02:29:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:29:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 649ms)
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: disk-health-check
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 124ms)
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job conversion-copy-release completed (took 290ms)
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 318ms)
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 400ms)
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 674ms)
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job disk-health-check completed (took 765ms)
|
||||
2026/09/26 02:30:18 quiesce.go:505: [INFO] [quiesce] backup due on 1 tier(s) — quiescing 10 stack(s): [adventurelog bentopdf bookstack calibre-web docmost kimai opengist paperless-ngx privatebin romm]
|
||||
2026/09/26 02:30:30 scheduler.go:363: [INFO] [scheduler] Job hub-report completed (took 13.934s)
|
||||
2026/09/26 02:30:45 quiesce.go:554: [INFO] [quiesce] tier local: backup job backup-9201-1790389845916353490 started — polling
|
||||
2026/09/26 02:30:55 quiesce.go:623: [INFO] [quiesce] tier local: job backup-9201-1790389845916353490 snapshotted — resuming app early (8B.2)
|
||||
2026/09/26 02:30:55 quiesce.go:492: [INFO] [quiesce] unquiescing (snapshotted (early resume, last tier)): restarting 10 stack(s)
|
||||
2026/09/26 02:31:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:31:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 693ms)
|
||||
2026/09/26 02:32:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:32:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:32:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 245ms)
|
||||
2026/09/26 02:32:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 705ms)
|
||||
2026/09/26 02:33:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:33:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 668ms)
|
||||
2026/09/26 02:34:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:34:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:34:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 148ms)
|
||||
2026/09/26 02:34:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 671ms)
|
||||
2026/09/26 02:35:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:35:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:35:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:35:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 295ms)
|
||||
2026/09/26 02:35:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 311ms)
|
||||
2026/09/26 02:35:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 704ms)
|
||||
2026/09/26 02:36:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:36:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:36:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 110ms)
|
||||
2026/09/26 02:36:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 665ms)
|
||||
2026/09/26 02:37:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:37:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 720ms)
|
||||
2026/09/26 02:38:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:38:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:38:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 87ms)
|
||||
2026/09/26 02:38:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 648ms)
|
||||
2026/09/26 02:38:40 quiesce.go:628: [INFO] [quiesce] tier local: backup job backup-9201-1790389845916353490 done
|
||||
2026/09/26 02:39:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:39:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 687ms)
|
||||
2026/09/26 02:40:16 scheduler.go:346: [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:40:16 scheduler.go:346: [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:40:16 scheduler.go:346: [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:40:16 scheduler.go:346: [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:40:16 scheduler.go:363: [INFO] [scheduler] Job stack-scan completed (took 90ms)
|
||||
2026/09/26 02:40:16 scheduler.go:363: [INFO] [scheduler] Job system-health completed (took 230ms)
|
||||
2026/09/26 02:40:16 scheduler.go:363: [INFO] [scheduler] Job backup-cache completed (took 315ms)
|
||||
2026/09/26 02:40:16 scheduler.go:363: [INFO] [scheduler] Job agent-channel-health completed (took 659ms)
|
||||
@@ -0,0 +1,576 @@
|
||||
# demo-felhom night 2026-09-26, controller log 00:25Z–now (INFO/WARN/ERROR)
|
||||
2026/09/26 00:25:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:25:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:25:16 [INFO] [scheduler] Job backup-cache completed (took 79ms)
|
||||
2026/09/26 00:25:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:25:16 [INFO] [scheduler] Job system-health completed (took 193ms)
|
||||
2026/09/26 00:25:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.112s)
|
||||
2026/09/26 00:26:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:26:16 [INFO] [scheduler] Job stack-scan completed (took 54ms)
|
||||
2026/09/26 00:26:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:26:17 [INFO] [scheduler] Job agent-channel-health completed (took 856ms)
|
||||
2026/09/26 00:27:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:27:17 [INFO] [scheduler] Job agent-channel-health completed (took 843ms)
|
||||
2026/09/26 00:28:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:28:16 [INFO] [scheduler] Job stack-scan completed (took 49ms)
|
||||
2026/09/26 00:28:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:28:17 [INFO] [scheduler] Job agent-channel-health completed (took 830ms)
|
||||
2026/09/26 00:29:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:29:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 00:30:00 [INFO] [scheduler] Running job: db-dump
|
||||
2026/09/26 00:30:00 [INFO] [backup] App-data backup completed: 0 databases (0 B total), 1 volume dump(s) (776ms)
|
||||
2026/09/26 00:30:00 [INFO] [scheduler] Job db-dump completed (took 777ms)
|
||||
2026/09/26 00:30:00 [INFO] Event pushed: db_dump_completed (info) [hu-only] — Adatbázis mentés elkészült
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: selfupdate-check
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: geo-verify
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job geo-verify completed (took 0s)
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job selfupdate-check completed (took 68ms)
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: disk-health-check
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job stack-scan completed (took 114ms)
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job conversion-copy-release completed (took 119ms)
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job backup-cache completed (took 160ms)
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job system-health completed (took 311ms)
|
||||
2026/09/26 00:30:16 [INFO] [scheduler] Job hub-report completed (took 510ms)
|
||||
2026/09/26 00:30:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.379s)
|
||||
2026/09/26 00:30:17 [INFO] [scheduler] Job disk-health-check completed (took 1.47s)
|
||||
2026/09/26 00:31:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:31:17 [INFO] [scheduler] Job agent-channel-health completed (took 824ms)
|
||||
2026/09/26 00:32:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:32:16 [INFO] [scheduler] Job stack-scan completed (took 42ms)
|
||||
2026/09/26 00:32:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:32:17 [INFO] [scheduler] Job agent-channel-health completed (took 830ms)
|
||||
2026/09/26 00:33:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:33:17 [INFO] [scheduler] Job agent-channel-health completed (took 819ms)
|
||||
2026/09/26 00:34:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:34:16 [INFO] [scheduler] Job stack-scan completed (took 36ms)
|
||||
2026/09/26 00:34:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:34:17 [INFO] [scheduler] Job agent-channel-health completed (took 821ms)
|
||||
2026/09/26 00:35:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:35:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:35:16 [INFO] [scheduler] Job backup-cache completed (took 54ms)
|
||||
2026/09/26 00:35:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:35:16 [INFO] [scheduler] Job system-health completed (took 192ms)
|
||||
2026/09/26 00:35:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.029s)
|
||||
2026/09/26 00:36:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:36:16 [INFO] [scheduler] Job stack-scan completed (took 54ms)
|
||||
2026/09/26 00:36:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:36:17 [INFO] [scheduler] Job agent-channel-health completed (took 834ms)
|
||||
2026/09/26 00:37:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:37:17 [INFO] [scheduler] Job agent-channel-health completed (took 843ms)
|
||||
2026/09/26 00:38:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:38:16 [INFO] [scheduler] Job stack-scan completed (took 43ms)
|
||||
2026/09/26 00:38:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:38:17 [INFO] [scheduler] Job agent-channel-health completed (took 836ms)
|
||||
2026/09/26 00:39:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:39:17 [INFO] [scheduler] Job agent-channel-health completed (took 849ms)
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Job stack-scan completed (took 93ms)
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Job backup-cache completed (took 97ms)
|
||||
2026/09/26 00:40:16 [INFO] [scheduler] Job system-health completed (took 202ms)
|
||||
2026/09/26 00:40:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.075s)
|
||||
2026/09/26 00:41:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:41:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 00:42:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:42:16 [INFO] [scheduler] Job stack-scan completed (took 56ms)
|
||||
2026/09/26 00:42:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:42:17 [INFO] [scheduler] Job agent-channel-health completed (took 848ms)
|
||||
2026/09/26 00:43:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:43:17 [INFO] [scheduler] Job agent-channel-health completed (took 838ms)
|
||||
2026/09/26 00:44:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:44:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 00:44:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:44:17 [INFO] [scheduler] Job agent-channel-health completed (took 852ms)
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Job backup-cache completed (took 93ms)
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Job system-health completed (took 243ms)
|
||||
2026/09/26 00:45:16 [INFO] [scheduler] Job hub-report completed (took 441ms)
|
||||
2026/09/26 00:45:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.083s)
|
||||
2026/09/26 00:46:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:46:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 00:46:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:46:17 [INFO] [scheduler] Job agent-channel-health completed (took 898ms)
|
||||
2026/09/26 00:47:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:47:17 [INFO] [scheduler] Job agent-channel-health completed (took 828ms)
|
||||
2026/09/26 00:48:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:48:16 [INFO] [scheduler] Job stack-scan completed (took 48ms)
|
||||
2026/09/26 00:48:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:48:17 [INFO] [scheduler] Job agent-channel-health completed (took 820ms)
|
||||
2026/09/26 00:49:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:49:17 [INFO] [scheduler] Job agent-channel-health completed (took 835ms)
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Job stack-scan completed (took 71ms)
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Job backup-cache completed (took 116ms)
|
||||
2026/09/26 00:50:16 [INFO] [scheduler] Job system-health completed (took 191ms)
|
||||
2026/09/26 00:50:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.065s)
|
||||
2026/09/26 00:51:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:51:17 [INFO] [scheduler] Job agent-channel-health completed (took 836ms)
|
||||
2026/09/26 00:52:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:52:16 [INFO] [scheduler] Job stack-scan completed (took 36ms)
|
||||
2026/09/26 00:52:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:52:17 [INFO] [scheduler] Job agent-channel-health completed (took 846ms)
|
||||
2026/09/26 00:53:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:53:17 [INFO] [scheduler] Job agent-channel-health completed (took 840ms)
|
||||
2026/09/26 00:54:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:54:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 00:54:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:54:17 [INFO] [scheduler] Job agent-channel-health completed (took 850ms)
|
||||
2026/09/26 00:55:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 00:55:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 00:55:16 [INFO] [scheduler] Job backup-cache completed (took 41ms)
|
||||
2026/09/26 00:55:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:55:16 [INFO] [scheduler] Job system-health completed (took 165ms)
|
||||
2026/09/26 00:55:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.057s)
|
||||
2026/09/26 00:56:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:56:16 [INFO] [scheduler] Job stack-scan completed (took 43ms)
|
||||
2026/09/26 00:56:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:56:17 [INFO] [scheduler] Job agent-channel-health completed (took 824ms)
|
||||
2026/09/26 00:57:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:57:17 [INFO] [scheduler] Job agent-channel-health completed (took 840ms)
|
||||
2026/09/26 00:58:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 00:58:16 [INFO] [scheduler] Job stack-scan completed (took 61ms)
|
||||
2026/09/26 00:58:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:58:17 [INFO] [scheduler] Job agent-channel-health completed (took 841ms)
|
||||
2026/09/26 00:59:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 00:59:17 [INFO] [scheduler] Job agent-channel-health completed (took 832ms)
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Job stack-scan completed (took 108ms)
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Job backup-cache completed (took 179ms)
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Job system-health completed (took 267ms)
|
||||
2026/09/26 01:00:16 [INFO] [scheduler] Job hub-report completed (took 509ms)
|
||||
2026/09/26 01:00:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.022s)
|
||||
2026/09/26 01:01:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:01:17 [INFO] [scheduler] Job agent-channel-health completed (took 854ms)
|
||||
2026/09/26 01:02:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:02:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 01:02:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:02:17 [INFO] [scheduler] Job agent-channel-health completed (took 820ms)
|
||||
2026/09/26 01:03:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:03:17 [INFO] [scheduler] Job agent-channel-health completed (took 824ms)
|
||||
2026/09/26 01:04:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:04:16 [INFO] [scheduler] Job stack-scan completed (took 47ms)
|
||||
2026/09/26 01:04:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:04:17 [INFO] [scheduler] Job agent-channel-health completed (took 869ms)
|
||||
2026/09/26 01:05:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:05:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:05:16 [INFO] [scheduler] Job backup-cache completed (took 46ms)
|
||||
2026/09/26 01:05:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:05:16 [INFO] [scheduler] Job system-health completed (took 180ms)
|
||||
2026/09/26 01:05:17 [INFO] [scheduler] Job agent-channel-health completed (took 970ms)
|
||||
2026/09/26 01:06:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:06:16 [INFO] [scheduler] Job stack-scan completed (took 64ms)
|
||||
2026/09/26 01:06:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:06:17 [INFO] [scheduler] Job agent-channel-health completed (took 823ms)
|
||||
2026/09/26 01:07:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:07:17 [INFO] [scheduler] Job agent-channel-health completed (took 835ms)
|
||||
2026/09/26 01:08:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:08:16 [INFO] [scheduler] Job stack-scan completed (took 58ms)
|
||||
2026/09/26 01:08:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:08:17 [INFO] [scheduler] Job agent-channel-health completed (took 829ms)
|
||||
2026/09/26 01:09:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:09:17 [INFO] [scheduler] Job agent-channel-health completed (took 845ms)
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Job stack-scan completed (took 48ms)
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Job backup-cache completed (took 112ms)
|
||||
2026/09/26 01:10:16 [INFO] [scheduler] Job system-health completed (took 196ms)
|
||||
2026/09/26 01:10:17 [INFO] [scheduler] Job agent-channel-health completed (took 961ms)
|
||||
2026/09/26 01:11:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:11:17 [INFO] [scheduler] Job agent-channel-health completed (took 833ms)
|
||||
2026/09/26 01:12:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:12:16 [INFO] [scheduler] Job stack-scan completed (took 52ms)
|
||||
2026/09/26 01:12:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:12:17 [INFO] [scheduler] Job agent-channel-health completed (took 838ms)
|
||||
2026/09/26 01:13:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:13:17 [INFO] [scheduler] Job agent-channel-health completed (took 822ms)
|
||||
2026/09/26 01:14:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:14:16 [INFO] [scheduler] Job stack-scan completed (took 48ms)
|
||||
2026/09/26 01:14:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:14:17 [INFO] [scheduler] Job agent-channel-health completed (took 854ms)
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Job backup-cache completed (took 60ms)
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Job system-health completed (took 237ms)
|
||||
2026/09/26 01:15:16 [INFO] [scheduler] Job hub-report completed (took 436ms)
|
||||
2026/09/26 01:15:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.043s)
|
||||
2026/09/26 01:16:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:16:16 [INFO] [scheduler] Job stack-scan completed (took 41ms)
|
||||
2026/09/26 01:16:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:16:17 [INFO] [scheduler] Job agent-channel-health completed (took 840ms)
|
||||
2026/09/26 01:17:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:17:17 [INFO] [scheduler] Job agent-channel-health completed (took 898ms)
|
||||
2026/09/26 01:18:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:18:16 [INFO] [scheduler] Job stack-scan completed (took 58ms)
|
||||
2026/09/26 01:18:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:18:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 01:19:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:19:17 [INFO] [scheduler] Job agent-channel-health completed (took 839ms)
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Job stack-scan completed (took 69ms)
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Job backup-cache completed (took 102ms)
|
||||
2026/09/26 01:20:16 [INFO] [scheduler] Job system-health completed (took 200ms)
|
||||
2026/09/26 01:20:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.069s)
|
||||
2026/09/26 01:21:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:21:17 [INFO] [scheduler] Job agent-channel-health completed (took 820ms)
|
||||
2026/09/26 01:22:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:22:16 [INFO] [scheduler] Job stack-scan completed (took 49ms)
|
||||
2026/09/26 01:22:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:22:17 [INFO] [scheduler] Job agent-channel-health completed (took 854ms)
|
||||
2026/09/26 01:23:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:23:17 [INFO] [scheduler] Job agent-channel-health completed (took 861ms)
|
||||
2026/09/26 01:24:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:24:16 [INFO] [scheduler] Job stack-scan completed (took 37ms)
|
||||
2026/09/26 01:24:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:24:17 [INFO] [scheduler] Job agent-channel-health completed (took 821ms)
|
||||
2026/09/26 01:25:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:25:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:25:16 [INFO] [scheduler] Job backup-cache completed (took 47ms)
|
||||
2026/09/26 01:25:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:25:16 [INFO] [scheduler] Job system-health completed (took 184ms)
|
||||
2026/09/26 01:25:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.048s)
|
||||
2026/09/26 01:26:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:26:16 [INFO] [scheduler] Job stack-scan completed (took 33ms)
|
||||
2026/09/26 01:26:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:26:17 [INFO] [scheduler] Job agent-channel-health completed (took 844ms)
|
||||
2026/09/26 01:27:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:27:17 [INFO] [scheduler] Job agent-channel-health completed (took 809ms)
|
||||
2026/09/26 01:28:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:28:16 [INFO] [scheduler] Job stack-scan completed (took 48ms)
|
||||
2026/09/26 01:28:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:28:17 [INFO] [scheduler] Job agent-channel-health completed (took 824ms)
|
||||
2026/09/26 01:29:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:29:17 [INFO] [scheduler] Job agent-channel-health completed (took 837ms)
|
||||
2026/09/26 01:30:00 [INFO] [scheduler] Running job: tier2-backup
|
||||
2026/09/26 01:30:00 [INFO] [scheduler] Running job: fill-watch
|
||||
2026/09/26 01:30:00 [INFO] [scheduler] Job fill-watch completed (took 0s)
|
||||
2026/09/26 01:30:00 [INFO] [backup] Tier 2 for opengist: no off-drive target — nincs másik fizikai meghajtó — a 2. mentéshez 2. meghajtó szükséges
|
||||
2026/09/26 01:30:00 [INFO] [backup] Tier 2 run complete: 1 app(s) processed (incl. volume-only — F6)
|
||||
2026/09/26 01:30:00 [INFO] [scheduler] Job tier2-backup completed (took 5ms)
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Job conversion-copy-release completed (took 34ms)
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Running job: disk-health-check
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Job stack-scan completed (took 117ms)
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Job backup-cache completed (took 128ms)
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Job system-health completed (took 254ms)
|
||||
2026/09/26 01:30:16 [INFO] [scheduler] Job hub-report completed (took 505ms)
|
||||
2026/09/26 01:30:17 [INFO] [scheduler] Job disk-health-check completed (took 1.46s)
|
||||
2026/09/26 01:30:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.461s)
|
||||
2026/09/26 01:31:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:31:17 [INFO] [scheduler] Job agent-channel-health completed (took 808ms)
|
||||
2026/09/26 01:32:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:32:16 [INFO] [scheduler] Job stack-scan completed (took 58ms)
|
||||
2026/09/26 01:32:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:32:17 [INFO] [scheduler] Job agent-channel-health completed (took 847ms)
|
||||
2026/09/26 01:33:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:33:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 01:34:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:34:16 [INFO] [scheduler] Job stack-scan completed (took 65ms)
|
||||
2026/09/26 01:34:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:34:17 [INFO] [scheduler] Job agent-channel-health completed (took 826ms)
|
||||
2026/09/26 01:35:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:35:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:35:16 [INFO] [scheduler] Job backup-cache completed (took 53ms)
|
||||
2026/09/26 01:35:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:35:16 [INFO] [scheduler] Job system-health completed (took 188ms)
|
||||
2026/09/26 01:35:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.028s)
|
||||
2026/09/26 01:36:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:36:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 01:36:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:36:17 [INFO] [scheduler] Job agent-channel-health completed (took 844ms)
|
||||
2026/09/26 01:37:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:37:17 [INFO] [scheduler] Job agent-channel-health completed (took 815ms)
|
||||
2026/09/26 01:38:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:38:16 [INFO] [scheduler] Job stack-scan completed (took 44ms)
|
||||
2026/09/26 01:38:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:38:17 [INFO] [scheduler] Job agent-channel-health completed (took 846ms)
|
||||
2026/09/26 01:39:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:39:17 [INFO] [scheduler] Job agent-channel-health completed (took 843ms)
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Job stack-scan completed (took 82ms)
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Job backup-cache completed (took 111ms)
|
||||
2026/09/26 01:40:16 [INFO] [scheduler] Job system-health completed (took 196ms)
|
||||
2026/09/26 01:40:17 [INFO] [scheduler] Job agent-channel-health completed (took 990ms)
|
||||
2026/09/26 01:41:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:41:17 [INFO] [scheduler] Job agent-channel-health completed (took 836ms)
|
||||
2026/09/26 01:42:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:42:16 [INFO] [scheduler] Job stack-scan completed (took 37ms)
|
||||
2026/09/26 01:42:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:42:17 [INFO] [scheduler] Job agent-channel-health completed (took 844ms)
|
||||
2026/09/26 01:43:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:43:17 [INFO] [scheduler] Job agent-channel-health completed (took 833ms)
|
||||
2026/09/26 01:44:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:44:16 [INFO] [scheduler] Job stack-scan completed (took 53ms)
|
||||
2026/09/26 01:44:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:44:17 [INFO] [scheduler] Job agent-channel-health completed (took 828ms)
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Job backup-cache completed (took 54ms)
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Job system-health completed (took 263ms)
|
||||
2026/09/26 01:45:16 [INFO] [scheduler] Job hub-report completed (took 459ms)
|
||||
2026/09/26 01:45:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.102s)
|
||||
2026/09/26 01:46:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:46:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 01:46:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:46:17 [INFO] [scheduler] Job agent-channel-health completed (took 828ms)
|
||||
2026/09/26 01:47:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:47:17 [INFO] [scheduler] Job agent-channel-health completed (took 842ms)
|
||||
2026/09/26 01:48:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:48:16 [INFO] [scheduler] Job stack-scan completed (took 33ms)
|
||||
2026/09/26 01:48:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:48:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.124s)
|
||||
2026/09/26 01:49:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:49:17 [INFO] [scheduler] Job agent-channel-health completed (took 844ms)
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Job stack-scan completed (took 47ms)
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Job backup-cache completed (took 97ms)
|
||||
2026/09/26 01:50:16 [INFO] [scheduler] Job system-health completed (took 175ms)
|
||||
2026/09/26 01:50:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.016s)
|
||||
2026/09/26 01:51:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:51:17 [INFO] [scheduler] Job agent-channel-health completed (took 865ms)
|
||||
2026/09/26 01:52:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:52:16 [INFO] [scheduler] Job stack-scan completed (took 47ms)
|
||||
2026/09/26 01:52:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:52:17 [INFO] [scheduler] Job agent-channel-health completed (took 822ms)
|
||||
2026/09/26 01:53:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:53:17 [INFO] [scheduler] Job agent-channel-health completed (took 834ms)
|
||||
2026/09/26 01:54:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:54:16 [INFO] [scheduler] Job stack-scan completed (took 49ms)
|
||||
2026/09/26 01:54:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:54:17 [INFO] [scheduler] Job agent-channel-health completed (took 842ms)
|
||||
2026/09/26 01:55:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 01:55:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 01:55:16 [INFO] [scheduler] Job backup-cache completed (took 58ms)
|
||||
2026/09/26 01:55:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:55:16 [INFO] [scheduler] Job system-health completed (took 180ms)
|
||||
2026/09/26 01:55:17 [INFO] [scheduler] Job agent-channel-health completed (took 960ms)
|
||||
2026/09/26 01:56:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:56:16 [INFO] [scheduler] Job stack-scan completed (took 47ms)
|
||||
2026/09/26 01:56:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:56:17 [INFO] [scheduler] Job agent-channel-health completed (took 826ms)
|
||||
2026/09/26 01:57:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:57:17 [INFO] [scheduler] Job agent-channel-health completed (took 837ms)
|
||||
2026/09/26 01:58:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 01:58:16 [INFO] [scheduler] Job stack-scan completed (took 36ms)
|
||||
2026/09/26 01:58:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:58:17 [INFO] [scheduler] Job agent-channel-health completed (took 829ms)
|
||||
2026/09/26 01:59:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 01:59:17 [INFO] [scheduler] Job agent-channel-health completed (took 828ms)
|
||||
2026/09/26 02:00:00 [INFO] [scheduler] Running job: metrics-prune
|
||||
2026/09/26 02:00:00 [INFO] [scheduler] Job metrics-prune completed (took 81ms)
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Job stack-scan completed (took 106ms)
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Job backup-cache completed (took 156ms)
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Job system-health completed (took 298ms)
|
||||
2026/09/26 02:00:16 [INFO] [scheduler] Job hub-report completed (took 515ms)
|
||||
2026/09/26 02:00:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.02s)
|
||||
2026/09/26 02:01:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:01:17 [INFO] [scheduler] Job agent-channel-health completed (took 832ms)
|
||||
2026/09/26 02:02:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:02:16 [INFO] [scheduler] Job stack-scan completed (took 60ms)
|
||||
2026/09/26 02:02:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:02:17 [INFO] [scheduler] Job agent-channel-health completed (took 832ms)
|
||||
2026/09/26 02:03:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:03:17 [INFO] [scheduler] Job agent-channel-health completed (took 855ms)
|
||||
2026/09/26 02:04:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:04:16 [INFO] [scheduler] Job stack-scan completed (took 48ms)
|
||||
2026/09/26 02:04:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:04:17 [INFO] [scheduler] Job agent-channel-health completed (took 837ms)
|
||||
2026/09/26 02:05:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:05:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:05:16 [INFO] [scheduler] Job backup-cache completed (took 43ms)
|
||||
2026/09/26 02:05:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:05:16 [INFO] [scheduler] Job system-health completed (took 171ms)
|
||||
2026/09/26 02:05:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.039s)
|
||||
2026/09/26 02:06:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:06:16 [INFO] [scheduler] Job stack-scan completed (took 34ms)
|
||||
2026/09/26 02:06:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:06:17 [INFO] [scheduler] Job agent-channel-health completed (took 836ms)
|
||||
2026/09/26 02:07:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:07:17 [INFO] [scheduler] Job agent-channel-health completed (took 815ms)
|
||||
2026/09/26 02:08:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:08:16 [INFO] [scheduler] Job stack-scan completed (took 50ms)
|
||||
2026/09/26 02:08:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:08:17 [INFO] [scheduler] Job agent-channel-health completed (took 823ms)
|
||||
2026/09/26 02:09:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:09:17 [INFO] [scheduler] Job agent-channel-health completed (took 859ms)
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Job stack-scan completed (took 91ms)
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Job backup-cache completed (took 106ms)
|
||||
2026/09/26 02:10:16 [INFO] [scheduler] Job system-health completed (took 197ms)
|
||||
2026/09/26 02:10:17 [INFO] [scheduler] Job agent-channel-health completed (took 961ms)
|
||||
2026/09/26 02:11:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:11:17 [INFO] [scheduler] Job agent-channel-health completed (took 819ms)
|
||||
2026/09/26 02:12:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:12:16 [INFO] [scheduler] Job stack-scan completed (took 49ms)
|
||||
2026/09/26 02:12:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:12:17 [INFO] [scheduler] Job agent-channel-health completed (took 850ms)
|
||||
2026/09/26 02:13:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:13:17 [INFO] [scheduler] Job agent-channel-health completed (took 832ms)
|
||||
2026/09/26 02:14:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:14:16 [INFO] [scheduler] Job stack-scan completed (took 48ms)
|
||||
2026/09/26 02:14:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:14:17 [INFO] [scheduler] Job agent-channel-health completed (took 830ms)
|
||||
2026/09/26 02:15:00 [INFO] [scheduler] Running job: offbox-backup
|
||||
2026/09/26 02:15:00 [INFO] [offbox] backup run started (1 app(s) toggled)
|
||||
2026/09/26 02:15:00 [INFO] [backup] App-data backup completed: 0 databases (0 B total), 1 volume dump(s) (752ms)
|
||||
2026/09/26 02:15:00 [INFO] [offbox] pre-push dump leg completed in 753ms — snapshot pair is coherent
|
||||
2026/09/26 02:15:08 [INFO] [offbox] backed up opengist (/mnt/sys_drive/felhom-data/backups/primary/opengist, 0 mandatory path(s))
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Job backup-cache completed (took 93ms)
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Job system-health completed (took 301ms)
|
||||
2026/09/26 02:15:16 [INFO] [scheduler] Job hub-report completed (took 469ms)
|
||||
2026/09/26 02:15:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.052s)
|
||||
2026/09/26 02:15:46 [INFO] [offbox] backup OK: 1 app(s) backed up, 11 snapshot(s), 42s
|
||||
2026/09/26 02:15:46 [INFO] [update-leg] started (after-offsite): window 02:30, no step starts at or after 07:30
|
||||
2026/09/26 02:15:46 [INFO] [update-leg] update leg (after-offsite): done=0 undone=0 held=0 failed=0 skipped=0 in 0s [skipped: ]
|
||||
2026/09/26 02:15:46 [INFO] [scheduler] Job offbox-backup completed (took 46.731s)
|
||||
2026/09/26 02:16:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:16:16 [INFO] [scheduler] Job stack-scan completed (took 60ms)
|
||||
2026/09/26 02:16:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:16:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 02:17:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:17:17 [INFO] [scheduler] Job agent-channel-health completed (took 835ms)
|
||||
2026/09/26 02:18:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:18:16 [INFO] [scheduler] Job stack-scan completed (took 52ms)
|
||||
2026/09/26 02:18:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:18:17 [INFO] [scheduler] Job agent-channel-health completed (took 846ms)
|
||||
2026/09/26 02:19:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:19:17 [INFO] [scheduler] Job agent-channel-health completed (took 916ms)
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Job stack-scan completed (took 64ms)
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Job backup-cache completed (took 113ms)
|
||||
2026/09/26 02:20:16 [INFO] [scheduler] Job system-health completed (took 196ms)
|
||||
2026/09/26 02:20:17 [INFO] [scheduler] Job agent-channel-health completed (took 960ms)
|
||||
2026/09/26 02:21:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:21:17 [INFO] [scheduler] Job agent-channel-health completed (took 834ms)
|
||||
2026/09/26 02:22:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:22:16 [INFO] [scheduler] Job stack-scan completed (took 52ms)
|
||||
2026/09/26 02:22:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:22:17 [INFO] [scheduler] Job agent-channel-health completed (took 848ms)
|
||||
2026/09/26 02:23:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:23:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 02:24:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:24:16 [INFO] [scheduler] Job stack-scan completed (took 40ms)
|
||||
2026/09/26 02:24:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:24:17 [INFO] [scheduler] Job agent-channel-health completed (took 833ms)
|
||||
2026/09/26 02:25:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:25:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:25:16 [INFO] [scheduler] Job backup-cache completed (took 41ms)
|
||||
2026/09/26 02:25:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:25:16 [INFO] [scheduler] Job system-health completed (took 179ms)
|
||||
2026/09/26 02:25:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.042s)
|
||||
2026/09/26 02:26:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:26:16 [INFO] [scheduler] Job stack-scan completed (took 34ms)
|
||||
2026/09/26 02:26:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:26:17 [INFO] [scheduler] Job agent-channel-health completed (took 835ms)
|
||||
2026/09/26 02:27:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:27:17 [INFO] [scheduler] Job agent-channel-health completed (took 835ms)
|
||||
2026/09/26 02:28:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:28:16 [INFO] [scheduler] Job stack-scan completed (took 59ms)
|
||||
2026/09/26 02:28:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:28:17 [INFO] [scheduler] Job agent-channel-health completed (took 840ms)
|
||||
2026/09/26 02:29:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:29:17 [INFO] [scheduler] Job agent-channel-health completed (took 813ms)
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: hub-report
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Job conversion-copy-release completed (took 0s)
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Running job: disk-health-check
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Job stack-scan completed (took 109ms)
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Job backup-cache completed (took 162ms)
|
||||
2026/09/26 02:30:16 [INFO] [scheduler] Job system-health completed (took 276ms)
|
||||
2026/09/26 02:30:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.426s)
|
||||
2026/09/26 02:30:17 [INFO] [scheduler] Job disk-health-check completed (took 1.507s)
|
||||
2026/09/26 02:30:29 [INFO] [scheduler] Job hub-report completed (took 13.629s)
|
||||
2026/09/26 02:31:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:31:17 [INFO] [scheduler] Job agent-channel-health completed (took 825ms)
|
||||
2026/09/26 02:32:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:32:16 [INFO] [scheduler] Job stack-scan completed (took 42ms)
|
||||
2026/09/26 02:32:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:32:17 [INFO] [scheduler] Job agent-channel-health completed (took 834ms)
|
||||
2026/09/26 02:33:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:33:17 [INFO] [scheduler] Job agent-channel-health completed (took 827ms)
|
||||
2026/09/26 02:34:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:34:16 [INFO] [scheduler] Job stack-scan completed (took 51ms)
|
||||
2026/09/26 02:34:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:34:17 [INFO] [scheduler] Job agent-channel-health completed (took 850ms)
|
||||
2026/09/26 02:35:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:35:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:35:16 [INFO] [scheduler] Job backup-cache completed (took 60ms)
|
||||
2026/09/26 02:35:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:35:16 [INFO] [scheduler] Job system-health completed (took 206ms)
|
||||
2026/09/26 02:35:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.036s)
|
||||
2026/09/26 02:36:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:36:16 [INFO] [scheduler] Job stack-scan completed (took 63ms)
|
||||
2026/09/26 02:36:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:36:17 [INFO] [scheduler] Job agent-channel-health completed (took 825ms)
|
||||
2026/09/26 02:37:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:37:17 [INFO] [scheduler] Job agent-channel-health completed (took 837ms)
|
||||
2026/09/26 02:38:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:38:16 [INFO] [scheduler] Job stack-scan completed (took 47ms)
|
||||
2026/09/26 02:38:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:38:17 [INFO] [scheduler] Job agent-channel-health completed (took 832ms)
|
||||
2026/09/26 02:39:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:39:17 [INFO] [scheduler] Job agent-channel-health completed (took 830ms)
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Running job: backup-cache
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Running job: stack-scan
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Running job: system-health
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Job stack-scan completed (took 68ms)
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Running job: agent-channel-health
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Job backup-cache completed (took 96ms)
|
||||
2026/09/26 02:40:16 [INFO] [scheduler] Job system-health completed (took 188ms)
|
||||
2026/09/26 02:40:17 [INFO] [scheduler] Job agent-channel-health completed (took 1.057s)
|
||||
@@ -0,0 +1,24 @@
|
||||
# demo-hp docmost AFTER the night — read-only, 2026-09-26T02:40:49Z
|
||||
docmost docmost/docmost:0.96.0 Up 9 minutes (healthy)
|
||||
docmost-redis redis:7-alpine Up 9 minutes (healthy)
|
||||
docmost-postgres postgres:18-alpine Up 9 minutes (healthy)
|
||||
18
|
||||
users=1
|
||||
workspaces=1
|
||||
spaces=1
|
||||
pages=4
|
||||
front door GET / -> 200
|
||||
kept copy:
|
||||
last_auto_update:
|
||||
at: "2026-09-26T02:18:25Z"
|
||||
outcome: done
|
||||
2026/09/26 02:30:30 manager.go:1305: [INFO] [stacks] Stopping stack: docmost
|
||||
2026/09/26 02:30:31 manager.go:1314: [INFO] [stacks] Stack docmost stopped successfully (took 0.8s)
|
||||
2026/09/26 02:19:19 update.go:1015: [INFO] [stacks] update docmost: KEEPING the pre-conversion datadir copy docmost_docmost_postgres_data.pre-update-20260926T021838Z (PostgreSQL 16) until a backup of the converted app is proven
|
||||
2026/09/26 02:30:16 scheduler.go:346: [INFO] [scheduler] Running job: conversion-copy-release
|
||||
2026/09/26 02:30:16 pgconvert.go:584: [INFO] [stacks] docmost: REMOVED the pre-conversion datadir copy docmost_docmost_postgres_data.pre-update-20260926T021838Z (PostgreSQL 16) — the converted app has a backup proven on 18: Tier 1 (own recovery unit) at 2026-09-26T02:20:16Z
|
||||
2026/09/26 02:30:16 scheduler.go:363: [INFO] [scheduler] Job conversion-copy-release completed (took 290ms)
|
||||
# R-696 evidence: the unit's manifest vs its dump
|
||||
2026-09-26 02:20:16.395531699 +0000 /mnt/sys_drive/felhom-data/backups/primary/docmost/manifest.json
|
||||
2026-09-26 02:15:01.344676503 +0000 /mnt/sys_drive/felhom-data/backups/primary/docmost/db-dumps/docmost-postgres.sql
|
||||
-- Dumped from database version 16.15
|
||||
@@ -0,0 +1,2 @@
|
||||
Sep 26 04:38:34 demo-hp felhom-agent[995644]: time=2026-09-26T04:38:34.211+02:00 level=INFO msg="backup: completed" vmid=9201 target=local archive=local:backup/vzdump-lxc-9201-2026_09_26-04_30_46.tar.zst size_bytes=83845
|
||||
Sep 26 04:38:34 demo-hp felhom-agent[995644]: time=2026-09-26T04:38:34.211+02:00 level=INFO msg="local-api: backup job complete" vmid=9201 target=local job=backup-9201-1790389845916353490 archive=local:backup/vzdump-lxc-
|
||||
@@ -0,0 +1,3 @@
|
||||
# hub stored reports, update_leg after 2026-09-26 02:00Z (copy of the hub DB + wal, deleted after)
|
||||
demo-felhom received 2026-09-26 02:30:29 update_leg= {"trigger": "after-offsite", "started_at": "2026-09-26T02:15:46.693716149Z", "ended_at": "2026-09-26T02:15:46.730952718Z", "deadline": "2026-09-26T07:30:00+02:00", "enabled": true, "done": 0, "undone": 0, "held": 0, "failed": 0, "skipped": 0, "steps": []}
|
||||
demo-hp received 2026-09-26 02:30:29 update_leg= {"trigger": "after-offsite", "started_at": "2026-09-26T02:18:25.371084185Z", "ended_at": "2026-09-26T02:19:20.571423199Z", "deadline": "2026-09-26T07:30:00+02:00", "enabled": true, "done": 1, "undone": 0, "held": 0, "failed": 0, "skipped": 0, "steps": [{"app": "docmost", "outcome": "done", "from": {"docmost": "docmost/docmost:0.96.0", "docmost-postgres": "postgres:16-alpine", "docmost-redis": "redis:7-alpine"}, "to": {"docmost": "docmost/docmost:0.96.0", "docmost-postgres": "postgres:18-alpine", "docmost-redis": "redis:7-alpine"}, "seconds": 55.1}]}
|
||||
@@ -814,6 +814,7 @@ class (an image `VOLUME` at an unmounted path) is still live — `immich-server`
|
||||
| **R-693** | **[P3-LOW] The memory watch marks a Node app `memory_tight` at any limit — its heap sizes itself from the limit.** Measured 2026-09-25 on the bench (docmost 0.96.0, harness v4): the app's own memory (`anon`) peaked at **349 MB of 384 MB (90.9 %)**, then, with the limit raised to 512 MB, at **431 MB of 512 MB (80.4 %)** — 0 OOM kills and 0 restarts in both 10-minute watches (~12 000 requests each). So the mark (decision 22's "does not fit the memory") fires for an app that fits, and the gate's remedy (raise the limit) cannot clear it. docmost moved with the limit raised to 512 MB (decision 39). **Needs:** a basis that tells growth-to-fill from pressure (e.g. kills/restarts plus a GC-pressure signal, or a second watch at a higher limit showing the peak scales), or a per-app `memory_scales_with_limit` fact. `audits/night-2026-09-26/C/bench-run1/`, `…/bench-run2/` | **OPEN — P3; owner: CC** |
|
||||
| **R-694** | **[P3-LOW] Loading kept data (and every unit restore) regenerates a withheld login secret — does the household's shown password still work?** Seen 2026-09-25 on 9202 (E5, nextcloud): `generated replacement for [NEXTCLOUD_ADMIN_PASSWORD] — the credential was reset (old value unrecoverable)`. The unit deliberately carries no internet-reachable admin login (D5). For nextcloud the real admin password lives in the loaded DATABASE, so the new env value is likely inert — but if the app page shows the regenerated value as "your password", it is a false one. **Not measured:** what the page shows after a load, per app. `audits/night-2026-09-26/E/E5-5-use.txt` | **OPEN — P3; owner: CC (measure first)** |
|
||||
| **R-695** | **[P3-LOW] Two kept-data Deletes in the same second can leave a self-perpetuating empty kept folder.** Seen 2026-09-25 on 9202 (v0.274.0, teardown): two Deletes at 13:35:16 each started `SyncFileBrowserMounts` in a goroutine; one restarted the file browser with the OLD bind list, Docker recreated the deleted folder `kept/nextcloud/2026-09-25_141014` EMPTY (root, 13:35:17), and the next sync LISTED that empty folder as a kept item and kept binding it — so the bind recreated the folder and the folder kept the bind. Broken by removing the folder and one controller restart. Harm: an empty 0-byte row and a stale empty source in the view; no data. **Fix direction:** single-flight the file-browser sync (the second waits and re-reads), and never list or bind an EMPTY dated kept folder. `audits/night-2026-09-26/G/T1-teardown-9202.txt` | **OPEN — P3; owner: CC** |
|
||||
| **R-696** | **[P2-MEDIUM] Tier 1's "proven at" is the unit MANIFEST's refresh time, not its data's — so the kept pre-conversion copy was released on a backup taken BEFORE the conversion.** Seen 2026-09-26 on demo-hp (v0.274.0, the automatic leg): docmost converted 16 → 18 at 02:18:52Z; at 02:20:16Z the recovery unit was re-captured (its pins changed) — `manifest.json` `created_at` 02:20:16Z — while its `db-dumps/docmost-postgres.sql` is from **02:15:01Z, on PostgreSQL 16**. `UpdateRestorePoints` reads Tier 1's time from `ListRestorePoints` (the unit's time), so at 02:30:16Z `ReleaseConversionCopies` logged "a backup proven on 18: Tier 1 at 02:20:16Z" and removed the 16 datadir copy. **Harm tonight: low** — the 02:15 logical dump holds the rows the conversion's check proved equal, and the next night's dump is on 18. **The class is wider:** the update's own precondition reads the same time, and a unit is re-captured on every controller release or pin change (`CaptureRecoveryUnit`), so a stale dump can read as minutes old (9202 2026-09-25 11:06: "Tier 1 copy 2m0s old" from the 11:04 restart, dumps older). On 9202 the release was right by luck (dump 11:57 > conversion 11:13). **Fix direction:** Tier 1's time = the newest DATA in the unit (its db/volume dumps' own times), never the manifest's; the release additionally requires a dump of the converted service written after the conversion. Presence-is-not-success, `CLAUDE.md`. `audits/night-2026-09-26/G/G4-demo-hp-docmost-after.txt` | **OPEN — P2; owner: CC** |
|
||||
<!-- DUE-CHECKS-BEGIN — machine-readable. Parsed by scripts/due_checks_gate.py.
|
||||
One row per dated check. The R-number must have a row above. Dates are UTC.
|
||||
Clearing a row means the check was DONE and its result recorded in that R-row —
|
||||
|
||||
Reference in New Issue
Block a user