73efb091d9
gates / gates (push) Successful in 9s
appbackup's path helpers take a NAMESPACE ROOT. Five call sites passed a bare DRIVE path.
On an enrolled drive the two coincide, so nothing showed; on the system-data fallback they
differ by exactly the felhom-data segment, and the app then bound a directory the off-site
capture set never looked at -- while the run reported ok. Measured live on demo-hp: the app
wrote to /mnt/sys_drive/userdata/media/books, the capture set looked for
/mnt/sys_drive/felhom-data/userdata/media/books.
THE RULE NOW HAS ONE EXPRESSION. appbackup.NamespaceRootFor / IsEnrolledDrive encode the
drive-kind comparison; backup.Manager.namespaceRoot and stacks.Manager.inGuest delegate to
it. There were already TWO copies and they differed -- the backup package's compared without
filepath.Clean, the stacks package's with it, so a trailing slash from config would have
flipped the mode in one and not the other.
Sites routed through it:
- stacks/deploy.go withPathVars -> ${USERDATA_PATH} (the live defect)
- appexport/fabplan.go + export.go (via a new provider method)
- web/handlers.go FileBrowser mounts (latent: the system drive is
deliberately never a registered StoragePath, so this is the identity today)
ComputeFabBuckets now receives the namespace root, which is what ComputeCaptureSet has always
received -- so the export's classified paths and the backup's capture set describe the same
directories by construction instead of by coincidence.
Tests are table-driven over BOTH drive kinds, because this survived by being invisible on the
kind that already worked. Red-proofs observed: restoring the bare-path call fails the
system-drive row with the two paths differing by /felhom-data; inverting the drive-kind
comparison fails every enrolled row.
159 lines
8.2 KiB
Go
159 lines
8.2 KiB
Go
// Package appbackup holds the self-contained app-data backup primitives:
|
|
// database dump and Docker-volume archive discovery/execution, plus the
|
|
// keep-side storage path helpers. It depends only on stable abstractions
|
|
// (the StackDataProvider interface) and has no dependency on the restic,
|
|
// cross-drive, or drive-mount code in the backup package.
|
|
package appbackup
|
|
|
|
import (
|
|
"path/filepath"
|
|
"sort"
|
|
"strings"
|
|
)
|
|
|
|
// FelhomDataDir is the namespace directory on storage drives for all felhom-managed data.
|
|
const FelhomDataDir = "felhom-data"
|
|
|
|
// NamespaceRoot resolves the felhom-data namespace ROOT for a drive path. All the path helpers
|
|
// below take this namespace root (the directory that directly contains backups/ and appdata/),
|
|
// NOT a bare drive path — they do not append felhom-data themselves.
|
|
//
|
|
// Model A (slice 10): the host agent binds <drive>/felhom-data onto the guest mountpoint, so an
|
|
// enrolled user-data drive's IN-GUEST mount already IS the namespace root (and its basename need
|
|
// NOT be "felhom-data" — e.g. /mnt/felhom-usb). For such mounts pass inGuestDrive=true → the path
|
|
// is returned as-is, so callers no longer double-nest into .../felhom-data/felhom-data/... .
|
|
//
|
|
// For a bare drive root that still holds a felhom-data SUBDIR — the SSD-only system-data fallback,
|
|
// or any legacy host-side layout — pass inGuestDrive=false → the felhom-data segment is appended.
|
|
func NamespaceRoot(drivePath string, inGuestDrive bool) string {
|
|
if inGuestDrive {
|
|
return filepath.Clean(drivePath)
|
|
}
|
|
return filepath.Join(drivePath, FelhomDataDir)
|
|
}
|
|
|
|
// IsEnrolledDrive reports whether a drive path is an ENROLLED user-data drive (Model A: its in-guest
|
|
// mount already IS the namespace root) rather than the system-data fallback. It is the ONE comparison
|
|
// that decides which NamespaceRoot mode applies, and it lives here so no package re-derives it.
|
|
//
|
|
// Both sides are Clean'd: `/mnt/sys_drive/` and `/mnt/sys_drive` are the same drive, and a trailing
|
|
// slash arriving from config must not silently flip the mode.
|
|
func IsEnrolledDrive(drivePath, systemDataPath string) bool {
|
|
return filepath.Clean(drivePath) != filepath.Clean(systemDataPath)
|
|
}
|
|
|
|
// NamespaceRootFor is the resolver every caller should use when it holds a bare DRIVE path and the
|
|
// system-data path — i.e. everywhere outside the backup package, which already had this rule.
|
|
//
|
|
// R-203: FIVE call sites passed a bare drive path straight to UserdataDir (and its siblings), which
|
|
// take a NAMESPACE ROOT. On an enrolled drive the two coincide, so nothing showed; on the system-data
|
|
// fallback they differ by exactly the felhom-data segment, and the app then bound a directory the
|
|
// backup never looked at. The run still reported ok. Measured live on demo-hp 2026-08-04:
|
|
// the app wrote to /mnt/sys_drive/userdata/media/books while the off-site capture set looked for
|
|
// /mnt/sys_drive/felhom-data/userdata/media/books.
|
|
//
|
|
// THE CONTRACT, restated because four callers got it wrong and a fifth will: UserdataDir,
|
|
// PrimaryBackupPath, RecoveryUnitPath and AppDataDir all take a NAMESPACE ROOT. If you are holding
|
|
// something that came out of HDD_PATH or a StoragePath, it is a DRIVE path — put it through here
|
|
// first. `UserdataDir(bareDrivePath)` still compiles and is still wrong; TestNoBareDrivePathToUserdataDir
|
|
// is the guard that keeps the count from growing.
|
|
func NamespaceRootFor(drivePath, systemDataPath string) string {
|
|
return NamespaceRoot(drivePath, IsEnrolledDrive(drivePath, systemDataPath))
|
|
}
|
|
|
|
// PrimaryBackupPath returns the root primary backup directory under a felhom-data namespace root.
|
|
func PrimaryBackupPath(nsRoot string) string {
|
|
return filepath.Join(nsRoot, "backups", "primary")
|
|
}
|
|
|
|
// RecoveryUnitPath returns the per-app self-contained recovery-unit ROOT under a namespace root.
|
|
// It is the existing per-app backup dir (`backups/primary/<stack>/`) — the legacy name is kept so the
|
|
// db-dumps/ and volume-dumps/ already written there need no migration; the unit gains compose/ and
|
|
// manifest.json as siblings, making the whole dir a complete, recreatable unit (Phase 2). Since D5 the
|
|
// unit's compose/app.yaml CARRIES the portable secret class (data keys, DB passwords, internal signing
|
|
// secrets) at mode 0600, so a Tier-1/2 restore needs the drive and nothing else; internet-reachable
|
|
// admin logins are still withheld. See backup.recoveryUnit / restore for the capture + restore flow.
|
|
func RecoveryUnitPath(nsRoot, stackName string) string {
|
|
return filepath.Join(nsRoot, "backups", "primary", stackName)
|
|
}
|
|
|
|
// RecoveryUnitComposePath returns the compose/config capture dir within an app's recovery unit
|
|
// (docker-compose.yml + .felhom.yml + secret-stripped app.yaml).
|
|
func RecoveryUnitComposePath(nsRoot, stackName string) string {
|
|
return filepath.Join(RecoveryUnitPath(nsRoot, stackName), "compose")
|
|
}
|
|
|
|
// RecoveryUnitManifestPath returns the manifest.json path within an app's recovery unit.
|
|
func RecoveryUnitManifestPath(nsRoot, stackName string) string {
|
|
return filepath.Join(RecoveryUnitPath(nsRoot, stackName), "manifest.json")
|
|
}
|
|
|
|
// AppDBDumpPath returns the DB dump directory for an app under a felhom-data namespace root.
|
|
func AppDBDumpPath(nsRoot, stackName string) string {
|
|
return filepath.Join(RecoveryUnitPath(nsRoot, stackName), "db-dumps")
|
|
}
|
|
|
|
// AppVolumeDumpPath returns the Docker-volume dump-tar directory for an app under a namespace root.
|
|
func AppVolumeDumpPath(nsRoot, stackName string) string {
|
|
return filepath.Join(RecoveryUnitPath(nsRoot, stackName), "volume-dumps")
|
|
}
|
|
|
|
// AppDataDir returns the app data directory under a felhom-data namespace root. The final segment
|
|
// is the app's real appdata dir NAME — usually the stack name, but NOT always: paperless-ngx writes
|
|
// appdata/paperless (F-S2/F-S3). Callers that key by stack name silently miss such apps; use
|
|
// AppDataDirNames to resolve the real name(s) from the app's compose binds and pass them here.
|
|
func AppDataDir(nsRoot, stackName string) string {
|
|
return filepath.Join(nsRoot, "appdata", stackName)
|
|
}
|
|
|
|
// AppDataDirNames returns the app's real directory name(s) under <hddPath>/appdata, derived from its
|
|
// compose HDD bind mounts (F-S2/F-S3: the dir name is NOT always the stack name — paperless-ngx
|
|
// writes appdata/paperless). hddMounts are resolved host paths in the ParseComposeHDDMounts shape
|
|
// (each is <hddPath> itself or a subpath, filepath.Clean'd). The first path element under
|
|
// <hddPath>/appdata/ is taken as the dir name; results are deduped and sorted. Falls back to
|
|
// []string{stackName} when no appdata-prefixed mount is derivable (no HDD appdata binds, unreadable
|
|
// compose, nil provider) — the exact legacy behavior.
|
|
//
|
|
// Today every catalog app resolves to exactly ONE name (immich→immich, nextcloud→nextcloud,
|
|
// romm→romm, paperless-ngx→paperless). The N>1 return is defensive: tier-2 refuses it loudly,
|
|
// migrate handles it naturally.
|
|
func AppDataDirNames(hddPath, stackName string, hddMounts []string) []string {
|
|
prefix := filepath.Clean(hddPath) + string(filepath.Separator) + "appdata" + string(filepath.Separator)
|
|
seen := make(map[string]bool)
|
|
var names []string
|
|
for _, mnt := range hddMounts {
|
|
cm := filepath.Clean(mnt)
|
|
if !strings.HasPrefix(cm, prefix) {
|
|
continue // not under appdata/ (a whole-root bind, a different subtree, a foreign drive)
|
|
}
|
|
rem := strings.TrimPrefix(cm, prefix)
|
|
first := strings.Split(rem, string(filepath.Separator))[0]
|
|
if first == "" {
|
|
continue
|
|
}
|
|
if !seen[first] {
|
|
seen[first] = true
|
|
names = append(names, first)
|
|
}
|
|
}
|
|
if len(names) == 0 {
|
|
return []string{stackName}
|
|
}
|
|
sort.Strings(names)
|
|
return names
|
|
}
|
|
|
|
// AppDataBindsPresent reports whether any of the app's resolved HDD mounts sits under
|
|
// <hddPath>/appdata/ — i.e. the compose actually DECLARES an appdata bind. Callers use it to
|
|
// distinguish "no appdata to back up" (silent skip is correct) from "declared appdata dir missing
|
|
// on disk" (the silence that hid F-S2 — worth a WARN). Same prefix rule as AppDataDirNames.
|
|
func AppDataBindsPresent(hddPath string, hddMounts []string) bool {
|
|
prefix := filepath.Clean(hddPath) + string(filepath.Separator) + "appdata" + string(filepath.Separator)
|
|
for _, mnt := range hddMounts {
|
|
if strings.HasPrefix(filepath.Clean(mnt), prefix) {
|
|
return true
|
|
}
|
|
}
|
|
return false
|
|
}
|