Future Work
Items that are known gaps, not oversights:
- IONOS/yooshtek.com info — add info regarding the domain/subdomain structure, setup refresh for dynamic ip, etc.
- mainsail.yooshtek.com — external access broken, cause unknown. Investigate Mainsail/Klipper network binding config.
- Alertmanager — not yet configured. Priority alerts to add: immichbox low RAM (
node_memory_MemAvailable_bytes{job="immichbox"} < 500MB), anyprobe_successgoing to 0, backup ZFS pool state change. - GPU utilisation on attic-gremlin — thermals are covered by node_hwmon, but GPU % utilisation requires
amdgpu_topexposed on port 9400. - Matrix Synapse metrics — ✅ Done. Scraping
192.168.4.30:9092/_synapse/metrics. - Immich native metrics — investigated. Immich runs as a TrueNAS app on smaug; the metrics port is not exposed through TrueNAS app isolation. Neither port 30041 nor 9091 responds to a metrics scrape. Deferred until a REST API or textfile collector approach is implemented.
- Caddy metrics — enable the Caddy admin API and add its metrics endpoint as a scrape target.
- ExpressVPN monitoring — no Prometheus exporter exists. A blackbox ICMP probe against the tunnel endpoint could at least detect if
tun0goes down. - TrueNAS pool health — not available via Graphite (SCALE 25.10 does not push zpool state). Future option: poll
/api/v2.0/poolREST API from attic-gremlin and expose via node_exporter textfile collector. - TrueNAS drive SMART data — not yet confirmed present in Graphite metrics. Check TrueNAS UI or use REST API approach above.
- Ollama metrics — investigated.
localhost:11434/metricsreturns 404. No Prometheus metrics endpoint exists at this path. Deferred pending further research into Ollama metrics support. - Requestrr — ✅ Done. Blackbox probes
http://192.168.4.30:4545/(returns 200). Port 4545, runs baremetal. - TrueNAS SCALE update — 25.10.2.1 is available (current: 25.10.1).
- Wiki via Caddy — MkDocs currently served via
mkdocs serveon attic-gremlin port 8000. Move tomkdocs build+ rsync to immichbox + Caddy for a proper production setup. - bazzite SSH keys — generate ed25519 key on bazzite and deploy to attic-gremlin and immichbox, then disable password auth on both servers.