Tech Stack Used:

  • Debian
  • Podman containers
    • Each container has their own IP address
  • Incus to manage LXCs
  • PiHole (DNS/Network-wide Adblocker)
  • Self-hosted Ollama

Hardware:

  • Old Dell Optiplex
  • POE-powered Raspberry Pi 4
  • Old desktop with NVIDIA card