discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
blake-hamm/bhamm-lab · source
Snapshot 0 · 2026-11-04T12:47:27Z · Nix · BSD-3-Clause
Content fingerprint
31dd12f35324bd05645f9c0084c02a1e74fd8eba08fcfa32a9d9e82ff01d9230GitHub description at capture
My homelab
README at capture
# bhamm-lab <!----> [](https://github.com/blake-hamm/bhamm-lab/stargazers) [](LICENSE.md) Welcome to my personal lab for exploring AI/ML, DevOps, and security. I've built a robust platform to power self hosted apps. It's a place for learning, tinkering, and maybe over-engineer a solution or two. > **Repository Hosting:** This project is mirrored on [Codeberg](https://codeberg.org/blake-hamm/bhamm-lab), which serves as the source of truth for all GitOps and infrastructure-as-code deployments. The [GitHub mirror](https://github.com/blake-hamm/bhamm-lab) remains available for public visibility and portfolio reference (and because [GitHub is cooked](https://isgithubcooked.com/) more often than I'd like). Codeberg is built on [Forgejo](https://forgejo.org/), which I also self-host. - [Documentation](#documentation) - [Guiding Principles](#guiding-principles) - [Core Infrastructure](#core-infrastructure) - [Key Features](#key-features) - [Roadmap](#roadmap) ## Documentation Comprehensive documentation is available in my **[docs site](https://docs.bhamm-lab.com/)**, covering architecture, deployments, operations, security, and AI/ML implementations. ## Guiding Principles This project is, first and foremost, a platform for learning and exploration. The core philosophy is to maintain a resilient and reproducible test environment where experimentation is encouraged. While this approach can sometimes lead to over-engineering (here's [the counter-argument](https://frenck.dev/the-enterprise-smart-home-syndrome/)), the primary goal is to guarantee that any component can be rebuilt from code. This philosophy is supported by several key principles: * **Everything as Code:** All infrastructure, from bare-metal provisioning to application deployment, is defined declaratively and managed through version control. This ensures consistency and enables rapid disaster recovery. * **Monorepo Simplicity:** The entire homelab is managed within a single repository, providing a unified view of all services, configurations, and documentation. * **Open Source First:** I prioritize the use of open-source software to maintain flexibility and support the community. * **Accelerated AI/ML:** The environment is specifically tailored for AI/ML workloads, with a focus on leveraging AMD and Intel GPU acceleration for inference. ## Core Infrastructure **Hardware:** - **Servers:** 5 servers – ‘Method’ (SuperMicro H12SSL‑i), ‘Indy’ (SuperMicro D‑2146NT), ‘Stale’ (X10SDV‑4C‑TLN4F), ‘Nose’ & ‘Tail’ (Framework Mainboard) - **Networking:** TP‑Link Omada switches & Protectli Opnsense firewall - **Accelerated compute:** Intel Arc A310, AMD Radeon AI Pro R9700, AMD Ryzen AI MAX+ 395 “Strix Halo” - **Management:** UPS, PiKVM **Software Stack:** - **Operating Systems**: [Debian](https://www.debian.org/), [Proxmox](https://www.proxmox.com/), [Talos](https://www.talos.dev/), [NixOS](https://nixos.org/), [Truenas](https://www.truenas.com/) - **Storage:** [Ceph](https://ceph.io/) cluster (hot storage) and [Truenas](https://www.truenas.com/) (cold storage) - **Container Orchestration:** Ephemeral [Talos](https://www.talos.dev/) [Kubernetes](https://kubernetes.io/) clusters and [Harbor](https://goharbor.io/) proxy/registry - **Automation:** [OpenTofu](https://opentofu.org/), [Ansible](https://www.ansible.com/), [ArgoCD](https://argo-cd.readthedocs.io/en/stable/), [NixOS](https://nixos.org/), [Argo Events](https://argoproj.github.io/argo-events/) and [Argo Workflows](https://argoproj.github.io/argo-workflows/) - **Security:** [SOPS](https://github.com/mozilla/sops), [HashiCorp Vault](https://www.vaultproject.io/), [Authelia](https://www.authelia.com/), [Traefik](https://traefik.io/traefik/), VLANs - **Observability:** [Kube Prometheus Stack](https://github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack), [Alloy](https://github.com/grafana/alloy), [Arise Phoenix](https://arize.com/docs/phoenix) ## Key Features **AI/ML Capabilities:** - 🤖 Managing device through [Intel GPU plugin](https://intel.github.io/intel-device-plugins-for-kubernetes/cmd/gpu_plugin/README.html) and [AMD ROCm operator](https://github.com/ROCm/gpu-operator) - 🖼️ [Immich](https://immich.app/) machine learning & [Jellyfin](https://jellyfin.org/) transcoding with Intel Arc A310 - 📦 `llm-models` [Helm chart](kubernetes/charts/llm-models) – [KubeElasti](https://kubeelasti.dev/) scale‑to‑zero [Llama.cpp](https://github.com/ggml-org/llama.cpp) inference routed through [LiteLLM](https://github.com/BerriAI/litellm) - 🧠 Embedding model inference with AMD Radeon AI Pro R9700 - ⚡ Dense & MoE inference on two AMD Ryzen AI MAX+ 395 - ☁️ GCP Vertex AI for larger ML inference **Automation:** - Infrastructure as Code with [OpenTofu](https://opentofu.org/) - [Debian](https://www.debian.org/), [Proxmox](https://www.proxmox.com/) and [Opnsense](https://opnsense.org/) management with [Ansible](https://www.ansible.com/) - GitOps deployment with [ArgoCD](https://argo-cd.readthedocs.io/en/stable/) - Test/prod deployment strategies - Container registry and proxy with [Harbor](https://goharbor.io/) - [Argo Events](https://argoproj.github.io/argo-events/) and [Argo Workflows](https://argoproj.github.io/argo-workflows/) for backups, secret management and CI/CD pipelines - [NixOS](https://nixos.org/) for Framework 13 laptop and Aorus gaming desktop - [Common helm chart](kubernetes/charts/common) **Storage & Backups:** - [Ceph](https://ceph.io/) backbone - [SeaweedFS](https://github.com/chrislusf/seaweedfs) PVC hot storage - [Truenas](https://www.truenas.com/) / [MinIO](https://min.io/) cold storage - Offsite replication to [Cloudflare R2](https://www.cloudflare.com/products/cloudflare-r2/) - Automated backups with [Argo Workflows](https://argoproj.github.io/argo-workflows/), [k8up](https://github.com/k8up-io/k8up) and [CloudNative PG](https://cloudnative-pg.io/) **Security:** - Network segmentation with [OPNsense](https://opnsense.org/) and intervlan routing with TP Link Omada - Secrets management with [SOPS](https://github.com/mozilla/sops) and [Vault](https://www.vaultproject.io/) - Automated TLS certificates with [Cert Manager](https://cert-manager.io/) and [Cloudflare](https://www.cloudflare.com/) - OIDC/MFA authentication with [Authelia](https://www.authelia.com/) - Middleware and encrypted ingress with [Traefik](https://traefik.io/traefik) **Disaster Recovery:** - Infrastructure-as-Code for rapid rebuilding - Automated backup restoration workflows and gitops - Regular disaster recovery testing with test/prod cluster - 3-2-1 backup strategy ## Roadmap - **Short-term:** Run MiniMax with llama.cpp grpc accross two Strix Halo system - **Mid-term:** Setup renovate and automate maintenance processes - **Long-term:** Fine-tuning generative models, Home Assistant integration *Github issues are more up to date with detailed task tracking.*