How LiteLLM, llama-swap, and Lemonade Server compose into a unified local inference platform — routing dozens of models across GPU and NPU through a single API endpoint, accessible anywhere via Tailscale and a local reverse proxy.
read more →Setting up AMD's Lemonade Server on Strix Halo to run LLM and Whisper inference on the XDNA 2 NPU — driver builds, architecture decisions, and benchmarks against the integrated GPU.
read more →Running a 600+ language zero-shot TTS model on an AMD integrated GPU — voice cloning benchmarks, ROCm compatibility adventures, and the container workaround that actually worked.
read more →Running a 2B parameter tokenizer-free TTS model in both Python and C++ on AMD's integrated GPU — near-real-time speech synthesis on CPU, and the Vulkan crash that stopped GPU acceleration in its tracks.
read more →Running Fish Audio's 4B parameter S2-Pro text-to-speech model locally on an AMD Strix Halo integrated GPU via ROCm and Podman.
read more →A browser-based AI music generation tool powered by ACE-Step, ported to Linux for local generation on AMD Strix Halo hardware.
read more →