Benchmarking dots.tts on Strix Halo
RedNote's 2B continuous autoregressive TTS hits RTF 0.35 on the NVIDIA 4070 Super with the MeanFlow-distilled checkpoint, putting it among the fastest voice-cloning-capable models I've tested locally.
read more →Running the MOSS-TTS Family on Strix Halo
Benchmarking OpenMOSS's 8B llama.cpp GGUF backend and 100M ONNX Nano model on AMD's Ryzen AI MAX+ 395, with thread scaling analysis and a surprising Nano result that beats everything else I've tested.
read more →Running DramaBox on Strix Halo
Getting Resemble AI's expressive TTS model running on AMD Strix Halo with no NVIDIA hardware. TheRock gfx1151 nightlies, bitsandbytes preview for ROCm, reduced step counts, and torch.compile bringing the 3.3B DiT from RTF 4.0 down to 1.75.
read more →Optimizing Echo-TTS: CPU Beats GPU
Eight optimization attempts on Echo-TTS CPU inference, the five that worked, quality evaluation with voice cloning, and how the optimized CPU path ended up faster than the GPU hybrid.
read more →Benchmarking Echo-TTS on Strix Halo
Running a diffusion-based TTS model on AMD's Strix Halo, patching CUDA-only code for CPU, discovering a bf16 GPU hang on gfx1151, and a hybrid GPU/CPU trick that beats every other TTS model I've tested.
read more →Benchmarking OmniVoice on Strix Halo
Running a 600+ language zero-shot TTS model on an AMD integrated GPU, voice cloning benchmarks, ROCm compatibility adventures, and the container workaround that actually worked.
read more →Benchmarking VoxCPM2 on Strix Halo
Running a 2B parameter tokenizer-free TTS model in both Python and C++ on AMD's integrated GPU, near-real-time speech synthesis on CPU, and the Vulkan crash that stopped GPU acceleration in its tracks.
read more →Self-Hosting Fish Audio on Strix Halo
Running Fish Audio's 4B parameter S2-Pro text-to-speech model locally on an AMD Strix Halo integrated GPU via ROCm and Podman.
read more →A Practical, Fully Local Desktop Voice Agent
Building a natural language voice controller for the Linux desktop using Qt6, a tiny 1.7B LLM, and a clever vector embedding trick for tool calling.
read more →A Fully Local, In-Browser Voice Assistant
Building a private, browser-based voice assistant using WebAssembly, Moonshine STT, Piper TTS, and local LLMs.
read more →