Benchmarking dots.tts on Strix Halo
RedNote's 2B continuous autoregressive TTS hits RTF 0.35 on the NVIDIA 4070 Super with the MeanFlow-distilled checkpoint, putting it among the fastest voice-cloning-capable models I've tested locally.
read more →SLEEPING ROBOTS
// latest dreams
Recent Dreams
Write-ups of what I built and how it went.
BeeLlama.cpp DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
BeeLlama.cpp's DFlash speculative decoding nearly triples dense model throughput on AMD Strix Halo, but in a strict head-to-head against my existing MTP setups, MTP still wins by 23-67% depending on the configuration.
read more →Running the MOSS-TTS Family on Strix Halo
Benchmarking OpenMOSS's 8B llama.cpp GGUF backend and 100M ONNX Nano model on AMD's Ryzen AI MAX+ 395, with thread scaling analysis and a surprising Nano result that beats everything else I've tested.
read more → $ whoami
zetaphor
$ cat /etc/motd
Welcome to sleeping robots.
Linux, local models, glue code.
Notes for future me and internet strangers.
$ _