llama-cpp-python in Docker
A Dockerfile and docker-compose setup for running llama.cpp with its Python bindings in a container, because finding a working one shouldn't be this hard.
read more →Lavabo: The Kitchen Sink of Local AI
An all-in-one Docker container that bundles LLMs, embeddings, vision, and TTS into a single unified inference server.
read more →A Practical, Fully Local Desktop Voice Agent
Building a natural language voice controller for the Linux desktop using Qt6, a tiny 1.7B LLM, and a clever vector embedding trick for tool calling.
read more →A Fully Local, In-Browser Voice Assistant
Building a private, browser-based voice assistant using WebAssembly, Moonshine STT, Piper TTS, and local LLMs.
read more →You Are John
A text-driven simulation where you interact with a guy named John through natural language, and an LLM determines how his world responds.
read more →