Local & private AI for privacy
Use cases where keeping data on your own hardware is the main reason to go local, for personal, family, legal or medical reasons.
Rebel BitesAuto-tagging documents in Paperless-ngx with Ollama
Since version 3.0, Paperless-ngx suggests titles, senders, document types and tags, and can chat with your documents, using a local Ollama model.
Home Assistant Voice PE with a local LLM instead of Echo
A $60 Voice Preview Edition, an N100 box and an optional RTX 3060 replace every Echo and Nest in the house. It keeps working with the internet unplugged.
A private ChatGPT for a family of four on a Mac mini
One always-on M4 Mac mini serves Open WebUI to every phone and laptop in the house. Kids get a tutor preset, and three AI subscriptions are gone.
Fully local Home Assistant voice assistant on a GPU
Wake word to spoken answer in 2-3 seconds, with zero audio leaving the house. Built from faster-whisper, Piper and Ollama, with a cloud fallback.
Øxygen: a private desktop chat app for Ollama
Conversations, files and settings live in a file in your home directory. It talks only to Ollama on 127.0.0.1 and adds optional embeddings, vision, voice and image generation.
Branching conversation graphs with OpenYoke
A Tauri and Rust desktop app for Ollama where every exchange is a node you can branch from, and sibling branches never bleed context into each other.
Leaving Google Photos for Immich with local AI search
CLIP smart search and face recognition run on the author's own NAS. A GTX 1070 turned days of indexing into one night.
Offline LLM on a Raspberry Pi 5 for classification and extraction
Phi-3 mini at Q4_K_M runs at 4-6 tokens per second on an 8 GB Pi 5 with no network at all. Under GDPR, data that never leaves the board isn't transferred anywhere.
Copilot-style coding assistant from a headless RTX 3090 box
qwen2.5-coder:7b on a home server, reached from a laptop over an SSH tunnel and wired into VS Code through Continue for chat, edits and autocomplete.