Local & private AI for coding
Local coding assistants for chat, autocomplete, edits and code review, so proprietary code never goes to a third-party API.
Rebel BitesHome RAG assistant for embedded-systems docs on Proxmox
Ollama, llama.cpp, Open WebUI, BGE-M3 and SearXNG in a GPU-passthrough VM. Moving from 6 GB to 16 GB of VRAM changed which models could run.
Hybrid workflow: local for private and repetitive, cloud for hard
A Linux sysadmin stopped trying to replace cloud LLMs. Ollama now handles private docs, overnight article summaries and VS Code autocomplete.
Offline RAG over 268 Obsidian notes, queryable from a coding agent
nomic-embed-text, ChromaDB and mistral-nemo:12b give cited answers from a vault of internal docs, and an MCP server lets the coding agent search it too.
14 months local-first: what still breaks
An honest report from a three-machine home lab. Local handles about 85% of tasks, but four kinds of work still fail, and that cut cloud spend from $187 to about $25 a month.
Aider + qwen2.5-coder:14b as a local Claude Code alternative
A tic-tac-toe test on an RTX 5060 Ti 16 GB. The game worked on the first pass, but the tests and input validation needed several rounds of prompting.
Copilot-style coding assistant from a headless RTX 3090 box
qwen2.5-coder:7b on a home server, reached from a laptop over an SSH tunnel and wired into VS Code through Continue for chat, edits and autocomplete.