Offline chat on desktop or Android via Termux with Prefrontal

What they built

Prefrontal is an open-source chat interface for local models. When run with Ollama or llama.cpp, no chat data leaves your machine or LAN. OpenRouter is an optional cloud mode.

Setup

• Node.js app at http://localhost:3000
• Runtime: Ollama (desktop) or llama.cpp (any platform, including Android/Termux)
• Suggested models: gemma3:4b (recommended), gemma3:12b, llama3.2, mistral

Gotchas

• The hosted live demo only supports OpenRouter and stores your key in a cookie; it's for previewing the UI, not private use

Do it yourself

1. ollama serve & then ollama pull gemma3:4b
2. git clone the repo, npm install && npm start
3. Open http://localhost:3000 → Settings → Runtime: Ollama, URL http://localhost:11434, model gemma3:4b

git clone https://github.com/sidx1-scratch/prefrontal
cd prefrontal
npm install && npm start