Your own private ChatGPT in a box that fits in your pocket
What if you could run a fully local AI assistant on 25 watts? I built Monroe: a plug-and-play box with RAG, streaming chat, and no cloud dependency. Here's the architecture, the compromises, and what I learned about building AI systems under real hardware constraints.