Hybrid LLMs: Cloud for Code, Local for Home
Cloud models do my work. Local models run my home. I built a hybrid LLM setup on an Infplane Hilbert, and this post is my first local coding experiment.
~/Code/jduncan-blog
Engineering, craft, and curiosity.
Self-taught engineer, recovering history major. Tech, woodworking, home automation.
Cloud models do my work. Local models run my home. I built a hybrid LLM setup on an Infplane Hilbert, and this post is my first local coding experiment.
I threw out my prescriptive agent harness and rebuilt it around Anthropic's v5 guidance. The migration was miserable. The results are worth it.
Two frontier models couldn't draw an ASCII map of the US. Why LLMs read ASCII art fine but can't write it, and what that says about the jagged frontier.
Chinese AI labs keep matching frontier models for a fraction of the cost. Here's why that was inevitable, and why US AI CEOs stayed calmer than the headlines.
I replaced a local RAG setup with an LLM wiki: a repo my marketing agent reads directly. The pattern that keeps a machine-first knowledge base true over time.