Ollama

Local AI is no longer a hobby project. Here's how to set it up properly: provider abstraction, versioned models, evaluation harnesses, and cloud fallback for when local isn't enough.

Local LLMs are finally good enough for development. Use them for iteration, keep the API bills for production.