Here's my take on where AI is headed and why subject matter experts, not ML engineers, will be the ones building the next generation of AI applications. Most of this comes from the podcast above. The Big Picture One of the main predictions I base a lot of
My technically curious dad just asked if Deepseek is a game changer. It's a fair question that gets at the heart of what's happening in AI right now. What's Really Going On Deepseek is good. They've built the best open-source model out
What we can learn from o1 models and "Thinking Claude" The AI landscape has shifted dramatically. We now have access to both "smart" and "dumb" models, where smart model families o1 take time to think and reason before answering. But here's where
As language models evolve, their context windows keep getting longer and longer. This evolution is challenging our assumptions about how we should feed information to these models. Enter Cache-Augmented Generation (CAG), a new approach that's making waves in the AI community. What is CAG? Cache-Augmented Generation loads all
Recent research suggests that modern AI language models, particularly reasoning-focused LLMs like o1, often engage in excessive computation. Here's what this means for prompt engineering and how you can optimize your AI interactions. The Overthinking Problem Consider this striking example: when asked to solve a simple "2+
The o1 model family, developed by OpenAI, represents a significant advancement in AI reasoning capabilities. These models are specifically designed to excel at complex problem-solving tasks, from mathematical reasoning to coding challenges. What makes o1 particularly interesting is its ability to break down problems systematically and explore multiple solution paths—
I recently recorded a podcast with Dan Shipper on Every. We covered a lot, but most interestingly spoke a lot about prompt engineering from first principles. Figured I would out all the highlights in blog form. The reports of prompt engineering's demise have been greatly exaggerated. The Three