"Evals are your company's intellectual property" - Alexander Bricken at AI Engineer Summit I recently attended Anthropic's talk at AI Engineer Summit, and it offered fascinating insights into how one of the leading AI companies thinks about building robust AI systems. Here are my
OpenAI's Model Spec tells us a lot about how the company thinks about prompt engineering. Let's explore it and see how to use it in your daily prompting. The Three-Layer Approach The Model Spec uses three layers: objectives, rules, and defaults. This structure makes prompts more
As AI models become increasingly sophisticated, there's a growing narrative that prompt engineering – the art and science of instructing large language models – will soon become obsolete. As models get better at understanding natural language, will the need for carefully crafted prompts will disappear? The death of prompt engineering
Software development is being fundamentally reshaped by AI, but the biggest challenge isn't technical expertise – it's domain knowledge. The next generation of AI products will be built by doctors, lawyers, and educators, not just machine learning engineers. We're excited to announce that PromptLayer has
Here's my take on where AI is headed and why subject matter experts, not ML engineers, will be the ones building the next generation of AI applications. Most of this comes from the podcast above. The Big Picture One of the main predictions I base a lot of
My technically curious dad just asked if Deepseek is a game changer. It's a fair question that gets at the heart of what's happening in AI right now. What's Really Going On Deepseek is good. They've built the best open-source model out
What we can learn from o1 models and "Thinking Claude" The AI landscape has shifted dramatically. We now have access to both "smart" and "dumb" models, where smart model families o1 take time to think and reason before answering. But here's where
As language models evolve, their context windows keep getting longer and longer. This evolution is challenging our assumptions about how we should feed information to these models. Enter Cache-Augmented Generation (CAG), a new approach that's making waves in the AI community. What is CAG? Cache-Augmented Generation loads all
Recent research suggests that modern AI language models, particularly reasoning-focused LLMs like o1, often engage in excessive computation. Here's what this means for prompt engineering and how you can optimize your AI interactions. The Overthinking Problem Consider this striking example: when asked to solve a simple "2+
The o1 model family, developed by OpenAI, represents a significant advancement in AI reasoning capabilities. These models are specifically designed to excel at complex problem-solving tasks, from mathematical reasoning to coding challenges. What makes o1 particularly interesting is its ability to break down problems systematically and explore multiple solution paths—
I recently recorded a podcast with Dan Shipper on Every. We covered a lot, but most interestingly spoke a lot about prompt engineering from first principles. Figured I would out all the highlights in blog form. The reports of prompt engineering's demise have been greatly exaggerated. The Three