LLM Infrastructure
How prefix caching actually works, why most teams get the ordering wrong, and the exact restructuring that turns a cache-miss prompt into a cache-hit one. I once reviewed a system where every single call to the model was a cache miss. Not most calls. Every call. The team
grapine
Most AI project briefs contain three things: a description of what the business wants, a rough sense of the technology involved, and a lot of assumptions that nobody has written down. The build happens. The assumptions surface. The result was not quite what anyone actually needed. A good brief is
grapine
Most AI projects don't fail because the technology doesn't work. They fail because nobody agreed on what it was supposed to do. The brief was vague. The scope kept shifting. The developer built what they understood, which was not quite what the client meant, which was