63 articles tagged with LLM.
Standard APM doesn't tell you when your LLM-powered features are silently degrading. The signals we track and the dashboards that catch the regressions standard tools miss.
Multi-agent systems are mostly hype. The patterns we've seen actually deliver value, plus the ones we'd avoid until the tooling is more mature.
We have ~40 prompts in production. The patterns that improved quality, the ones that turned out to be folklore, and how we test prompts now.
We tried four quantization techniques on Llama-3 and Mistral models. The quality vs cost trade-offs we found, plus what works for production inference.
We benchmarked four vector databases on the same workload. Each has a place. Here's how we'd pick today.
We've shipped four production RAG applications. Each one taught us something. The end-to-end pattern that works.
Run retrieval-augmented generation at scale. Chunking, caching, and observability.
We cut LLM inference cost 47% over a quarter while improving p95 latency. Six changes, ranked by what each one actually delivered.
A field report from rolling out retrieval-augmented generation in production, including cache bugs, bad embeddings, and how we fixed them.
Copilots suggest, agents act. Here's the spectrum between them, where each earns its keep in DevOps, and how to add autonomy without lighting your infra on fire.
I spent 3 weeks chasing an answer-quality regression that turned out to be a tokenizer mismatch in a library upgrade. Here's what I learned about evaluating RAG.
We changed a system prompt for what we thought was a tone improvement and broke a customer-critical extraction overnight. The version control and regression tests we built next.
