Older Posts — Page 7 of 19
Why scaling agents kills plain logs
Why plain-text logs and unpinned models break down past a handful of agents, and how to add structured logging plus hash verification.
11 min read · 11 September 2026
Thundering Herd: The Hidden Scaling Trap
Why synchronized cache misses and naive retries collapse services, and how coalescing, jittered backoff, and locks prevent self-inflicted overload.
12 min read · 10 September 2026
LLM agents: why monoliths win
Why splitting an LLM agent into micro-services often costs latency, audit continuity and money, and how to measure before you decompose.
11 min read · 10 September 2026
Agent drift: why it hurts UX
Agent drift degrades latency and error rates without obvious alarms. Learn the four drift classes, detection methods, and a 30-minute audit.
12 min read · 9 September 2026
Cost tools fail when agents scale autonomously
Autonomous scaling agents decide faster than hourly cost reports can explain. Here is how to instrument cost per scaling decision and where the feedback loop breaks.
11 min read · 9 September 2026
Why do production agents still need humans?
Why production agents still need humans: designing HITL boundaries, error-code routing, cache fallbacks, and how to measure the results.
12 min read · 9 September 2026
Why platform metrics lie
Aggregate p99 and request counts hide regional variance, cost attribution gaps, and failure modes. Here is how to build a composite platform metric.
12 min read · 8 September 2026
Rogue Agent API Calls: Stop the Bleeding
Runaway agents rarely crash — they succeed too often. Diagnose unbounded loops, retry storms, and feedback cycles, then add budgets and breakers.
10 min read · 7 September 2026
Two engineer classes: the AI tool norm trap
Uneven AI tool adoption fractures teams through review load, not productivity. Here is how to make AI-assisted code reviewable with a PR template and one metric.
12 min read · 7 September 2026
Offline Agents: Local-First Sync Patterns
Design offline-capable agents with operation logs, versioned conflict resolution, auditable sync, and GDPR-aware deletion propagation.
12 min read · 7 September 2026
AI Experimentation: Guardrails, Not Gates
How to replace a centralized AI provisioning bottleneck with a self-service sandbox: least-privilege proxy, token budgets, tagging, and what to measure.
12 min read · 7 September 2026
Hybrid Cloud Routing: Cost-Speed Balance for SEA
How SEA teams route latency-sensitive traffic locally and bursty workloads to the cloud, with Nginx fallback config, failure modes, and cost checks.
13 min read · 4 September 2026
Why your routing layer will collapse at scale
How to build stateful, region-aware LLM routing: config schema, retry budgets, circuit breakers, audit trails, and the failure modes to plan for.
12 min read · 4 September 2026
Durable Execution for Multi-Step Agent Workflows
Why cron and ad-hoc retries break multi-step agent workflows, and how durable execution runtimes model retries, idempotency, and compensation.
16 min read · 3 September 2026
Portfolio projects that hire remote senior devs
Build a portfolio that proves operational rigor: caching, rate limiting, observability, and load tests that survive a senior remote technical screen.
14 min read · 3 September 2026
IDP for AI: 2026 stack evolution
How to wire embedding model changes into an internal developer platform so dimension drift fails loudly instead of silently shipping broken indexes.
14 min read · 2 September 2026
Agent drift: why prod breaks without human checkpoints
Why agents pass staging and drift in production, and how to add confidence thresholds, escalation queues and compliance guards that make drift visible.
15 min read · 1 September 2026
Only boring stacks survive AI services
Why monoliths beat microservices for solo AI builders, how to spot the "one more abstraction" trap, and how to measure when vertical scaling stops working.
16 min read · 31 August 2026
Commit ownership in AI pair coding
AI pair coding shifts who is accountable for a commit. A practical contract: prompt hashing, test gates, ownership tags, and review discipline.
14 min read · 31 August 2026
Ship evals before your agent ships
Agent evals fail when they only test the happy path. Build outcome-based evals from shadow traffic, wire them into CI, and catch regressions before users do.
16 min read · 31 August 2026
Always-on agents cost more than you think
Always-on agents bill you while idle; on-demand agents bill you at wake-up. A cost model, failure modes, and how to measure both.
15 min read · 30 August 2026
LLM risks underestimated in OWASP Top 10
The OWASP LLM Top 10 covers prompt injection, but production failures cluster in tool use, latency budgets and supply chain. How to measure and mitigate each.
9 min read · 30 August 2026
Prevent ownership drift when velocity explodes
How to keep clear ownership of caches, SLOs and services when teams ship faster: deployment boundaries, error budgets, stampede locks and useful telemetry.
15 min read · 29 August 2026
LLM eval drift that users notice first
Three pipeline-level causes of user-visible LLM drift, how to instrument each one, and how to verify the fix with metrics rather than vibes.
16 min read · 28 August 2026