Older Posts — Page 11 of 19
Observability for Long-Running LLM Agent Workflows
Design an observability stack for agentic LLM workloads: millisecond event timestamps, queue-depth metrics, and bounded buffering that survives outages.
14 min read · 17 July 2026
Why progressive web apps fail on 2G and how to fix…
How to audit and fix a progressive web app for 2G and 3G: transport, payload, rendering, caching, and a 30-minute first step.
12 min read · 17 July 2026
Red-teaming agents without killing velocity
How to embed lightweight adversarial testing for LLM agents into pull requests: fuzzed payloads, resilience assertions, shadow canaries.
11 min read · 17 July 2026
AI features as tech debt or golden paths
Why wrapper-plus-cache AI features fail under network drops and model drift, and how to design state-machine fallbacks you can actually measure.
12 min read · 17 July 2026
Offline-first agents for field teams
Design an offline-first field agent: local state machine, durable sync queue, conflict resolution, and honest ways to measure latency and battery.
14 min read · 16 July 2026
Stabilize multi-model agent routers: six production rules
Six rules for multi-model agent routers: bounded concurrency, idempotency keys, timeouts, observability, and how to measure each one yourself.
15 min read · 15 July 2026
Designing AI-Assisted Sales for Developer Tools
How to build an AI-assisted sales pipeline for developer tools: intent routing, code generation, handoff rules, failure modes, and what to instrument.
16 min read · 14 July 2026
Stop guessing tech stacks: validate tools in 2 hours
A repeatable two-hour process for validating an unfamiliar library or service before it reaches production, with concrete checks and exit criteria.
13 min read · 12 July 2026
Trim LLM bills: 3 FinOps moves that work
Request shaping, two-layer caching and priority queuing explained with working code, honest failure modes, and a cost measurement method you can run today.
11 min read · 12 July 2026
Designing Alert Triage That Suppresses Noise Safely
Classify alerts by shape and downstream impact, then suppress with evidence. Includes PromQL, SQL, breaker logic, and a 30-minute first step.
12 min read · 11 July 2026
Why Cloud Cost Tools Miss Agent-Driven GPU Spend
Agent-driven GPU spend breaks assumptions in standard cloud cost tools. Learn why they miss it, how to measure detection latency, and what to build instead.
12 min read · 10 July 2026
Agent context: short-term vs long-term memory
Compare Redis-style short-term agent context with Postgres event logs: latency, durability, auditability, cost, and how to measure each.
15 min read · 9 July 2026
Observability for LLM Features: Metrics That Drive Decisions
Log one structured event per LLM interaction instead of tracing every token, then alert only on user-facing outcomes that justify keeping a feature.
14 min read · 8 July 2026
7 ways to measure prompt platform ROI in 2026
How to attribute token cost, latency and developer time to prompt and agent platforms, with instrumentation recipes, failure modes and a decision checklist.
14 min read · 8 July 2026
AI in local currency: costs that surprise…
How to choose where to run AI inference: decouple variable compute cost from fixed per-region compliance cost, and measure the trade-off.
15 min read · 7 July 2026
AI feature drift: why your model died at midnight
Diagnose nightly AI model drift and FeatureStoreKeyNotFound errors: tokenizer drift, memory fragmentation, and cold-start timeouts, with fixes.
14 min read · 7 July 2026
Audit logs: ship them fast, keep them forever
Design an audit log pipeline that separates durability from searchability, with tiered retention, integrity hashing, and a cost model you can verify.
14 min read · 6 July 2026
Build agent workflows that survive restarts
How to build agent task pipelines that resume after crashes, schema drift and model changes, using Redis streams, idempotent steps and replay.
12 min read · 6 July 2026
LLMOps 2026: evaluation stack that replaced RAG dashboards
Why RAG dashboards miss real failures, and how to build an evaluation stack around task resolution, dataset rotation, prompt versioning, and drift checks.
13 min read · 5 July 2026
7 skills senior engineers need now agents are live
Long-running agents break assumptions built for short-lived processes. Seven skills, how to measure each one, and failure modes to watch for.
15 min read · 5 July 2026
AI in slow networks: why models flop where data costs rise
How to cut payload size, round-trips and cost for AI features on 2G/3G networks, with a worked ASR example, failure modes and a measurement checklist.
14 min read · 5 July 2026
Always-On vs On-Demand Agents: Real Cost Trade-offs
Always-on containers bill for idle time; on-demand functions bill per invocation. Compare latency, retries, cold starts, and the failure modes that decide which fits.
12 min read · 5 July 2026
LLM drift: the silent quality drop metrics miss
Latency and error rate stay flat while LLM output quality quietly degrades. Here is how to log prompts, measure embedding drift, and catch it early.
11 min read · 4 July 2026
Audit trails: ImmutableDB vs DynamoDB Streams
Compare append-only hash-chained logs with DynamoDB Streams for audit trails: replay, tamper evidence, cost model, and a decision checklist.
15 min read · 4 July 2026