Kubai Kevin

Older Posts — Page 11 of 19

Observability for Long-Running LLM Agent Workflows

Design an observability stack for agentic LLM workloads: millisecond event timestamps, queue-depth metrics, and bounded buffering that survives outages.

14 min read · 17 July 2026

Why progressive web apps fail on 2G and how to fix…

How to audit and fix a progressive web app for 2G and 3G: transport, payload, rendering, caching, and a 30-minute first step.

12 min read · 17 July 2026

Red-teaming agents without killing velocity

How to embed lightweight adversarial testing for LLM agents into pull requests: fuzzed payloads, resilience assertions, shadow canaries.

11 min read · 17 July 2026

AI features as tech debt or golden paths

Why wrapper-plus-cache AI features fail under network drops and model drift, and how to design state-machine fallbacks you can actually measure.

12 min read · 17 July 2026

Offline-first agents for field teams

Design an offline-first field agent: local state machine, durable sync queue, conflict resolution, and honest ways to measure latency and battery.

14 min read · 16 July 2026

Stabilize multi-model agent routers: six production rules

Six rules for multi-model agent routers: bounded concurrency, idempotency keys, timeouts, observability, and how to measure each one yourself.

15 min read · 15 July 2026

Designing AI-Assisted Sales for Developer Tools

How to build an AI-assisted sales pipeline for developer tools: intent routing, code generation, handoff rules, failure modes, and what to instrument.

16 min read · 14 July 2026

Stop guessing tech stacks: validate tools in 2 hours

A repeatable two-hour process for validating an unfamiliar library or service before it reaches production, with concrete checks and exit criteria.

13 min read · 12 July 2026

Trim LLM bills: 3 FinOps moves that work

Request shaping, two-layer caching and priority queuing explained with working code, honest failure modes, and a cost measurement method you can run today.

11 min read · 12 July 2026

Designing Alert Triage That Suppresses Noise Safely

Classify alerts by shape and downstream impact, then suppress with evidence. Includes PromQL, SQL, breaker logic, and a 30-minute first step.

12 min read · 11 July 2026

Why Cloud Cost Tools Miss Agent-Driven GPU Spend

Agent-driven GPU spend breaks assumptions in standard cloud cost tools. Learn why they miss it, how to measure detection latency, and what to build instead.

12 min read · 10 July 2026

Agent context: short-term vs long-term memory

Compare Redis-style short-term agent context with Postgres event logs: latency, durability, auditability, cost, and how to measure each.

15 min read · 9 July 2026

Observability for LLM Features: Metrics That Drive Decisions

Log one structured event per LLM interaction instead of tracing every token, then alert only on user-facing outcomes that justify keeping a feature.

14 min read · 8 July 2026

7 ways to measure prompt platform ROI in 2026

How to attribute token cost, latency and developer time to prompt and agent platforms, with instrumentation recipes, failure modes and a decision checklist.

14 min read · 8 July 2026

AI in local currency: costs that surprise…

How to choose where to run AI inference: decouple variable compute cost from fixed per-region compliance cost, and measure the trade-off.

15 min read · 7 July 2026

AI feature drift: why your model died at midnight

Diagnose nightly AI model drift and FeatureStoreKeyNotFound errors: tokenizer drift, memory fragmentation, and cold-start timeouts, with fixes.

14 min read · 7 July 2026

Audit logs: ship them fast, keep them forever

Design an audit log pipeline that separates durability from searchability, with tiered retention, integrity hashing, and a cost model you can verify.

14 min read · 6 July 2026

Build agent workflows that survive restarts

How to build agent task pipelines that resume after crashes, schema drift and model changes, using Redis streams, idempotent steps and replay.

12 min read · 6 July 2026

LLMOps 2026: evaluation stack that replaced RAG dashboards

Why RAG dashboards miss real failures, and how to build an evaluation stack around task resolution, dataset rotation, prompt versioning, and drift checks.

13 min read · 5 July 2026

7 skills senior engineers need now agents are live

Long-running agents break assumptions built for short-lived processes. Seven skills, how to measure each one, and failure modes to watch for.

15 min read · 5 July 2026

AI in slow networks: why models flop where data costs rise

How to cut payload size, round-trips and cost for AI features on 2G/3G networks, with a worked ASR example, failure modes and a measurement checklist.

14 min read · 5 July 2026

Always-On vs On-Demand Agents: Real Cost Trade-offs

Always-on containers bill for idle time; on-demand functions bill per invocation. Compare latency, retries, cold starts, and the failure modes that decide which fits.

12 min read · 5 July 2026

LLM drift: the silent quality drop metrics miss

Latency and error rate stay flat while LLM output quality quietly degrades. Here is how to log prompts, measure embedding drift, and catch it early.

11 min read · 4 July 2026

Audit trails: ImmutableDB vs DynamoDB Streams

Compare append-only hash-chained logs with DynamoDB Streams for audit trails: replay, tamper evidence, cost model, and a decision checklist.

15 min read · 4 July 2026