Kubai Kevin

25 articles tagged Serverless

HPA vs KEDA vs Karpenter: autoscaling traps

How HPA, KEDA and Karpenter divide responsibility, where each one silently fails, and how to verify each layer before traffic arrives.

17 min read · 26 October 2026

Always-on agents cost more than you think

Always-on agents bill you while idle; on-demand agents bill you at wake-up. A cost model, failure modes, and how to measure both.

15 min read · 30 August 2026

Mobile-first AI fails you didn’t plan…

Mobile-first AI features fail on payload size, latency and device RAM, not model quality. A practical guide to measuring and fixing the network and device bottlenecks.

13 min read · 26 August 2026

AI unit costs: the metric both teams fight over

Why per-call AI cost estimates break down, and how to instrument a shared cost-per-outcome metric that product and finance both accept.

14 min read · 18 August 2026

Orchestration tax kills multi-agent systems

Why coordination layers dominate multi-agent latency and memory, with patterns that remove the scheduler and how to measure your own orchestration tax.

13 min read · 11 August 2026

Agent frameworks: stop rewriting the same glue code

Agent glue code — retries, credentials, state — is mostly boilerplate. Here are three abstractions, worked examples, and how to measure the savings.

13 min read · 10 August 2026

Cost-Effective AI Infrastructure for Micro-SaaS

How to architect an AI micro-SaaS on a tight budget: caching, batching, serverless scaling, cost measurement, and the failure modes that break naive designs.

15 min read · 5 August 2026

MCP servers: the 3 hidden costs nobody quotes

MCP servers are stateful async processes, not stateless APIs. Here are the real cost drivers, failure modes, and how to measure them yourself.

16 min read · 5 August 2026

Boring AWS Lambda layers that don’t lock…

How to version, publish and reference Lambda layers so runtime upgrades, region moves and architecture changes don't break dependent functions.

12 min read · 31 July 2026

Model router: keep it simple, keep it local

Design a local-plus-cloud model router that stays small: rule-based selection, real health checks, pre-warming, and the failure modes that actually bite.

14 min read · 24 July 2026

Poolers won’t save your serverless DB

Why poolers add latency and cost to bursty serverless workloads, and how multiplexing, the Aurora Data API, and direct connections compare.

14 min read · 19 July 2026

Designing AI-Assisted Sales for Developer Tools

How to build an AI-assisted sales pipeline for developer tools: intent routing, code generation, handoff rules, failure modes, and what to instrument.

16 min read · 14 July 2026

Always-On vs On-Demand Agents: Real Cost Trade-offs

Always-on containers bill for idle time; on-demand functions bill per invocation. Compare latency, retries, cold starts, and the failure modes that decide which fits.

12 min read · 5 July 2026

Detect lazy agents without false alarms

Success/fail gates miss agents that keep running while producing harmful output. Measure outcomes instead, with a worked predictor design and decision rules.

14 min read · 4 July 2026

AI-proof your mid-level salary

Tracking commits and story points keeps engineers in the layer AI automates best. Here is how to measure p99 latency, cost per request and error rate instead.

15 min read · 1 July 2026

9 Vibe coding traps that break production code

Nine patterns that make AI-assisted prototypes fail under load, with the instrumentation to catch each one before it reaches production.

11 min read · 1 July 2026

2026 AI stack: solo SaaS cost showdown

A framework for choosing between AI-generated and hand-written infrastructure for a solo SaaS, with cost models, failure modes and a 30-minute audit.

13 min read · 30 June 2026

LLM output metrics that actually move the needle

A layered approach to measuring LLM output quality in production: structured validation, p95 latency, cost per request, and retention signals.

10 min read · 26 June 2026

AI-native apps break when you copy old rules

Model calls are distributed workloads, not function calls. Here is how to design task queues, cache keys, token budgets and retry policy for AI features.

13 min read · 23 June 2026

Serverless Cold Starts: Cost Levers and How to Measure Them

Cold starts are a cost and consistency problem, not just latency. Learn how to measure latency-per-dollar and tune concurrency, memory, and architecture.

12 min read · 20 June 2026

Resize Images at the Edge: A CloudFront and Lambda Guide

Build an on-the-fly image resizing pipeline with CloudFront, Lambda@Edge, S3 and Terraform, including streaming, format negotiation and observability.

13 min read · 18 June 2026

Portfolio that hires: show constraints, not code

A portfolio that proves engineering judgement: latency budgets, load tests, failure-mode notes and honest trade-offs recruiters can verify.

14 min read · 16 June 2026

AI-native apps: forget the old stack

LLM-backed services are token-bound, stateful and failure-prone. Learn the failure modes, how to measure them, and patterns that contain them.

10 min read · 12 June 2026

AI agents eat your budget 3 ways

Token inflation, retry storms and timeout math quietly inflate AI agent bills. Learn how to instrument, cap and verify each cost vector.

12 min read · 11 June 2026

Neon vs PlanetScale vs Turso: which broke first?

Diagnose connection drops, replica lag and proxy limits in Neon, PlanetScale and Turso, with reproducible tests and fixes that do not rely on guesswork.

13 min read · 10 June 2026