Kubai Kevin

44 articles tagged Kubernetes

Senior without the title: what stalls engineers

Senior work without the senior title: how freelance engineers build real technical depth through decision logs, timezone-aware design, and payment…

16 min read · 18 November 2026

Kubernetes Requests and Limits: Seven Production Traps

Why pods get OOMKilled, throttled, or evicted: seven common requests-and-limits mistakes, how to detect each with real metrics, and which to fix first.

15 min read · 16 November 2026

Gateway API won't fix your Ingress mess

Gateway API does not fix messy Ingress manifests. It changes who owns routing. Here is when delegation is worth the migration and when to wait.

13 min read · 2 November 2026

Distroless images: smaller attack surface

How to move runtime containers to distroless bases, measure the reduction in packages and CVEs, and keep scans blocking in CI.

13 min read · 2 November 2026

OpenTelemetry collector pipelines: sampling, batching…

How receivers, processors, and exporters interact under load, with worked memory arithmetic, sampling trade-offs, routing isolation, and metrics to watch.

13 min read · 30 October 2026

HPA vs KEDA vs Karpenter: autoscaling traps

How HPA, KEDA and Karpenter divide responsibility, where each one silently fails, and how to verify each layer before traffic arrives.

17 min read · 26 October 2026

Deployment platforms: senior vs new hire

How to build a deployment platform that serves both senior engineers and new hires, with escape hatches, guardrails, and a decision checklist.

17 min read · 7 October 2026

SBOM + attestation that gets used

How to generate, sign, attach and enforce SBOMs and build attestations so admission control and CI gates reject unverified artifacts.

17 min read · 3 October 2026

Chaos engineering without an SRE team

How to run controlled fault injection in CI without a dedicated SRE team: scoping, kill switches, instrumentation, and failure modes to avoid.

14 min read · 30 September 2026

World models won't replace your backend

World models add a high-rate prediction stream to your system. Treat it as a sensor: schema, retention, backpressure, and rollback, not a new stack.

15 min read · 24 September 2026

Sandboxed computer-use agents with gVisor

How to contain computer-use agents using gVisor, egress allowlists, and short-lived credentials, with code, failure modes, and planning figures.

14 min read · 21 September 2026

Spot instances vs on-demand for AI experiments

How spot and on-demand GPU instances differ on interruption handling, effective throughput, and the spend threshold where spot engineering pays off.

13 min read · 18 September 2026

Zero-trust AI: skip the latency tax

How to keep per-request identity and least privilege in inference services while moving handshakes and policy evaluation off the hot path.

14 min read · 15 September 2026

Agent drift: why it hurts UX

Agent drift degrades latency and error rates without obvious alarms. Learn the four drift classes, detection methods, and a 30-minute audit.

12 min read · 9 September 2026

Cost tools fail when agents scale autonomously

Autonomous scaling agents decide faster than hourly cost reports can explain. Here is how to instrument cost per scaling decision and where the feedback loop breaks.

11 min read · 9 September 2026

Why your routing layer will collapse at scale

How to build stateful, region-aware LLM routing: config schema, retry budgets, circuit breakers, audit trails, and the failure modes to plan for.

12 min read · 4 September 2026

Only boring stacks survive AI services

Why monoliths beat microservices for solo AI builders, how to spot the "one more abstraction" trap, and how to measure when vertical scaling stops working.

16 min read · 31 August 2026

Spot evictions: the retry logic that holds up

Spot evictions break naive retry logic. Learn how to decouple retries from instance lifecycle, add jitter, and avoid coordinated retry storms.

13 min read · 12 August 2026

Observability Agents as Application Code

Why telemetry agents break at scale, how to budget their resources, and when the standard install-and-forget playbook is actually fine.

13 min read · 11 August 2026

Agent followed instructions too literally: the cron job trap

Why agents that follow retry instructions literally hang forever, and how to fix it with per-request timeouts, async retries, and DNS limits.

12 min read · 11 August 2026

eBPF observability in 2026: what actually works

A practical guide to production eBPF observability and runtime security: kernel requirements, verifier failures, ring buffers, pinning, and how to measure overhead.

14 min read · 9 August 2026

Kubernetes or Nomad: the real experiment cost split

A practical comparison of Kubernetes and Nomad for GPU training jobs, covering scheduler latency, cost modelling, GPU sharing, and a decision checklist.

11 min read · 3 August 2026

Event-driven systems avoid agent-driven contention

How to tell when scheduled jobs and polling loops quietly turn an event-driven system into an agent-driven one, and how to fix it without a rewrite.

15 min read · 30 July 2026

Why Cloud Cost Tools Miss Agent-Driven GPU Spend

Agent-driven GPU spend breaks assumptions in standard cloud cost tools. Learn why they miss it, how to measure detection latency, and what to build instead.

12 min read · 10 July 2026

7 skills senior engineers need now agents are live

Long-running agents break assumptions built for short-lived processes. Seven skills, how to measure each one, and failure modes to watch for.

15 min read · 5 July 2026

Audit trails: ImmutableDB vs DynamoDB Streams

Compare append-only hash-chained logs with DynamoDB Streams for audit trails: replay, tamper evidence, cost model, and a decision checklist.

15 min read · 4 July 2026

AI made self-service platforms trivial in 2026

AI can draft Terraform and Kubernetes manifests, but correctness still needs policy checks, schema validation, and runtime verification before merge.

10 min read · 3 July 2026

Agent Governance: OPA vs Kyverno in Kubernetes

Compare OPA and Kyverno for agent governance in Kubernetes: policy language, latency, audit trails, and a decision checklist.

11 min read · 3 July 2026

AI memory systems: context that survives sessions

Why AI agents silently lose memory across restarts, how to scope memory to a session, and how to test persistence before production.

12 min read · 2 July 2026

Choosing an AI Pair Programming Setup: A Practical Guide

How to evaluate AI pair programming tools by latency, signal-to-noise, cost, and privacy, with configs, failure modes, and a decision checklist.

15 min read · 29 June 2026

CI/CD pipelines stall with GPU pods: 2026 benchmarks

GPU pods stuck Pending are usually a scheduling or quota problem, not a broken container. Learn how to diagnose node selectors, device plugins and quotas.

13 min read · 28 June 2026

Spot AI’s hidden cost spike in your stack

AI refactors often trade cache hits for database reads, exhausting pools and inflating bills. Here is how to detect, verify and gate the change.

14 min read · 28 June 2026

AI agents vs Argo, Tekton: which pipeline heals itself?

How Argo Workflows and Tekton Pipelines differ for automated failure detection and recovery, with working code and failure-mode analysis.

13 min read · 27 June 2026

Platform teams in 2026: Docs vs. production reality

Platform docs describe happy paths; production exposes the gaps. Covers cluster defaults, IDP design by company size, Helm guardrails, and policy enforcement.

18 min read · 27 June 2026

Self-healing pipelines: Argo vs Crossplane in 2026

Compare Argo CD and Crossplane for self-healing infrastructure: reconciliation models, health signals, failure modes, and how to measure detection and recovery yourself.

13 min read · 25 June 2026

Alerts 2026: AI turns false alarms to silence

Build a webhook service that counts alert firings per fingerprint and demotes noisy alerts, plus how to measure whether it works.

15 min read · 24 June 2026

Use feature flags to deploy AI models safely

Use feature flags to canary, shadow and roll back AI model changes without redeploys, with code, metrics and failure-mode handling.

15 min read · 20 June 2026

AI interviews break systems: 5 real mistakes in 2026

AI coding assistants assume a standard Docker environment. Here are five failure modes that break builds in CI, with fixes, verification steps, and a checklist.

14 min read · 20 June 2026

Container Build Caching: What Actually Speeds Up CI

How container build caching works, why cache keys invalidate, and how to measure hit rate and cost before choosing a cache backend.

13 min read · 14 June 2026

Designing an AI Alert Triage Layer That Reduces Pages

How to build an AI alert-triage service between Alertmanager and your pager: fingerprinting, LLM filtering, fail-open rules, and honest measurement.

14 min read · 12 June 2026

AI sales cycles: why dev tools now need 3 demos

Developer tools are increasingly bought by non-engineers who want proof in their own cluster. Here is how to structure three live demos that survive real infrastructure.

11 min read · 12 June 2026

Self-healing agents vs rule-based deployment rollback

Comparing AI-agent and rule-based deployment rollback: failure modes, what to instrument, and a decision checklist for choosing between them.

12 min read · 11 June 2026

AI interviews broke system design: 3 patterns that

AI design tools produce complete-looking architectures that fail under real load. Three patterns, why they happen, and how to catch them before staging.

15 min read · 11 June 2026

Observability 2026: ditch the three pillars

Why the logs-metrics-traces split breaks under load, and how to design a single event store with schemas, queries and migration steps.

14 min read · 10 June 2026