Kubai Kevin

21 articles tagged Rag

BM25 vs dense embeddings: hybrid search reality

How BM25 and dense retrieval fail differently, why score fusion is not free, and how to choose RRF, weighted fusion, or a cascade for your corpus.

14 min read · 3 November 2026

3 LLM context techniques: when each fails

Compare fine-tuning, retrieval-augmented generation and long context by failure mode, cost arithmetic and a decision checklist, with code for each.

15 min read · 1 November 2026

JWT sessions: revocation, rotation, storage

Why JWT revocation is a state problem, how refresh token rotation with reuse detection works, and how token storage shapes the threat model.

14 min read · 27 October 2026

7 guardrails for safer LLM apps

A practical review of seven guardrail layers for LLM applications: what each catches, where it fails, and which to build first.

18 min read · 25 October 2026

APM is blind to your AI agents

Traditional APM monitors transport, not semantics. See how to instrument retrieval quality, token cost, and answer correctness in AI agent pipelines.

12 min read · 25 September 2026

Designing a Schema That Survives Embedding Model Upgrades

Why embedding columns break on model upgrades, how to version vectors, migrate legacy JSON payloads, and when to offload to a vector store.

11 min read · 13 September 2026

RAG rots if you don’t refresh indexes

RAG indexes rot when source documents change. Learn change detection, chunk versioning, and incremental refresh patterns, with code and a cost model.

15 min read · 4 August 2026

When a vector DB misconfiguration breaks RAG silently

Vector DB misconfigurations cause RAG outages that look like app bugs. Learn to detect index errors, add circuit breakers, and instrument query latency.

11 min read · 29 July 2026

Postgres vector search: what breaks first

pgvector works until load grows. Here is what fails first, how to measure it, and when a dedicated ANN service earns its operational cost.

13 min read · 24 July 2026

Designing Alert Triage That Suppresses Noise Safely

Classify alerts by shape and downstream impact, then suppress with evidence. Includes PromQL, SQL, breaker logic, and a 30-minute first step.

12 min read · 11 July 2026

Audit logs: ship them fast, keep them forever

Design an audit log pipeline that separates durability from searchability, with tiered retention, integrity hashing, and a cost model you can verify.

14 min read · 6 July 2026

LLMOps 2026: evaluation stack that replaced RAG dashboards

Why RAG dashboards miss real failures, and how to build an evaluation stack around task resolution, dataset rotation, prompt versioning, and drift checks.

13 min read · 5 July 2026

RAG on legacy systems: vector DB vs. full-text SQL

Compare vector databases and in-database vector search for adding RAG to legacy systems, with latency, cost, and operational trade-offs.

14 min read · 30 June 2026

RAG is not enough: hybrid search + reranking in 2026

Dense retrieval alone ranks poorly. A two-stage pipeline of BM25 plus a cross-encoder reranker fixes it. Architecture, code, and how to measure it.

12 min read · 27 June 2026

AI steals junior tasks: 3 skills that protect pay

AI coding tools make boilerplate cheap. Here is how to measure whether your time is shifting to validated product work or just faster scaffolding.

13 min read · 24 June 2026

Designing Offline-First Apps for Unreliable Networks

Offline-first architecture for metered, low-signal networks: storage, encryption, sync scheduling, conflict resolution, and how to measure each.

15 min read · 21 June 2026

Compare Kafka, Redpanda, NATS for event-driven systems

Compare Kafka, Redpanda and NATS on durability, tail latency and cost, with config defaults, failure modes and a bake-off checklist you can run yourself.

14 min read · 14 June 2026

LLM metrics that stop wasting time

A practical guide to LLM evaluation in production: grounding checks, drift detection, cost and latency metrics, and how to measure each one.

13 min read · 14 June 2026

Which AI wrappers made money in 2026

Most AI wrapper products fail on latency, cost, and churn rather than model quality. Here is a rubric, failure analysis, and code to build one that lasts.

10 min read · 12 June 2026

RAG pipelines: 4 silent prod killers

A practical guide to the silent failure modes that break RAG pipelines at scale: tokenizer drift, GPU fragmentation, index skew, and cache stampedes.

13 min read · 8 June 2026

RAG in prod: what tutorials won’t tell you

Why nightly embedding refreshes break RAG latency, and how a hot/cold retrieval split with partial vector updates fixes it.

14 min read · 8 June 2026