🎧 Listen
The Wire
How to Reduce AI Agent Latency
Buying a faster model is the reflex, and usually the wrong first move. An agent's wait is a chain of serial round-trips — so the latency is in the loop, not the tokens-per-second.
🎧 Listen
The Wire
🎧 Listen
The Wire
RAG Context Ordering: Where to Put Your Best Chunk in the Prompt
The 'reorder so the best chunks sit at the start and end' trick everyone copies from LangChain is a 2023 patch for a 2023 problem. On a tight, well-reranked context it can quietly demote your second-best evidence to the worst seat in the room.
🎧 Listen
The Wire
How to Migrate Embedding Models in Production Without Wrecking Retrieval
Re-embedding your corpus is cheap. The expensive part is that two models live in two incompatible vector spaces — and a naive rolling reindex hides the damage behind green dashboards.
🎧 Listen
The Wire
How to Handle LLM Rate Limits: Retries, Backoff, and Fallbacks Without Burning Your Bill
Every agent in production eventually meets a 429. The naive fix — just retry — is also the most expensive bug in modern LLM apps. Here's the layered pattern that survives the limit instead of paying triple for it.
🎧 Listen
The Wire
How to Handle LLM API Failures: Retries, Timeouts, and Fallback Chains
A 429 means wait; a 400 means stop; a 200 from your backup model can be the most dangerous answer of all. The reliability layer every agent needs and most skip.
🎧 Listen
The Wire
How to Get a Confidence Score From an LLM (and Why the Easy One Lies)
Token logprobs are right there in the API, cheap and ignored — and after RLHF they're systematically overconfident. The signal that actually tracks whether the answer is right costs you N times the inference.
🎧 Listen
The Wire
How to Deploy an MCP Server: stdio, Streamable HTTP, and the Stateless Fork
The code is the easy part. The decision that quietly dictates your hosting bill, your scaling story, and your deploy strategy is one you make before you write a line: will your server hold a session, or not?
🎧 Listen
The Stack
How to Chunk Code for RAG: AST-Aware Splitting vs Fixed-Size
Prose chunkers shred code mid-function and wreck the structure retrieval depends on. Here is how to split on the AST instead — and why context enrichment matters more than chunk size.
🎧 Listen
The Wire
How to Build an LLM Eval Dataset
The scoring framework is the commodity. The hard, valuable, un-buyable work is looking at your own outputs and distilling real failures into labeled cases — your eval set is a precipitate of error analysis, not a download.
🎧 Listen
The Wire
How to Build a Knowledge Graph From Documents With an LLM
Extracting entities and relations is the easy 80%. The graph is only as good as the step everyone skips — deciding that 'OpenAI', 'OpenAI Inc.', and 'the company' are one node.
🎧 Listen
The Wire
How to Add Citations to a RAG Pipeline
A citation is a pointer, not a proof. Getting an LLM to footnote its answer is an architecture decision about which IDs survive into the prompt — not a line you add to the system message.
🎧 Listen
The Wire
Why AI Agents Get Worse as You Add Tools — and How Tool Retrieval Fixes It
Every tool you connect sits in the context window competing for attention. Past a few dozen, accuracy falls. The fix isn't a bigger model — it's treating tool selection as a search problem.
🎧 Listen
The Stack
Semantic Caching for LLM Apps: GPTCache vs Redis vs Gateway Caching
The cheapest LLM call is the one you never make. Three ways to skip it when a question is close enough to one you already answered — and the one knob that decides whether that's a feature or a bug.
🎧 Listen
The Wire
Google ADK vs LangGraph: Which Agent Framework Should You Build On in 2026?
Both will run the same agent. The real difference is altitude — ADK hands you an org chart of agents, LangGraph hands you the wiring and a roll of tape.
🎧 Listen
The Wire
Git Worktrees Solve the Easy Half of Parallel AI Agents
Worktrees stop your agents from overwriting each other's files. They do nothing about the shared database, the fight over port 3000, or the review queue that becomes your real bottleneck.
🎧 Listen
The Wire
Dify vs LangChain: Platform or Framework for Your LLM App?
One hands you a finished application to configure; the other hands you parts to assemble. The choice isn't easy-vs-powerful — it's whether your product's hard part lives where the platform already decided.
🎧 Listen
The Wire
Cross-Encoder vs Bi-Encoder: Why Your Retriever and Your Reranker Can't Be the Same Model
They read like rivals you choose between. They're two stages of one pipeline, forced apart by a single computational fact — and that fact tells you exactly where each one belongs.
🎧 Listen
The Stack
Cline vs Roo Code vs Kilo Code: Picking a VS Code Agent in 2026
Three open-source coding agents from one family tree — and the middle child just shut itself down. Its death is the most useful thing in the comparison.
🎧 Listen
The Wire
Choosing an Open Vision-Language Model for Agents in 2026: Qwen3-VL vs InternVL3.5 vs Holo1.5
The best open VLM for an agent isn't the one that scores highest on MMMU. It's the one that can hand back an accurate click coordinate — and those are not the same models.
🎧 Listen
The Wire
AWS Bedrock AgentCore, Explained: The Agent Runtime That Doesn't Care Which Framework You Use
Amazon's agent platform sells you everything except the agent. Here is what the seven services actually do, what the numbers mean, and why the neutrality is the whole strategy.
🎧 Listen
The Wire
Apache Burr vs LangGraph: State Machine or Graph for Your Agent?
Both let you wire an agent as nodes and edges, so they look like the same tool with different syntax. The real split is what each one lets you prove about the thing before it runs.
🎧 Listen
The Wire
Agentic AI vs Generative AI: What Actually Separates Them
The slide deck says one makes content and the other takes action. The sharper line is a single word: loop. Agentic AI is a generative model placed inside a feedback loop with tools and a goal — and that loop is where the value and the failure both live.
🎧 Listen
The Wire
Agent Skills vs Subagents vs Tools: When to Use Which
They get pitched as three ways to extend an agent. They aren't interchangeable — a tool is an action, a Skill writes knowledge into the context window, and a subagent keeps work out of it.
🎧 Listen
The Wire
Agent Memory vs RAG: What's Actually Different
Both embed a query and pull matching text into the prompt, so they look like the same trick. The difference is who writes the index — and that single fact moves the hard problem from retrieval to write discipline.
🎧 Listen
The Wire
AG2 vs AutoGen: Which One Should You Actually Install in 2026?
They share a name, a history, and a lot of code — but by 2026 'AutoGen' splintered into three projects, and the one you pip install decides whose roadmap you inherit.
🎧 Listen
The Wire
Why LLM Inference Isn't Deterministic — Even at Temperature 0
Greedy decoding should give the same answer every time. It doesn't — and the usual 'floating-point' excuse is wrong. The real culprit is what else is in the batch with you.
🎧 Listen
The Wire
Cosine vs Dot Product vs Euclidean: Which Vector Similarity Metric (and Why It Often Doesn't Matter)
For the normalized embeddings most models now emit, all three metrics rank results identically. The decisions that actually change your recall are the two nobody frames as a choice.
🎧 Listen
The Wire
Turn Detection for Voice Agents: VAD vs Semantic End-of-Utterance
The reason a voice agent feels rude is almost never its voice. It's that the agent confused "the user stopped making noise" with "the user is finished" — two different questions a silence timer cannot tell apart.
🎧 Listen
The Wire
tiktoken vs SentencePiece vs Hugging Face Tokenizers
Three libraries everyone compares as if you get to choose. You don't — your model already chose for you. The real question is what that choice costs, and who pays it.
🎧 Listen
The Wire
The Official MCP Registry, Explained: How to Publish and Find MCP Servers
The official MCP Registry isn't an app store — it's a canonical metadata feed built to prove who owns a server name, and it leaves search and curation to everyone downstream.