Function-calling leaderboards test a model against a handful of curated tools. A real MCP host hands it thousands — and that is a different benchmark, with a different failure mode.
The invoice arrives and no one can say which customer spent the money. Cost attribution isn't a report you run later — it's a schema decision you make at request time, and for agents the gateway total lies about where the spend went.
Firecracker gives each agent a whole Linux to boot — 125 ms of it. Hyperlight keeps the hardware wall and throws away the OS behind it, and that deletion is what makes per-tool-call isolation affordable.
A new automated auditor didn't just flag risky code in Model Context Protocol servers — it wrote the prompts to prove the holes were real. 67 already carry CVE IDs, and almost none are AI-specific.
M, ef_construction, and ef_search decide whether your vector search is fast, accurate, or neither. Only one of them can be changed after you build the index — and it's the one most teams never touch.
Map-reduce's 'reduce' step quietly re-creates the exact overflow you were escaping. Refine can't parallelize. And in 2026 the fastest-improving option is often to stop summarizing and put the whole document in a million-token window — if you can pay the middle.
A cut-off completion isn't an error your code catches — it's a 200 OK whose only tell is a stop-reason field most callers never read. And on reasoning models, the fix everyone reaches for can hand you an empty response.
Public leaderboards answer 'which model is smartest,' not 'will it fix my bugs' — the only test that predicts your outcome is a private eval built from your own repo.
A web server drains its in-flight requests in 30 seconds and restarts. An agent's in-flight request is a multi-hour, side-effecting loop — so graceful shutdown stops being a deploy setting and becomes an architecture decision you had to make weeks earlier.
Every serious agent-memory system is really a forgetting system. The hard part was never storing what the agent learns — it's pruning the contradictions and stale facts that quietly poison retrieval.
GPT-5.5 and Claude Opus 4.8 are tied on SWE-bench Verified at ~88.6%. That means the leaderboard number stopped being the answer — and your agent's scaffolding started being it.
Round-robin is the wrong way to route an LLM request. Kubernetes now has a GA'd standard that lets the gateway pick a model server by live KV-cache pressure and queue depth instead — and it changes what a load balancer is.
With ADK 2.0's GA, LangGraph, OpenAI's Agents SDK, Google's ADK, and Microsoft's Agent Framework all now run on a graph execution engine. The programming model war is over. It settled the easy question.
Microsoft and Google both now let you define an agent in YAML instead of code. The split isn't about simplicity — it's about whether your agent's logic lives in its wiring or in its decisions.
The Kubernetes-native serving stack got very good at spreading a model across a cluster. But in 2026 your GPUs aren't in one cluster — they're scattered across clouds by price and availability, and that's a different problem.
The summary your long-running agent writes to stay under its token budget is lossy in one direction: it keeps the rules that fire and drops the rules that forbid. New research puts a number on how fast safety erodes.
Approximate nearest-neighbor search is a tax you pay to survive scale you may not have. Below a few hundred thousand vectors, exact brute-force is faster, perfectly accurate, and has no index to rot.
Amazon Q auto-ran an MCP config out of any repo you opened, with your live AWS keys in the process. It got a CVE. The identical bug in Claude Code, Cursor, Gemini CLI and Copilot got declared working-as-designed — because the trust prompt you inherited from your editor was never a consent to run code.
Nearly a year after the first Comet and Atlas exploits, the browsers' own makers say prompt injection may never be fully solved. The reason is structural, not a bug waiting for a patch.
An autonomous agent found 21 genuine zero-days in FFmpeg for about $1,000. The same technology just made curl kill its bug bounty. Discovery got cheap; disposition didn't.
A June 2026 paper clocks three popular memory frameworks on the same benchmark: 118K, 632K, and 3.26M tokens per query. The 500x spread isn't noise — it's a design choice most teams never realize they're making.
For 25 years the web tried to detect bots by behavior and kept losing. Web Bot Auth gives up on detection and asks the bot to sign its name instead — and the big agent makers have already started doing it.
Both shipped the same six production features in 2026. The choice isn't capabilities — it's which half of your agent you're willing to lock to a vendor.
A Chinese lab shipped a 266B/10B-active model that claims to decompose and finish 100+ step tasks on its own. The benchmark line isn't the story — the category claim is.
Interruptible GPUs scare people because of training horror stories. For stateless inference the math inverts — there's nothing to checkpoint, so the only real tax is cold start.
Both drive a real browser from natural language. But one reads the DOM and one looks at pixels — and that single perception choice decides your cost per step, your reliability on ugly sites, and whether you can even ship it in a closed product.
Swapping LLM providers in one line is true for a chatbot and a lie for an agent. The cage is one layer up, in tool-calling behavior — and no gateway unlocks it for you.
OpenAI and Google ship deep-research as a closed feature. These seven open repositories let you run the same plan-search-read-synthesize loop on your own models, your own sources, and — if you want — entirely on your own machine.
Most MCP servers are REST APIs underneath. The honest question isn't which transport to use — it's how much of your API to expose, and the data says the answer is about a fifth of it.