agentgateway v1.6.0: Cost Tracking With No Catalog Config
agentgateway v1.6.0 went GA on October 2. Two features are worth a hands-on look before anything else: a built-in LLM pricing catalog that gives you cost …
Read more →#Platform Engineering
43 posts
Do AI Agents Need SPIFFE or OAuth?
They answer different questions. SPIFFE proves which process is calling, without a provisioned secret. OAuth scopes what it may do and, when a human is in the …
Read more →Per-Request Minted JWTs for Agent Backends with agentgateway
I built a demo where an AI agent calls a backend API and holds no credential for it. No API key in its environment, no key file on disk, no token. agentgateway …
Read more →Stateless MCP on Kubernetes: No More Sticky Sessions
Three replicas of an MCP server, fronted by agentgateway , with no session affinity configured anywhere. A four-call shopping cart session (create cart, add two …
Read more →Choose an AI Agent Gateway: agentgateway Guide
Choose by the controls in the request path, not by model-catalog size. Write down what you must enforce on agent→model and agent→tool traffic: workload …
Read more →Building Workload Identity Federation for AI Agents on Kubernetes
The easy way to give an agent pod access to an external API is a long-lived key in a Kubernetes Secret. It doesn’t expire when the pod dies, it …
Read more →What Is an Agentic Mesh (vs a Service Mesh)?
An agentic mesh is infrastructure that applies identity, policy, and observability to agent traffic (calls to models, tools, and other agents) so those controls …
Read more →agentgateway vs LiteLLM vs Portkey, Compared
Disclosure: I work at Solo.io, which created agentgateway and sells Solo Enterprise for agentgateway. Every product claim below links to that project’s …
Read more →Agent Runtimes Have an Autoscaler, Not a Scheduler
Every capacity knob in an agent runtime today is an efficiency knob. Pack more agents onto fewer pods, snapshot the idle ones, scale the pool to match demand, …
Read more →Regression Tests for kagent Agents with agentevals
An AI agent that stops calling its tools does not throw an error. It answers from the model’s memory, confidently and plausibly, and the output still …
Read more →Serve Markdown to Agents at the Gateway, Not the Origin
Agents parse HTML badly and expensively. The usual fix is to make the site emit markdown: add a per-page index.md, publish an llms.txt, change the build. That …
Read more →Your Artifact Registry Is a Two-Way Channel for Agents
Egress control for AI agents usually gets framed as a blocklist problem. Keep the agent off the hosts it should not reach, and you have contained it. This …
Read more →A WAF That Reads the Prompt: OWASP CRS for LLM and MCP
A conventional web application firewall reads a URL, some headers, and maybe a form body. For agent traffic that is the wrong layer. The interesting content is …
Read more →I Benchmarked Jev on Agent Tool-Call Risk. Calibration Held.
TypeSafe AI launched Jev on 2026-09-15 with the usual launch-day multipliers — 193.6x faster, 444.6x cheaper than frontier LLMs — plus “zero …
Read more →agentgateway CEL Gotchas: Fail-Open + 403 Fix
I was writing a CEL authorization policy for an LLM route in Solo Enterprise for agentgateway : restrict which models a caller may reach, and refuse callers …
Read more →kagent v1.0: Claude Code Harness on Kubernetes
kagent shipped v1.0.0-alpha1 this morning, its first 1.0 line after nine months on 0.x. The tag says alpha; GitHub’s own release flag says otherwise; …
Read more →Agent Identity on Kubernetes: The Complete Series
An AI agent that calls a model, a tool, or another agent has to prove who it is. Almost every production failure I have written up this month traces back to …
Read more →Securing AI Agents in Production: The Complete Series
Almost everything in this series started the same way: a control that everybody agrees is the right control, applied to an agent, quietly not doing the thing …
Read more →Shadow MCP Servers: Why They're Hard to Track
Tracking shadow MCP servers across teams is hard because most of them never show up anywhere a platform team looks. Local MCP servers run as child processes of …
Read more →Conway's Law Is Coming for Your MCP Servers
I have some version of this conversation just about every week. A platform team is rolling out MCP across the company, and the plan looks the same every time: …
Read more →Your Agent's LLM Key Survives Every Kubernetes Secret Control
I gave an agent pod an LLM API key the normal way, as a Secret projected into its environment. Then I turned on every Kubernetes control that sounds like it …
Read more →kagent Audience-Bound Tokens (RFC 8707)
kagent v0.10.0 went GA on September 4 . Buried in a long release list is a pair of environment variables that decide whether an agent’s credential works …
Read more →Cap LLM Spend per API Key: agentgateway 1.5
agentgateway v1.5.0 shipped on 2026-08-27 with two controls that attach to the API key rather than the route: a rolling spend budget that blocks with an HTTP …
Read more →Why Proxy-Variable Agent Sandboxes Fail, and the CONNECT-Time Fix
On September 4, 2026, researchers published ~18,000 posts that autonomous agents left on a 25-year-old German wiki over six weeks, using it as a message board …
Read more →MCP Agent Identity: What Shipped, What to Use
The Model Context Protocol roadmap published on August 22 names agent identity and enterprise-ready security as a priority workstream, with four specific …
Read more →Your AGENTS.md Is Not a Security Control
An agent with a policy file that says “you must not delete customer records”, running behind an approval layer that denylists the delete tool, …
Read more →Which Controls Would Have Stopped the July 2026 Agent Intrusion?
An autonomous agent escaped its evaluation sandbox on July 9, 2026, and about twelve and a half hours of wall-clock work later it held cluster-admin on multiple …
Read more →SPIFFE for AI Agents: End-to-End Identity Demo
SPIFFE gives each AI agent a short-lived, attested workload identity (an SVID) instead of a stored secret, issued at runtime by SPIRE, rotated automatically, …
Read more →Your AI Agent Should Not Hold the LLM API Key
I built a demo where an agent calls an LLM and has no LLM credential anywhere in its process. No API key in the environment, no key file on disk, nothing in …
Read more →Multi-Tenant MCP Servers: Per-Customer Tools
Three companies authenticate against three different identity providers, connect to the same three MCP URLs, and get three completely different products. Acme …
Read more →Substrate Scope: a Live Visualizer for Agent Substrate
I open-sourced Substrate Scope, a live visualizer for Agent Substrate , the Kubernetes-native runtime that runs AI agents as snapshot-backed actors in gVisor …
Read more →Cap LLM Spend per Team with Virtual Keys
Every agent platform demo eventually meets the same question from the person who signs off on it: who is spending what, and what stops a runaway agent from …
Read more →kagent Agent Substrate: Thousands of Agents
Agent Substrate is a Kubernetes-native runtime that breaks the pod-per-agent model. Instead of one always-on pod per AI agent, idle agents are checkpointed to …
Read more →LLM Robot Fleet Governance with agentgateway
I built a simulated warehouse robot fleet where LLMs do the planning and every piece of traffic that crosses the network runs through one open source gateway. …
Read more →Revenant: A Gateway-Native, Always-On Agent Runtime
Always-on personal agents keep dying the same three deaths: leaked keys, runaway spend, and silence. The first two get the headlines. The third one is the one …
Read more →Beyond the Algorithm: Why Industry Veterans are Still Vital in the Age of AI Consulting
In an era where artificial intelligence consulting dominates tech headlines, a thoughtful perspective from ActualHumans reminds us of an often-overlooked truth: …
Read more →Revisiting Observability: A Deep Dive Into the State of Monitoring, Costs, and Data Ownership
Originally posted on DZone Hey internet humans! I’ve recently re-entered the world of observability and monitoring after a short detour in the Internal …
Read more →Mastering Kubernetes: Key Metrics for Cluster Monitoring
Kubernetes administration is like navigating through a perpetually expanding puzzle, where distinguishing essential components from duplicate information …
Read more →Maximizing DevOps Efficiency: Best Practices, KPIs, and Realtime Feedback
Inefficient DevOps practices can lead to reduced productivity, delayed releases, and increased costs. A Developer Portal can help teams understand best …
Read more →Maximizing Your Developer Efficiency: Scaffolding for Faster Time to Market
As software development continues to evolve, developers are faced with the challenge of delivering high-quality applications at an ever-increasing pace. The …
Read more →Maximizing Developer Onboarding for Improved Retention and Growth: A Comprehensive Guide
The onboarding experience sets the tone for new developers and shapes their initial perception of the organization and role. A well-structured program should …
Read more →Mastering the Art of Platform Engineering: The Latest Secret to Digital Transformation
As technology continues to evolve and disrupt traditional business models, organizations are constantly seeking ways to streamline and optimize their …
Read more →Maximize your ROI with a Developer Portal: How Improving DevOps, DevX, and SRE Can Drive Visibility, Productivity, and Profitability
Implementing and maintaining a developer portal involves complexity, but a fully-featured and well-implemented developer portal can have a significant impact on …
Read more →