AI Gateways and LLM Cost
An AI gateway sits on the path between agents and models, tools, and other agents. It is where identity, spend, and policy get enforced once instead of in every …
Read more →#Generative AI
40 posts
Free Plumbing, Paid in Footage
There’s a new deal for homeowners in three cities. Your plumber is free. The price is footage. I’ve spent this series walking the connected house …
Read more →Robotics: The House, the Cost, and the Test Report
Robots are computers that can reach you. I write about the house as a cluster, the cost of a capable machine, and the same identity and audit questions that …
Read more →Hardware Is AI's Teeth: Robots Are Building the AI Buildout
“If AI is going to eat the world, hardware will be its teeth.” Haomiao Huang, a founding partner at Matter Venture Partners, said that when the firm …
Read more →Portkey Alternative: agentgateway, Self-Hosted
agentgateway is an open source gateway you run yourself, and it covers the jobs most teams use Portkey for: virtual keys that hide the provider key, per-key …
Read more →The Robot Is the Next Node in Your House Cluster
In the first post of my house series, I asked you to count the connected things in your house . Then we walked through it room by room . TVs, routers, cameras, …
Read more →Second-Source Your Models
Every hardware engineer learns the same lesson early, usually the hard way. Don’t design a board around a part only one company makes. It’s called …
Read more →LiteLLM 1.107.0: Why Image Signing Didn't Stop the Backdoor
LiteLLM 1.107.0 landed on PyPI and Docker Hub on October 21, 2026, with a credential stealer built into every wheel, and it was cryptographically signed through …
Read more →The Last 20 Percent: What Robots and LLMs Still Can't Do
Here’s the number from Anthropic’s robot report that I keep coming back to: about 80% of job tasks, by working time, are exposed to either robots or …
Read more →
The Hard Part Is the Hands: Why Sensing and Touch Hold Robots Back
Here’s a list that surprises people. In Anthropic’s report What work can robots do? , nine of the ten most exposed occupations are vehicle …
Read more →agentgateway Guardrails How-To
Agents and apps already send prompts through a gateway. Content safety belongs on that hop: inspect the request before it reaches a model, and inspect the …
Read more →Capable Isn't Cheap: Reading Anthropic's Robot Report Like a Test Engineer
Every week there’s a new headline that says robots are coming for our jobs. This week most of them came from one report. On September 30, Anthropic …
Read more →Room by room: what a self-copying AI could do in your house
Last week I asked you to count the connected things in your house . Parks Associates says the average US internet household has about 17 (source ). This week we …
Read more →agentgateway vs Agent Router v1.2: MCP prefixMode Defaults
Agent Router v1.2.0 added prefixMode: Never for MCP tool names on October 7, 2026, a control agentgateway already ships with three values: Conditional, Always, …
Read more →Testing Open-Weight Models as an Agent's Cheap Tier
Disclosure: I work at Solo.io, which created agentgateway and sells Solo Enterprise for agentgateway. The demos I cite are public repositories. Two open-weight …
Read more →What Is an AI Agent Gateway?
An AI agent gateway is a reverse proxy between your agents and everything they call: language models, MCP tools, other agents over A2A, and ordinary HTTP or …
Read more →The house is full of computers now. Anthropic just showed what an AI could do with them.
Count the connected things in your house. The TV. The doorbell. The robot vacuum. The thermostat. The router blinking in the closet. Parks Associates puts the …
Read more →What Is a Cloud-Native Agent Harness? (kagent)
Coding agents grew up on laptops: one person, one machine, and one process that is the UI, the agent loop, the sandbox, the credential store and the session …
Read more →Is Jev Actually Calibrated? The Reliability Curve on 240 Cases
TypeSafe AI’s Jev is mostly calibrated on agent tool-call risk, with one weak spot you need to know about before you route on it. Across 240 hand-labelled …
Read more →Agent Platform Gateway Control Plane
A production agent platform needs one gateway path where SPIFFE identity binds the caller and four controls ride the same hop: secretless provider keys, per-key …
Read more →agentgateway v1.6.0: Cost Tracking With No Catalog Config
agentgateway v1.6.0 went GA on October 2. Two features are worth a hands-on look before anything else: a built-in LLM pricing catalog that gives you cost …
Read more →Do AI Agents Need SPIFFE or OAuth?
They answer different questions. SPIFFE proves which process is calling, without a provisioned secret. OAuth scopes what it may do and, when a human is in the …
Read more →Choose an AI Agent Gateway: agentgateway Guide
Choose by the controls in the request path, not by model-catalog size. Write down what you must enforce on agent to model and agent to tool traffic: workload …
Read more →What Is an Agentic Mesh (vs a Service Mesh)?
An agentic mesh is infrastructure that applies identity, policy, and observability to agent traffic (calls to models, tools, and other agents) so those controls …
Read more →agentgateway vs LiteLLM vs Portkey, Compared
Disclosure: I work at Solo.io, which created agentgateway and sells Solo Enterprise for agentgateway. Every product claim below links to that project’s …
Read more →I Benchmarked Jev on Agent Tool-Call Risk. Calibration Held.
TypeSafe AI launched Jev on 2026-09-15 with the usual launch-day multipliers — 193.6x faster, 444.6x cheaper than frontier LLMs — plus “zero …
Read more →agentgateway CEL Gotchas: Fail-Open + 403 Fix
I was writing a CEL authorization policy for an LLM route in Solo Enterprise for agentgateway : restrict which models a caller may reach, and refuse callers …
Read more →kagent v1.0: Claude Code Harness on Kubernetes
Yes, kagent can run Claude Code on Kubernetes: since v1.0.0-alpha1, PR #2602 adds a native Claude harness that runs the pinned Claude Code CLI over A2A with …
Read more →Cap LLM Spend per API Key: agentgateway 1.5
agentgateway v1.5.0 shipped on 2026-08-27 with two controls that attach to the API key rather than the route: a rolling spend budget that blocks with an HTTP …
Read more →MCP Agent Identity: What Shipped, What to Use
The Model Context Protocol roadmap published on August 22 names agent identity and enterprise-ready security as a priority workstream, with four specific …
Read more →SPIFFE for AI Agents: End-to-End Identity Demo
SPIFFE gives each AI agent a short-lived, attested workload identity (an SVID) instead of a stored secret, issued at runtime by SPIRE, rotated automatically, …
Read more →Your AI Agent Should Not Hold the LLM API Key
I built a demo where an agent calls an LLM and has no LLM credential anywhere in its process. No API key in the environment, no key file on disk, nothing in …
Read more →Multi-Tenant MCP Servers: Per-Customer Tools
Three companies authenticate against three different identity providers, connect to the same three MCP URLs, and get three completely different products. Acme …
Read more →Substrate Scope: a Live Visualizer for Agent Substrate
I open-sourced Substrate Scope, a live visualizer for Agent Substrate , the Kubernetes-native runtime that runs AI agents as snapshot-backed actors in gVisor …
Read more →Cap LLM Spend per Team with Virtual Keys
Cap LLM spend at the AI gateway: give each team or agent a virtual key, price every request against a model catalog, and refuse the request with HTTP 429 once …
Read more →kagent Agent Substrate: Thousands of Agents
Agent Substrate is a Kubernetes-native runtime that breaks the pod-per-agent model. It is one of the runtimes that sit under an agentic mesh . Instead of one …
Read more →LLM Robot Fleet Governance with agentgateway
I built a simulated warehouse robot fleet where LLMs do the planning and every piece of traffic that crosses the network runs through one open source gateway. …
Read more →Revenant: A Gateway-Native, Always-On Agent Runtime
Always-on personal agents keep dying the same three deaths: leaked keys, runaway spend, and silence. The first two get the headlines. The third one is the one …
Read more →Building an LLM Agent Playground: A Deep Dive into AI Orchestration and Evaluation
Introduction In the rapidly evolving landscape of artificial intelligence and machine learning, Large Language Models (LLMs) have emerged as powerful tools for …
Read more →How to Get Ready for the AI Revolution: Embrace, Learn, and Innovate
The advent of generative AI is not something to be feared—it’s an exciting opportunity to elevate your business and career. Getting ready for this …
Read more →