Capping LLM Spend at the AI Gateway: Budgets and Virtual Keys
Every agent platform demo eventually meets the same question from the person who signs off on it: who is spending what, and what stops a runaway agent from …
Read more →#Generative AI
6 posts
Governing an LLM-Driven Robot Fleet with agentgateway
I built a simulated warehouse robot fleet where LLMs do the planning and every piece of traffic that crosses the network runs through one open source gateway. …
Read more →Revenant: A Gateway-Native, Always-On Agent Runtime
Always-on personal agents keep dying the same three deaths: leaked keys, runaway spend, and silence. The first two get the headlines. The third one is the one …
Read more →Thousands of AI Agents on Tens of Pods: kagent Agent Substrate
Agent Substrate is a Kubernetes-native runtime that breaks the pod-per-agent model. Instead of one always-on pod per AI agent, idle agents are checkpointed to …
Read more →Building an LLM Agent Playground: A Deep Dive into AI Orchestration and Evaluation
Introduction In the rapidly evolving landscape of artificial intelligence and machine learning, Large Language Models (LLMs) have emerged as powerful tools for …
Read more →How to Get Ready for the AI Revolution: Embrace, Learn, and Innovate
The advent of generative AI is not something to be feared—it’s an exciting opportunity to elevate your business and career. Getting ready for this …
Read more →