Off the Laptop, Into Production: An Open Source Stack for AI Agents… Brian Hammons & Nirmal Mehta

Video by The Linux Foundation via YouTube
Off the Laptop, Into Production: An Open Source Stack for AI Agents... Brian Hammons & Nirmal Mehta

Join us at the premier vendor-neutral open source conference, where developers and technologists come together to collaborate, share knowledge, and explore the latest innovations and advancements in open source technology. Learn more at https://events.linuxfoundation.org/

Off the Laptop, Into Production: An Open Source Stack for AI Agents on Kubernetes – Brian Hammons & Nirmal Mehta, Amazon Web Services

AI agents are fast becoming how modern software gets built. But taking one from prototype to safe, production-grade operation is still genuinely challenging, and how they behave at scale remains largely uncharted. Agents are stochastic, so testing becomes continuous evaluation. They run code nobody wrote, so a shared kernel stops being a boundary you can trust. They decide their own network calls at runtime, so egress is no longer predictable. And they still need what any service needs: source control, CI/CD, observability, memory, and tool access.

This session walks the full lifecycle of running agents on Kubernetes, open source the whole way. The "outer loop" (build, deploy, trace, evaluate) runs on tools like GitLab, Argo, Langfuse, Milvus, and MCP gateways. The "inner loop" (isolated execution) runs on the kubernetes-sigs Agent Sandbox CRD, gVisor, and FQDN-aware egress via Cilium. We’ll show what maps cleanly from the platform you run, what changes for agents, and the production gotchas no quickstart warns you about, drawn from building these in the open with teams running from a handful of developer sandboxes to the hundreds of thousands that frontier-scale RL spins up.

Source