InfoQ - Scalability - Presentations https://www.infoq.com InfoQ Scalability Presentations feed Presentation: Beyond the Prototype: Scaling Framework Agnostic AI Agent Infrastructure with Ray https://www.infoq.com/presentations/scale-llm-agents-production-ray/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Scalability-presentations <img src="https://res.infoq.com/presentations/scale-llm-agents-production-ray/en/mediumimage/medium-1792065446239.jpg"/><p>The speakers discuss transitioning AI agents from local FastAPI prototypes to resilient production systems on Kubernetes using Ray. They share operational insights on RayCluster topology, stateful memory handling, auto-scaling on dynamic traffic, and robust control plane designs, while highlighting critical guardrails, multi-region setups, and LLM-as-a-judge evaluation pipelines.</p> <i>By Deepak Mohanakumar Chandramouli, Bhumik Vinodkumar Thakkar</i> Scalability Large language models Machine Learning Agents Transcripts QCon AI Boston 2026 AI, ML & Data Engineering Architecture & Design Development presentation Tue, 20 Oct 2026 11:00:00 GMT https://www.infoq.com/presentations/scale-llm-agents-production-ray/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Scalability-presentations Deepak Mohanakumar Chandramouli, Bhumik Vinodkumar Thakkar 2026-10-20T11:00:00Z /presentations/scale-llm-agents-production-ray/en