https://www.infoq.com InfoQ Scalability Presentations feed https://www.infoq.com/presentations/realtime-gpu-workloads/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Scalability-presentations <img src="https://res.infoq.com/presentations/realtime-gpu-workloads/en/mediumimage/medium-1779194310932.jpg"/><p>Joseph Stein discusses engineering an enterprise AI-as-a-Service platform within a private cloud data center. He explains how to maximize underutilized GPU pools via multi-namespace scheduling, leverage Valkey and Lua for atomic priority queuing and backpressure management, mitigate OWASP Top 10 LLM risks via central proxy gateways, and scale batch pipelines using a custom S3-to-Kafka proxy.</p> <i>By Joseph Stein</i> Case Study GPU Scalability Cloud QCon San Francisco 2025 Transcripts DevOps presentation Tue, 26 May 2026 09:08:00 GMT https://www.infoq.com/presentations/realtime-gpu-workloads/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Scalability-presentations Joseph Stein 2026-05-26T09:08:00Z /presentations/realtime-gpu-workloads/en https://www.infoq.com/presentations/ai-gateway-scalability/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Scalability-presentations <img src="https://res.infoq.com/presentations/ai-gateway-scalability/en/mediumimage/medium-1778663382364.jpg"/><p>Meryem Arik discusses why modern engineering teams face "inference chaos" and how AI model gateways provide a critical control layer. She explains the balance between empowering decentralized teams to choose the best models and maintaining centralized oversight for security, RBAC, and cost control. Explore open-source solutions like LiteLLM and Doubleword to streamline your AI infra.</p> <i>By Meryem Arik</i> QCon AI 2025 Scalability Artificial Intelligence Transcripts AI, ML & Data Engineering presentation Wed, 20 May 2026 12:40:00 GMT https://www.infoq.com/presentations/ai-gateway-scalability/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Scalability-presentations Meryem Arik 2026-05-20T12:40:00Z /presentations/ai-gateway-scalability/en