Podcast: Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM

Edoardo Vacchi — Mon, 09 Nov 2026 11:00:00 GMT

In this episode, Edoardo Vacchi discusses the evolving landscape of WebAssembly on the backend, running Java workloads on GPUs using TornadoVM, and optimizing distributed AI inference using llm-d and vLLM on Kubernetes. Edoardo explains how llm-d manages cache locality (KV and prefix caches), request routing, and batch inference across Kubernetes clusters to maximize expensive GPU utilization.

By Edoardo Vacchi

Podcast: AI, ML, and Data Engineering InfoQ Trends Report 2026

Chip Huyen, Daniel Dominguez, Hien Luu, Arthur Casals — Fri, 30 Oct 2026 09:00:00 GMT

In this episode, members of the InfoQ AI and ML editorial staff and friends of InfoQ discuss the current trends in the domain of AI, ML and Data Engineering. One of the regular features of InfoQ are the trends reports, which each focus on a different aspect of software dev. These reports provide the InfoQ readers and listeners with a high-level overview of the topics to pay attention to this year.

By Chip Huyen, Daniel Dominguez, Hien Luu, Arthur Casals

InfoQ - AI, ML & Data Engineering - Podcasts

Podcast: Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM

Podcast: AI, ML, and Data Engineering InfoQ Trends Report 2026