InfoQ - AI, ML & Data Engineering

Mini book: Next-Gen Architecture Playbook: Insights and Patterns for the AI Era

InfoQ — Fri, 04 Sep 2026 11:00:00 GMT

This eMag examines how architects can lead with clarity in a rapidly evolving engineering world, distilling industry insights into field-tested practices for teams. Together, these stories reveal a core theme: the technology leader’s role is expanding from building systems to guiding how tech behaves and learns, while enabling engineers and organizations to bring out their best.

By InfoQ

Presentation: From S3 to GPU in One Copy: Rethinking Data Loading for ML Training

Onur Satici — Fri, 04 Sep 2026 11:00:00 GMT

Onur Satici explains how Vortex, an open-source columnar file format under the Linux Foundation, revolutionizes high-throughput data loading. He details how cascading lightweight encodings, layout-based segment pruning, and zero-copy memory pipelines eliminate CPU/NVMe bottlenecks to stream S3 data straight to GPUs at speeds up to 60 Gbps without requiring upfront data reprocessing.

By Onur Satici

Copilot Code Review Reaches Azure Repos, Billed Per Review with Reporting Two Days Behind

Steef-Jan Wiggers — Fri, 04 Sep 2026 10:01:00 GMT

Microsoft opened GitHub Copilot code review for Azure Repos to all Azure DevOps customers, after acknowledging that many are not ready to migrate to GitHub. Reviews bill per use through the linked Azure subscription and appear in Cost Management 48 hours later. Budgets notify but do not stop reviews, and concurrency caps at five per organization.

By Steef-Jan Wiggers

Shopify Introduces Gisting: Compressing LLM System Prompts into Learned Tokens

Sergio De Simone — Thu, 03 Sep 2026 20:00:00 GMT

Shopify's engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving throughput and reducing inference cost.

By Sergio De Simone

Cohere’s Parse 5 Promises Efficient Multi-Modal Information Extraction from Complex Documents

Olimpiu Pop — Thu, 03 Sep 2026 06:06:00 GMT

Cohere has launched Parse 5, a multimodal foundation model designed to extract structured data from complex enterprise documents. The 2.3-billion-parameter system converts visually rich PDFs into Markdown while providing bounding box coordinates for visual grounding. It has been evaluated against over 2,000 enterprise pages, achieving an average score of 79.2 in key performance areas.

By Olimpiu Pop

Swiggy Uses 350+ Features and Multi-Task MLP to Predict Customer Lifetime Value

Leela Kumili — Wed, 02 Sep 2026 13:55:00 GMT

Swiggy developed an in-house predicted lifetime value model using more than 350 pre order features and a multi task MLP for Food and Instamart. Adding order count as an auxiliary task reduced model parameters by 63% while improving predictive performance. The pLTV signal is used with Google Target ROAS bidding to optimize customer acquisition.

By Leela Kumili

Presentation: Beyond Prompting: Context Engineering for Production-Grade AI

Ricardo Ferreira — Wed, 02 Sep 2026 11:00:00 GMT

Ricardo Ferreira discusses moving beyond simple prompt engineering to build production-grade AI applications. He shares practical architectural strategies for integrating long-term and short-term memory using Redis, managing LLM token limits via summarization, mitigating context rot with reranking and semantic caching, and controlling exponential API costs under strict latency constraints.

By Ricardo Ferreira

Cloudflare Adds Optional OAuth Scopes, Letting Developers Mark What Users May Decline

Steef-Jan Wiggers — Wed, 02 Sep 2026 09:07:00 GMT

Cloudflare has added optional OAuth scopes, letting client owners mark which permissions users may deselect at consent. The company names MCP servers as the motivating case, since agents request the union of everything they might do. Partial consent exists elsewhere, but developer control over which scopes are droppable does not.

By Steef-Jan Wiggers

OpenClaw 2.0 Releases with Simplified Setup and Collaborative Agents

Daniel Dominguez — Tue, 01 Sep 2026 18:47:00 GMT

OpenClaw has released OpenClaw 2.0, a major update to the open-source personal AI agent that changes its installation process, browser interface, memory, skills, automations, plugins, security, and collaboration features.

By Daniel Dominguez

InfoQ previews the September Cohorts of its Online Certification Programs

Artenisa Chatziou — Tue, 01 Sep 2026 13:00:00 GMT

A preview of the September cohorts of the InfoQ Online Certification Programs, and the facilitators leading them: Luca Mezzalira, Michelle Brush, Zichuan Xiong, and Premanand Chandrasekaran.

By Artenisa Chatziou

HCP Terraform Positions Itself as the Control Plane for AI-Driven Infrastructure

Craig Risi — Tue, 01 Sep 2026 12:00:00 GMT

HashiCorp is positioning HCP Terraform as the governance and control plane for a new generation of AI-driven infrastructure, arguing that the rapid adoption of coding agents is shifting the biggest infrastructure challenge from writing configuration to verifying and safely executing it.

By Craig Risi

DoorDash’s Flux Runs 130,000 Engineering Tasks through Cloud-Based Agents

Leela Kumili — Mon, 31 Aug 2026 14:28:00 GMT

DoorDash has moved engineering agent workloads from developer laptops to its Flux cloud platform. The platform automated 130,000 engineering tasks in one month and supports more than 25,000 automated code reviews weekly. Flux uses isolated Firecracker microVMs, an MCP gateway, reusable playbooks, and multiple invocation surfaces to run agent workflows with scoped access and centralized auditing.

By Leela Kumili

Podcast: Scott Jenson on Evolving Desktop OS, Local-First, & Agentic UX

Scott Jenson — Mon, 31 Aug 2026 11:00:00 GMT

In this episode, Scott Jenson, a veteran UX designer known for his work on the Macintosh, Google Maps, and Chrome examines the long-term stagnation of desktop operating systems and the limitations of current mobile and cloud-centric models.

By Scott Jenson

Presentation: Running AI at the Edge: Running Real Workloads Directly in the Browser

James Hall — Mon, 31 Aug 2026 11:00:00 GMT

James Hall discusses the strategic and technical imperative of moving AI workloads from cloud providers to local edge devices. He shares practical approaches using WebGPU, Transformers.js, and DuckDB to achieve near-native performance in JavaScript. Through real-world case studies, he explains how to minimize data privacy risks, optimize browser inference, and build rigorous evaluation suites.

By James Hall

Foundry Model Router Expands from Two Regions to 28, Refreshing Its Model Pool

Steef-Jan Wiggers — Mon, 31 Aug 2026 10:18:00 GMT

Microsoft expanded Foundry's model router from two regions to 28 for global standard and 21 for data zone deployments, while adding Claude Opus 4.8 and GPT-5.6 and removing four deprecated models. Default deployments receive pool changes automatically; configured subsets exclude new models until added. The effective context window equals the smallest model in the pool.

By Steef-Jan Wiggers