InfoQ - Large language models

Anthropic Launches Claude Platform on AWS

Daniel Dominguez — Wed, 13 May 2026 19:20:00 GMT

Anthropic has announced the general availability of Claude Platform on AWS, a new deployment option that gives AWS customers direct access to Anthropic’s native Claude platform using AWS authentication, billing, and monitoring services.

By Daniel Dominguez

Coder Agents Enable Running AI Coding Workflows on Self-Hosted Infrastructure

Sergio De Simone — Mon, 11 May 2026 17:00:00 GMT

Coder Agents is a model-agnostic platform designed to let organizations run AI coding agents on their own infrastructure, rather than relying on cloud-based services. This allows teams to maintain full control over code, data, and execution environments.

By Sergio De Simone

Article: Local-First AI Inference: A Cloud Architecture Pattern for Cost-Effective Document Processing

Obinna Iheanachor — Mon, 11 May 2026 11:00:00 GMT

The Local-First AI Inference pattern routes 70–80% of documents to deterministic local extraction at zero API cost, reserving Azure OpenAI calls for edge cases and flagging low-confidence results for human review. Deployed on 4,700 engineering drawing PDFs, it cut API costs by 75% and processing time by 55%, while bounding errors through a human review tier.

By Obinna Iheanachor

OpenAI Introduces Websocket-Based Execution Mode to Reduce Latency in Agentic Workflows

Leela Kumili — Thu, 07 May 2026 14:48:00 GMT

OpenAI introduces a WebSocket-based execution mode for its Responses API to improve agentic workflow performance in coding agents and real-time AI systems. The update reduces latency by up to 40 percent by replacing HTTP request-response cycles with persistent connections, improving streaming, tool execution, and multi-step orchestration in production-scale AI systems.

By Leela Kumili

Google New TPU Generation is Specifically Designed for Agents and SOTA Model Training

Sergio De Simone — Wed, 06 May 2026 10:00:00 GMT

Google has unvelied a new generation of Tensor Processing Units (TPUs), featuring two specialized chips designed to accelerate model training and agent workflows, which require continuous, multi-step reasoning, and action loops distributed across multiple models. The new TPUs deliver better performance, memory, and energy efficiency, the company says.

By Sergio De Simone

Mistral Adds Remote Agents and Work Mode to Le Chat

Daniel Dominguez — Tue, 05 May 2026 10:08:00 GMT

Mistral has released Mistral Medium 3.5, a 128-billion parameter model designed to handle instruction following, reasoning, and coding within a single system, and introduced new cloud-based agent capabilities in its Vibe and Le Chat products.

By Daniel Dominguez

Cloudflare Builds High-Performance Infrastructure for Running LLMs

Renato Losio — Sun, 03 May 2026 10:58:00 GMT

Cloudflare has recently announced new infrastructure designed to run large AI language models across its global network. As these models rely on costly hardware and must handle large volumes of incoming and outgoing text, Cloudflare separates the model's input processing and output generation onto different optimized systems.

By Renato Losio