InfoQ - Performance - News

Lambda SnapStart Comes to Container Images, Ending a Packaging Tradeoff

Steef-Jan Wiggers — Sat, 12 Sep 2026 10:09:00 GMT

AWS has extended Lambda SnapStart to container image functions, which hold up to 10 GB against 250 MB for zip archives. Teams previously chose between dependency headroom and sub-second startup. A Reddit thread from a month earlier shows what that cost: stripping whitespace and docstrings from installed packages to stay under the limit.

By Steef-Jan Wiggers

NVIDIA Personal AI Router Distributes AI Tasks across Local Compute

Sergio De Simone — Fri, 11 Sep 2026 15:00:00 GMT

NVIDIA Personal AI Router (PAIR), now available in beta, lets you combine the inference capacity of multiple computers on your local network and automatically distribute AI requests among them. It is primarily designed for local multi-agent AI workloads, where multiple independent model calls can otherwise overwhelm one GPU.

By Sergio De Simone

Shopify Introduces Gisting: Compressing LLM System Prompts into Learned Tokens

Sergio De Simone — Thu, 03 Sep 2026 20:00:00 GMT

Shopify's engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving throughput and reducing inference cost.

By Sergio De Simone