InfoQ - Scalability

CSIRO Uses Serverless Architecture to Query 100x More Genomic Variants on AWS

Leela Kumili — Fri, 23 Oct 2026 14:30:00 GMT

CSIRO has developed Serverless Beacon, a serverless architecture for querying genomic variants without copying VCF files into a central database. The system combines Amazon S3, Lambda, Athena and DynamoDB, using metadata indexes and HTTP byte range requests to query compressed genomic regions. Tests reported 1.52 second average latency for 10,000 base pair queries.

By Leela Kumili

Article: Distributed Spring Batch without a Message Broker

Janardhan Reddy Chejarla — Wed, 21 Oct 2026 09:00:00 GMT

Distributed Spring Batch partitioning already needs a shared, persistent job repository. This article makes that database the whole coordination plane and drops the message broker, sizing work to the live node count, a per-job master with no standing coordinator, compare-and-set claiming that prevents double-execution, two-phase heartbeat failover, and where a broker is still the right choice.

By Janardhan Reddy Chejarla

GitHub Actions Runner Controller 0.15.0 Targets Reliability at Scale

Craig Risi — Tue, 20 Oct 2026 12:00:00 GMT

GitHub has released Actions Runner Controller (ARC) 0.15.0, introducing reliability, scalability, and observability improvements for organisations running self-hosted GitHub Actions runners on Kubernetes.

By Craig Risi

Presentation: Beyond the Prototype: Scaling Framework Agnostic AI Agent Infrastructure with Ray

Deepak Mohanakumar Chandramouli, Bhumik Vinodkumar Thakkar — Tue, 20 Oct 2026 11:00:00 GMT

The speakers discuss transitioning AI agents from local FastAPI prototypes to resilient production systems on Kubernetes using Ray. They share operational insights on RayCluster topology, stateful memory handling, auto-scaling on dynamic traffic, and robust control plane designs, while highlighting critical guardrails, multi-region setups, and LLM-as-a-judge evaluation pipelines.

By Deepak Mohanakumar Chandramouli, Bhumik Vinodkumar Thakkar