InfoQ - Benchmark - News

Android Bench 2 Adds Support for Long-Horizon Tasks, Agentic Evaluation, and Continuous Scoring

Sergio De Simone — Fri, 09 Oct 2026 17:00:00 GMT

Google has released Android Bench 2.0, a major update to its benchmark framework for evaluating AI models and agents on Android development tasks. The update introduces long-horizon tasks (LHTs), agent-based evaluation, and continuous scoring to better assess performance on complex, multi-step development tasks.

By Sergio De Simone

Akka Tests Spec-Driven AI Delivery across 65 Open Source Projects

Leela Kumili — Mon, 05 Oct 2026 13:58:00 GMT

Akka used 65 open-source projects to examine how specification structure, context, model selection, automated validation, and delivery guardrails affect AI assisted software porting. The experiment measured time, token use, code size, test parity, and performance, finding substantial variation across models, effort levels, and project types.

By Leela Kumili