Code generation is emerging as one of the most popular applications for large language models (LLMs), but not all agents are equally good at all development tasks. Google created a benchmark earlier this year to evaluate how LLMs perform in Android app development, and Android Bench is getting a big update today. The leaderboard now includes a raft of new models, and Google has adopted a new framework that should be easier to use. Developers are invited to run their own tests and submit feedback that could shape the future of Android Bench.

While they are popular coding tools, LLMs don't get everything right. Separating the useful outputs from straight-up slop means choosing the right tool. Android Bench aims to demonstrate which AI agents do best on a suite of 100 Android development tasks. After launching Android Bench in March, Google has added metrics like cost and efficiency, as well as open-weight models.

To keep Android Bench relevant, Google is updating the test with eight new models, including all the latest heavy-hitters: Claude Fable 5, Claude Sonnet 5, Claude Opus 4.8, GLM 5.2, Kimi K2.7 Code, MiniMax M3, Qwen 3.7 Plus, and Qwen 3.7 Max.

Read full article

Comments

Google has announced its next Made By Google event, taking place on August 12 in New York City. Google's invite doesn't name names, but the imagery clearly shows a new Pixel phone that looks a whole lot like last year's phone. Some new rumors, however, suggest the updated phones will come with inflated price tags courtesy of the AI-driven component shortage.

The sleek lines of the phone in the teaser image are a dead ringer for Google's last few Pixel phones, and that matches some early rumors. Google's new phones will have similar shapes, with the Pro and Pro Fold models perhaps shaving off a little thickness. The most notable design change will probably be the rumored "Pixel Glow" lights, a rear-facing notification and status light.

Recent reports claim that Google is finally doing away with the base 128GB storage option for the smaller phones. In 2025, both the Pixel 10 and Pixel 10 Pro started at 128GB of storage, a bit lacking for a modern flagship device at a time when people don't upgrade as often. Google will reportedly move to 256GB as the base storage for both phones.

Read full article

Comments