3 updates on Google.
Google releases ADK for Kotlin 1.0 with on-device agents for Android
ADK for Kotlin 1.0 adds Android modules that run agents on the device with Gemma through LiteRT-LM and Gemini Nano through ML Kit.
MobiBench paper benchmarks small LLMs in llama.cpp on two laptops and an RTX 3060
MobiBench is a llama.cpp benchmark suite for speed, memory and accuracy of small LLMs, but the reported tests ran on two laptops and not on phones.
Google adds multi-token prediction to Gemini Nano v3 on Pixel 9 and 10
Google added a prediction head to frozen Gemini Nano v3 on Pixel 9 and 10, saving 130 MB per instance over a standalone drafter.