On-device
Liquid AI releases LFM2.5-2.6B for on-device agents
Liquid AI reports 30 tokens per second on a phone and under 2.5 GB of memory for its 2.6-billion-parameter model, released with open weights.
Gemini Nano 4 ships on Samsung foldables with ML Kit Prompt API access
Google says Samsung’s new foldables carry Gemini Nano 4 with support for more than 140 languages, reachable from apps through ML Kit’s Prompt API.
MobiBench paper benchmarks small LLMs in llama.cpp on two laptops and an RTX 3060
MobiBench is a llama.cpp benchmark suite for speed, memory and accuracy of small LLMs, but the reported tests ran on two laptops and not on phones.
Prism ML releases Bonsai 27B, a 3.9 GB 1-bit model that fits an iPhone 17 Pro
Prism ML’s 1-bit Bonsai 27B compresses Qwen3.6 27B to 3.9 GB and runs on iPhone, iPad, Mac and NVIDIA GPUs under Apache 2.0.
FBLayout fine-tunes transformers on phone GPUs 2.2 to 5.7 times faster
A MobiSys 2026 paper fine-tunes seven transformer models on phone GPUs 2.2 to 5.7 times faster than MNN, TFLite and TVM, with 4.2 times fewer cache misses.
MLPerf Mobile v6.0 adds Llama tests in 1B, 3B and 8B sizes
MLCommons added Llama tests in 1B, 3B and 8B sizes to its mobile benchmark app, reporting token throughput next to the existing vision and image tests.
llada.cpp runs a diffusion LLM on a Snapdragon NPU up to 42 times faster
Tsinghua and Beihang researchers report LLaDA-8B generating 128 tokens 17 to 42 times faster on a Hexagon NPU than on the phone CPU.
CAPED redacts phone screenshots before a cloud GUI agent sees them
Researchers at CUHK, Southeast University and Shandong University report a phone-side screenshot filter that cuts seeded leakage from 0.766 to 0.268.
Apertus Mini distils an open-data 8B into 0.5B, 1.5B and 4B models
Swiss AI distilled its fully open Apertus 8B into 0.5B, 1.5B and 4B models on 1.7T tokens, with 3-bit to 6-bit MLX builds for Apple devices.
Meta AI builds MobileMoE, 5.3B parameters with 0.9B active per token
Meta AI trained three on-device mixture-of-experts models that store 1.3B to 5.3B parameters and run 272M to 922M of them per token.
Prism ML releases Bonsai Image 4B, a 1-bit image model that runs on iPhone
Bonsai Image 4B generates a 512x512 image in 9.4 seconds on an iPhone 17 Pro Max, and its 1-bit diffusion transformer needs 0.93 GB.
LiteRT-LM reports 52 decode tokens per second for Gemma 4 E2B on an Android GPU
Google publishes prefill and decode figures for its on-device runtime, adds Swift and JavaScript APIs, and reports a 2.2x speedup from multi-token prediction.