Open source
27 updates on Open source.
Online-SDFT reports 70.28% routing accuracy and updates a LoRA adapter on the phone
I-Ju Lin and Zhang-Wei Hong measure 70.28% accuracy against 52.78% for the best baseline, and run the LoRA update itself on an Android phone.
RikkaHub Agent test: Android phone agent compiles whisper.cpp on its own
XDA runs RikkaHub Agent on an Oppo Find N5 against a self-hosted Qwen 3.6 27B. The agent installed dependencies and built whisper.cpp in Termux in seven minutes.
Airgap is a React Native kit for support chatbots that answer offline
Xavier Puspus published a React Native kit for support chatbots that answer without a network, running a 2.4 GB Gemma 4 E2B file through llama.rn.
ClawMobile tries system commands before screen taps and finishes all six test tasks
An agent runtime that runs on the phone itself routes tasks to ADB commands before UI taps, and the authors report 100 percent completion on six tasks.
Apple ships Python bindings for the on-device Foundation Models framework
The apple-fm-sdk package calls the on-device Apple Intelligence model from Python on macOS 26, for scripting and batch evaluation outside Swift.
Show HN: Off Grid runs text, image, vision and speech models offline on phones
An MIT-licensed Android and iOS app bundles llama.cpp, Stable Diffusion and Whisper for offline use. The Show HN thread reached 124 points and 66 comments.
ExecuTorch 1.0 reaches general availability for on-device PyTorch models
The PyTorch edge runtime promotes Core ML, Qualcomm Hexagon, Arm Ethos-U, Vulkan and XNNPACK backends to production status.
Hugging Face's SmolLM3 is a 3B model with 128k context and two reasoning modes
Hugging Face released a 3B model with a 128k context window, six languages and a switchable reasoning mode, along with the full training recipe.
Google AI Edge Gallery runs Gemma 3 1B and Qwen2.5 offline on Android
An experimental Google app downloads LiteRT models from Hugging Face, runs chat, image questions and prompt tests offline, and prints decode speed per reply.
Flower Intelligence runs models on device, with remote handoff off by default
Flower Labs released a preview library that runs Llama 3.2 and SmolLM2 locally via WebLLM or MLX Swift, and calls its remote service only if an app enables it.
Alibaba MNN runs 4-bit LLMs on phone CPUs and GPUs, with a multimodal Android app
MNN-LLM converts PyTorch checkpoints into a 4-bit MNN format for phones, and Alibaba reports prefill 8.6 times faster than llama.cpp on an Android CPU.
Hugging Face trains SmolLM2 at 135M, 360M and 1.7B on up to 11T tokens
Hugging Face released SmolLM2 in three sizes trained on up to 11 trillion tokens, with 4-bit builds from 118 MB for on-device runtimes.