Open source
36 updates on Open source.
Qualcomm positions Snapdragon X2 as an agentic PC chip and previews Linux support
Qualcomm says its Snapdragon X2 platform now delivers up to 85 TOPS and up to twice the tokens per second of the first-generation X Elite for on-device AI agents.
Cactus releases Needle 3, a 121M-parameter tool-calling model in an 8 to 29 MB binary
Needle 3 is a 121M-parameter model for tool calling, structured extraction and embeddings that ships as a single 8 to 29 MB binary.
PalmClaw is an open-source agent framework that runs natively on Android phones
PalmClaw runs sessions, memory, tools and the agent loop on the phone and reports 97.1% task success on 70 mobile tasks.
Graphcore runs Llama 3.2 11B Vision on a Pixel 8a with 2.7-bit quantisation
Graphcore Research fits Llama-3.2-11B-Vision-Instruct into 3.6 GB with a 2.7-bit format and runs it on a Pixel 8a at 3.8 tok/s.
S2-MoE speeds up MoE decoding by up to 5.3x in llama.cpp
S2-MoE is a self-speculative decoding method for mixture-of-experts models that reaches up to 5.3x speedup and about 2.0x on average.
Online-SDFT reports 70.28% routing accuracy and updates a LoRA adapter on the phone
I-Ju Lin and Zhang-Wei Hong measure 70.28% accuracy against 52.78% for the best baseline, and run the LoRA update itself on an Android phone.
RikkaHub Agent test: Android phone agent compiles whisper.cpp on its own
XDA runs RikkaHub Agent on an Oppo Find N5 against a self-hosted Qwen 3.6 27B. The agent installed dependencies and built whisper.cpp in Termux in seven minutes.
Prism ML releases Bonsai 27B, a 3.9 GB 1-bit model that fits an iPhone 17 Pro
Prism ML’s 1-bit Bonsai 27B compresses Qwen3.6 27B to 3.9 GB and runs on iPhone, iPad, Mac and NVIDIA GPUs under Apache 2.0.
Prism ML releases Bonsai Image 4B, a 1-bit image model that runs on iPhone
Bonsai Image 4B generates a 512x512 image in 9.4 seconds on an iPhone 17 Pro Max, and its 1-bit diffusion transformer needs 0.93 GB.
Airgap is a React Native kit for support chatbots that answer offline
Xavier Puspus published a React Native kit for support chatbots that answer without a network, running a 2.4 GB Gemma 4 E2B file through llama.rn.
Prism ML releases Ternary Bonsai, 1.58-bit models with an 8B version at 1.75 GB
Ternary Bonsai 8B needs 1.75 GB, scores 75.5 on Prism ML’s benchmark average and runs at 27 tok/s on an iPhone 17 Pro Max.
Prism ML releases 1-bit Bonsai 8B, an 8.2B-parameter model that needs 1.15 GB
1-bit Bonsai 8B stores all weights in one bit, needs 1.15 GB and runs at about 40 tok/s on an iPhone 17 Pro, according to Prism ML.