Back to the ticker

Gemini Nano ships on the Pixel 8 Pro and Android gets AICore

Google brought Gemini Nano to the Pixel 8 Pro in its December 2023 feature drop, where it powers Summarize in Recorder and Smart Reply in Gboard. Google calls the Pixel 8 Pro the first smartphone engineered for Gemini Nano and runs the model on the Tensor G3.

Video: Google. Gemini Nano summarising a recording in the Recorder app. Open the Android Developers post

According to Google, running the model locally helps prevent sensitive data from leaving the phone and lets the features work without a network connection. Summarize in Recorder launched in English. Smart Reply in Gboard launched globally on the United States English keyboard layout, starting with WhatsApp, Line and KakaoTalk.

On the same day Google introduced AICore, a system service in Android 14 that handles model management, runtimes and safety features for Gemini Nano. It supports Low Rank Adaptation, so developers can build small adapters trained on their own data, and it targets the Google Tensor TPU as well as NPUs from Qualcomm, Samsung and MediaTek. Google describes the service as isolated from the network by design and opened access through an early access programme.

Diagram showing an Android app calling an SDK that reaches AICore in Android OS, which holds LoRA, Gemini Nano and safety features and drives a TPU or NPU accelerator
Diagram: Google.
  1. ONNX Runtime 1.5 adds a mobile build that ships only the operators a model uses
  2. MobileBERT runs in 62 ms on a Pixel 4 with 25.3M parameters
  3. Apple publishes MLX, where CPU and GPU share arrays without copies