LLMobile.news

Google

23 updates on Google.

  1. Gemma 4 lands on the edge with Agent Skills in Google AI Edge Gallery

    Google says Gemma 4 E2B runs in under 1.5 GB on some devices and reaches 3,700 prefill tokens per second on a Qualcomm Dragonwing IQ8 NPU.

  2. Gemma 3n runs 5B and 8B models in 2 GB and 3 GB of memory

    Google previewed a mobile-first model whose Per-Layer Embeddings cut RAM use, and said the same architecture powers the next Gemini Nano.

  3. Google AI Edge Gallery runs Gemma 3 1B and Qwen2.5 offline on Android

    An experimental Google app downloads LiteRT models from Hugging Face, runs chat, image questions and prompt tests offline, and prints decode speed per reply.

  4. Google's ML Drift runs Llama 3.1 8B on a phone GPU at 12.7 tokens per second

    The paper measures 37.1 decode tokens per second for Gemma2 2B and 12.7 for Llama 3.1 8B on the Adreno 750 GPU of a Samsung S24.

  5. Gemma 3 adds a 1B size that fits in 0.5 GB as an int4 checkpoint

    Google released Gemma 3 at 1B, 4B, 12B and 27B with quantisation-aware int4 checkpoints of 0.5 GB and 2.6 GB for the two smallest sizes.

  6. Gemma 2 2B is distilled from a larger model and scores 1126 on Chatbot Arena

    Google released a 2.6B-parameter Gemma 2 trained by distilling a larger model, and reported an Elo of 1126 on the LMSYS Chatbot Arena.

  7. Google ships an experimental MediaPipe LLM Inference API for web, Android and iOS

    The experimental API runs Gemma 2B, Phi 2, Falcon 1B and Stable LM 3B fully on device, with int8 and int4 weights.

  8. Gemma 2B and 7B open the Gemma line, built on Gemini research

    Google released Gemma 2B and 7B with an 8192-token context, weights on Kaggle and Hugging Face under a custom Gemma licence, not an open source one.

  9. Galaxy S24 becomes the second phone line to run Gemini Nano

    Google brought Gemini Nano to the Galaxy S24 for on-device Magic Compose in Messages, while the rest of the Galaxy AI features run on Gemini Pro.

  10. Gemini Nano ships on the Pixel 8 Pro and Android gets AICore

    Google put Gemini Nano on the Pixel 8 Pro for Recorder summaries and Gboard Smart Reply, and introduced AICore as the Android service behind it.

  11. MobileBERT runs in 62 ms on a Pixel 4 with 25.3M parameters

    Carnegie Mellon and Google Brain distilled BERT into a 25.3M-parameter model that answers in 62 ms on a Pixel 4 and scores 77.7 on GLUE.